2024-04-23T09:58:16.957 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-23T09:58:16.958 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} --owner scheduled_leonidus@teuthology --archive /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533 --verbose --name leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi -- /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/orig.config.yaml 2024-04-23T09:58:17.019 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T09:58:17.111 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533 branch: wip-lusov-quiescer description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} email: null first_in_suite: false job_id: '7669533' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false log-rotate: ceph-mds: 10G ceph-osd: 10G machine_type: smithi mgrmodules: sequential: - print: Enabling mgr modules name: leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 20 - machine: disk: 200 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-lusov-quiescer ceph: cephfs: ec_profile: - m=2 - k=2 - crush-failure-domain=osd max_mds: 5 session_timeout: 300 conf: client: client mount timeout: 600 client_shutdown_timeout: 120 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds bal fragment size max: 10000 mds bal merge size: 5 mds bal split bits: 3 mds bal split size: 100 mds debug frag: true mds debug scatterstat: true mds oft prefetch dirfrags: true mds op complaint time: 180 mds verify scatter: true mds_dir_prefetch: true mds_sleep_rank_change: 5000000.0 mon client directed command retry: 5 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds osd ms inject socket failures: 2500 osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug client: 20 debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon down mkfs grace: 300 mon op complaint time: 120 osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug ms: 1 debug osd: 20 debug rocksdb: 10 mon client directed command retry: 5 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 ms inject delay max: 1 ms inject delay probability: 0.005 ms inject delay type: client mds ms inject socket failures: 2500 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(OSD_SLOW_PING_TIME - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - filesystem is online with fewer MDS than max_mds - POOL_APP_NOT_ENABLED - do not have an application enabled - overall HEALTH_ - Replacing daemon - deprecated feature inline_data - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding - PG_AVAILABILITY - PG_DEGRADED - Reduced data availability - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 20 debug bluestore: 20 debug rocksdb: 10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs check-counter: counters: mds: - mds.exported - mds.imported install: ceph: flavor: default sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-lusov-quiescer sha1: 0a6c3ed699031b80a2b419e7e795368719871394 owner: scheduled_leonidus@teuthology priority: 70 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mgr.y - mds.a - mds.c - mds.e - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - - mon.b - mon.c - mgr.x - mds.b - mds.d - mds.f - osd.4 - osd.5 - osd.6 - osd.7 seed: 5306 sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f sleep_before_teardown: 0 subset: 200/111111 suite: fs suite_branch: wip-lusov-quiescer suite_path: /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph suite_sha1: 0a6c3ed699031b80a2b419e7e795368719871394 syslog: ignorelist: - WARNING*.*check_session_state - WARNING*.*__ceph_remove_cap targets: smithi026.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpvoBFAED6/4vb3WLwHt84TPBsY5tyPFUcSSlZVQu+EQqUZo7eagiF9M3+9pUf/M0EPT47UsODwLIBaBsRa9Rk= smithi190.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKWao+f5vNz9MTbFYxPFlYyCsSUiCSEfuIo0BLBqjIBxyuTkpLZkUTXUVHI0ihEZMw0GeaUfIV2HWvKMc0T7RRE= tasks: - install: extra_packages: deb: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror rpm: - python3-cephfs - cephfs-shell - cephfs-top - cephfs-mirror extra_system_packages: deb: - bison - flex - libelf-dev - libssl-dev - network-manager - iproute2 - util-linux - dump - indent - libaio-dev - libtool-bin - uuid-dev - xfslibs-dev - postgresql - postgresql-client - postgresql-common - postgresql-contrib rpm: - bison - flex - elfutils-libelf-devel - openssl-devel - NetworkManager - iproute - util-linux - libacl-devel - libaio-devel - libattr-devel - libtool - libuuid-devel - xfsdump - xfsprogs - xfsprogs-devel - libaio-devel - libtool - libuuid-devel - xfsprogs-devel - postgresql - postgresql-server - postgresql-contrib - ceph: create_rbd_pool: false - sequential: - mgrmodules - ceph-fuse: null - quiescer: null - workunit: clients: all: - suites/fsstress.sh timeout: 6h teuthology: fragments_dropped: [] meta: {} postmerge: - local function is_kupstream() return false end - local function is_kdistro() return false end - local function is_fuse() return true end - local function syntax_version() return '' end teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-23_09:49:14 tube: smithi user: leonidus verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-23T09:58:17.112 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa; will attempt to use it 2024-04-23T09:58:17.112 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa/tasks 2024-04-23T09:58:17.113 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-23T09:58:17.114 INFO:teuthology.task.internal:Checking packages... 2024-04-23T09:58:17.137 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash 'd69f13d827952bb07bb9b7973bca14f97d764d6f' 2024-04-23T09:58:17.138 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-23T09:58:17.138 INFO:teuthology.packaging:ref: None 2024-04-23T09:58:17.138 INFO:teuthology.packaging:tag: None 2024-04-23T09:58:17.138 INFO:teuthology.packaging:branch: wip-lusov-quiescer 2024-04-23T09:58:17.138 INFO:teuthology.packaging:sha1: d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T09:58:17.138 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-lusov-quiescer 2024-04-23T09:58:17.374 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T09:58:17.376 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-23T09:58:17.382 INFO:teuthology.task.internal:no buildpackages task found 2024-04-23T09:58:17.382 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-23T09:58:17.407 INFO:teuthology.task.internal:Saving configuration 2024-04-23T09:58:17.426 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-23T09:58:17.435 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-23T09:58:17.460 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi026.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:20.122633', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIOoB0/ryMlPMYne5egU0pd4Y/en87VtRZVT2Q6YCNytT'} 2024-04-23T09:58:17.479 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi190.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-23 09:51:20.124250', 'locked_by': 'scheduled_leonidus@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAINQyo4N4NcEh1OxSNVrU6KTQMgcYcZWI06vcFj8lgMqv'} 2024-04-23T09:58:17.479 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-23T09:58:17.485 INFO:teuthology.task.internal:roles: ubuntu@smithi026.front.sepia.ceph.com - ['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'] 2024-04-23T09:58:17.485 INFO:teuthology.task.internal:roles: ubuntu@smithi190.front.sepia.ceph.com - ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7'] 2024-04-23T09:58:17.485 INFO:teuthology.run_tasks:Running task console_log... 2024-04-23T09:58:17.567 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f3fe8f680d0>, signals=[15]) 2024-04-23T09:58:17.568 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-23T09:58:17.576 INFO:teuthology.task.internal:Opening connections... 2024-04-23T09:58:17.576 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T09:58:17.578 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:58:17.664 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T09:58:17.665 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:58:17.742 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-23T09:58:17.750 DEBUG:teuthology.orchestra.run.smithi026:> uname -m 2024-04-23T09:58:17.756 INFO:teuthology.orchestra.run.smithi026.stdout:x86_64 2024-04-23T09:58:17.756 DEBUG:teuthology.orchestra.run.smithi026:> cat /etc/os-release 2024-04-23T09:58:17.802 INFO:teuthology.orchestra.run.smithi026.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:NAME="Ubuntu" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_ID="22.04" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:VERSION_CODENAME=jammy 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:ID=ubuntu 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:ID_LIKE=debian 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T09:58:17.803 INFO:teuthology.orchestra.run.smithi026.stdout:UBUNTU_CODENAME=jammy 2024-04-23T09:58:17.804 INFO:teuthology.lock.ops:Updating smithi026.front.sepia.ceph.com on lock server 2024-04-23T09:58:17.826 DEBUG:teuthology.orchestra.run.smithi190:> uname -m 2024-04-23T09:58:17.831 INFO:teuthology.orchestra.run.smithi190.stdout:x86_64 2024-04-23T09:58:17.831 DEBUG:teuthology.orchestra.run.smithi190:> cat /etc/os-release 2024-04-23T09:58:17.878 INFO:teuthology.orchestra.run.smithi190.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-23T09:58:17.878 INFO:teuthology.orchestra.run.smithi190.stdout:NAME="Ubuntu" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_ID="22.04" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:VERSION_CODENAME=jammy 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:ID=ubuntu 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:ID_LIKE=debian 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-23T09:58:17.879 INFO:teuthology.orchestra.run.smithi190.stdout:UBUNTU_CODENAME=jammy 2024-04-23T09:58:17.879 INFO:teuthology.lock.ops:Updating smithi190.front.sepia.ceph.com on lock server 2024-04-23T09:58:17.900 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-23T09:58:17.910 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-23T09:58:17.918 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-23T09:58:17.919 DEBUG:teuthology.orchestra.run.smithi026:> test '!' -e /home/ubuntu/cephtest 2024-04-23T09:58:17.921 DEBUG:teuthology.orchestra.run.smithi190:> test '!' -e /home/ubuntu/cephtest 2024-04-23T09:58:17.925 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-23T09:58:17.942 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-23T09:58:17.942 DEBUG:teuthology.orchestra.run.smithi026:> test -z $(ls -A /var/lib/ceph) 2024-04-23T09:58:17.968 DEBUG:teuthology.orchestra.run.smithi190:> test -z $(ls -A /var/lib/ceph) 2024-04-23T09:58:17.975 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-23T09:58:18.029 INFO:teuthology.run_tasks:Running task kernel... 2024-04-23T09:58:18.048 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-23T09:58:18.049 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-23T09:58:18.049 DEBUG:teuthology.orchestra.run.smithi026:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T09:58:18.049 DEBUG:teuthology.orchestra.run.smithi190:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-23T09:58:18.054 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T09:58:18.054 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-04-23T09:58:18.055 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T09:58:18.055 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-04-23T09:58:18.103 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-56-generic 2024-04-23T09:58:18.103 INFO:teuthology.task.kernel:Running kernel on smithi190: 5.15.0-56-generic 2024-04-23T09:58:18.103 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-04-23T09:58:18.104 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-56-generic 2024-04-23T09:58:18.104 INFO:teuthology.task.kernel:Running kernel on smithi026: 5.15.0-56-generic 2024-04-23T09:58:18.105 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get clean 2024-04-23T09:58:18.220 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-04-23T09:58:18.245 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-23T09:58:18.390 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T09:58:18.396 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T09:58:18.397 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T09:58:18.402 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T09:58:18.406 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-23T09:58:18.470 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T09:58:18.486 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T09:58:18.494 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-23T09:58:18.630 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T09:58:18.660 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T09:58:18.745 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-23T09:58:18.745 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T09:58:18.785 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-23T09:58:18.788 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T09:58:18.798 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T09:58:18.798 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-23T09:58:18.798 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T09:58:18.805 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T09:58:18.805 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T09:58:18.805 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T09:58:18.841 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T09:58:18.842 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T09:58:18.849 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T09:58:18.849 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T09:58:18.849 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T09:58:18.857 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T09:58:18.857 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T09:58:18.864 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T09:58:18.869 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,608 kB] 2024-04-23T09:58:18.876 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T09:58:18.903 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T09:58:18.905 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T09:58:18.906 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T09:58:18.906 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T09:58:18.926 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T09:58:18.927 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T09:58:18.928 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,388 kB] 2024-04-23T09:58:18.933 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T09:58:18.937 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T09:58:18.937 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T09:58:18.952 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-23T09:58:18.958 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T09:58:18.959 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T09:58:18.959 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T09:58:18.960 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T09:58:18.960 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T09:58:18.961 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T09:58:18.961 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T09:58:18.962 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-23T09:58:18.963 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,826 kB] 2024-04-23T09:58:18.980 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T09:58:18.981 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T09:58:18.981 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T09:58:18.995 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-23T09:58:18.996 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [310 kB] 2024-04-23T09:58:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T09:58:19.000 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [699 kB] 2024-04-23T09:58:19.005 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T09:58:19.009 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-23T09:58:19.021 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-23T09:58:19.024 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-23T09:58:19.025 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-23T09:58:19.025 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-23T09:58:19.028 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-23T09:58:19.028 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-23T09:58:19.046 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-23T09:58:19.047 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-23T09:58:19.048 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-23T09:58:19.048 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-23T09:58:19.048 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [28.4 kB] 2024-04-23T09:58:19.050 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [17.2 kB] 2024-04-23T09:58:19.050 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-23T09:58:19.050 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-23T09:58:19.340 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-23T09:58:19.357 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-23T09:58:19.367 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-23T09:58:19.367 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-23T09:58:19.369 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,762 kB] 2024-04-23T09:58:19.462 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-23T09:58:19.473 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-23T09:58:19.473 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [600 kB] 2024-04-23T09:58:19.493 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-23T09:58:19.678 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [162 kB] 2024-04-23T09:58:20.086 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-23T09:58:20.091 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-23T09:58:20.092 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-23T09:58:20.105 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-23T09:58:20.109 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-23T09:58:24.685 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 13.2 MB in 2s (6,749 kB/s) 2024-04-23T09:58:24.975 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 13.2 MB in 2s (6,773 kB/s) 2024-04-23T09:58:26.034 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T09:58:26.052 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T09:58:26.102 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T09:58:26.280 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-04-23T09:58:26.280 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-04-23T09:58:26.355 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T09:58:26.373 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T09:58:26.425 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T09:58:26.434 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T09:58:26.434 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T09:58:26.434 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T09:58:26.435 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T09:58:26.435 INFO:teuthology.orchestra.run.smithi190.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T09:58:26.435 INFO:teuthology.orchestra.run.smithi190.stdout: python2.7-minimal 2024-04-23T09:58:26.435 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T09:58:26.436 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-04-23T09:58:26.436 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T09:58:26.436 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T09:58:26.437 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T09:58:26.438 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-04-23T09:58:26.438 INFO:teuthology.orchestra.run.smithi190.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T09:58:26.438 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-04-23T09:58:26.438 INFO:teuthology.orchestra.run.smithi190.stdout: thermald 2024-04-23T09:58:26.488 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-04-23T09:58:26.488 INFO:teuthology.orchestra.run.smithi190.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T09:58:26.488 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T09:58:26.488 INFO:teuthology.orchestra.run.smithi190.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T09:58:26.489 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-04-23T09:58:26.490 INFO:teuthology.orchestra.run.smithi190.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T09:58:26.597 INFO:teuthology.orchestra.run.smithi190.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T09:58:26.597 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 113 MB of archives. 2024-04-23T09:58:26.597 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T09:58:26.597 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T09:58:26.606 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-23T09:58:26.607 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-23T09:58:26.767 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T09:58:26.767 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T09:58:26.767 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T09:58:26.768 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T09:58:26.768 INFO:teuthology.orchestra.run.smithi026.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-23T09:58:26.768 INFO:teuthology.orchestra.run.smithi026.stdout: python2.7-minimal 2024-04-23T09:58:26.768 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T09:58:26.769 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-23T09:58:26.769 INFO:teuthology.orchestra.run.smithi026.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T09:58:26.769 INFO:teuthology.orchestra.run.smithi026.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-23T09:58:26.769 INFO:teuthology.orchestra.run.smithi026.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-23T09:58:26.770 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-23T09:58:26.770 INFO:teuthology.orchestra.run.smithi026.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-23T09:58:26.771 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2024-04-23T09:58:26.771 INFO:teuthology.orchestra.run.smithi026.stdout: thermald 2024-04-23T09:58:26.819 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-23T09:58:26.819 INFO:teuthology.orchestra.run.smithi026.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-23T09:58:26.819 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-23T09:58:26.819 INFO:teuthology.orchestra.run.smithi026.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-23T09:58:26.821 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2024-04-23T09:58:26.821 INFO:teuthology.orchestra.run.smithi026.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-23T09:58:27.002 INFO:teuthology.orchestra.run.smithi026.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T09:58:27.003 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 113 MB of archives. 2024-04-23T09:58:27.003 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-23T09:58:27.003 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-23T09:58:27.885 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T09:58:28.148 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T09:58:28.425 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-23T09:58:28.759 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-23T09:58:29.965 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T09:58:29.965 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T09:58:29.965 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T09:58:30.257 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T09:58:30.320 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T09:58:30.787 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 113 MB in 4s (29.5 MB/s) 2024-04-23T09:58:30.907 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-23T09:58:30.907 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-23T09:58:30.908 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-23T09:58:30.969 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T09:58:31.849 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-23T09:58:31.981 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-23T09:58:32.411 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 113 MB in 5s (22.0 MB/s) 2024-04-23T09:58:32.563 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-23T09:58:32.934 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T09:58:32.938 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:33.016 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:34.525 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-23T09:58:34.529 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:34.610 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:35.050 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T09:58:35.071 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:35.151 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:35.569 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T09:58:35.579 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:35.610 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:36.770 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-23T09:58:36.791 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:36.880 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:37.331 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-23T09:58:37.341 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:37.381 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:42.269 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:42.385 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:42.709 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:42.805 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:43.125 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T09:58:43.147 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T09:58:43.191 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T09:58:43.931 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:44.058 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:44.390 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:44.503 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:44.764 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-23T09:58:44.787 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-23T09:58:44.822 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T09:58:48.666 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T09:58:48.703 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:48.741 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:50.357 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-23T09:58:50.395 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-23T09:58:50.440 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:51.314 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:51.436 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:51.762 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T09:58:51.883 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:51.984 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T09:58:52.087 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:53.396 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-23T09:58:53.409 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:58:53.409 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T09:58:53.409 INFO:teuthology.orchestra.run.smithi190.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:58:53.409 INFO:teuthology.orchestra.run.smithi190.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T09:58:53.518 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-23T09:58:53.581 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:53.844 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-23T09:58:54.690 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:54.800 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-23T09:58:54.911 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:54.975 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:56.265 INFO:teuthology.orchestra.run.smithi026.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:58:56.265 INFO:teuthology.orchestra.run.smithi026.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-23T09:58:56.266 INFO:teuthology.orchestra.run.smithi026.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:58:56.266 INFO:teuthology.orchestra.run.smithi026.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-23T09:58:56.351 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T09:58:56.477 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T09:58:56.555 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:56.628 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T09:58:56.698 INFO:teuthology.orchestra.run.smithi190.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:58:57.991 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:59.432 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-23T09:58:59.558 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-23T09:58:59.685 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-23T09:58:59.745 INFO:teuthology.orchestra.run.smithi026.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-23T09:58:59.745 INFO:teuthology.orchestra.run.smithi026.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:59:10.589 INFO:teuthology.orchestra.run.smithi190.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T09:59:10.589 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub' 2024-04-23T09:59:10.600 INFO:teuthology.orchestra.run.smithi190.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T09:59:10.625 INFO:teuthology.orchestra.run.smithi190.stdout:Generating grub configuration file ... 2024-04-23T09:59:10.897 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:59:10.914 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:59:11.184 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:59:11.189 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T09:59:11.257 INFO:teuthology.orchestra.run.smithi190.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T09:59:11.262 INFO:teuthology.orchestra.run.smithi190.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T09:59:11.424 INFO:teuthology.orchestra.run.smithi190.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T09:59:11.424 INFO:teuthology.orchestra.run.smithi190.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T09:59:11.424 INFO:teuthology.orchestra.run.smithi190.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T09:59:11.473 INFO:teuthology.orchestra.run.smithi190.stdout:done 2024-04-23T09:59:11.890 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-04-23T09:59:11.914 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-04-23T09:59:11.914 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.105.102 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-04-23T09:59:11.915 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-04-23T09:59:11.916 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-04-23T09:59:11.916 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-04-23T09:59:11.916 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T09:59:11.917 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T09:59:11.917 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T09:59:11.917 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-23T09:59:11.917 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi190.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T09:59:11.917 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get clean 2024-04-23T09:59:12.074 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-04-23T09:59:12.212 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T09:59:12.221 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T09:59:12.228 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T09:59:12.241 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T09:59:13.639 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T09:59:13.656 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T09:59:13.707 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T09:59:13.885 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-04-23T09:59:13.886 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-04-23T09:59:14.047 INFO:teuthology.orchestra.run.smithi190.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T09:59:14.047 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T09:59:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T09:59:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T09:59:14.047 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T09:59:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T09:59:14.048 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T09:59:14.048 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T09:59:14.084 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T09:59:14.086 DEBUG:teuthology.orchestra.run.smithi190:> dpkg -s linux-image-generic 2024-04-23T09:59:14.141 INFO:teuthology.orchestra.run.smithi190.stdout:Package: linux-image-generic 2024-04-23T09:59:14.141 INFO:teuthology.orchestra.run.smithi190.stdout:Status: install ok installed 2024-04-23T09:59:14.141 INFO:teuthology.orchestra.run.smithi190.stdout:Priority: optional 2024-04-23T09:59:14.141 INFO:teuthology.orchestra.run.smithi190.stdout:Section: kernel 2024-04-23T09:59:14.141 INFO:teuthology.orchestra.run.smithi190.stdout:Installed-Size: 21 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Architecture: amd64 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Source: linux-meta 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Version: 5.15.0.105.102 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Recommends: thermald 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout:Description: Generic Linux kernel image 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout: This package will always depend on the latest generic kernel image 2024-04-23T09:59:14.142 INFO:teuthology.orchestra.run.smithi190.stdout: available. 2024-04-23T09:59:14.143 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-04-23T09:59:14.189 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.XgJ28owvGg 2024-04-23T09:59:14.189 DEBUG:teuthology.orchestra.run.smithi190:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XgJ28owvGg 2024-04-23T09:59:14.245 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.XgJ28owvGg 2024-04-23T09:59:14.361 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.XgJ28owvGg is 10KB 2024-04-23T09:59:14.375 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.XgJ28owvGg 2024-04-23T09:59:14.380 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T09:59:14.410 INFO:teuthology.orchestra.run.smithi026.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-23T09:59:14.410 INFO:teuthology.orchestra.run.smithi026.stdout:Sourcing file `/etc/default/grub' 2024-04-23T09:59:14.433 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T09:59:14.433 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T09:59:14.433 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T09:59:14.466 INFO:teuthology.orchestra.run.smithi026.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T09:59:14.482 INFO:teuthology.orchestra.run.smithi026.stdout:Generating grub configuration file ... 2024-04-23T09:59:14.501 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T09:59:14.501 DEBUG:teuthology.orchestra.run.smithi190:> sudo update-grub 2024-04-23T09:59:14.790 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:59:14.808 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:59:15.164 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:59:15.170 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T09:59:15.262 INFO:teuthology.orchestra.run.smithi026.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T09:59:15.269 INFO:teuthology.orchestra.run.smithi026.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T09:59:15.471 INFO:teuthology.orchestra.run.smithi026.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T09:59:15.471 INFO:teuthology.orchestra.run.smithi026.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T09:59:15.472 INFO:teuthology.orchestra.run.smithi026.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T09:59:15.513 INFO:teuthology.orchestra.run.smithi026.stdout:done 2024-04-23T09:59:15.598 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub' 2024-04-23T09:59:15.599 INFO:teuthology.orchestra.run.smithi190.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T09:59:15.602 INFO:teuthology.orchestra.run.smithi190.stderr:Generating grub configuration file ... 2024-04-23T09:59:15.788 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:59:15.794 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:59:16.012 DEBUG:teuthology.orchestra.run.smithi026:> dpkg -s linux-image-generic 2024-04-23T09:59:16.032 INFO:teuthology.orchestra.run.smithi026.stdout:Package: linux-image-generic 2024-04-23T09:59:16.032 INFO:teuthology.orchestra.run.smithi026.stdout:Status: install ok installed 2024-04-23T09:59:16.032 INFO:teuthology.orchestra.run.smithi026.stdout:Priority: optional 2024-04-23T09:59:16.032 INFO:teuthology.orchestra.run.smithi026.stdout:Section: kernel 2024-04-23T09:59:16.032 INFO:teuthology.orchestra.run.smithi026.stdout:Installed-Size: 21 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: amd64 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Source: linux-meta 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Version: 5.15.0.105.102 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Recommends: thermald 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout:Description: Generic Linux kernel image 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: This package will always depend on the latest generic kernel image 2024-04-23T09:59:16.033 INFO:teuthology.orchestra.run.smithi026.stdout: available. 2024-04-23T09:59:16.034 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-23T09:59:16.034 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-23T09:59:16.034 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-23T09:59:16.034 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-23T09:59:16.034 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi026.front.sepia.ceph.com, path=None, version=distro) 2024-04-23T09:59:16.035 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get clean 2024-04-23T09:59:16.035 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:59:16.041 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T09:59:16.079 INFO:teuthology.orchestra.run.smithi190.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T09:59:16.083 INFO:teuthology.orchestra.run.smithi190.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T09:59:16.195 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T09:59:16.195 INFO:teuthology.orchestra.run.smithi190.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T09:59:16.196 INFO:teuthology.orchestra.run.smithi190.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T09:59:16.213 INFO:teuthology.orchestra.run.smithi190.stderr:done 2024-04-23T09:59:16.222 DEBUG:teuthology.orchestra.run.smithi190:> sudo shutdown -r now 2024-04-23T09:59:16.235 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-23T09:59:16.354 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-23T09:59:16.355 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T09:59:16.367 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T09:59:16.388 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T09:59:17.777 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T09:59:17.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-23T09:59:17.850 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T09:59:18.037 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-23T09:59:18.038 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-23T09:59:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-23T09:59:18.200 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T09:59:18.201 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T09:59:18.240 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-23T09:59:18.243 DEBUG:teuthology.orchestra.run.smithi026:> dpkg -s linux-image-generic 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Package: linux-image-generic 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Status: install ok installed 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Priority: optional 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Section: kernel 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Installed-Size: 21 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Maintainer: Ubuntu Kernel Team 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Architecture: amd64 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Source: linux-meta 2024-04-23T09:59:18.302 INFO:teuthology.orchestra.run.smithi026.stdout:Version: 5.15.0.105.102 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout:Recommends: thermald 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout:Description: Generic Linux kernel image 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout: This package will always depend on the latest generic kernel image 2024-04-23T09:59:18.303 INFO:teuthology.orchestra.run.smithi026.stdout: available. 2024-04-23T09:59:18.303 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-04-23T09:59:18.351 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.opsU8sTwrQ 2024-04-23T09:59:18.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo cp /boot/grub/grub.cfg /tmp/tmp.opsU8sTwrQ 2024-04-23T09:59:18.410 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.opsU8sTwrQ 2024-04-23T09:59:18.532 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.opsU8sTwrQ is 10KB 2024-04-23T09:59:18.545 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.opsU8sTwrQ 2024-04-23T09:59:18.551 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-23T09:59:18.606 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T09:59:18.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-23T09:59:18.607 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-23T09:59:18.675 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-23T09:59:18.675 DEBUG:teuthology.orchestra.run.smithi026:> sudo update-grub 2024-04-23T09:59:19.849 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub' 2024-04-23T09:59:19.850 INFO:teuthology.orchestra.run.smithi026.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-23T09:59:19.852 INFO:teuthology.orchestra.run.smithi026.stderr:Generating grub configuration file ... 2024-04-23T09:59:20.101 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-23T09:59:20.107 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-23T09:59:20.393 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-23T09:59:20.398 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-23T09:59:20.438 INFO:teuthology.orchestra.run.smithi026.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-23T09:59:20.444 INFO:teuthology.orchestra.run.smithi026.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-23T09:59:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-23T09:59:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-23T09:59:20.581 INFO:teuthology.orchestra.run.smithi026.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-23T09:59:20.601 INFO:teuthology.orchestra.run.smithi026.stderr:done 2024-04-23T09:59:20.618 DEBUG:teuthology.orchestra.run.smithi026:> sudo shutdown -r now 2024-04-23T09:59:46.246 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-23T09:59:46.247 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T09:59:46.248 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T09:59:50.622 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-23T09:59:50.622 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T09:59:50.623 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:04.638 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-23T10:00:08.994 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-23T10:00:13.644 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:00:13.645 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:16.702 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-23T10:00:17.996 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:00:17.997 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:28.716 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:00:28.717 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:36.382 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-23T10:00:47.138 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.190 2024-04-23T10:00:48.384 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:00:48.385 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:00:51.454 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.26 2024-04-23T10:01:02.150 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:01:02.152 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:01:02.487 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-04-23T10:01:03.011 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:01:03.011 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-23T10:01:03.011 DEBUG:teuthology.orchestra.run.smithi190:> uname -r 2024-04-23T10:01:03.058 INFO:teuthology.orchestra.run.smithi190.stdout:5.15.0-105-generic 2024-04-23T10:01:03.058 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T10:01:03.058 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T10:01:03.058 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T10:01:04.060 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-23T10:01:04.060 DEBUG:teuthology.orchestra.run.smithi190:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T10:01:04.376 INFO:teuthology.orchestra.run.smithi190.stdout:ttyS1 2024-04-23T10:01:04.403 DEBUG:teuthology.parallel:result is None 2024-04-23T10:01:06.455 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:01:06.455 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:01:06.790 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-23T10:01:07.328 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:01:07.328 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-23T10:01:07.328 DEBUG:teuthology.orchestra.run.smithi026:> uname -r 2024-04-23T10:01:07.374 INFO:teuthology.orchestra.run.smithi026.stdout:5.15.0-105-generic 2024-04-23T10:01:07.374 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-23T10:01:07.375 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-23T10:01:07.375 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-23T10:01:08.376 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-23T10:01:08.376 DEBUG:teuthology.orchestra.run.smithi026:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-23T10:01:08.454 INFO:teuthology.orchestra.run.smithi026.stdout:ttyS1 2024-04-23T10:01:08.499 DEBUG:teuthology.parallel:result is None 2024-04-23T10:01:08.500 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-23T10:01:08.511 INFO:teuthology.task.internal:Creating test directory... 2024-04-23T10:01:08.511 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:01:08.517 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-23T10:01:08.524 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-23T10:01:08.536 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-23T10:01:08.543 INFO:teuthology.task.internal:Creating archive directory... 2024-04-23T10:01:08.544 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:01:08.563 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-23T10:01:08.583 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-23T10:01:08.590 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-23T10:01:08.590 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:01:08.645 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-23T10:01:08.662 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:01:08.668 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:01:08.670 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:01:08.678 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-23T10:01:08.680 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-23T10:01:08.687 INFO:teuthology.task.internal:Configuring sudo... 2024-04-23T10:01:08.688 DEBUG:teuthology.orchestra.run.smithi026:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:01:08.719 DEBUG:teuthology.orchestra.run.smithi190:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-23T10:01:08.735 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-23T10:01:08.751 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-23T10:01:08.751 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:01:08.775 DEBUG:teuthology.orchestra.run.smithi190:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-23T10:01:08.781 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:01:08.827 DEBUG:teuthology.orchestra.run.smithi026:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:01:08.877 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:01:08.878 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:01:08.947 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-23T10:01:08.957 DEBUG:teuthology.orchestra.run.smithi190:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-23T10:01:09.006 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:01:09.006 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-23T10:01:09.099 DEBUG:teuthology.orchestra.run.smithi026:> sudo service rsyslog restart 2024-04-23T10:01:09.102 DEBUG:teuthology.orchestra.run.smithi190:> sudo service rsyslog restart 2024-04-23T10:01:09.174 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-23T10:01:09.181 INFO:teuthology.task.internal:Starting timer... 2024-04-23T10:01:09.181 INFO:teuthology.run_tasks:Running task pcp... 2024-04-23T10:01:09.193 INFO:teuthology.run_tasks:Running task selinux... 2024-04-23T10:01:09.206 DEBUG:teuthology.task.selinux:Excluding smithi026: OS 'ubuntu' does not support SELinux 2024-04-23T10:01:09.206 DEBUG:teuthology.task.selinux:Excluding smithi190: OS 'ubuntu' does not support SELinux 2024-04-23T10:01:09.206 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-23T10:01:09.206 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-23T10:01:09.206 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-23T10:01:09.207 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-23T10:01:09.231 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-23T10:01:09.299 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-23T10:01:09.300 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi026.front.sepia.ceph.com,smithi190.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-23T10:08:38.341 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi026.front.sepia.ceph.com'), Remote(name='ubuntu@smithi190.front.sepia.ceph.com')] 2024-04-23T10:08:38.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:08:38.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi026.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:08:38.427 DEBUG:teuthology.orchestra.run.smithi026:> true 2024-04-23T10:08:38.510 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi026.front.sepia.ceph.com' 2024-04-23T10:08:38.511 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:08:38.511 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi190.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-23T10:08:38.588 DEBUG:teuthology.orchestra.run.smithi190:> true 2024-04-23T10:08:38.666 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi190.front.sepia.ceph.com' 2024-04-23T10:08:38.666 INFO:teuthology.run_tasks:Running task clock... 2024-04-23T10:08:38.678 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-23T10:08:38.678 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:08:38.679 DEBUG:teuthology.orchestra.run.smithi026:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:08:38.681 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-23T10:08:38.681 DEBUG:teuthology.orchestra.run.smithi190:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Command line: ntpd -gq 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: ---------------------------------------------------- 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: corporation. Support and training for ntp-4 are 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: available at https://www.nwtime.org/support 2024-04-23T10:08:38.709 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: ---------------------------------------------------- 2024-04-23T10:08:38.710 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: proto: precision = 0.047 usec (-24) 2024-04-23T10:08:38.710 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: basedate set to 2022-02-04 2024-04-23T10:08:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: gps base set to 2022-02-06 (week 2196) 2024-04-23T10:08:38.711 INFO:teuthology.orchestra.run.smithi026.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:08:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:08:38.711 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:08:38.712 INFO:teuthology.orchestra.run.smithi026.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen normally on 3 ens1f0 172.21.15.26:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen normally on 4 lo [::1]:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listen normally on 5 ens1f0 [fe80::ae1f:6bff:fea5:cac0%4]:123 2024-04-23T10:08:38.713 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:38 ntpd[17169]: Listening on routing socket on fd #22 for interface updates 2024-04-23T10:08:38.733 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-23T10:08:38.733 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Command line: ntpd -gq 2024-04-23T10:08:38.733 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: ---------------------------------------------------- 2024-04-23T10:08:38.733 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: ntp-4 is maintained by Network Time Foundation, 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: corporation. Support and training for ntp-4 are 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: available at https://www.nwtime.org/support 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: ---------------------------------------------------- 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: proto: precision = 0.061 usec (-24) 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: basedate set to 2022-02-04 2024-04-23T10:08:38.734 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: gps base set to 2022-02-06 (week 2196) 2024-04-23T10:08:38.735 INFO:teuthology.orchestra.run.smithi190.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:08:38.735 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-23T10:08:38.735 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:08:38.735 INFO:teuthology.orchestra.run.smithi190.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-23T10:08:38.736 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen and drop on 0 v6wildcard [::]:123 2024-04-23T10:08:38.736 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-23T10:08:38.736 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen normally on 2 lo 127.0.0.1:123 2024-04-23T10:08:38.737 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen normally on 3 enp3s0f1 172.21.15.190:123 2024-04-23T10:08:38.737 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen normally on 4 lo [::1]:123 2024-04-23T10:08:38.737 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:7763%5]:123 2024-04-23T10:08:38.737 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:38 ntpd[17214]: Listening on routing socket on fd #22 for interface updates 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:39.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:39 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:41.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:41 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:42.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:42.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:42 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:42.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:42.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:42 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:43.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:43 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:43.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:43 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:44.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:44 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:44.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:44 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:45.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:45 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:45.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:45.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:45.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:45.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:45.734 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:45.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:45.735 INFO:teuthology.orchestra.run.smithi190.stdout:23 Apr 10:08:45 ntpd[17214]: ntpd: time slew -0.000428 s 2024-04-23T10:08:45.735 INFO:teuthology.orchestra.run.smithi190.stdout:ntpd: time slew -0.000428s 2024-04-23T10:08:45.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T10:08:45.735 INFO:teuthology.orchestra.run.smithi190.stderr:23 Apr 10:08:45 ntpd[17214]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:45.875 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:46.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:46.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:46 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:47.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:47.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:47 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: can't open /var/log/ntpstats/rawstats.20240423: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-23T10:08:48.710 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: can't open /var/log/ntpstats/peerstats.20240423: Permission denied 2024-04-23T10:08:48.711 INFO:teuthology.orchestra.run.smithi026.stdout:23 Apr 10:08:48 ntpd[17169]: ntpd: time slew -0.000519 s 2024-04-23T10:08:48.711 INFO:teuthology.orchestra.run.smithi026.stdout:ntpd: time slew -0.000519s 2024-04-23T10:08:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-23T10:08:48.711 INFO:teuthology.orchestra.run.smithi026.stderr:23 Apr 10:08:48 ntpd[17169]: can't open /var/log/ntpstats/loopstats.20240423: Permission denied 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:48.764 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-23T10:08:48.765 INFO:teuthology.run_tasks:Running task install... 2024-04-23T10:08:48.773 DEBUG:teuthology.task.install:project ceph 2024-04-23T10:08:48.774 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}} 2024-04-23T10:08:48.774 DEBUG:teuthology.task.install:config {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'} 2024-04-23T10:08:48.774 INFO:teuthology.task.install:Using flavor: default 2024-04-23T10:08:48.779 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-23T10:08:48.779 INFO:teuthology.task.install:extra packages: {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']} 2024-04-23T10:08:48.780 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-key list | grep Ceph 2024-04-23T10:08:48.780 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-key list | grep Ceph 2024-04-23T10:08:48.842 INFO:teuthology.orchestra.run.smithi190.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T10:08:48.865 INFO:teuthology.orchestra.run.smithi026.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-23T10:08:48.893 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T10:08:48.893 INFO:teuthology.orchestra.run.smithi026.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T10:08:48.894 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T10:08:48.894 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T10:08:48.895 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:08:48.908 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-23T10:08:48.908 INFO:teuthology.orchestra.run.smithi190.stdout:uid [ unknown] Ceph.com (release key) 2024-04-23T10:08:48.909 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse, python3-cephfs, cephfs-shell, cephfs-top, cephfs-mirror on remote deb x86_64 2024-04-23T10:08:48.909 INFO:teuthology.task.install.deb:Installing system (non-project) packages: bison, flex, libelf-dev, libssl-dev, network-manager, iproute2, util-linux, dump, indent, libaio-dev, libtool-bin, uuid-dev, xfslibs-dev, postgresql, postgresql-client, postgresql-common, postgresql-contrib on remote deb x86_64 2024-04-23T10:08:48.909 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:08:49.035 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T10:08:49.035 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:08:49.123 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default/ 2024-04-23T10:08:49.123 INFO:teuthology.task.install.deb:Package version is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:08:49.208 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:08:49.209 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T10:08:49.223 DEBUG:teuthology.orchestra.run.smithi026:> sudo apt-get update 2024-04-23T10:08:49.229 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:08:49.229 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-23T10:08:49.242 DEBUG:teuthology.orchestra.run.smithi190:> sudo apt-get update 2024-04-23T10:08:49.394 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T10:08:49.420 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-23T10:08:49.515 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T10:08:49.515 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:08:49.521 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy InRelease 2024-04-23T10:08:49.527 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-23T10:08:49.551 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T10:08:49.557 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-23T10:08:49.588 INFO:teuthology.orchestra.run.smithi026.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T10:08:49.594 INFO:teuthology.orchestra.run.smithi190.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-23T10:08:49.596 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T10:08:49.609 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-23T10:08:49.625 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T10:08:49.630 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T10:08:49.667 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-23T10:08:49.672 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,417 B] 2024-04-23T10:08:49.679 INFO:teuthology.orchestra.run.smithi026.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:08:49.691 INFO:teuthology.orchestra.run.smithi190.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-23T10:08:49.850 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 140 kB in 0s (316 kB/s) 2024-04-23T10:08:49.859 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 140 kB in 0s (317 kB/s) 2024-04-23T10:08:50.817 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T10:08:50.833 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:08:50.843 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T10:08:50.859 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3156-gd69f13d8-1jammy cephadm=19.0.0-3156-gd69f13d8-1jammy ceph-mds=19.0.0-3156-gd69f13d8-1jammy ceph-mgr=19.0.0-3156-gd69f13d8-1jammy ceph-common=19.0.0-3156-gd69f13d8-1jammy ceph-fuse=19.0.0-3156-gd69f13d8-1jammy ceph-test=19.0.0-3156-gd69f13d8-1jammy ceph-volume=19.0.0-3156-gd69f13d8-1jammy radosgw=19.0.0-3156-gd69f13d8-1jammy python3-rados=19.0.0-3156-gd69f13d8-1jammy python3-rgw=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy python3-rbd=19.0.0-3156-gd69f13d8-1jammy libcephfs2=19.0.0-3156-gd69f13d8-1jammy libcephfs-dev=19.0.0-3156-gd69f13d8-1jammy librados2=19.0.0-3156-gd69f13d8-1jammy librbd1=19.0.0-3156-gd69f13d8-1jammy rbd-fuse=19.0.0-3156-gd69f13d8-1jammy python3-cephfs=19.0.0-3156-gd69f13d8-1jammy cephfs-shell=19.0.0-3156-gd69f13d8-1jammy cephfs-top=19.0.0-3156-gd69f13d8-1jammy cephfs-mirror=19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:08:50.897 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T10:08:50.923 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T10:08:51.097 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-04-23T10:08:51.098 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-04-23T10:08:51.128 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-23T10:08:51.128 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-23T10:08:51.293 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:08:51.294 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:08:51.294 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:08:51.294 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T10:08:51.295 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T10:08:51.296 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:08:51.296 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T10:08:51.297 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T10:08:51.298 INFO:teuthology.orchestra.run.smithi190.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout:Recommended packages: 2024-04-23T10:08:51.299 INFO:teuthology.orchestra.run.smithi190.stdout: btrfs-tools 2024-04-23T10:08:51.329 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:08:51.329 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:08:51.329 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:08:51.329 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:08:51.330 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:08:51.331 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-23T10:08:51.331 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-23T10:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-23T10:08:51.332 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cherrypy3 python3-cmd2 python3-colorama python3-google-auth 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-idna python3-iniconfig python3-jaraco.classes 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.collections python3-jaraco.functools python3-jaraco.text 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jinja2 python3-joblib python3-kubernetes python3-logutils 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-mako python3-markupsafe python3-natsort python3-openssl 2024-04-23T10:08:51.333 INFO:teuthology.orchestra.run.smithi026.stdout: python3-paste python3-pastedeploy python3-pastescript python3-pecan 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pluggy python3-portend python3-prettytable python3-psutil python3-py 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyasn1 python3-pyasn1-modules python3-pygments python3-pyinotify 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pyperclip python3-pytest python3-repoze.lru python3-requests 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-routes python3-rsa python3-simplegeneric 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplejson python3-singledispatch python3-sklearn 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn-lib python3-tempita python3-tempora python3-threadpoolctl 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-toml python3-urllib3 python3-waitress python3-wcwidth python3-webob 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: python3-websocket python3-webtest python3-werkzeug python3-zc.lockfile 2024-04-23T10:08:51.334 INFO:teuthology.orchestra.run.smithi026.stdout: qttranslations5-l10n socat unzip xmlstarlet zip 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout:Recommended packages: 2024-04-23T10:08:51.335 INFO:teuthology.orchestra.run.smithi026.stdout: btrfs-tools 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T10:08:51.406 INFO:teuthology.orchestra.run.smithi190.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T10:08:51.407 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T10:08:51.408 INFO:teuthology.orchestra.run.smithi190.stdout: socat unzip xmlstarlet zip 2024-04-23T10:08:51.447 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-23T10:08:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-23T10:08:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-23T10:08:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm 2024-04-23T10:08:51.447 INFO:teuthology.orchestra.run.smithi026.stdout: cephfs-mirror cephfs-shell cephfs-top jq libcephfs-dev libcephfs2 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 librados2 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: libradosstriper1 librbd1 librdkafka1 libreadline-dev librgw2 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec lua-socket lua5.1 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: luarocks nvme-cli pkg-config python-asyncssh-doc python-babel-localedata 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: python-pastedeploy-tpl python3-asyncssh python3-babel python3-bcrypt 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-cachetools python3-ceph-argparse python3-ceph-common python3-cephfs 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-certifi python3-cheroot python3-cherrypy3 python3-cmd2 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-colorama python3-google-auth python3-idna python3-iniconfig 2024-04-23T10:08:51.449 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-pygments python3-pyinotify python3-pyperclip python3-pytest 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-rados python3-rbd python3-repoze.lru python3-requests 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-requests-oauthlib python3-rgw python3-routes python3-rsa 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-23T10:08:51.450 INFO:teuthology.orchestra.run.smithi026.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n radosgw rbd-fuse 2024-04-23T10:08:51.451 INFO:teuthology.orchestra.run.smithi026.stdout: socat unzip xmlstarlet zip 2024-04-23T10:08:51.478 INFO:teuthology.orchestra.run.smithi190.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T10:08:51.479 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 182 MB of archives. 2024-04-23T10:08:51.479 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T10:08:51.479 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T10:08:51.509 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T10:08:51.523 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T10:08:51.525 INFO:teuthology.orchestra.run.smithi026.stdout:0 upgraded, 124 newly installed, 0 to remove and 302 not upgraded. 2024-04-23T10:08:51.525 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 182 MB of archives. 2024-04-23T10:08:51.525 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 830 MB of additional disk space will be used. 2024-04-23T10:08:51.526 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyperclip all 1.8.2-2 [11.5 kB] 2024-04-23T10:08:51.550 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-23T10:08:51.572 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cmd2 all 2.3.3-1 [124 kB] 2024-04-23T10:08:51.590 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T10:08:51.622 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T10:08:51.624 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-23T10:08:51.627 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T10:08:51.643 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T10:08:51.652 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-23T10:08:51.654 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T10:08:51.655 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-23T10:08:51.669 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-23T10:08:51.694 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3156-gd69f13d8-1jammy [3,555 kB] 2024-04-23T10:08:51.699 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T10:08:51.704 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T10:08:51.716 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T10:08:51.720 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T10:08:51.720 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T10:08:51.729 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T10:08:51.731 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T10:08:51.733 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T10:08:51.734 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-23T10:08:51.735 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T10:08:51.735 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T10:08:51.739 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-23T10:08:51.754 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-23T10:08:51.756 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T10:08:51.758 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T10:08:51.759 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-23T10:08:51.759 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-23T10:08:51.760 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T10:08:51.760 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T10:08:51.762 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T10:08:51.763 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T10:08:51.763 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T10:08:51.764 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T10:08:51.764 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T10:08:51.769 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-23T10:08:51.772 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-23T10:08:51.775 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-23T10:08:51.776 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-23T10:08:51.776 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-23T10:08:51.777 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T10:08:51.779 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-23T10:08:51.782 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-23T10:08:51.784 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T10:08:51.785 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T10:08:51.787 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T10:08:51.788 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T10:08:51.788 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T10:08:51.789 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T10:08:51.790 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T10:08:51.790 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T10:08:51.797 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T10:08:51.799 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-23T10:08:51.800 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-23T10:08:51.800 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-23T10:08:51.801 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-23T10:08:51.801 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-23T10:08:51.802 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-23T10:08:51.802 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-23T10:08:51.811 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T10:08:51.812 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T10:08:51.812 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T10:08:51.817 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T10:08:51.818 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T10:08:51.818 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T10:08:51.819 INFO:teuthology.orchestra.run.smithi190.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T10:08:51.820 INFO:teuthology.orchestra.run.smithi190.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T10:08:51.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-23T10:08:51.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-23T10:08:51.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-23T10:08:51.822 INFO:teuthology.orchestra.run.smithi190.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T10:08:51.840 INFO:teuthology.orchestra.run.smithi190.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T10:08:51.841 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-23T10:08:51.842 INFO:teuthology.orchestra.run.smithi190.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T10:08:51.842 INFO:teuthology.orchestra.run.smithi190.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T10:08:51.843 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-23T10:08:51.843 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-23T10:08:51.843 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-23T10:08:51.844 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-23T10:08:51.844 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-23T10:08:51.845 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-23T10:08:51.845 INFO:teuthology.orchestra.run.smithi190.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T10:08:51.845 INFO:teuthology.orchestra.run.smithi190.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T10:08:51.846 INFO:teuthology.orchestra.run.smithi190.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T10:08:51.859 INFO:teuthology.orchestra.run.smithi190.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T10:08:51.861 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-23T10:08:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-23T10:08:51.863 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-23T10:08:51.897 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-23T10:08:51.897 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-23T10:08:51.898 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-23T10:08:51.898 INFO:teuthology.orchestra.run.smithi026.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-23T10:08:51.900 INFO:teuthology.orchestra.run.smithi026.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-23T10:08:51.902 INFO:teuthology.orchestra.run.smithi026.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-23T10:08:51.903 INFO:teuthology.orchestra.run.smithi026.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-23T10:08:51.925 INFO:teuthology.orchestra.run.smithi190.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T10:08:51.926 INFO:teuthology.orchestra.run.smithi190.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T10:08:51.928 INFO:teuthology.orchestra.run.smithi190.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T10:08:51.928 INFO:teuthology.orchestra.run.smithi190.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T10:08:51.929 INFO:teuthology.orchestra.run.smithi190.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T10:08:51.933 INFO:teuthology.orchestra.run.smithi026.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-23T10:08:51.935 INFO:teuthology.orchestra.run.smithi026.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-23T10:08:51.940 INFO:teuthology.orchestra.run.smithi026.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-23T10:08:51.951 INFO:teuthology.orchestra.run.smithi190.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T10:08:51.953 INFO:teuthology.orchestra.run.smithi190.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T10:08:51.954 INFO:teuthology.orchestra.run.smithi190.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T10:08:51.972 INFO:teuthology.orchestra.run.smithi026.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-23T10:08:51.973 INFO:teuthology.orchestra.run.smithi026.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-23T10:08:51.978 INFO:teuthology.orchestra.run.smithi026.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-23T10:08:51.989 INFO:teuthology.orchestra.run.smithi190.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T10:08:51.989 INFO:teuthology.orchestra.run.smithi190.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T10:08:52.007 INFO:teuthology.orchestra.run.smithi190.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T10:08:52.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T10:08:52.008 INFO:teuthology.orchestra.run.smithi190.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T10:08:52.009 INFO:teuthology.orchestra.run.smithi190.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T10:08:52.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T10:08:52.010 INFO:teuthology.orchestra.run.smithi190.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T10:08:52.015 INFO:teuthology.orchestra.run.smithi190.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T10:08:52.043 INFO:teuthology.orchestra.run.smithi190.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T10:08:52.045 INFO:teuthology.orchestra.run.smithi190.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T10:08:52.046 INFO:teuthology.orchestra.run.smithi190.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T10:08:52.060 INFO:teuthology.orchestra.run.smithi026.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-23T10:08:52.061 INFO:teuthology.orchestra.run.smithi026.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-23T10:08:52.062 INFO:teuthology.orchestra.run.smithi026.stdout:Get:56 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-23T10:08:52.063 INFO:teuthology.orchestra.run.smithi026.stdout:Get:57 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-23T10:08:52.064 INFO:teuthology.orchestra.run.smithi026.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-23T10:08:52.077 INFO:teuthology.orchestra.run.smithi190.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T10:08:52.081 INFO:teuthology.orchestra.run.smithi190.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T10:08:52.081 INFO:teuthology.orchestra.run.smithi190.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T10:08:52.082 INFO:teuthology.orchestra.run.smithi190.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T10:08:52.083 INFO:teuthology.orchestra.run.smithi190.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T10:08:52.088 INFO:teuthology.orchestra.run.smithi190.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T10:08:52.089 INFO:teuthology.orchestra.run.smithi190.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T10:08:52.092 INFO:teuthology.orchestra.run.smithi026.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-23T10:08:52.095 INFO:teuthology.orchestra.run.smithi026.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-23T10:08:52.095 INFO:teuthology.orchestra.run.smithi026.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-23T10:08:52.112 INFO:teuthology.orchestra.run.smithi026.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-23T10:08:52.112 INFO:teuthology.orchestra.run.smithi026.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-23T10:08:52.114 INFO:teuthology.orchestra.run.smithi190.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T10:08:52.114 INFO:teuthology.orchestra.run.smithi190.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T10:08:52.115 INFO:teuthology.orchestra.run.smithi190.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T10:08:52.123 INFO:teuthology.orchestra.run.smithi026.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-23T10:08:52.123 INFO:teuthology.orchestra.run.smithi026.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-23T10:08:52.124 INFO:teuthology.orchestra.run.smithi026.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-23T10:08:52.124 INFO:teuthology.orchestra.run.smithi026.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-23T10:08:52.125 INFO:teuthology.orchestra.run.smithi026.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-23T10:08:52.125 INFO:teuthology.orchestra.run.smithi026.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-23T10:08:52.129 INFO:teuthology.orchestra.run.smithi026.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-23T10:08:52.133 INFO:teuthology.orchestra.run.smithi190.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T10:08:52.136 INFO:teuthology.orchestra.run.smithi190.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T10:08:52.138 INFO:teuthology.orchestra.run.smithi190.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T10:08:52.146 INFO:teuthology.orchestra.run.smithi026.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-23T10:08:52.148 INFO:teuthology.orchestra.run.smithi026.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-23T10:08:52.149 INFO:teuthology.orchestra.run.smithi026.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-23T10:08:52.151 INFO:teuthology.orchestra.run.smithi190.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T10:08:52.151 INFO:teuthology.orchestra.run.smithi190.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T10:08:52.152 INFO:teuthology.orchestra.run.smithi190.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T10:08:52.156 INFO:teuthology.orchestra.run.smithi190.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T10:08:52.157 INFO:teuthology.orchestra.run.smithi190.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T10:08:52.172 INFO:teuthology.orchestra.run.smithi026.stdout:Get:74 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T10:08:52.178 INFO:teuthology.orchestra.run.smithi026.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-23T10:08:52.182 INFO:teuthology.orchestra.run.smithi026.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-colorama all 0.4.4-1 [24.5 kB] 2024-04-23T10:08:52.183 INFO:teuthology.orchestra.run.smithi026.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-23T10:08:52.184 INFO:teuthology.orchestra.run.smithi026.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-23T10:08:52.185 INFO:teuthology.orchestra.run.smithi026.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-23T10:08:52.192 INFO:teuthology.orchestra.run.smithi026.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-23T10:08:52.193 INFO:teuthology.orchestra.run.smithi026.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-23T10:08:52.198 INFO:teuthology.orchestra.run.smithi026.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-23T10:08:52.198 INFO:teuthology.orchestra.run.smithi026.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-23T10:08:52.199 INFO:teuthology.orchestra.run.smithi026.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-23T10:08:52.218 INFO:teuthology.orchestra.run.smithi026.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-23T10:08:52.221 INFO:teuthology.orchestra.run.smithi026.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-23T10:08:52.222 INFO:teuthology.orchestra.run.smithi026.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-23T10:08:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-23T10:08:52.233 INFO:teuthology.orchestra.run.smithi026.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-23T10:08:52.234 INFO:teuthology.orchestra.run.smithi026.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-23T10:08:52.239 INFO:teuthology.orchestra.run.smithi026.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-23T10:08:52.240 INFO:teuthology.orchestra.run.smithi026.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-23T10:08:52.339 INFO:teuthology.orchestra.run.smithi026.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T10:08:52.369 INFO:teuthology.orchestra.run.smithi026.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T10:08:52.379 INFO:teuthology.orchestra.run.smithi026.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T10:08:52.380 INFO:teuthology.orchestra.run.smithi026.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T10:08:52.385 INFO:teuthology.orchestra.run.smithi026.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T10:08:52.386 INFO:teuthology.orchestra.run.smithi026.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T10:08:52.408 INFO:teuthology.orchestra.run.smithi026.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T10:08:52.584 INFO:teuthology.orchestra.run.smithi190.stdout:Get:92 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3156-gd69f13d8-1jammy [3,224 kB] 2024-04-23T10:08:52.673 INFO:teuthology.orchestra.run.smithi026.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T10:08:52.676 INFO:teuthology.orchestra.run.smithi026.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T10:08:52.701 INFO:teuthology.orchestra.run.smithi026.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T10:08:53.113 INFO:teuthology.orchestra.run.smithi190.stdout:Get:93 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3156-gd69f13d8-1jammy [712 kB] 2024-04-23T10:08:53.195 INFO:teuthology.orchestra.run.smithi190.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3156-gd69f13d8-1jammy [356 kB] 2024-04-23T10:08:53.270 INFO:teuthology.orchestra.run.smithi190.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3156-gd69f13d8-1jammy [32.8 kB] 2024-04-23T10:08:53.271 INFO:teuthology.orchestra.run.smithi190.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3156-gd69f13d8-1jammy [180 kB] 2024-04-23T10:08:53.276 INFO:teuthology.orchestra.run.smithi190.stdout:Get:97 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3156-gd69f13d8-1jammy [66.9 kB] 2024-04-23T10:08:53.344 INFO:teuthology.orchestra.run.smithi190.stdout:Get:98 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3156-gd69f13d8-1jammy [330 kB] 2024-04-23T10:08:53.355 INFO:teuthology.orchestra.run.smithi190.stdout:Get:99 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3156-gd69f13d8-1jammy [6,894 kB] 2024-04-23T10:08:53.893 INFO:teuthology.orchestra.run.smithi026.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T10:08:54.018 INFO:teuthology.orchestra.run.smithi026.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T10:08:54.033 INFO:teuthology.orchestra.run.smithi026.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:08:54.037 INFO:teuthology.orchestra.run.smithi026.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T10:08:54.102 INFO:teuthology.orchestra.run.smithi026.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T10:08:54.241 INFO:teuthology.orchestra.run.smithi190.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3156-gd69f13d8-1jammy [112 kB] 2024-04-23T10:08:54.244 INFO:teuthology.orchestra.run.smithi190.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3156-gd69f13d8-1jammy [466 kB] 2024-04-23T10:08:54.309 INFO:teuthology.orchestra.run.smithi190.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3156-gd69f13d8-1jammy [25.8 MB] 2024-04-23T10:08:54.380 INFO:teuthology.orchestra.run.smithi026.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T10:08:55.473 INFO:teuthology.orchestra.run.smithi026.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T10:08:55.474 INFO:teuthology.orchestra.run.smithi026.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T10:08:55.491 INFO:teuthology.orchestra.run.smithi026.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T10:08:55.534 INFO:teuthology.orchestra.run.smithi026.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T10:08:55.553 INFO:teuthology.orchestra.run.smithi026.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T10:08:55.558 INFO:teuthology.orchestra.run.smithi026.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T10:08:55.653 INFO:teuthology.orchestra.run.smithi026.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T10:08:56.033 INFO:teuthology.orchestra.run.smithi026.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T10:08:56.034 INFO:teuthology.orchestra.run.smithi026.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T10:08:57.863 INFO:teuthology.orchestra.run.smithi190.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3156-gd69f13d8-1jammy [5,094 kB] 2024-04-23T10:08:58.441 INFO:teuthology.orchestra.run.smithi190.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3156-gd69f13d8-1jammy [244 kB] 2024-04-23T10:08:58.457 INFO:teuthology.orchestra.run.smithi190.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:08:58.460 INFO:teuthology.orchestra.run.smithi190.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3156-gd69f13d8-1jammy [1,527 kB] 2024-04-23T10:08:58.484 INFO:teuthology.orchestra.run.smithi026.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:08:58.486 INFO:teuthology.orchestra.run.smithi026.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T10:08:58.491 INFO:teuthology.orchestra.run.smithi026.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T10:08:58.492 INFO:teuthology.orchestra.run.smithi026.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T10:08:58.493 INFO:teuthology.orchestra.run.smithi026.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T10:08:58.494 INFO:teuthology.orchestra.run.smithi026.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T10:08:58.555 INFO:teuthology.orchestra.run.smithi190.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3156-gd69f13d8-1jammy [6,260 kB] 2024-04-23T10:08:58.995 INFO:teuthology.orchestra.run.smithi026.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T10:08:59.135 INFO:teuthology.orchestra.run.smithi190.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3156-gd69f13d8-1jammy [22.8 MB] 2024-04-23T10:08:59.648 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 182 MB in 8s (24.1 MB/s) 2024-04-23T10:08:59.765 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T10:08:59.859 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T10:08:59.865 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T10:08:59.905 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T10:09:00.166 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T10:09:00.193 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T10:09:00.233 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:09:00.493 INFO:teuthology.orchestra.run.smithi190.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3156-gd69f13d8-1jammy [14.0 kB] 2024-04-23T10:09:00.494 INFO:teuthology.orchestra.run.smithi190.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [870 kB] 2024-04-23T10:09:00.510 INFO:teuthology.orchestra.run.smithi190.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3156-gd69f13d8-1jammy [2,435 kB] 2024-04-23T10:09:00.577 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T10:09:00.604 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T10:09:00.637 INFO:teuthology.orchestra.run.smithi190.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3156-gd69f13d8-1jammy [791 kB] 2024-04-23T10:09:00.644 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T10:09:00.675 INFO:teuthology.orchestra.run.smithi190.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3156-gd69f13d8-1jammy [148 kB] 2024-04-23T10:09:00.679 INFO:teuthology.orchestra.run.smithi190.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3156-gd69f13d8-1jammy [2,324 kB] 2024-04-23T10:09:00.815 INFO:teuthology.orchestra.run.smithi190.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3156-gd69f13d8-1jammy [8,625 kB] 2024-04-23T10:09:00.997 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T10:09:01.023 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T10:09:01.114 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:09:01.283 INFO:teuthology.orchestra.run.smithi190.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3156-gd69f13d8-1jammy [14.2 kB] 2024-04-23T10:09:01.284 INFO:teuthology.orchestra.run.smithi190.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3156-gd69f13d8-1jammy [51.6 MB] 2024-04-23T10:09:01.484 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T10:09:01.510 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T10:09:01.550 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:09:01.887 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T10:09:01.913 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T10:09:01.953 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:09:02.507 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T10:09:02.534 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:02.591 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:03.018 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T10:09:03.045 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:03.085 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:03.421 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T10:09:03.448 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:03.488 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:03.908 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T10:09:03.934 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T10:09:03.983 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:09:04.344 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librados2. 2024-04-23T10:09:04.371 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:04.410 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:04.612 INFO:teuthology.orchestra.run.smithi190.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3156-gd69f13d8-1jammy [124 kB] 2024-04-23T10:09:04.614 INFO:teuthology.orchestra.run.smithi190.stdout:Get:119 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-mirror amd64 19.0.0-3156-gd69f13d8-1jammy [232 kB] 2024-04-23T10:09:04.619 INFO:teuthology.orchestra.run.smithi190.stdout:Get:120 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-shell all 19.0.0-3156-gd69f13d8-1jammy [33.9 kB] 2024-04-23T10:09:04.620 INFO:teuthology.orchestra.run.smithi190.stdout:Get:121 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 cephfs-top all 19.0.0-3156-gd69f13d8-1jammy [23.4 kB] 2024-04-23T10:09:04.620 INFO:teuthology.orchestra.run.smithi190.stdout:Get:122 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3156-gd69f13d8-1jammy [38.9 kB] 2024-04-23T10:09:04.622 INFO:teuthology.orchestra.run.smithi190.stdout:Get:123 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3156-gd69f13d8-1jammy [13.6 MB] 2024-04-23T10:09:04.871 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librbd1. 2024-04-23T10:09:04.899 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:04.938 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:05.174 INFO:teuthology.orchestra.run.smithi190.stdout:Get:124 https://3.chacra.ceph.com/r/ceph/wip-lusov-quiescer/d69f13d827952bb07bb9b7973bca14f97d764d6f/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3156-gd69f13d8-1jammy [91.6 kB] 2024-04-23T10:09:05.425 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T10:09:05.451 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:05.499 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:05.827 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rados. 2024-04-23T10:09:05.852 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 182 MB in 14s (13.1 MB/s) 2024-04-23T10:09:05.854 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:05.910 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:05.992 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyperclip. 2024-04-23T10:09:06.085 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-23T10:09:06.160 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../000-python3-pyperclip_1.8.2-2_all.deb ... 2024-04-23T10:09:06.229 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T10:09:06.233 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyperclip (1.8.2-2) ... 2024-04-23T10:09:06.256 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:06.296 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:06.549 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T10:09:06.576 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:06.615 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:06.952 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-23T10:09:06.979 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../001-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-23T10:09:07.027 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T10:09:07.027 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:09:07.053 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:07.102 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:07.347 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cmd2. 2024-04-23T10:09:07.373 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../002-python3-cmd2_2.3.3-1_all.deb ... 2024-04-23T10:09:07.413 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cmd2 (2.3.3-1) ... 2024-04-23T10:09:07.496 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T10:09:07.523 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T10:09:07.571 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T10:09:07.700 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-23T10:09:07.726 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../003-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-23T10:09:07.800 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:09:07.857 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T10:09:07.882 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:07.924 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:08.145 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-23T10:09:08.171 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../004-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-23T10:09:08.211 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:09:08.268 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T10:09:08.295 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T10:09:08.335 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:09:08.506 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-23T10:09:08.532 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../005-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-23T10:09:08.573 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:09:08.671 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T10:09:08.698 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T10:09:08.746 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:09:08.992 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-23T10:09:09.019 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../006-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:09.067 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:09.099 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T10:09:09.126 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T10:09:09.174 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:09:09.512 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-23T10:09:09.527 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua5.1. 2024-04-23T10:09:09.538 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../007-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:09.554 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T10:09:09.579 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:09.602 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:09:09.897 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-any. 2024-04-23T10:09:09.913 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T10:09:09.923 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-23T10:09:09.949 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../008-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-23T10:09:09.955 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T10:09:10.006 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:09:10.200 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package zip. 2024-04-23T10:09:10.216 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T10:09:10.257 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T10:09:10.309 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-23T10:09:10.335 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../009-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-23T10:09:10.367 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:09:10.603 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package unzip. 2024-04-23T10:09:10.630 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T10:09:10.662 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librados2. 2024-04-23T10:09:10.669 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:09:10.688 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../010-librados2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:10.728 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:11.031 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package luarocks. 2024-04-23T10:09:11.058 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T10:09:11.089 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:09:11.198 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librbd1. 2024-04-23T10:09:11.226 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../011-librbd1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:11.264 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:11.464 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package librgw2. 2024-04-23T10:09:11.491 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:11.530 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:11.742 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs2. 2024-04-23T10:09:11.768 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../012-libcephfs2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:11.809 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:12.077 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rados. 2024-04-23T10:09:12.091 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T10:09:12.093 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../013-python3-rados_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:12.107 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:12.136 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:12.149 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:12.472 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-23T10:09:12.498 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../014-python3-ceph-argparse_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:12.502 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T10:09:12.529 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T10:09:12.539 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:12.569 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:09:12.774 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cephfs. 2024-04-23T10:09:12.789 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../015-python3-cephfs_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:12.797 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T10:09:12.823 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:12.824 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:12.863 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:13.119 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-23T10:09:13.145 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../016-python3-ceph-common_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:13.185 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:13.317 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-common. 2024-04-23T10:09:13.344 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:13.383 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:13.522 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-prettytable. 2024-04-23T10:09:13.548 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../017-python3-prettytable_2.5.0-2_all.deb ... 2024-04-23T10:09:13.605 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-23T10:09:13.866 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rbd. 2024-04-23T10:09:13.892 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../018-python3-rbd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:13.932 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:14.285 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-23T10:09:14.311 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../019-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-23T10:09:14.351 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:09:14.604 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-23T10:09:14.630 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../020-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-23T10:09:14.662 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:09:14.788 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-base. 2024-04-23T10:09:14.815 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:14.864 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:14.948 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-23T10:09:14.964 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../021-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-23T10:09:15.007 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:09:15.301 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua5.1. 2024-04-23T10:09:15.325 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../022-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-23T10:09:15.360 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:09:15.418 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T10:09:15.445 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T10:09:15.484 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:09:15.688 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-any. 2024-04-23T10:09:15.714 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../023-lua-any_27ubuntu1_all.deb ... 2024-04-23T10:09:15.754 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-23T10:09:15.771 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T10:09:15.797 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T10:09:15.837 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:09:15.998 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package zip. 2024-04-23T10:09:16.014 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../024-zip_3.0-12build2_amd64.deb ... 2024-04-23T10:09:16.057 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking zip (3.0-12build2) ... 2024-04-23T10:09:16.190 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T10:09:16.217 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T10:09:16.265 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:09:16.385 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package unzip. 2024-04-23T10:09:16.411 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../025-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-23T10:09:16.451 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:09:16.635 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T10:09:16.662 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T10:09:16.709 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:09:16.980 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package luarocks. 2024-04-23T10:09:17.006 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../026-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-23T10:09:17.012 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T10:09:17.038 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:09:17.039 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T10:09:17.079 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:09:17.379 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package librgw2. 2024-04-23T10:09:17.405 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../027-librgw2_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:17.407 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T10:09:17.434 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T10:09:17.445 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:17.482 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T10:09:17.860 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-portend. 2024-04-23T10:09:17.887 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T10:09:17.935 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T10:09:18.006 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rgw. 2024-04-23T10:09:18.021 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../028-python3-rgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:18.064 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:18.254 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T10:09:18.270 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T10:09:18.312 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T10:09:18.409 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-23T10:09:18.435 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../029-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-23T10:09:18.475 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:09:18.599 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T10:09:18.626 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T10:09:18.665 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:09:18.745 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libradosstriper1. 2024-04-23T10:09:18.771 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../030-libradosstriper1_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:18.811 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:19.019 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T10:09:19.046 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T10:09:19.085 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T10:09:19.240 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-common. 2024-04-23T10:09:19.266 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../031-ceph-common_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:19.306 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:19.397 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T10:09:19.424 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T10:09:19.463 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T10:09:19.741 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T10:09:19.768 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T10:09:19.808 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:09:20.053 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-mako. 2024-04-23T10:09:20.080 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T10:09:20.119 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:09:20.431 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T10:09:20.458 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T10:09:20.514 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:09:20.744 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-base. 2024-04-23T10:09:20.771 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../032-ceph-base_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:20.817 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T10:09:20.820 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:20.844 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T10:09:20.883 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:09:21.178 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webob. 2024-04-23T10:09:21.205 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T10:09:21.244 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:09:21.399 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-23T10:09:21.425 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../033-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-23T10:09:21.465 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:09:21.556 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T10:09:21.582 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T10:09:21.642 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:09:21.709 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cheroot. 2024-04-23T10:09:21.736 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../034-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-23T10:09:21.909 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T10:09:21.935 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T10:09:21.975 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:09:22.218 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:09:22.278 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-paste. 2024-04-23T10:09:22.305 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T10:09:22.348 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:09:22.771 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-23T10:09:22.797 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../035-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-23T10:09:22.837 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:09:22.906 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T10:09:22.933 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T10:09:22.972 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:09:23.098 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-23T10:09:23.114 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../036-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-23T10:09:23.156 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:09:23.276 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T10:09:23.302 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T10:09:23.342 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:09:23.443 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-23T10:09:23.469 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../037-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-23T10:09:23.509 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:09:23.645 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T10:09:23.672 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T10:09:23.711 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T10:09:23.837 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempora. 2024-04-23T10:09:23.863 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../038-python3-tempora_4.1.2-1_all.deb ... 2024-04-23T10:09:23.903 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-23T10:09:23.981 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T10:09:23.997 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T10:09:24.031 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:09:24.215 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-portend. 2024-04-23T10:09:24.241 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../039-python3-portend_3.0.0-1_all.deb ... 2024-04-23T10:09:24.281 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-23T10:09:24.361 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T10:09:24.388 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T10:09:24.419 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T10:09:24.559 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-23T10:09:24.585 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../040-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-23T10:09:24.625 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-23T10:09:24.861 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-23T10:09:24.885 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../041-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-23T10:09:24.928 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:09:25.282 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-natsort. 2024-04-23T10:09:25.308 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../042-python3-natsort_8.0.2-1_all.deb ... 2024-04-23T10:09:25.348 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-23T10:09:25.397 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-idna. 2024-04-23T10:09:25.425 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T10:09:25.622 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T10:09:25.626 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-logutils. 2024-04-23T10:09:25.641 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../043-python3-logutils_0.3.3-8_all.deb ... 2024-04-23T10:09:25.676 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-23T10:09:25.954 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-23T10:09:25.976 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T10:09:25.980 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../044-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-23T10:09:26.002 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T10:09:26.020 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:09:26.042 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:09:26.323 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-mako. 2024-04-23T10:09:26.350 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../045-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-23T10:09:26.370 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests. 2024-04-23T10:09:26.390 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:09:26.397 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T10:09:26.436 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:09:26.693 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-23T10:09:26.719 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../046-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-23T10:09:26.748 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T10:09:26.759 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:09:26.775 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T10:09:26.814 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:09:27.109 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T10:09:27.137 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:27.176 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:27.253 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-23T10:09:27.280 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../047-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-23T10:09:27.320 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:09:27.539 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T10:09:27.555 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:27.589 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:27.598 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webob. 2024-04-23T10:09:27.624 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../048-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-23T10:09:27.664 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:09:27.892 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T10:09:27.919 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T10:09:27.958 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:09:28.001 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-waitress. 2024-04-23T10:09:28.027 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../049-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-23T10:09:28.070 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:09:28.261 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T10:09:28.288 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T10:09:28.327 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T10:09:28.378 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-tempita. 2024-04-23T10:09:28.405 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../050-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-23T10:09:28.445 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:09:28.656 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T10:09:28.683 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:28.722 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:28.731 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-paste. 2024-04-23T10:09:28.758 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../051-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-23T10:09:28.798 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:09:29.084 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T10:09:29.111 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:29.125 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-23T10:09:29.150 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:29.152 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../052-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-23T10:09:29.192 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:09:29.486 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-23T10:09:29.513 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../053-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-23T10:09:29.553 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:09:29.754 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T10:09:29.781 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:29.820 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:29.856 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-webtest. 2024-04-23T10:09:29.883 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../054-python3-webtest_2.0.35-1_all.deb ... 2024-04-23T10:09:29.922 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-23T10:09:30.234 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pecan. 2024-04-23T10:09:30.260 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../055-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-23T10:09:30.300 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:09:30.638 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-certifi. 2024-04-23T10:09:30.665 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../056-python3-certifi_2020.6.20-1_all.deb ... 2024-04-23T10:09:30.704 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-23T10:09:31.041 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph. 2024-04-23T10:09:31.057 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-idna. 2024-04-23T10:09:31.068 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:31.084 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../057-python3-idna_3.3-1_all.deb ... 2024-04-23T10:09:31.115 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:31.124 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-23T10:09:31.393 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-urllib3. 2024-04-23T10:09:31.416 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../058-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-23T10:09:31.451 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:09:31.468 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T10:09:31.495 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:31.534 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:31.730 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests. 2024-04-23T10:09:31.745 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../059-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-23T10:09:31.779 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:09:31.962 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T10:09:31.990 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:32.037 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:32.066 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-23T10:09:32.092 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../060-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-23T10:09:32.132 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:09:32.418 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-23T10:09:32.445 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../061-ceph-mgr-modules-core_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:32.476 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:32.498 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephadm. 2024-04-23T10:09:32.525 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:32.576 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:32.859 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-23T10:09:32.886 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../062-libsqlite3-mod-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:32.925 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:33.020 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T10:09:33.047 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T10:09:33.086 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T10:09:33.177 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-23T10:09:33.193 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../063-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-23T10:09:33.236 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:09:33.431 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T10:09:33.447 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:09:33.489 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:09:33.538 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-openssl. 2024-04-23T10:09:33.565 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../064-python3-openssl_21.0.0-1_all.deb ... 2024-04-23T10:09:33.605 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-23T10:09:33.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr. 2024-04-23T10:09:33.985 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../065-ceph-mgr_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:34.025 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:34.411 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mon. 2024-04-23T10:09:34.438 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../066-ceph-mon_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:34.477 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:34.553 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-babel. 2024-04-23T10:09:34.580 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:09:34.619 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:09:34.980 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T10:09:35.008 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T10:09:35.055 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:09:35.056 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-osd. 2024-04-23T10:09:35.082 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../067-ceph-osd_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:35.122 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:35.392 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T10:09:35.419 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:35.458 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:35.812 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T10:09:35.839 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T10:09:35.878 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T10:09:36.147 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-routes. 2024-04-23T10:09:36.164 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T10:09:36.192 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph. 2024-04-23T10:09:36.197 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:09:36.207 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../068-ceph_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:36.250 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:36.492 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T10:09:36.519 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:36.558 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:36.586 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-fuse. 2024-04-23T10:09:36.613 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../069-ceph-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:36.652 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:36.989 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mds. 2024-04-23T10:09:37.004 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../070-ceph-mds_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:37.038 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:37.433 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephadm. 2024-04-23T10:09:37.460 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../071-cephadm_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:37.500 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:37.747 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T10:09:37.763 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T10:09:37.805 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:09:37.828 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-23T10:09:37.855 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../072-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-23T10:09:37.910 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-23T10:09:38.222 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-23T10:09:38.237 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../073-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:09:38.280 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:09:38.325 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T10:09:38.353 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T10:09:38.392 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:09:38.754 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T10:09:38.781 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T10:09:38.906 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:09:39.192 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T10:09:39.220 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T10:09:39.258 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:09:39.302 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-babel. 2024-04-23T10:09:39.329 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../074-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-23T10:09:39.368 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:09:39.696 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-jinja2. 2024-04-23T10:09:39.723 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../075-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-23T10:09:39.762 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:09:39.934 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T10:09:39.962 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:40.001 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:40.116 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-23T10:09:40.142 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../076-ceph-mgr-cephadm_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:40.182 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:40.518 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-23T10:09:40.545 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../077-python3-repoze.lru_0.7-2_all.deb ... 2024-04-23T10:09:40.585 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-23T10:09:40.871 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-routes. 2024-04-23T10:09:40.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../078-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-23T10:09:40.929 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T10:09:40.929 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:09:40.956 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T10:09:40.995 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T10:09:41.274 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-23T10:09:41.298 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T10:09:41.301 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../079-ceph-mgr-dashboard_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:41.326 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T10:09:41.340 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:41.365 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:09:41.727 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T10:09:41.754 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T10:09:41.793 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:09:42.104 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T10:09:42.132 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T10:09:42.171 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T10:09:42.475 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T10:09:42.502 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T10:09:42.541 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T10:09:42.712 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-23T10:09:42.739 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../080-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-23T10:09:42.778 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:09:42.878 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T10:09:42.905 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T10:09:42.944 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:09:43.266 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-joblib. 2024-04-23T10:09:43.292 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../081-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-23T10:09:43.332 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:09:43.581 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T10:09:43.608 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T10:09:43.647 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T10:09:43.685 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-23T10:09:43.712 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../082-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-23T10:09:43.845 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:09:43.950 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T10:09:43.978 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T10:09:44.016 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:09:44.123 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-sklearn. 2024-04-23T10:09:44.150 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../083-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-23T10:09:44.190 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:09:44.689 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T10:09:44.714 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:44.755 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:44.840 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-23T10:09:44.867 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../084-ceph-mgr-diskprediction-local_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:44.915 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:45.033 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T10:09:45.061 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T10:09:45.099 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:09:45.403 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T10:09:45.431 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:09:45.469 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:09:45.739 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package jq. 2024-04-23T10:09:45.766 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:09:45.805 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T10:09:45.860 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-cachetools. 2024-04-23T10:09:45.875 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../085-python3-cachetools_5.0.0-1_all.deb ... 2024-04-23T10:09:45.909 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-23T10:09:46.058 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package socat. 2024-04-23T10:09:46.085 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T10:09:46.124 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:09:46.195 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-23T10:09:46.223 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../086-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-23T10:09:46.262 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:09:46.411 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T10:09:46.427 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T10:09:46.461 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:09:46.607 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-23T10:09:46.634 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../087-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-23T10:09:46.673 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:09:46.832 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-test. 2024-04-23T10:09:46.848 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:46.889 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:46.985 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-rsa. 2024-04-23T10:09:47.012 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../088-python3-rsa_4.8-1_all.deb ... 2024-04-23T10:09:47.051 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-23T10:09:47.363 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-google-auth. 2024-04-23T10:09:47.390 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../089-python3-google-auth_1.5.1-3_all.deb ... 2024-04-23T10:09:47.429 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-23T10:09:47.783 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-23T10:09:47.810 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../090-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-23T10:09:47.849 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:09:48.127 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-websocket. 2024-04-23T10:09:48.143 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../091-python3-websocket_1.2.3-1_all.deb ... 2024-04-23T10:09:48.177 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-23T10:09:48.480 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-23T10:09:48.507 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../092-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-23T10:09:48.547 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:09:49.119 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T10:09:49.147 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:49.185 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:49.194 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-23T10:09:49.218 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../093-ceph-mgr-k8sevents_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:49.260 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:49.565 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T10:09:49.588 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-23T10:09:49.592 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:49.615 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../094-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-23T10:09:49.631 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:49.654 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:09:49.942 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T10:09:49.958 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-23T10:09:49.970 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T10:09:49.985 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../095-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:09:50.009 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T10:09:50.024 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:09:50.260 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package jq. 2024-04-23T10:09:50.270 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T10:09:50.287 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../096-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-23T10:09:50.298 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:50.326 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-23T10:09:50.336 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:50.579 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package socat. 2024-04-23T10:09:50.580 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T10:09:50.595 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../097-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-23T10:09:50.597 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:50.630 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:50.637 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:09:50.858 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T10:09:50.874 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:50.916 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:50.982 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package xmlstarlet. 2024-04-23T10:09:51.010 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../098-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-23T10:09:51.049 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:09:51.244 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T10:09:51.272 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T10:09:51.310 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:09:51.394 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-test. 2024-04-23T10:09:51.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../099-ceph-test_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:51.452 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:51.673 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T10:09:51.701 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T10:09:51.739 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:09:52.085 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T10:09:52.113 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T10:09:52.143 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:09:52.523 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pkg-config. 2024-04-23T10:09:52.551 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T10:09:52.590 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:09:52.851 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T10:09:52.867 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T10:09:52.909 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:09:53.346 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T10:09:53.372 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T10:09:53.412 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T10:09:53.606 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ceph-volume. 2024-04-23T10:09:53.634 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../100-ceph-volume_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:53.673 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:53.715 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T10:09:53.743 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T10:09:53.781 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T10:09:54.044 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-mirror. 2024-04-23T10:09:54.071 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../101-cephfs-mirror_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:54.085 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T10:09:54.110 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:54.113 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T10:09:54.143 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:09:54.429 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T10:09:54.430 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-colorama. 2024-04-23T10:09:54.457 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../102-python3-colorama_0.4.4-1_all.deb ... 2024-04-23T10:09:54.457 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T10:09:54.496 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T10:09:54.496 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-colorama (0.4.4-1) ... 2024-04-23T10:09:54.774 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-shell. 2024-04-23T10:09:54.801 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../103-cephfs-shell_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:54.815 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-py. 2024-04-23T10:09:54.840 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:54.843 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T10:09:54.882 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T10:09:55.084 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package cephfs-top. 2024-04-23T10:09:55.112 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../104-cephfs-top_19.0.0-3156-gd69f13d8-1jammy_all.deb ... 2024-04-23T10:09:55.151 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:55.169 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T10:09:55.197 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T10:09:55.235 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:09:55.403 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-23T10:09:55.430 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../105-libcephfs-dev_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:55.469 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:55.689 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T10:09:55.717 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T10:09:55.755 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:09:55.789 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-23T10:09:55.817 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../106-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-23T10:09:55.855 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:09:56.033 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-toml. 2024-04-23T10:09:56.061 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T10:09:56.091 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T10:09:56.168 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-23T10:09:56.195 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../107-lua-sec_1.0.2-1_amd64.deb ... 2024-04-23T10:09:56.235 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:09:56.361 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T10:09:56.389 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T10:09:56.452 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:09:56.589 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package nvme-cli. 2024-04-23T10:09:56.616 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../108-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-23T10:09:56.655 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:09:56.773 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T10:09:56.801 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T10:09:56.830 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:09:57.077 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pkg-config. 2024-04-23T10:09:57.083 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T10:09:57.104 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../109-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-23T10:09:57.112 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T10:09:57.143 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:09:57.150 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:09:57.396 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-23T10:09:57.423 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../110-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-23T10:09:57.462 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:09:57.874 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-23T10:09:57.901 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../111-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-23T10:09:57.904 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package radosgw. 2024-04-23T10:09:57.932 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:57.940 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-23T10:09:57.962 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:58.477 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pastescript. 2024-04-23T10:09:58.504 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../112-python3-pastescript_2.0.2-4_all.deb ... 2024-04-23T10:09:58.543 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-23T10:09:58.846 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pluggy. 2024-04-23T10:09:58.873 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../113-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-23T10:09:58.912 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:09:58.998 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T10:09:59.026 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:09:59.065 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:09:59.224 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-psutil. 2024-04-23T10:09:59.251 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../114-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-23T10:09:59.290 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-23T10:09:59.379 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T10:09:59.628 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:09:59.635 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-py. 2024-04-23T10:09:59.662 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../115-python3-py_1.10.0-1_all.deb ... 2024-04-23T10:09:59.701 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-23T10:09:59.729 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:09:59.976 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T10:10:00.021 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pygments. 2024-04-23T10:10:00.049 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../116-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-23T10:10:00.087 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:10:00.314 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T10:10:00.533 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-23T10:10:00.561 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../117-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-23T10:10:00.591 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:10:00.735 INFO:teuthology.orchestra.run.smithi026.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T10:10:00.822 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:00.894 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-toml. 2024-04-23T10:10:00.922 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../118-python3-toml_0.10.2-1_all.deb ... 2024-04-23T10:10:00.960 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-23T10:10:01.280 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-pytest. 2024-04-23T10:10:01.308 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../119-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-23T10:10:01.331 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user cephadm....done 2024-04-23T10:10:01.346 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:10:01.495 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:10:01.658 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package python3-simplejson. 2024-04-23T10:10:01.686 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../120-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-23T10:10:01.724 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:10:01.755 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:10:01.989 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:10:01.993 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-23T10:10:02.010 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../121-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-23T10:10:02.053 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:10:02.132 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:10:02.391 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T10:10:02.642 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:10:02.714 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package radosgw. 2024-04-23T10:10:02.742 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../122-radosgw_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:10:02.772 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:02.777 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T10:10:03.095 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:10:03.472 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T10:10:03.634 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package rbd-fuse. 2024-04-23T10:10:03.650 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../123-rbd-fuse_19.0.0-3156-gd69f13d8-1jammy_amd64.deb ... 2024-04-23T10:10:03.692 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:03.715 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T10:10:04.005 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-23T10:10:04.033 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T10:10:04.263 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-23T10:10:04.342 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:10:04.389 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-23T10:10:04.594 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:10:04.682 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-23T10:10:04.854 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:10:05.035 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-23T10:10:05.096 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:10:05.441 INFO:teuthology.orchestra.run.smithi190.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-23T10:10:05.456 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:05.541 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:05.707 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:10:05.833 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:10:05.950 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T10:10:06.023 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user cephadm....done 2024-04-23T10:10:06.193 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:10:06.241 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-23T10:10:06.319 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:10:06.579 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:10:06.603 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-23T10:10:06.930 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T10:10:06.956 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-23T10:10:06.960 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T10:10:07.065 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:10:07.184 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-23T10:10:07.191 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T10:10:07.495 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-23T10:10:07.559 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:10:07.693 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T10:10:07.729 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-23T10:10:07.830 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-23T10:10:08.011 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:10:08.132 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-23T10:10:08.279 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:10:08.492 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-23T10:10:08.572 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T10:10:08.723 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:10:08.752 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-colorama (0.4.4-1) ... 2024-04-23T10:10:09.028 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-23T10:10:09.296 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-23T10:10:09.433 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:10:09.547 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-23T10:10:09.718 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:10:09.798 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-23T10:10:09.827 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:10:09.953 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:10:10.058 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-23T10:10:10.263 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T10:10:10.326 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-argparse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:10.593 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-23T10:10:10.639 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T10:10:10.719 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-23T10:10:10.820 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyperclip (1.8.2-2) ... 2024-04-23T10:10:10.890 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:10:11.063 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-23T10:10:11.188 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-23T10:10:11.300 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:10:11.448 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-23T10:10:11.593 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T10:10:11.859 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-23T10:10:11.887 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-23T10:10:11.911 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:10:11.951 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-23T10:10:12.077 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-23T10:10:12.262 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:10:12.445 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-23T10:10:12.496 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:10:12.562 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-23T10:10:12.622 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:12.830 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-23T10:10:12.924 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T10:10:13.106 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-23T10:10:13.258 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:10:13.407 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up zip (3.0-12build2) ... 2024-04-23T10:10:13.533 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-23T10:10:14.202 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-23T10:10:14.414 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:10:14.453 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-23T10:10:14.562 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-23T10:10:14.649 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:14.688 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-23T10:10:14.775 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T10:10:14.972 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-23T10:10:15.026 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:10:15.152 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:10:15.253 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:10:15.392 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-23T10:10:15.538 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:10:15.635 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-23T10:10:15.798 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T10:10:16.003 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-23T10:10:16.074 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:16.200 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:10:16.271 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cmd2 (2.3.3-1) ... 2024-04-23T10:10:16.493 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:10:16.555 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-23T10:10:16.746 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T10:10:16.907 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-23T10:10:17.005 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T10:10:17.157 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-23T10:10:17.265 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:10:17.283 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:17.524 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T10:10:17.585 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-idna (3.3-1) ... 2024-04-23T10:10:17.783 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:10:17.894 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-23T10:10:17.909 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T10:10:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:10:18.354 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:10:18.663 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:10:18.948 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:10:19.000 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-23T10:10:19.207 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:10:19.252 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:19.333 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:10:19.386 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-23T10:10:19.459 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:10:19.549 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T10:10:19.653 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-23T10:10:19.779 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-23T10:10:19.802 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:10:19.905 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-23T10:10:19.928 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:10:20.190 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-23T10:10:20.338 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:10:20.449 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-23T10:10:20.589 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T10:10:20.709 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:20.715 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T10:10:20.818 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-23T10:10:20.983 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:21.109 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:10:21.128 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-23T10:10:21.362 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-23T10:10:21.427 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:10:21.605 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-23T10:10:21.728 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:10:21.848 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-23T10:10:21.996 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T10:10:22.124 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-23T10:10:22.207 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T10:10:22.383 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-23T10:10:22.475 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T10:10:22.526 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-23T10:10:22.768 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:10:22.793 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-23T10:10:22.894 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-23T10:10:23.028 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:10:23.170 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-23T10:10:23.421 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T10:10:23.446 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-23T10:10:23.697 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-23T10:10:23.706 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:10:23.823 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-23T10:10:23.949 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-23T10:10:24.038 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-23T10:10:24.050 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:10:24.176 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:24.285 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-23T10:10:24.302 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:24.385 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-23T10:10:24.411 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:10:24.689 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:24.754 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-23T10:10:24.815 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:24.941 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T10:10:25.004 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-23T10:10:25.130 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-23T10:10:25.209 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:25.319 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:25.381 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-23T10:10:25.445 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:25.507 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-23T10:10:25.664 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:10:25.664 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:10:25.825 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-23T10:10:26.126 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-23T10:10:26.129 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:26.255 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:26.377 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-23T10:10:26.390 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:26.516 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:26.572 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-23T10:10:26.633 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:10:26.832 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-23T10:10:27.108 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-23T10:10:27.376 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-23T10:10:27.745 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-23T10:10:27.821 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:27.921 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.004 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-23T10:10:28.039 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.165 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.291 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.340 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-23T10:10:28.417 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.466 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librados2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.617 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:28.751 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-23T10:10:28.936 INFO:teuthology.orchestra.run.smithi026.stdout:Adding group ceph....done 2024-04-23T10:10:29.079 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:29.180 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libradosstriper1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:29.298 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-23T10:10:29.320 INFO:teuthology.orchestra.run.smithi026.stdout:Adding system user ceph....done 2024-04-23T10:10:29.454 INFO:teuthology.orchestra.run.smithi026.stdout:Setting system user ceph properties....done 2024-04-23T10:10:29.470 INFO:teuthology.orchestra.run.smithi026.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T10:10:29.574 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librbd1 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:29.622 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T10:10:29.700 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-modules-core (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:29.818 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:29.979 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T10:10:30.011 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:10:30.011 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-23T10:10:30.435 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:30.452 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libcephfs-dev (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:30.553 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rados (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:30.658 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:10:30.658 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:10:30.679 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up librgw2 (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:30.805 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-top (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:30.931 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-23T10:10:31.137 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:31.254 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:31.718 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:10:31.718 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:10:32.076 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rbd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.164 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.177 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up rbd-fuse (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.278 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-rgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.396 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up python3-cephfs (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.522 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-shell (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.523 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T10:10:32.648 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-common (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:32.999 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:33.207 INFO:teuthology.orchestra.run.smithi190.stdout:Adding group ceph....done 2024-04-23T10:10:33.224 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:10:33.224 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:10:33.592 INFO:teuthology.orchestra.run.smithi190.stdout:Adding system user ceph....done 2024-04-23T10:10:33.684 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:33.761 INFO:teuthology.orchestra.run.smithi190.stdout:Setting system user ceph properties....done 2024-04-23T10:10:33.776 INFO:teuthology.orchestra.run.smithi190.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-23T10:10:33.913 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-23T10:10:33.931 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:10:33.931 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:10:34.253 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-23T10:10:34.402 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:34.690 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:10:34.690 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:10:34.715 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up cephfs-mirror (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:34.920 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:10:34.920 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/cephfs-mirror.target -> /lib/systemd/system/cephfs-mirror.target. 2024-04-23T10:10:35.220 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:35.326 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:35.400 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-test (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:35.477 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:35.526 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up radosgw (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:35.698 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:10:35.698 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:10:35.959 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:10:35.959 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-23T10:10:36.170 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:36.321 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:36.403 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-base (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:36.447 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:36.598 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:36.733 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-23T10:10:36.960 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:10:37.060 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:10:37.179 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mds (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:37.213 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:10:37.399 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:10:37.399 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-23T10:10:37.848 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:38.051 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:10:38.052 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-23T10:10:38.322 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:10:38.499 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-osd (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:38.792 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:10:38.793 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-23T10:10:38.966 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:10:38.969 DEBUG:teuthology.orchestra.run.smithi026:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T10:10:39.021 INFO:teuthology.orchestra.run.smithi026.stdout:Reading package lists... 2024-04-23T10:10:39.225 INFO:teuthology.orchestra.run.smithi026.stdout:Building dependency tree... 2024-04-23T10:10:39.226 INFO:teuthology.orchestra.run.smithi026.stdout:Reading state information... 2024-04-23T10:10:39.292 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:10:39.427 INFO:teuthology.orchestra.run.smithi026.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:10:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:10:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:10:39.428 INFO:teuthology.orchestra.run.smithi026.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:10:39.428 INFO:teuthology.orchestra.run.smithi026.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:10:39.429 INFO:teuthology.orchestra.run.smithi026.stdout:The following additional packages will be installed: 2024-04-23T10:10:39.429 INFO:teuthology.orchestra.run.smithi026.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T10:10:39.429 INFO:teuthology.orchestra.run.smithi026.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T10:10:39.429 INFO:teuthology.orchestra.run.smithi026.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T10:10:39.430 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T10:10:39.430 INFO:teuthology.orchestra.run.smithi026.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:10:39.431 INFO:teuthology.orchestra.run.smithi026.stdout:Suggested packages: 2024-04-23T10:10:39.431 INFO:teuthology.orchestra.run.smithi026.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T10:10:39.431 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T10:10:39.431 INFO:teuthology.orchestra.run.smithi026.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T10:10:39.475 INFO:teuthology.orchestra.run.smithi026.stdout:The following NEW packages will be installed: 2024-04-23T10:10:39.476 INFO:teuthology.orchestra.run.smithi026.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T10:10:39.476 INFO:teuthology.orchestra.run.smithi026.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T10:10:39.476 INFO:teuthology.orchestra.run.smithi026.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T10:10:39.476 INFO:teuthology.orchestra.run.smithi026.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T10:10:39.476 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T10:10:39.477 INFO:teuthology.orchestra.run.smithi026.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T10:10:39.477 INFO:teuthology.orchestra.run.smithi026.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:10:39.478 INFO:teuthology.orchestra.run.smithi026.stdout:The following packages will be upgraded: 2024-04-23T10:10:39.479 INFO:teuthology.orchestra.run.smithi026.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T10:10:39.562 INFO:teuthology.orchestra.run.smithi026.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-23T10:10:39.562 INFO:teuthology.orchestra.run.smithi026.stdout:Need to get 55.7 MB of archives. 2024-04-23T10:10:39.562 INFO:teuthology.orchestra.run.smithi026.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T10:10:39.562 INFO:teuthology.orchestra.run.smithi026.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T10:10:39.588 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:39.739 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mon (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:39.745 INFO:teuthology.orchestra.run.smithi026.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T10:10:39.753 INFO:teuthology.orchestra.run.smithi026.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T10:10:39.803 INFO:teuthology.orchestra.run.smithi026.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T10:10:39.804 INFO:teuthology.orchestra.run.smithi026.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T10:10:39.806 INFO:teuthology.orchestra.run.smithi026.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T10:10:39.821 INFO:teuthology.orchestra.run.smithi026.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T10:10:39.823 INFO:teuthology.orchestra.run.smithi026.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T10:10:39.826 INFO:teuthology.orchestra.run.smithi026.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T10:10:39.827 INFO:teuthology.orchestra.run.smithi026.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T10:10:39.828 INFO:teuthology.orchestra.run.smithi026.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T10:10:39.830 INFO:teuthology.orchestra.run.smithi026.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T10:10:39.858 INFO:teuthology.orchestra.run.smithi026.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T10:10:39.859 INFO:teuthology.orchestra.run.smithi026.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T10:10:39.859 INFO:teuthology.orchestra.run.smithi026.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T10:10:39.879 INFO:teuthology.orchestra.run.smithi026.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T10:10:39.952 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:10:39.952 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-23T10:10:40.247 INFO:teuthology.orchestra.run.smithi026.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T10:10:40.249 INFO:teuthology.orchestra.run.smithi026.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T10:10:40.249 INFO:teuthology.orchestra.run.smithi026.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T10:10:40.252 INFO:teuthology.orchestra.run.smithi026.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T10:10:40.253 INFO:teuthology.orchestra.run.smithi026.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T10:10:40.257 INFO:teuthology.orchestra.run.smithi026.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T10:10:40.259 INFO:teuthology.orchestra.run.smithi026.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T10:10:40.267 INFO:teuthology.orchestra.run.smithi026.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T10:10:40.267 INFO:teuthology.orchestra.run.smithi026.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T10:10:40.291 INFO:teuthology.orchestra.run.smithi026.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T10:10:40.291 INFO:teuthology.orchestra.run.smithi026.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T10:10:40.302 INFO:teuthology.orchestra.run.smithi026.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T10:10:40.327 INFO:teuthology.orchestra.run.smithi026.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T10:10:40.331 INFO:teuthology.orchestra.run.smithi026.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T10:10:40.331 INFO:teuthology.orchestra.run.smithi026.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T10:10:40.332 INFO:teuthology.orchestra.run.smithi026.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T10:10:40.333 INFO:teuthology.orchestra.run.smithi026.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T10:10:40.344 INFO:teuthology.orchestra.run.smithi026.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T10:10:40.346 INFO:teuthology.orchestra.run.smithi026.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T10:10:40.407 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-cephadm (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:40.558 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T10:10:40.563 INFO:teuthology.orchestra.run.smithi026.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T10:10:40.575 INFO:teuthology.orchestra.run.smithi026.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T10:10:40.575 INFO:teuthology.orchestra.run.smithi026.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T10:10:40.692 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-mgr-dashboard (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:40.835 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ceph-volume (19.0.0-3156-gd69f13d8-1jammy) ... 2024-04-23T10:10:41.001 INFO:teuthology.orchestra.run.smithi026.stdout:Preconfiguring packages ... 2024-04-23T10:10:41.160 INFO:teuthology.orchestra.run.smithi026.stdout:Fetched 55.7 MB in 1s (51.2 MB/s) 2024-04-23T10:10:41.163 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:10:41.255 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:10:41.407 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:10:41.453 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:10:41.459 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:41.602 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:42.232 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T10:10:42.507 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:10:43.135 INFO:teuthology.orchestra.run.smithi026.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T10:10:43.152 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:10:43.155 DEBUG:teuthology.orchestra.run.smithi190:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install bison flex libelf-dev libssl-dev network-manager iproute2 util-linux dump indent libaio-dev libtool-bin uuid-dev xfslibs-dev postgresql postgresql-client postgresql-common postgresql-contrib 2024-04-23T10:10:43.208 INFO:teuthology.orchestra.run.smithi190.stdout:Reading package lists... 2024-04-23T10:10:43.383 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package flex. 2024-04-23T10:10:43.391 INFO:teuthology.orchestra.run.smithi190.stdout:Building dependency tree... 2024-04-23T10:10:43.391 INFO:teuthology.orchestra.run.smithi190.stdout:Reading state information... 2024-04-23T10:10:43.481 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:10:43.487 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T10:10:43.523 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout:iproute2 is already the newest version (5.15.0-1ubuntu2). 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout:libtool-bin is already the newest version (2.4.6-15build2). 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout:xfslibs-dev is already the newest version (5.13.0-1ubuntu2). 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages were automatically installed and are no longer required: 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-23T10:10:43.565 INFO:teuthology.orchestra.run.smithi190.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout:The following additional packages will be installed: 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout: libbluetooth3 libfl-dev libfl2 libjson-perl libllvm14 liblzo2-2 2024-04-23T10:10:43.566 INFO:teuthology.orchestra.run.smithi190.stdout: libmbim-glib4 libmbim-proxy libmm-glib0 libndp0 libnm0 libpq5 libqmi-glib5 2024-04-23T10:10:43.567 INFO:teuthology.orchestra.run.smithi190.stdout: libqmi-proxy libssl3 libteamdctl0 libuuid1 modemmanager network-manager-pptp 2024-04-23T10:10:43.567 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-14 postgresql-client-14 postgresql-client-common ppp pptp-linux 2024-04-23T10:10:43.567 INFO:teuthology.orchestra.run.smithi190.stdout: tcl tcl8.6 usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:10:43.568 INFO:teuthology.orchestra.run.smithi190.stdout:Suggested packages: 2024-04-23T10:10:43.568 INFO:teuthology.orchestra.run.smithi190.stdout: bison-doc flex-doc indent-doc libssl-doc avahi-autoipd libteam-utils 2024-04-23T10:10:43.568 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-doc postgresql-doc-14 tcl-tclreadline comgt wvdial 2024-04-23T10:10:43.568 INFO:teuthology.orchestra.run.smithi190.stdout: util-linux-locales wpagui libengine-pkcs11-openssl 2024-04-23T10:10:43.607 INFO:teuthology.orchestra.run.smithi190.stdout:The following NEW packages will be installed: 2024-04-23T10:10:43.607 INFO:teuthology.orchestra.run.smithi190.stdout: bison dump flex indent libaio-dev libbluetooth3 libelf-dev libfl-dev libfl2 2024-04-23T10:10:43.607 INFO:teuthology.orchestra.run.smithi190.stdout: libjson-perl libllvm14 liblzo2-2 libmbim-glib4 libmbim-proxy libmm-glib0 2024-04-23T10:10:43.608 INFO:teuthology.orchestra.run.smithi190.stdout: libndp0 libnm0 libpq5 libqmi-glib5 libqmi-proxy libssl-dev libteamdctl0 2024-04-23T10:10:43.608 INFO:teuthology.orchestra.run.smithi190.stdout: modemmanager network-manager network-manager-pptp postgresql postgresql-14 2024-04-23T10:10:43.608 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-client postgresql-client-14 postgresql-client-common 2024-04-23T10:10:43.608 INFO:teuthology.orchestra.run.smithi190.stdout: postgresql-common postgresql-contrib ppp pptp-linux tcl tcl8.6 2024-04-23T10:10:43.608 INFO:teuthology.orchestra.run.smithi190.stdout: usb-modeswitch usb-modeswitch-data wpasupplicant 2024-04-23T10:10:43.609 INFO:teuthology.orchestra.run.smithi190.stdout:The following packages will be upgraded: 2024-04-23T10:10:43.610 INFO:teuthology.orchestra.run.smithi190.stdout: libssl3 libuuid1 util-linux uuid-dev 2024-04-23T10:10:43.791 INFO:teuthology.orchestra.run.smithi190.stdout:4 upgraded, 39 newly installed, 0 to remove and 298 not upgraded. 2024-04-23T10:10:43.791 INFO:teuthology.orchestra.run.smithi190.stdout:Need to get 55.7 MB of archives. 2024-04-23T10:10:43.791 INFO:teuthology.orchestra.run.smithi190.stdout:After this operation, 202 MB of additional disk space will be used. 2024-04-23T10:10:43.791 INFO:teuthology.orchestra.run.smithi190.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 util-linux amd64 2.37.2-4ubuntu3.4 [1,063 kB] 2024-04-23T10:10:44.269 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:10:44.484 INFO:teuthology.orchestra.run.smithi190.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 flex amd64 2.6.4-8build2 [307 kB] 2024-04-23T10:10:44.504 INFO:teuthology.orchestra.run.smithi190.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl3 amd64 3.0.2-0ubuntu1.15 [1,905 kB] 2024-04-23T10:10:44.566 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T10:10:44.795 INFO:teuthology.orchestra.run.smithi190.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 uuid-dev amd64 2.37.2-4ubuntu3.4 [33.1 kB] 2024-04-23T10:10:44.796 INFO:teuthology.orchestra.run.smithi190.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libuuid1 amd64 2.37.2-4ubuntu3.4 [23.8 kB] 2024-04-23T10:10:44.805 INFO:teuthology.orchestra.run.smithi190.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy/main amd64 bison amd64 2:3.8.2+dfsg-1build1 [748 kB] 2024-04-23T10:10:44.829 INFO:teuthology.orchestra.run.smithi190.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblzo2-2 amd64 2.10-2build3 [53.7 kB] 2024-04-23T10:10:44.843 INFO:teuthology.orchestra.run.smithi190.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 dump amd64 0.4b47-3 [133 kB] 2024-04-23T10:10:44.893 INFO:teuthology.orchestra.run.smithi190.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 indent amd64 2.2.12-1ubuntu0.22.04.1 [90.8 kB] 2024-04-23T10:10:44.895 INFO:teuthology.orchestra.run.smithi190.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 libaio-dev amd64 0.3.112-13build1 [21.2 kB] 2024-04-23T10:10:44.897 INFO:teuthology.orchestra.run.smithi190.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libbluetooth3 amd64 5.64-0ubuntu1.1 [87.0 kB] 2024-04-23T10:10:45.064 INFO:teuthology.orchestra.run.smithi190.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libelf-dev amd64 0.186-1build1 [64.4 kB] 2024-04-23T10:10:45.264 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:10:45.407 INFO:teuthology.orchestra.run.smithi190.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl2 amd64 2.6.4-8build2 [10.7 kB] 2024-04-23T10:10:45.421 INFO:teuthology.orchestra.run.smithi190.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/main amd64 libfl-dev amd64 2.6.4-8build2 [6,236 B] 2024-04-23T10:10:45.427 INFO:teuthology.orchestra.run.smithi190.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjson-perl all 4.04000-1 [81.8 kB] 2024-04-23T10:10:45.540 INFO:teuthology.orchestra.run.smithi190.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libllvm14 amd64 1:14.0.0-1ubuntu1.1 [24.0 MB] 2024-04-23T10:10:45.870 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:10:45.876 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:46.037 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:46.464 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:46.594 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:46.964 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:10:47.240 INFO:teuthology.orchestra.run.smithi190.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-glib4 amd64 1.28.0-1~ubuntu20.04.1 [191 kB] 2024-04-23T10:10:47.245 INFO:teuthology.orchestra.run.smithi190.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmbim-proxy amd64 1.28.0-1~ubuntu20.04.1 [6,130 B] 2024-04-23T10:10:47.245 INFO:teuthology.orchestra.run.smithi190.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libmm-glib0 amd64 1.20.0-1~ubuntu22.04.3 [263 kB] 2024-04-23T10:10:47.252 INFO:teuthology.orchestra.run.smithi190.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 libndp0 amd64 1.8-0ubuntu3 [12.3 kB] 2024-04-23T10:10:47.253 INFO:teuthology.orchestra.run.smithi190.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libnm0 amd64 1.36.6-0ubuntu2 [456 kB] 2024-04-23T10:10:47.264 INFO:teuthology.orchestra.run.smithi190.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpq5 amd64 14.11-0ubuntu0.22.04.1 [144 kB] 2024-04-23T10:10:47.403 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package bison. 2024-04-23T10:10:47.431 INFO:teuthology.orchestra.run.smithi190.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-glib5 amd64 1.32.0-1ubuntu0.22.04.1 [772 kB] 2024-04-23T10:10:47.512 INFO:teuthology.orchestra.run.smithi026.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:10:47.518 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T10:10:47.572 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:10:48.048 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T10:10:48.076 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T10:10:48.123 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:10:48.181 INFO:teuthology.orchestra.run.smithi190.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libqmi-proxy amd64 1.32.0-1ubuntu0.22.04.1 [6,072 B] 2024-04-23T10:10:48.181 INFO:teuthology.orchestra.run.smithi190.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libssl-dev amd64 3.0.2-0ubuntu1.15 [2,376 kB] 2024-04-23T10:10:48.451 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package dump. 2024-04-23T10:10:48.479 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T10:10:48.517 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T10:10:48.545 INFO:teuthology.orchestra.run.smithi190.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 libteamdctl0 amd64 1.31-1build2 [12.6 kB] 2024-04-23T10:10:48.546 INFO:teuthology.orchestra.run.smithi190.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 modemmanager amd64 1.20.0-1~ubuntu22.04.3 [1,094 kB] 2024-04-23T10:10:48.586 INFO:teuthology.orchestra.run.smithi190.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 network-manager amd64 1.36.6-0ubuntu2 [2,203 kB] 2024-04-23T10:10:48.648 INFO:teuthology.orchestra.run.smithi190.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 ppp amd64 2.4.9-1+1ubuntu3 [363 kB] 2024-04-23T10:10:48.655 INFO:teuthology.orchestra.run.smithi190.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/main amd64 pptp-linux amd64 1.10.0-1build3 [42.5 kB] 2024-04-23T10:10:48.656 INFO:teuthology.orchestra.run.smithi190.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 network-manager-pptp amd64 1.2.10-1 [30.9 kB] 2024-04-23T10:10:48.657 INFO:teuthology.orchestra.run.smithi190.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client-common all 238 [29.6 kB] 2024-04-23T10:10:48.658 INFO:teuthology.orchestra.run.smithi190.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-client-14 amd64 14.11-0ubuntu0.22.04.1 [1,222 kB] 2024-04-23T10:10:48.855 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package indent. 2024-04-23T10:10:48.868 INFO:teuthology.orchestra.run.smithi190.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-common all 238 [169 kB] 2024-04-23T10:10:48.883 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:10:48.921 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:10:49.224 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T10:10:49.252 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T10:10:49.289 INFO:teuthology.orchestra.run.smithi190.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 postgresql-14 amd64 14.11-0ubuntu0.22.04.1 [16.2 MB] 2024-04-23T10:10:49.299 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:10:49.653 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T10:10:49.675 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T10:10:49.719 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:10:49.989 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T10:10:50.005 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T10:10:50.047 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:10:50.451 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T10:10:50.479 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T10:10:50.524 INFO:teuthology.orchestra.run.smithi190.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql all 14+238 [3,288 B] 2024-04-23T10:10:50.524 INFO:teuthology.orchestra.run.smithi190.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-client all 14+238 [3,292 B] 2024-04-23T10:10:50.525 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:10:50.563 INFO:teuthology.orchestra.run.smithi190.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 postgresql-contrib all 14+238 [3,292 B] 2024-04-23T10:10:50.563 INFO:teuthology.orchestra.run.smithi190.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl8.6 amd64 8.6.12+dfsg-1build1 [15.0 kB] 2024-04-23T10:10:50.564 INFO:teuthology.orchestra.run.smithi190.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 tcl amd64 8.6.11+1build2 [4,678 B] 2024-04-23T10:10:50.564 INFO:teuthology.orchestra.run.smithi190.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 wpasupplicant amd64 2:2.10-6ubuntu2 [1,481 kB] 2024-04-23T10:10:50.592 INFO:teuthology.orchestra.run.smithi190.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch-data all 20191128-4 [33.2 kB] 2024-04-23T10:10:50.594 INFO:teuthology.orchestra.run.smithi190.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 usb-modeswitch amd64 2.6.1-3ubuntu2 [46.0 kB] 2024-04-23T10:10:50.811 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T10:10:50.840 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T10:10:50.878 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:10:51.003 INFO:teuthology.orchestra.run.smithi190.stdout:Preconfiguring packages ... 2024-04-23T10:10:51.131 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T10:10:51.144 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T10:10:51.161 INFO:teuthology.orchestra.run.smithi190.stdout:Fetched 55.7 MB in 7s (7,986 kB/s) 2024-04-23T10:10:51.181 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T10:10:51.497 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:10:51.501 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T10:10:51.503 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../util-linux_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:51.529 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T10:10:51.575 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:10:51.624 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking util-linux (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:52.218 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up util-linux (2.37.2-4ubuntu3.4) ... 2024-04-23T10:10:53.188 INFO:teuthology.orchestra.run.smithi190.stdout:fstrim.service is a disabled or a static unit not running, not starting it. 2024-04-23T10:10:53.328 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T10:10:53.356 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:10:53.395 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:10:53.462 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package flex. 2024-04-23T10:10:53.566 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 173995 files and directories currently installed.) 2024-04-23T10:10:53.571 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../flex_2.6.4-8build2_amd64.deb ... 2024-04-23T10:10:53.618 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking flex (2.6.4-8build2) ... 2024-04-23T10:10:53.683 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T10:10:53.683 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:10:53.689 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:10:54.009 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T10:10:54.037 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:10:54.075 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:10:54.134 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libssl3_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:10:54.315 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl3:amd64 (3.0.2-0ubuntu1.15) over (3.0.2-0ubuntu1.7) ... 2024-04-23T10:10:54.428 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T10:10:54.456 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T10:10:54.495 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:10:54.768 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl3:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:10:54.781 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T10:10:54.809 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:10:54.839 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:10:55.184 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T10:10:55.212 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:10:55.250 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:10:55.279 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:10:55.284 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../uuid-dev_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:55.389 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking uuid-dev:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:55.604 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T10:10:55.632 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:10:55.670 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:10:55.823 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../libuuid1_2.37.2-4ubuntu3.4_amd64.deb ... 2024-04-23T10:10:55.937 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libuuid1:amd64 (2.37.2-4ubuntu3.4) over (2.37.2-4ubuntu3) ... 2024-04-23T10:10:55.956 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T10:10:55.973 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:10:56.014 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:10:56.259 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T10:10:56.273 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libuuid1:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:10:56.287 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:10:56.342 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:10:56.638 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package bison. 2024-04-23T10:10:56.742 INFO:teuthology.orchestra.run.smithi190.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 174068 files and directories currently installed.) 2024-04-23T10:10:56.748 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../00-bison_2%3a3.8.2+dfsg-1build1_amd64.deb ... 2024-04-23T10:10:56.790 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:10:56.837 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T10:10:56.866 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T10:10:56.913 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:10:57.266 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package modemmanager. 2024-04-23T10:10:57.294 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:10:57.352 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:10:57.382 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package liblzo2-2:amd64. 2024-04-23T10:10:57.410 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../01-liblzo2-2_2.10-2build3_amd64.deb ... 2024-04-23T10:10:57.440 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:10:57.760 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package dump. 2024-04-23T10:10:57.788 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../02-dump_0.4b47-3_amd64.deb ... 2024-04-23T10:10:57.827 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking dump (0.4b47-3) ... 2024-04-23T10:10:57.964 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager. 2024-04-23T10:10:57.992 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:10:58.039 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:10:58.114 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package indent. 2024-04-23T10:10:58.141 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../03-indent_2.2.12-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:10:58.180 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:10:58.458 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libaio-dev:amd64. 2024-04-23T10:10:58.486 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../04-libaio-dev_0.3.112-13build1_amd64.deb ... 2024-04-23T10:10:58.533 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:10:58.696 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package ppp. 2024-04-23T10:10:58.725 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T10:10:58.879 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libbluetooth3:amd64. 2024-04-23T10:10:58.906 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../05-libbluetooth3_5.64-0ubuntu1.1_amd64.deb ... 2024-04-23T10:10:58.945 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:10:59.000 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:10:59.206 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libelf-dev:amd64. 2024-04-23T10:10:59.222 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../06-libelf-dev_0.186-1build1_amd64.deb ... 2024-04-23T10:10:59.264 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:10:59.359 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T10:10:59.388 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T10:10:59.434 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T10:10:59.668 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl2:amd64. 2024-04-23T10:10:59.695 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../07-libfl2_2.6.4-8build2_amd64.deb ... 2024-04-23T10:10:59.720 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T10:10:59.743 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:10:59.745 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T10:10:59.795 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T10:11:00.029 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libfl-dev:amd64. 2024-04-23T10:11:00.045 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../08-libfl-dev_2.6.4-8build2_amd64.deb ... 2024-04-23T10:11:00.087 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:11:00.115 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T10:11:00.144 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T10:11:00.182 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T10:11:00.331 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libjson-perl. 2024-04-23T10:11:00.359 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../09-libjson-perl_4.04000-1_all.deb ... 2024-04-23T10:11:00.414 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libjson-perl (4.04000-1) ... 2024-04-23T10:11:00.485 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T10:11:00.514 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:00.552 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:00.743 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libllvm14:amd64. 2024-04-23T10:11:00.771 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../10-libllvm14_1%3a14.0.0-1ubuntu1.1_amd64.deb ... 2024-04-23T10:11:00.822 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:11:01.142 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T10:11:01.170 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T10:11:01.228 INFO:teuthology.orchestra.run.smithi026.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T10:11:01.257 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-common (238) ... 2024-04-23T10:11:01.883 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T10:11:01.912 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:01.953 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:02.537 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-glib4:amd64. 2024-04-23T10:11:02.565 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../11-libmbim-glib4_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:11:02.629 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:02.881 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmbim-proxy. 2024-04-23T10:11:02.897 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../12-libmbim-proxy_1.28.0-1~ubuntu20.04.1_amd64.deb ... 2024-04-23T10:11:02.931 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:03.259 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libmm-glib0:amd64. 2024-04-23T10:11:03.287 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../13-libmm-glib0_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:11:03.319 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql. 2024-04-23T10:11:03.334 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:03.348 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T10:11:03.386 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql (14+238) ... 2024-04-23T10:11:03.646 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T10:11:03.664 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T10:11:03.687 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libndp0:amd64. 2024-04-23T10:11:03.704 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T10:11:03.715 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../14-libndp0_1.8-0ubuntu3_amd64.deb ... 2024-04-23T10:11:03.753 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:11:03.932 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T10:11:03.949 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T10:11:03.990 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T10:11:04.090 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libnm0:amd64. 2024-04-23T10:11:04.117 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../15-libnm0_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:11:04.156 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:11:04.309 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T10:11:04.338 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T10:11:04.376 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:11:04.551 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libpq5:amd64. 2024-04-23T10:11:04.578 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../16-libpq5_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:04.626 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:04.645 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package tcl. 2024-04-23T10:11:04.671 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T10:11:04.708 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T10:11:04.987 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-glib5:amd64. 2024-04-23T10:11:05.015 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../17-libqmi-glib5_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:05.023 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T10:11:05.051 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T10:11:05.053 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:05.089 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:11:05.365 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libqmi-proxy. 2024-04-23T10:11:05.392 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../18-libqmi-proxy_1.32.0-1ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:05.465 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:05.486 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T10:11:05.502 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T10:11:05.619 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T10:11:05.742 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libssl-dev:amd64. 2024-04-23T10:11:05.770 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../19-libssl-dev_3.0.2-0ubuntu1.15_amd64.deb ... 2024-04-23T10:11:05.817 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:11:06.247 INFO:teuthology.orchestra.run.smithi026.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T10:11:06.275 INFO:teuthology.orchestra.run.smithi026.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T10:11:06.313 INFO:teuthology.orchestra.run.smithi026.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:11:06.329 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package libteamdctl0:amd64. 2024-04-23T10:11:06.357 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../20-libteamdctl0_1.31-1build2_amd64.deb ... 2024-04-23T10:11:06.387 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:11:06.601 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T10:11:06.740 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package modemmanager. 2024-04-23T10:11:06.768 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../21-modemmanager_1.20.0-1~ubuntu22.04.3_amd64.deb ... 2024-04-23T10:11:06.794 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T10:11:06.807 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:06.945 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:11:07.096 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:07.222 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:11:07.357 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:11:07.414 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager. 2024-04-23T10:11:07.442 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../22-network-manager_1.36.6-0ubuntu2_amd64.deb ... 2024-04-23T10:11:07.483 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:07.489 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:11:08.015 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T10:11:08.104 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package ppp. 2024-04-23T10:11:08.105 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:11:08.132 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../23-ppp_2.4.9-1+1ubuntu3_amd64.deb ... 2024-04-23T10:11:08.408 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:11:08.506 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:11:08.506 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:11:08.750 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package pptp-linux. 2024-04-23T10:11:08.778 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../24-pptp-linux_1.10.0-1build3_amd64.deb ... 2024-04-23T10:11:08.817 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking pptp-linux (1.10.0-1build3) ... 2024-04-23T10:11:09.000 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:11:09.072 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package network-manager-pptp. 2024-04-23T10:11:09.088 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../25-network-manager-pptp_1.2.10-1_amd64.deb ... 2024-04-23T10:11:09.126 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:11:09.130 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking network-manager-pptp (1.2.10-1) ... 2024-04-23T10:11:09.252 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:11:09.369 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T10:11:09.470 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:11:09.483 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-common. 2024-04-23T10:11:09.511 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../26-postgresql-client-common_238_all.deb ... 2024-04-23T10:11:09.558 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-common (238) ... 2024-04-23T10:11:09.571 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:11:09.689 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:11:09.815 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:11:09.895 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client-14. 2024-04-23T10:11:09.923 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../27-postgresql-client-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:09.962 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:10.491 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-common. 2024-04-23T10:11:10.512 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:11:10.520 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../28-postgresql-common_238_all.deb ... 2024-04-23T10:11:10.577 INFO:teuthology.orchestra.run.smithi190.stdout:Adding 'diversion of /usr/bin/pg_config to /usr/bin/pg_config.libpq-dev by postgresql-common' 2024-04-23T10:11:10.606 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-common (238) ... 2024-04-23T10:11:10.613 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T10:11:10.690 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T10:11:10.756 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:10.891 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:11:11.057 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-14. 2024-04-23T10:11:11.085 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../29-postgresql-14_14.11-0ubuntu0.22.04.1_amd64.deb ... 2024-04-23T10:11:11.126 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:11.392 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T10:11:11.518 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T10:11:11.644 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:11:11.734 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T10:11:11.804 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:11:11.930 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:11:12.106 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:11:12.224 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:12.325 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T10:11:12.376 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql. 2024-04-23T10:11:12.405 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../30-postgresql_14+238_all.deb ... 2024-04-23T10:11:12.442 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql (14+238) ... 2024-04-23T10:11:12.468 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T10:11:12.594 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:11:12.677 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-client. 2024-04-23T10:11:12.694 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../31-postgresql-client_14+238_all.deb ... 2024-04-23T10:11:12.727 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-client (14+238) ... 2024-04-23T10:11:12.963 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package postgresql-contrib. 2024-04-23T10:11:12.979 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../32-postgresql-contrib_14+238_all.deb ... 2024-04-23T10:11:13.021 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking postgresql-contrib (14+238) ... 2024-04-23T10:11:13.078 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:13.078 INFO:teuthology.orchestra.run.smithi026.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T10:11:13.078 INFO:teuthology.orchestra.run.smithi026.stdout:which means they are currently configured by ifupdown: 2024-04-23T10:11:13.078 INFO:teuthology.orchestra.run.smithi026.stdout:- ens1f0 2024-04-23T10:11:13.079 INFO:teuthology.orchestra.run.smithi026.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T10:11:13.079 INFO:teuthology.orchestra.run.smithi026.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T10:11:13.079 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:13.208 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T10:11:13.324 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl8.6. 2024-04-23T10:11:13.352 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../33-tcl8.6_8.6.12+dfsg-1build1_amd64.deb ... 2024-04-23T10:11:13.390 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:11:13.563 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T10:11:13.676 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package tcl. 2024-04-23T10:11:13.704 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../34-tcl_8.6.11+1build2_amd64.deb ... 2024-04-23T10:11:13.748 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking tcl (8.6.11+1build2) ... 2024-04-23T10:11:13.921 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T10:11:14.062 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package wpasupplicant. 2024-04-23T10:11:14.090 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../35-wpasupplicant_2%3a2.10-6ubuntu2_amd64.deb ... 2024-04-23T10:11:14.120 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:11:14.405 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:14.483 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch-data. 2024-04-23T10:11:14.511 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../36-usb-modeswitch-data_20191128-4_all.deb ... 2024-04-23T10:11:14.548 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:11:14.549 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch-data (20191128-4) ... 2024-04-23T10:11:14.674 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T10:11:14.800 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-common (238) ... 2024-04-23T10:11:14.927 INFO:teuthology.orchestra.run.smithi190.stdout:Selecting previously unselected package usb-modeswitch. 2024-04-23T10:11:14.955 INFO:teuthology.orchestra.run.smithi190.stdout:Preparing to unpack .../37-usb-modeswitch_2.6.1-3ubuntu2_amd64.deb ... 2024-04-23T10:11:15.002 INFO:teuthology.orchestra.run.smithi190.stdout:Unpacking usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:11:15.298 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-common (238) ... 2024-04-23T10:11:15.508 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up flex (2.6.4-8build2) ... 2024-04-23T10:11:15.634 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl8.6 (8.6.12+dfsg-1build1) ... 2024-04-23T10:11:15.767 INFO:teuthology.orchestra.run.smithi026.stdout:Adding user postgres to group ssl-cert 2024-04-23T10:11:16.005 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:16.005 INFO:teuthology.orchestra.run.smithi026.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T10:11:16.127 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libpq5:amd64 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:16.195 INFO:teuthology.orchestra.run.smithi026.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T10:11:16.195 INFO:teuthology.orchestra.run.smithi026.stdout:Removing obsolete dictionary files: 2024-04-23T10:11:16.253 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up liblzo2-2:amd64 (2.10-2build3) ... 2024-04-23T10:11:16.363 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libaio-dev:amd64 (0.3.112-13build1) ... 2024-04-23T10:11:16.480 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:16.787 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T10:11:16.926 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/psql.1.gz to provide /usr/share/man/man1/psql.1.gz (psql.1.gz) in auto mode 2024-04-23T10:11:17.002 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up wpasupplicant (2:2.10-6ubuntu2) ... 2024-04-23T10:11:17.185 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:17.351 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-fi.w1.wpa_supplicant1.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:11:17.351 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/wpa_supplicant.service -> /lib/systemd/system/wpa_supplicant.service. 2024-04-23T10:11:17.521 INFO:teuthology.orchestra.run.smithi026.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T10:11:17.535 INFO:teuthology.orchestra.run.smithi026.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:This user must also own the server process. 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:The default text search configuration will be set to "english". 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout:Data page checksums are disabled. 2024-04-23T10:11:17.576 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:17.577 INFO:teuthology.orchestra.run.smithi026.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T10:11:17.577 INFO:teuthology.orchestra.run.smithi026.stdout:creating subdirectories ... ok 2024-04-23T10:11:17.577 INFO:teuthology.orchestra.run.smithi026.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T10:11:17.592 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default max_connections ... 100 2024-04-23T10:11:17.614 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default shared_buffers ... 128MB 2024-04-23T10:11:17.621 INFO:teuthology.orchestra.run.smithi026.stdout:selecting default time zone ... Etc/UTC 2024-04-23T10:11:17.622 INFO:teuthology.orchestra.run.smithi026.stdout:creating configuration files ... ok 2024-04-23T10:11:17.738 INFO:teuthology.orchestra.run.smithi026.stdout:running bootstrap script ... ok 2024-04-23T10:11:17.813 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up uuid-dev:amd64 (2.37.2-4ubuntu3.4) ... 2024-04-23T10:11:17.940 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libteamdctl0:amd64 (1.31-1build2) ... 2024-04-23T10:11:18.066 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libssl-dev:amd64 (3.0.2-0ubuntu1.15) ... 2024-04-23T10:11:18.191 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch-data (20191128-4) ... 2024-04-23T10:11:18.317 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libelf-dev:amd64 (0.186-1build1) ... 2024-04-23T10:11:18.369 INFO:teuthology.orchestra.run.smithi026.stdout:performing post-bootstrap initialization ... ok 2024-04-23T10:11:18.443 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl2:amd64 (2.6.4-8build2) ... 2024-04-23T10:11:18.569 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libnm0:amd64 (1.36.6-0ubuntu2) ... 2024-04-23T10:11:18.670 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up ppp (2.4.9-1+1ubuntu3) ... 2024-04-23T10:11:19.011 INFO:teuthology.orchestra.run.smithi026.stdout:syncing data to disk ... ok 2024-04-23T10:11:19.284 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libllvm14:amd64 (1:14.0.0-1ubuntu1.1) ... 2024-04-23T10:11:19.410 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up dump (0.4b47-3) ... 2024-04-23T10:11:19.424 INFO:teuthology.orchestra.run.smithi026.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T10:11:19.503 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/sbin/rmt-dump to provide /usr/sbin/rmt (rmt) in auto mode 2024-04-23T10:11:19.586 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmm-glib0:amd64 (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:19.695 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libbluetooth3:amd64 (5.64-0ubuntu1.1) ... 2024-04-23T10:11:19.813 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up tcl (8.6.11+1build2) ... 2024-04-23T10:11:19.922 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libjson-perl (4.04000-1) ... 2024-04-23T10:11:20.048 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up bison (2:3.8.2+dfsg-1build1) ... 2024-04-23T10:11:20.139 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/bin/bison.yacc to provide /usr/bin/yacc (yacc) in auto mode 2024-04-23T10:11:20.200 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up indent (2.2.12-1ubuntu0.22.04.1) ... 2024-04-23T10:11:20.325 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up usb-modeswitch (2.6.1-3ubuntu2) ... 2024-04-23T10:11:20.502 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libndp0:amd64 (1.8-0ubuntu3) ... 2024-04-23T10:11:20.628 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-glib4:amd64 (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:20.746 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up pptp-linux (1.10.0-1build3) ... 2024-04-23T10:11:20.889 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-client (14+238) ... 2024-04-23T10:11:21.015 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager (1.36.6-0ubuntu2) ... 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout:The following network interfaces were found in /etc/network/interfaces 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout:which means they are currently configured by ifupdown: 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout:- enp3s0f1 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout:If you want to manage those interfaces with NetworkManager instead 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout:remove their configuration from /etc/network/interfaces. 2024-04-23T10:11:21.882 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:22.011 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.nm-dispatcher.service -> /lib/systemd/system/NetworkManager-dispatcher.service. 2024-04-23T10:11:22.278 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:22.310 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/network-online.target.wants/NetworkManager-wait-online.service -> /lib/systemd/system/NetworkManager-wait-online.service. 2024-04-23T10:11:22.467 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T10:11:22.593 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up postgresql (14+238) ... 2024-04-23T10:11:22.623 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/NetworkManager.service -> /lib/systemd/system/NetworkManager.service. 2024-04-23T10:11:22.703 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:22.803 INFO:teuthology.orchestra.run.smithi026.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:23.038 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:11:23.038 INFO:teuthology.orchestra.run.smithi026.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:11:23.092 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libmbim-proxy (1.28.0-1~ubuntu20.04.1) ... 2024-04-23T10:11:23.210 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libfl-dev:amd64 (2.6.4-8build2) ... 2024-04-23T10:11:23.311 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up network-manager-pptp (1.2.10-1) ... 2024-04-23T10:11:23.437 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-common (238) ... 2024-04-23T10:11:23.565 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:11:23.657 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T10:11:23.976 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:11:24.128 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:11:24.311 INFO:teuthology.orchestra.run.smithi190.stdout:Adding user postgres to group ssl-cert 2024-04-23T10:11:24.533 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:24.533 INFO:teuthology.orchestra.run.smithi190.stdout:Creating config file /etc/postgresql-common/createcluster.conf with new version 2024-04-23T10:11:24.702 INFO:teuthology.orchestra.run.smithi190.stdout:Building PostgreSQL dictionaries from installed myspell/hunspell packages... 2024-04-23T10:11:24.702 INFO:teuthology.orchestra.run.smithi190.stdout:Removing obsolete dictionary files: 2024-04-23T10:11:25.239 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/postgresql.service -> /lib/systemd/system/postgresql.service. 2024-04-23T10:11:25.514 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T10:11:25.597 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-14 (14.11-0ubuntu0.22.04.1) ... 2024-04-23T10:11:25.606 INFO:teuthology.orchestra.run.smithi026.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:11:25.922 INFO:teuthology.orchestra.run.smithi190.stdout:Creating new PostgreSQL cluster 14/main ... 2024-04-23T10:11:25.938 INFO:teuthology.orchestra.run.smithi190.stdout:/usr/lib/postgresql/14/bin/initdb -D /var/lib/postgresql/14/main --auth-local peer --auth-host scram-sha-256 --no-instructions 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:The files belonging to this database system will be owned by user "postgres". 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:This user must also own the server process. 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:The database cluster will be initialized with locale "en_US". 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:The default database encoding has accordingly been set to "LATIN1". 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:The default text search configuration will be set to "english". 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:Data page checksums are disabled. 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:25.981 INFO:teuthology.orchestra.run.smithi190.stdout:fixing permissions on existing directory /var/lib/postgresql/14/main ... ok 2024-04-23T10:11:25.982 INFO:teuthology.orchestra.run.smithi190.stdout:creating subdirectories ... ok 2024-04-23T10:11:25.982 INFO:teuthology.orchestra.run.smithi190.stdout:selecting dynamic shared memory implementation ... posix 2024-04-23T10:11:25.993 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default max_connections ... 100 2024-04-23T10:11:26.011 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default shared_buffers ... 128MB 2024-04-23T10:11:26.030 INFO:teuthology.orchestra.run.smithi190.stdout:selecting default time zone ... Etc/UTC 2024-04-23T10:11:26.031 INFO:teuthology.orchestra.run.smithi190.stdout:creating configuration files ... ok 2024-04-23T10:11:26.066 INFO:teuthology.orchestra.run.smithi026.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:11:26.071 DEBUG:teuthology.parallel:result is None 2024-04-23T10:11:26.145 INFO:teuthology.orchestra.run.smithi190.stdout:running bootstrap script ... ok 2024-04-23T10:11:26.752 INFO:teuthology.orchestra.run.smithi190.stdout:performing post-bootstrap initialization ... ok 2024-04-23T10:11:27.375 INFO:teuthology.orchestra.run.smithi190.stdout:syncing data to disk ... ok 2024-04-23T10:11:27.749 INFO:teuthology.orchestra.run.smithi190.stdout:update-alternatives: using /usr/share/postgresql/14/man/man1/postmaster.1.gz to provide /usr/share/man/man1/postmaster.1.gz (postmaster.1.gz) in auto mode 2024-04-23T10:11:30.512 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-glib5:amd64 (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:30.612 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql-contrib (14+238) ... 2024-04-23T10:11:30.722 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up postgresql (14+238) ... 2024-04-23T10:11:30.848 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up libqmi-proxy (1.32.0-1ubuntu0.22.04.1) ... 2024-04-23T10:11:30.974 INFO:teuthology.orchestra.run.smithi190.stdout:Setting up modemmanager (1.20.0-1~ubuntu22.04.3) ... 2024-04-23T10:11:31.237 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/dbus-org.freedesktop.ModemManager1.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:11:31.238 INFO:teuthology.orchestra.run.smithi190.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ModemManager.service -> /lib/systemd/system/ModemManager.service. 2024-04-23T10:11:31.768 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-23T10:11:31.860 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for hicolor-icon-theme (0.17-2) ... 2024-04-23T10:11:32.179 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-23T10:11:32.323 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-23T10:11:33.575 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for dbus (1.12.20-2ubuntu4.1) ... 2024-04-23T10:11:33.675 INFO:teuthology.orchestra.run.smithi190.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-23T10:11:34.167 INFO:teuthology.orchestra.run.smithi190.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-23T10:11:34.171 DEBUG:teuthology.parallel:result is None 2024-04-23T10:11:34.172 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:11:34.313 DEBUG:teuthology.orchestra.run.smithi026:> dpkg-query -W -f '${Version}' ceph 2024-04-23T10:11:34.334 INFO:teuthology.orchestra.run.smithi026.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:34.337 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:34.337 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T10:11:34.338 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=d69f13d827952bb07bb9b7973bca14f97d764d6f 2024-04-23T10:11:34.480 DEBUG:teuthology.orchestra.run.smithi190:> dpkg-query -W -f '${Version}' ceph 2024-04-23T10:11:34.500 INFO:teuthology.orchestra.run.smithi190.stdout:19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:34.500 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3156-gd69f13d8-1jammy 2024-04-23T10:11:34.500 INFO:teuthology.task.install:The correct ceph version 19.0.0-3156-gd69f13d8-1jammy is installed. 2024-04-23T10:11:34.501 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-23T10:11:34.502 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:34.502 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:11:34.517 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:34.517 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-23T10:11:34.557 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-23T10:11:34.557 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:34.557 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:11:34.576 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:11:34.631 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:34.631 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/daemon-helper 2024-04-23T10:11:34.644 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-23T10:11:34.700 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-23T10:11:34.700 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:34.700 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:11:34.714 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:11:34.768 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:34.768 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-23T10:11:34.781 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-23T10:11:34.836 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-23T10:11:34.836 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:34.836 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:11:34.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:11:34.904 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:34.904 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/usr/bin/stdin-killer 2024-04-23T10:11:34.917 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-23T10:11:34.972 INFO:teuthology.run_tasks:Running task ceph... 2024-04-23T10:11:35.047 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-23T10:11:35.047 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 777 /var/log/ceph 2024-04-23T10:11:35.049 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 777 /var/log/ceph 2024-04-23T10:11:35.062 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-23T10:11:35.062 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T10:11:35.109 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-23T10:11:35.121 INFO:tasks.ceph:Creating extra log directories... 2024-04-23T10:11:35.122 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T10:11:35.169 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-23T10:11:35.187 INFO:tasks.ceph:Setting up log rotation with {'ceph-mds': '10G', 'ceph-osd': '10G'} 2024-04-23T10:11:35.187 INFO:tasks.ceph:writing logrotate stanza for ceph-mds 2024-04-23T10:11:35.187 INFO:tasks.ceph:writing logrotate stanza for ceph-osd 2024-04-23T10:11:35.187 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:35.188 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T10:11:35.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T10:11:35.306 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:35.306 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/logrotate.ceph-test.conf 2024-04-23T10:11:35.311 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv /home/ubuntu/cephtest/logrotate.ceph-test.conf /etc/logrotate.d/ceph-test.conf && sudo chmod 0644 /etc/logrotate.d/ceph-test.conf && sudo chown root.root /etc/logrotate.d/ceph-test.conf 2024-04-23T10:11:35.389 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-23T10:11:35.390 INFO:tasks.ceph:config {'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-23T10:11:35.390 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533', 'branch': 'wip-lusov-quiescer', 'description': 'fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}}', 'email': None, 'first_in_suite': False, 'job_id': '7669533', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'log-rotate': {'ceph-mds': '10G', 'ceph-osd': '10G'}, 'machine_type': 'smithi', 'mgrmodules': {'sequential': [{'print': 'Enabling mgr modules'}]}, 'name': 'leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 20}}, {'machine': {'disk': 200}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-lusov-quiescer'}, 'ceph': {'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug rocksdb': 10, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'check-counter': {'counters': {'mds': ['mds.exported', 'mds.imported']}}, 'install': {'ceph': {'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-lusov-quiescer', 'sha1': '0a6c3ed699031b80a2b419e7e795368719871394'}}, 'owner': 'scheduled_leonidus@teuthology', 'priority': 70, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mgr.y', 'mds.a', 'mds.c', 'mds.e', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0'], ['mon.b', 'mon.c', 'mgr.x', 'mds.b', 'mds.d', 'mds.f', 'osd.4', 'osd.5', 'osd.6', 'osd.7']], 'seed': 5306, 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'sleep_before_teardown': 0, 'subset': '200/111111', 'suite': 'fs', 'suite_branch': 'wip-lusov-quiescer', 'suite_path': '/home/teuthworker/src/github.com_ceph_ceph_0a6c3ed699031b80a2b419e7e795368719871394/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://github.com/ceph/ceph', 'suite_sha1': '0a6c3ed699031b80a2b419e7e795368719871394', 'syslog': {'ignorelist': ['WARNING*.*check_session_state', 'WARNING*.*__ceph_remove_cap']}, 'targets': {'smithi026.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBLpvoBFAED6/4vb3WLwHt84TPBsY5tyPFUcSSlZVQu+EQqUZo7eagiF9M3+9pUf/M0EPT47UsODwLIBaBsRa9Rk=', 'smithi190.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBKWao+f5vNz9MTbFYxPFlYyCsSUiCSEfuIo0BLBqjIBxyuTkpLZkUTXUVHI0ihEZMw0GeaUfIV2HWvKMc0T7RRE='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': {'extra_packages': {'deb': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror'], 'rpm': ['python3-cephfs', 'cephfs-shell', 'cephfs-top', 'cephfs-mirror']}, 'extra_system_packages': {'deb': ['bison', 'flex', 'libelf-dev', 'libssl-dev', 'network-manager', 'iproute2', 'util-linux', 'dump', 'indent', 'libaio-dev', 'libtool-bin', 'uuid-dev', 'xfslibs-dev', 'postgresql', 'postgresql-client', 'postgresql-common', 'postgresql-contrib'], 'rpm': ['bison', 'flex', 'elfutils-libelf-devel', 'openssl-devel', 'NetworkManager', 'iproute', 'util-linux', 'libacl-devel', 'libaio-devel', 'libattr-devel', 'libtool', 'libuuid-devel', 'xfsdump', 'xfsprogs', 'xfsprogs-devel', 'libaio-devel', 'libtool', 'libuuid-devel', 'xfsprogs-devel', 'postgresql', 'postgresql-server', 'postgresql-contrib']}, 'flavor': 'default', 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f'}}, {'ceph': {'create_rbd_pool': False, 'cephfs': {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300}, 'conf': {'client': {'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug client': 20, 'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'osd': {'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(OSD_SLOW_PING_TIME', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'filesystem is online with fewer MDS than max_mds', 'POOL_APP_NOT_ENABLED', 'do not have an application enabled', 'overall HEALTH_', 'Replacing daemon', 'deprecated feature inline_data', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding', 'PG_AVAILABILITY', 'PG_DEGRADED', 'Reduced data availability', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': 'd69f13d827952bb07bb9b7973bca14f97d764d6f', 'cluster': 'ceph'}}, {'sequential': ['mgrmodules']}, {'ceph-fuse': None}, {'quiescer': None}, {'workunit': {'clients': {'all': ['suites/fsstress.sh']}, 'timeout': '6h'}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': ['local function is_kupstream() return false end', 'local function is_kdistro() return false end', 'local function is_fuse() return true end', "local function syntax_version() return '' end"]}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-23_09:49:14', 'tube': 'smithi', 'user': 'leonidus', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-23T10:11:35.390 DEBUG:teuthology.orchestra.run.smithi026:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T10:11:35.393 DEBUG:teuthology.orchestra.run.smithi190:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-23T10:11:35.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T10:11:35.441 DEBUG:teuthology.orchestra.run.smithi190:> sudo install -d -m0777 -- /var/run/ceph 2024-04-23T10:11:35.489 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:35.489 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:11:35.500 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:11:35.500 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_1 2024-04-23T10:11:35.548 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:11:35.548 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:35.548 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 885 Links: 1 2024-04-23T10:11:35.549 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:35.549 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-23 10:05:18.224823671 +0000 2024-04-23T10:11:35.549 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-23 10:05:17.984825816 +0000 2024-04-23T10:11:35.549 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-23 10:05:17.984825816 +0000 2024-04-23T10:11:35.549 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-23T10:11:35.549 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:11:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-23T10:11:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-23T10:11:35.603 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000324341 s, 1.6 MB/s 2024-04-23T10:11:35.604 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:11:35.653 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_2 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 894 Links: 1 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-23 10:05:18.460821563 +0000 2024-04-23T10:11:35.700 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-23 10:05:18.456821600 +0000 2024-04-23T10:11:35.701 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-23 10:05:18.456821600 +0000 2024-04-23T10:11:35.701 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-23T10:11:35.701 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:11:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-23T10:11:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-23T10:11:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000301645 s, 1.7 MB/s 2024-04-23T10:11:35.756 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:11:35.806 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_3 2024-04-23T10:11:35.852 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:11:35.852 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:35.852 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 918 Links: 1 2024-04-23T10:11:35.852 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:35.853 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-23 10:05:19.172815204 +0000 2024-04-23T10:11:35.853 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-23 10:05:18.920817455 +0000 2024-04-23T10:11:35.853 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-23 10:05:18.920817455 +0000 2024-04-23T10:11:35.853 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-23T10:11:35.853 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:11:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-23T10:11:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-23T10:11:35.907 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000308014 s, 1.7 MB/s 2024-04-23T10:11:35.908 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:11:35.957 DEBUG:teuthology.orchestra.run.smithi026:> stat /dev/vg_nvme/lv_4 2024-04-23T10:11:36.004 INFO:teuthology.orchestra.run.smithi026.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:11:36.004 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 5h/5d Inode: 933 Links: 1 2024-04-23T10:11:36.004 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 2024-04-23 10:05:19.684810631 +0000 2024-04-23T10:11:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-23 10:05:19.408813096 +0000 2024-04-23T10:11:36.005 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-23 10:05:19.408813096 +0000 2024-04-23T10:11:36.005 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-23T10:11:36.005 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:11:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records in 2024-04-23T10:11:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:1+0 records out 2024-04-23T10:11:36.059 INFO:teuthology.orchestra.run.smithi026.stderr:512 bytes copied, 0.000303577 s, 1.7 MB/s 2024-04-23T10:11:36.060 DEBUG:teuthology.orchestra.run.smithi026:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:11:36.109 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:36.109 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:36.109 DEBUG:teuthology.orchestra.run.smithi190:> dd if=/scratch_devs of=/dev/stdout 2024-04-23T10:11:36.115 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-23T10:11:36.115 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_1 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 876 Links: 1 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-04-23 10:05:16.650070157 +0000 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-04-23 10:05:16.394072434 +0000 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-04-23 10:05:16.394072434 +0000 2024-04-23T10:11:36.161 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-04-23T10:11:36.161 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-23T10:11:36.215 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-04-23T10:11:36.215 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-04-23T10:11:36.215 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000369086 s, 1.4 MB/s 2024-04-23T10:11:36.217 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-23T10:11:36.266 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_2 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 896 Links: 1 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-04-23 10:05:17.154065673 +0000 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-04-23 10:05:16.910067844 +0000 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-04-23 10:05:16.910067844 +0000 2024-04-23T10:11:36.313 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-04-23T10:11:36.313 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-23T10:11:36.367 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-04-23T10:11:36.367 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-04-23T10:11:36.367 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000323378 s, 1.6 MB/s 2024-04-23T10:11:36.368 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-23T10:11:36.420 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_3 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 912 Links: 1 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-04-23 10:05:17.378063681 +0000 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-04-23 10:05:17.374063716 +0000 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-04-23 10:05:17.374063716 +0000 2024-04-23T10:11:36.469 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-04-23T10:11:36.469 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-23T10:11:36.523 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-04-23T10:11:36.523 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-04-23T10:11:36.523 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000320821 s, 1.6 MB/s 2024-04-23T10:11:36.524 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-23T10:11:36.574 DEBUG:teuthology.orchestra.run.smithi190:> stat /dev/vg_nvme/lv_4 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout:Device: 5h/5d Inode: 931 Links: 1 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout:Access: 2024-04-23 10:05:18.126057026 +0000 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout:Modify: 2024-04-23 10:05:17.870059303 +0000 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout:Change: 2024-04-23 10:05:17.870059303 +0000 2024-04-23T10:11:36.621 INFO:teuthology.orchestra.run.smithi190.stdout: Birth: - 2024-04-23T10:11:36.621 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-23T10:11:36.675 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records in 2024-04-23T10:11:36.675 INFO:teuthology.orchestra.run.smithi190.stderr:1+0 records out 2024-04-23T10:11:36.675 INFO:teuthology.orchestra.run.smithi190.stderr:512 bytes copied, 0.000388034 s, 1.3 MB/s 2024-04-23T10:11:36.676 DEBUG:teuthology.orchestra.run.smithi190:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-23T10:11:36.725 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:36.725 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T10:11:36.726 INFO:tasks.ceph:Generating config... 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] client mount timeout = 600 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] client_shutdown_timeout = 120 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] debug client = 20 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] debug ms = 1 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] rados mon op timeout = 900 2024-04-23T10:11:36.727 INFO:tasks.ceph:[client] rados osd op timeout = 900 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] debug mds = 20 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] debug mds balancer = 20 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] debug ms = 1 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] mds bal fragment size max = 10000 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] mds bal merge size = 5 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] mds bal split bits = 3 2024-04-23T10:11:36.727 INFO:tasks.ceph:[mds] mds bal split size = 100 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds debug frag = True 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds debug scatterstat = True 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds oft prefetch dirfrags = True 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds op complaint time = 180 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds verify scatter = True 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds_dir_prefetch = True 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mds_sleep_rank_change = 5000000.0 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] mon client directed command retry = 5 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] ms inject delay max = 1 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] ms inject delay probability = 0.005 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] ms inject delay type = client mds osd 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] ms inject socket failures = 2500 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] osd op complaint time = 180 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] rados mon op timeout = 900 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mds] rados osd op timeout = 900 2024-04-23T10:11:36.728 INFO:tasks.ceph:[mgr] debug client = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mon] mon down mkfs grace = 300 2024-04-23T10:11:36.729 INFO:tasks.ceph:[mon] mon op complaint time = 120 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] debug bluefs = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] debug bluestore = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] debug rocksdb = 10 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] mon client directed command retry = 5 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-23T10:11:36.729 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] ms inject delay max = 1 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] ms inject delay probability = 0.005 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] ms inject delay type = client mds 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] ms inject socket failures = 2500 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-23T10:11:36.730 INFO:tasks.ceph:[osd] osd op complaint time = 180 2024-04-23T10:11:36.730 INFO:tasks.ceph:Setting up mon.a... 2024-04-23T10:11:36.730 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-23T10:11:36.764 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.keyring 2024-04-23T10:11:36.795 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-23T10:11:36.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:11:36.928 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.26'), ('mon.b', '172.21.15.190'), ('mon.c', '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]')] 2024-04-23T10:11:36.928 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': 20, 'debug bluestore': 20, 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': 10, 'mon client directed command retry': 5, 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds', 'ms inject socket failures': 2500, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false', 'debug client': 20}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false', 'mon down mkfs grace': 300, 'mon op complaint time': 120}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'client mount timeout': 600, 'client_shutdown_timeout': 120, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mon.a': {}, 'mon.b': {}, 'mon.c': {}, 'mds.a': {}, 'mds.c': {}, 'mds.e': {}, 'mds.b': {}, 'mds.d': {}, 'mds.f': {}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds bal fragment size max': 10000, 'mds bal merge size': 5, 'mds bal split bits': 3, 'mds bal split size': 100, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds oft prefetch dirfrags': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'mds_dir_prefetch': True, 'mds_sleep_rank_change': 5000000.0, 'mon client directed command retry': 5, 'ms inject delay max': 1, 'ms inject delay probability': 0.005, 'ms inject delay type': 'client mds osd', 'ms inject socket failures': 2500, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}} 2024-04-23T10:11:36.929 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:36.929 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T10:11:36.977 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.26 --add b 172.21.15.190 --addv c '[v2:172.21.15.190:3301,v1:172.21.15.190:6790]' --print /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:37.062 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:37.062 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: generated fsid 8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8 2024-04-23T10:11:37.062 INFO:teuthology.orchestra.run.smithi026.stdout:setting min_mon_release = quincy 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:epoch 0 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:fsid 8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:last_changed 2024-04-23T10:11:37.065263+0000 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:created 2024-04-23T10:11:37.065263+0000 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:min_mon_release 17 (quincy) 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:election_strategy: 1 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:0: [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] mon.a 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:1: [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] mon.b 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:2: [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] mon.c 2024-04-23T10:11:37.063 INFO:teuthology.orchestra.run.smithi026.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-23T10:11:37.064 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-23T10:11:37.112 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8... 2024-04-23T10:11:37.113 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T10:11:37.157 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout:[global] 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: chdir = "" 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: auth supported = cephx 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: filestore xattr use omap = true 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.188 INFO:teuthology.orchestra.run.smithi026.stdout: mon clock drift allowed = 1.000 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: osd crush chooseleaf type = 0 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: auth debug = true 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on old message = true 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: ms die on bug = true 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: mon pg warn max object skew = 0 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T10:11:37.189 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default size = 2 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow primary affinity = true 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd allow pg remap = true 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on legacy crush tunables = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on crush straw calc version zero = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on no sortbitwise = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on osd down out interval zero = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon warn on too few osds = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: mon_allow_pool_size_one = true 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T10:11:37.190 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: osd default data pool replay window = 5 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: mon allow pool delete = true 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: mon cluster log file level = debug 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: debug asserts on shutdown = true 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: mon health detail to clog = false 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: mon host = "172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: fsid = 8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout:[osd] 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: osd journal size = 100 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub load threshold = 5.0 2024-04-23T10:11:37.191 INFO:teuthology.orchestra.run.smithi026.stdout: osd scrub max interval = 600 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd mclock profile = high_recovery_ops 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd recover clone overlap = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd recovery max chunk = 1048576 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug shutdown = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug op order = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug verify stray on activate = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug trim objects = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd open classes on start = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug pg log writeout = true 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: osd deep scrub update digest min age = 30 2024-04-23T10:11:37.192 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: osd map max advance = 10 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: journal zero on create = true 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: filestore ondisk finisher threads = 3 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: filestore apply finisher threads = 3 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: bdev debug aio = true 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: osd debug misdirected ops = true 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore block size = 96636764160 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: bluestore fsck on mount = True 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluefs = 20 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: debug bluestore = 20 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: debug osd = 20 2024-04-23T10:11:37.193 INFO:teuthology.orchestra.run.smithi026.stdout: debug rocksdb = 10 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: mon client directed command retry = 5 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd full ratio = 0.9 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd nearfull ratio = 0.8 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay max = 1 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay probability = 0.005 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay type = client mds 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject socket failures = 2500 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: osd blocked scrub grace period = 3600 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: osd failsafe full ratio = 0.95 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: osd max markdown count = 1000 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: osd objectstore = bluestore 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.194 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr] 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug mgr = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: mgr/telemetry/nag = false 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout:[mon] 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug mon = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug paxos = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: debug auth = 20 2024-04-23T10:11:37.195 INFO:teuthology.orchestra.run.smithi026.stdout: mon data avail warn = 5 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon mgr mkfs grace = 240 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd reporter subtree level = osd 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon osd prime pg temp = true 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.196 INFO:teuthology.orchestra.run.smithi026.stdout: # 1m isn't quite enough 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: mon_down_mkfs_grace = 2m 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: mon_warn_on_filestore_osds = false 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: mon down mkfs grace = 300 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: mon op complaint time = 120 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout:[client] 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: rgw cache enabled = true 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable ops log = true 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: rgw enable usage log = true 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: client mount timeout = 600 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: client_shutdown_timeout = 120 2024-04-23T10:11:37.197 INFO:teuthology.orchestra.run.smithi026.stdout: debug client = 20 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.a] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.b] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mon.c] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout:[mds] 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds = 20 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: debug mds balancer = 20 2024-04-23T10:11:37.198 INFO:teuthology.orchestra.run.smithi026.stdout: debug ms = 1 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal fragment size max = 10000 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal merge size = 5 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split bits = 3 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds bal split size = 100 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug frag = True 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds debug scatterstat = True 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds oft prefetch dirfrags = True 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds op complaint time = 180 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds verify scatter = True 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds_dir_prefetch = True 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: mon client directed command retry = 5 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay max = 1 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay probability = 0.005 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject delay type = client mds osd 2024-04-23T10:11:37.199 INFO:teuthology.orchestra.run.smithi026.stdout: ms inject socket failures = 2500 2024-04-23T10:11:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: osd op complaint time = 180 2024-04-23T10:11:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: rados mon op timeout = 900 2024-04-23T10:11:37.200 INFO:teuthology.orchestra.run.smithi026.stdout: rados osd op timeout = 900 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout:[global] 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: chdir = "" 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: auth supported = cephx 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: filestore xattr use omap = true 2024-04-23T10:11:37.201 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: mon clock drift allowed = 1.000 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: osd crush chooseleaf type = 0 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: auth debug = true 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on old message = true 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: ms die on bug = true 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: mon pg warn max object skew = 0 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: # disable pg_autoscaler by default for new pools 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default size = 2 2024-04-23T10:11:37.202 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow primary affinity = true 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd allow pg remap = true 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on legacy crush tunables = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on crush straw calc version zero = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on no sortbitwise = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on osd down out interval zero = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon warn on too few osds = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: mon_allow_pool_size_one = true 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: osd default data pool replay window = 5 2024-04-23T10:11:37.203 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: mon allow pool delete = true 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: mon cluster log file level = debug 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: debug asserts on shutdown = true 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: mon health detail to clog = false 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: mon host = "172.21.15.26,172.21.15.190,[v2:172.21.15.190:3301,v1:172.21.15.190:6790]" 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: fsid = 8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout:[osd] 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: osd journal size = 100 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub load threshold = 5.0 2024-04-23T10:11:37.204 INFO:teuthology.orchestra.run.smithi190.stdout: osd scrub max interval = 600 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd mclock profile = high_recovery_ops 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd recover clone overlap = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd recovery max chunk = 1048576 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug shutdown = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug op order = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug verify stray on activate = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug trim objects = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd open classes on start = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug pg log writeout = true 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: osd deep scrub update digest min age = 30 2024-04-23T10:11:37.205 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: osd map max advance = 10 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: journal zero on create = true 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: filestore ondisk finisher threads = 3 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: filestore apply finisher threads = 3 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: bdev debug aio = true 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: osd debug misdirected ops = true 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore block size = 96636764160 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: bluestore fsck on mount = True 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluefs = 20 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: debug bluestore = 20 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-04-23T10:11:37.206 INFO:teuthology.orchestra.run.smithi190.stdout: debug osd = 20 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: debug rocksdb = 10 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: mon client directed command retry = 5 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd backfillfull_ratio = 0.85 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd full ratio = 0.9 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd nearfull ratio = 0.8 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay max = 1 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay probability = 0.005 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay type = client mds 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject socket failures = 2500 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: osd blocked scrub grace period = 3600 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: osd failsafe full ratio = 0.95 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: osd max markdown count = 1000 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: osd objectstore = bluestore 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-04-23T10:11:37.207 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr] 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug mgr = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: mgr/telemetry/nag = false 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout:[mon] 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug mon = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug paxos = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: debug auth = 20 2024-04-23T10:11:37.208 INFO:teuthology.orchestra.run.smithi190.stdout: mon data avail warn = 5 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon mgr mkfs grace = 240 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min pgs per osd = 4 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd reporter subtree level = osd 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon osd prime pg temp = true 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon reweight min bytes per osd = 10 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: auth mon ticket ttl = 660 # 11m 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: auth service ticket ttl = 240 # 4m 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: # don't complain about insecure global_id in the test suite 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-23T10:11:37.209 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: # 1m isn't quite enough 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: mon_down_mkfs_grace = 2m 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: mon_warn_on_filestore_osds = false 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: mon down mkfs grace = 300 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: mon op complaint time = 120 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout:[client] 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: rgw cache enabled = true 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable ops log = true 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: rgw enable usage log = true 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: client mount timeout = 600 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: client_shutdown_timeout = 120 2024-04-23T10:11:37.210 INFO:teuthology.orchestra.run.smithi190.stdout: debug client = 20 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.a] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.b] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mon.c] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.e] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.f] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout:[mds] 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds = 20 2024-04-23T10:11:37.211 INFO:teuthology.orchestra.run.smithi190.stdout: debug mds balancer = 20 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: debug ms = 1 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal fragment size max = 10000 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal merge size = 5 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split bits = 3 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds bal split size = 100 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug frag = True 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds debug scatterstat = True 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds oft prefetch dirfrags = True 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds op complaint time = 180 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds verify scatter = True 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds_dir_prefetch = True 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mds_sleep_rank_change = 5000000.0 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: mon client directed command retry = 5 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay max = 1 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay probability = 0.005 2024-04-23T10:11:37.212 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject delay type = client mds osd 2024-04-23T10:11:37.213 INFO:teuthology.orchestra.run.smithi190.stdout: ms inject socket failures = 2500 2024-04-23T10:11:37.213 INFO:teuthology.orchestra.run.smithi190.stdout: osd op complaint time = 180 2024-04-23T10:11:37.213 INFO:teuthology.orchestra.run.smithi190.stdout: rados mon op timeout = 900 2024-04-23T10:11:37.213 INFO:teuthology.orchestra.run.smithi190.stdout: rados osd op timeout = 900 2024-04-23T10:11:37.213 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-23T10:11:37.213 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-23T10:11:37.293 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-23T10:11:37.293 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:37.293 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-23T10:11:37.299 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:37.299 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-23T10:11:37.344 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:11:37.344 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:37.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T10:11:37.344 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:11:37.412 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:11:37.412 DEBUG:teuthology.orchestra.run.smithi026:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:37.464 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:11:37.464 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:37.465 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-23T10:11:37.465 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-23T10:11:37.488 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:11:37.488 DEBUG:teuthology.orchestra.run.smithi190:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:37.538 INFO:tasks.ceph:Setting up mon nodes... 2024-04-23T10:11:37.538 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-23T10:11:37.538 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T10:11:37.585 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-23T10:11:37.588 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T10:11:37.631 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-23T10:11:37.646 INFO:tasks.ceph:Setting up mds nodes... 2024-04-23T10:11:37.646 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-a && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.a /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T10:11:37.689 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-a/keyring 2024-04-23T10:11:37.692 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-a 2024-04-23T10:11:37.748 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-c && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.c /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T10:11:37.832 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-c/keyring 2024-04-23T10:11:37.835 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-c 2024-04-23T10:11:37.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mds/ceph-e && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.e /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T10:11:37.972 INFO:teuthology.orchestra.run.smithi026.stdout:creating /var/lib/ceph/mds/ceph-e/keyring 2024-04-23T10:11:37.975 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-e 2024-04-23T10:11:38.030 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-b && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.b /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T10:11:38.074 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-b/keyring 2024-04-23T10:11:38.077 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-b 2024-04-23T10:11:38.133 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-d && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.d /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T10:11:38.216 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-d/keyring 2024-04-23T10:11:38.219 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-d 2024-04-23T10:11:38.271 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mds/ceph-f && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mds.f /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T10:11:38.353 INFO:teuthology.orchestra.run.smithi190.stdout:creating /var/lib/ceph/mds/ceph-f/keyring 2024-04-23T10:11:38.355 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mds/ceph-f 2024-04-23T10:11:38.407 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-23T10:11:38.408 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-23T10:11:38.446 INFO:teuthology.orchestra.run.smithi026.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-23T10:11:38.457 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-23T10:11:38.458 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi026.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi190.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-23T10:11:38.458 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-23T10:11:38.512 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:38.512 INFO:tasks.ceph:role: osd.0 2024-04-23T10:11:38.512 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:11:38.512 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:38.568 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:38.591 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-23T10:11:38.593 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-23T10:11:38.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-23T10:11:38.650 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-23T10:11:38.701 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:38.701 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-23T10:11:38.756 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:38.756 INFO:tasks.ceph:role: osd.1 2024-04-23T10:11:38.756 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:11:38.756 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:38.813 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:38.814 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:38.814 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:38.814 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:38.814 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:38.839 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-23T10:11:38.840 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-23T10:11:38.840 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-23T10:11:38.901 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-23T10:11:38.952 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:38.952 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:38.953 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-23T10:11:39.005 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:39.005 INFO:tasks.ceph:role: osd.2 2024-04-23T10:11:39.006 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:11:39.006 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:39.060 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:39.083 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-23T10:11:39.085 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-23T10:11:39.085 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-23T10:11:39.143 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-23T10:11:39.197 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:39.197 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:39.198 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-23T10:11:39.251 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:39.251 INFO:tasks.ceph:role: osd.3 2024-04-23T10:11:39.251 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:11:39.251 DEBUG:teuthology.orchestra.run.smithi026:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T10:11:39.304 INFO:teuthology.orchestra.run.smithi026.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:39.304 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:39.304 INFO:teuthology.orchestra.run.smithi026.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:39.304 INFO:teuthology.orchestra.run.smithi026.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:39.305 INFO:teuthology.orchestra.run.smithi026.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:39.328 INFO:teuthology.orchestra.run.smithi026.stdout:Discarding blocks...Done. 2024-04-23T10:11:39.330 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi026.front.sepia.ceph.com -o noatime 2024-04-23T10:11:39.330 DEBUG:teuthology.orchestra.run.smithi026:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-23T10:11:39.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-23T10:11:39.440 INFO:teuthology.orchestra.run.smithi026.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:39.441 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:39.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-23T10:11:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-23T10:11:39.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:11:39.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:11:39.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-23T10:11:39.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:39.547+0000 7f46529e07c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-23T10:11:42.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-23T10:11:42.524 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-23T10:11:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-23T10:11:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:11:42.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:11:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-23T10:11:42.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:42.603+0000 7faac703a7c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-23T10:11:45.571 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-23T10:11:45.625 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:45.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.703+0000 7eff37e637c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-23T10:11:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.707+0000 7eff37e637c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-23T10:11:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.707+0000 7eff37e637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:11:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.707+0000 7eff37e637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:11:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.707+0000 7eff37e637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-23T10:11:45.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:45.707+0000 7eff37e637c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-23T10:11:48.676 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-23T10:11:48.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-23T10:11:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-23T10:11:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:11:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:11:48.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-23T10:11:48.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:11:48.815+0000 7f26ab7ca7c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-23T10:11:51.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-23T10:11:51.849 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-23T10:11:51.863 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:51.863 INFO:tasks.ceph:role: osd.4 2024-04-23T10:11:51.864 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:11:51.864 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-23T10:11:51.924 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:51.924 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:51.924 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:51.924 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:51.924 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:51.925 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:51.925 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:51.925 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:51.925 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:51.925 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:52.373 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-04-23T10:11:52.375 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-04-23T10:11:52.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-23T10:11:52.484 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-23T10:11:52.495 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:52.495 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:52.496 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-23T10:11:52.552 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:52.552 INFO:tasks.ceph:role: osd.5 2024-04-23T10:11:52.553 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:11:52.553 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-23T10:11:52.616 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:52.617 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:53.084 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-04-23T10:11:53.086 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-04-23T10:11:53.086 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-23T10:11:53.254 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-23T10:11:53.262 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:53.263 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:53.263 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-23T10:11:53.314 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:53.314 INFO:tasks.ceph:role: osd.6 2024-04-23T10:11:53.314 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:11:53.315 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:53.381 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:53.861 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-04-23T10:11:53.863 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-04-23T10:11:53.864 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-23T10:11:54.004 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-23T10:11:54.015 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:54.015 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:54.016 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-23T10:11:54.072 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-23T10:11:54.072 INFO:tasks.ceph:role: osd.7 2024-04-23T10:11:54.072 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:11:54.072 DEBUG:teuthology.orchestra.run.smithi190:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-23T10:11:54.136 INFO:teuthology.orchestra.run.smithi190.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-23T10:11:54.136 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout: = sunit=0 swidth=0 blks 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-23T10:11:54.137 INFO:teuthology.orchestra.run.smithi190.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-23T10:11:54.565 INFO:teuthology.orchestra.run.smithi190.stdout:Discarding blocks...Done. 2024-04-23T10:11:54.567 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi190.front.sepia.ceph.com -o noatime 2024-04-23T10:11:54.567 DEBUG:teuthology.orchestra.run.smithi190:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-23T10:11:54.668 DEBUG:teuthology.orchestra.run.smithi190:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-23T10:11:54.678 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:11:54.678 INFO:teuthology.orchestra.run.smithi190.stderr:sudo: /sbin/restorecon: command not found 2024-04-23T10:11:54.678 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:54.783 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.781+0000 7f913b3f57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-23T10:11:54.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.785+0000 7f913b3f57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-23T10:11:54.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.785+0000 7f913b3f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:11:54.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.785+0000 7f913b3f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:11:54.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.785+0000 7f913b3f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-23T10:11:54.788 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:54.789+0000 7f913b3f57c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-23T10:11:57.769 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-23T10:11:57.783 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:11:57.865 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-23T10:11:57.866 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-23T10:11:57.866 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:11:57.866 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:11:57.866 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-23T10:11:57.867 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:11:57.865+0000 7fb254ab57c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-23T10:12:00.833 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-23T10:12:00.889 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:12:00.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-23T10:12:00.973 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-23T10:12:00.974 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:12:00.974 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:12:00.974 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-23T10:12:00.974 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:00.973+0000 7f3c1c8527c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-23T10:12:03.930 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-23T10:12:03.990 DEBUG:teuthology.orchestra.run.smithi190:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:12:04.071 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.069+0000 7f7675a557c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-23T10:12:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.069+0000 7f7675a557c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-23T10:12:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.069+0000 7f7675a557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:12:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.069+0000 7f7675a557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:12:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.069+0000 7f7675a557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-23T10:12:04.072 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:04.073+0000 7f7675a557c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-23T10:12:05.392 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:12:05.395 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:12:07.047 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-23T10:12:07.060 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-23T10:12:07.060 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.060 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-23T10:12:07.074 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.074 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-a/keyring of=/dev/stdout 2024-04-23T10:12:07.127 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-c/keyring of=/dev/stdout 2024-04-23T10:12:07.184 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.184 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/mds/ceph-e/keyring of=/dev/stdout 2024-04-23T10:12:07.239 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.240 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-23T10:12:07.295 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.295 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-23T10:12:07.351 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.351 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-23T10:12:07.407 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.407 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-23T10:12:07.468 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.468 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-23T10:12:07.481 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.482 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-b/keyring of=/dev/stdout 2024-04-23T10:12:07.536 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.536 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-d/keyring of=/dev/stdout 2024-04-23T10:12:07.592 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.592 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/mds/ceph-f/keyring of=/dev/stdout 2024-04-23T10:12:07.648 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.648 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-23T10:12:07.703 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.703 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-23T10:12:07.756 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.756 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-23T10:12:07.811 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:07.812 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-23T10:12:07.863 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:07.863 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-23T10:12:07.869 INFO:tasks.ceph:Adding keys to all mons... 2024-04-23T10:12:07.869 DEBUG:teuthology.orchestra.run.smithi026:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T10:12:07.917 DEBUG:teuthology.orchestra.run.smithi190:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.y] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZiSdm7zALIxAAb91Vx2MmAlqWJ0MuQzKPQw== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.a] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZiSdmX19EKRAAG8WYC3yRRURx2rIKGwldBQ== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.c] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZiSdmSzvHMRAA9fN8M9fWVDgrTT9IooEP6Q== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.e] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZiSdmjcMeOhAA4YKAyJxEMzJwvglMkSxaVw== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.0] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBbiSdmtl/4IBAAxkO5ByyzmSKMEnlv/f0gjQ== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.1] 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBeiSdmv7RYJBAAO7ANIq3FN8ARPDr29ZeI8g== 2024-04-23T10:12:07.927 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.2] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBhiSdmqWNaKhAAs9qI7oPdTHdf5tpLyw8YEw== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.3] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBkiSdmCejdMBAAll/fqnH7KF4bTOgsp3YhJw== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mgr.x] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBZiSdmEw7KJRAAz3zVv7PEsPOSv2PHiSBTxQ== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.b] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBaiSdmoiWMBBAAY+9JEUgRGl7Z93XxT3nX1g== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.d] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBaiSdmd3cHDRAAURzOb9JU1rEAgOBrvEr+xw== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[mds.f] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBaiSdm+0cuFRAA2X0L0WsM9uptMorpBRqIbQ== 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.4] 2024-04-23T10:12:07.928 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBqiSdmwfDYLhAAmotTsIsoUcwifSKyU5dPSQ== 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.5] 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBtiSdm5BS6MxAAQVAyJNyFa0PKBxqfYzjQcQ== 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.6] 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBwiSdmu48iOhAAuOAuqgMnlLH6d7EXNrGzkQ== 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:[osd.7] 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQB0iSdmcjVkBBAAFoY4TOXsbxZ2c1heyBYePg== 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout:[client.0] 2024-04-23T10:12:07.929 INFO:teuthology.orchestra.run.smithi026.stdout: key = AQBaiSdmQqjLGhAAKAfcIUNdNvF0UsNFiMxDyg== 2024-04-23T10:12:07.930 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.y] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBZiSdm7zALIxAAb91Vx2MmAlqWJ0MuQzKPQw== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.a] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBZiSdmX19EKRAAG8WYC3yRRURx2rIKGwldBQ== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.c] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBZiSdmSzvHMRAA9fN8M9fWVDgrTT9IooEP6Q== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.e] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBZiSdmjcMeOhAA4YKAyJxEMzJwvglMkSxaVw== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.0] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBbiSdmtl/4IBAAxkO5ByyzmSKMEnlv/f0gjQ== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.1] 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBeiSdmv7RYJBAAO7ANIq3FN8ARPDr29ZeI8g== 2024-04-23T10:12:07.931 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.2] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBhiSdmqWNaKhAAs9qI7oPdTHdf5tpLyw8YEw== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.3] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBkiSdmCejdMBAAll/fqnH7KF4bTOgsp3YhJw== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mgr.x] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBZiSdmEw7KJRAAz3zVv7PEsPOSv2PHiSBTxQ== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.b] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaiSdmoiWMBBAAY+9JEUgRGl7Z93XxT3nX1g== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.d] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaiSdmd3cHDRAAURzOb9JU1rEAgOBrvEr+xw== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[mds.f] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaiSdm+0cuFRAA2X0L0WsM9uptMorpBRqIbQ== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.4] 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBqiSdmwfDYLhAAmotTsIsoUcwifSKyU5dPSQ== 2024-04-23T10:12:07.932 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.5] 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBtiSdm5BS6MxAAQVAyJNyFa0PKBxqfYzjQcQ== 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.6] 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBwiSdmu48iOhAAuOAuqgMnlLH6d7EXNrGzkQ== 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout:[osd.7] 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQB0iSdmcjVkBBAAFoY4TOXsbxZ2c1heyBYePg== 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout:[client.0] 2024-04-23T10:12:07.933 INFO:teuthology.orchestra.run.smithi190.stdout: key = AQBaiSdmQqjLGhAAKAfcIUNdNvF0UsNFiMxDyg== 2024-04-23T10:12:07.933 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:12:07.973 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:12:08.018 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.061 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.a --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.110 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.113 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.c --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.201 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.e --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.289 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.333 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.336 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.417 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.421 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.500 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.505 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.583 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:12:08.589 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-23T10:12:08.665 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.673 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.b --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.754 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.756 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.d --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.805 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mds.f --cap mon 'allow *' --cap mgr 'allow *' --cap osd 'allow *' --cap mds allow 2024-04-23T10:12:08.880 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.889 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.960 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:08.977 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:09.048 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:09.050 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:09.136 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:09.138 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-23T10:12:09.182 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T10:12:09.225 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-23T10:12:09.272 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-23T10:12:09.273 DEBUG:teuthology.orchestra.run.smithi026:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-23T10:12:09.322 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:12:09.411 DEBUG:teuthology.orchestra.run.smithi026:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-23T10:12:09.420 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-23T10:12:09.434 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:12:09.529 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-23T10:12:09.540 DEBUG:teuthology.orchestra.run.smithi190:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-23T10:12:09.594 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-23T10:12:09.688 DEBUG:teuthology.orchestra.run.smithi190:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-23T10:12:09.698 DEBUG:teuthology.orchestra.run.smithi026:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:12:09.700 DEBUG:teuthology.orchestra.run.smithi190:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-23T10:12:09.744 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-23T10:12:09.744 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-23T10:12:09.744 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-23T10:12:09.749 INFO:tasks.ceph.mon.a:Started 2024-04-23T10:12:09.749 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-23T10:12:09.749 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-23T10:12:09.789 INFO:tasks.ceph.mon.b:Started 2024-04-23T10:12:09.789 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-23T10:12:09.789 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-23T10:12:09.791 INFO:tasks.ceph.mon.c:Started 2024-04-23T10:12:09.791 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-23T10:12:09.792 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-23T10:12:09.792 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-23T10:12:09.794 INFO:tasks.ceph.mgr.y:Started 2024-04-23T10:12:09.794 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-23T10:12:09.795 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-23T10:12:09.796 INFO:tasks.ceph.mgr.x:Started 2024-04-23T10:12:09.796 INFO:tasks.ceph:Setting crush tunables to default 2024-04-23T10:12:09.797 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph osd crush tunables default 2024-04-23T10:12:09.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.911+0000 7f0d28b00640 1 Processor -- start 2024-04-23T10:12:09.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.911+0000 7f0d28b00640 1 -- start start 2024-04-23T10:12:09.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d28b00640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:09.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d28b00640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:09.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d28b00640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0d2415beb0 con 0x7f0d240cda50 2024-04-23T10:12:09.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d28b00640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0d240cca40 con 0x7f0d2415b0b0 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d28b00640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0d240ccc90 con 0x7f0d24155350 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d21d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0d240cda50 0x7f0d240cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37422/0 (socket says 172.21.15.26:37422) 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d21d9b640 1 -- 172.21.15.26:0/229694851 learned_addr learned my addr 172.21.15.26:0/229694851 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 msgr2=0x7f0d2415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 msgr2=0x7f0d2415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d2259c640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 msgr2=0x7f0d240c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d2259c640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 msgr2=0x7f0d240c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:12:09.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:09.915+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:12:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 msgr2=0x7f0d2415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 15 2024-04-23T10:12:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 msgr2=0x7f0d2415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:12:10.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:12:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:12:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d2259c640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 msgr2=0x7f0d240c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 13 2024-04-23T10:12:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d2259c640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 msgr2=0x7f0d240c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:12:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:12:10.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.119+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.400000 2024-04-23T10:12:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.159+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2821651625 0 0) 0x7f0d2415beb0 con 0x7f0d240cda50 2024-04-23T10:12:10.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.159+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0d0c003530 con 0x7f0d240cda50 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2231283947 0 0) 0x7f0d0c003530 con 0x7f0d240cda50 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 msgr2=0x7f0d240c59c0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.190:3300/0 conn(0x7f0d24155350 0x7f0d240c59c0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 msgr2=0x7f0d2415b500 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 --2- 172.21.15.26:0/229694851 >> v2:172.21.15.26:3300/0 conn(0x7f0d2415b0b0 0x7f0d2415b500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d240ccf70 con 0x7f0d240cda50 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f0d18001680 con 0x7f0d240cda50 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 >> v1:172.21.15.26:6789/0 conn(0x7f0d240cda50 legacy=0x7f0d240cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c003a10 0x7f0d0c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 0x7f0d0c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240cca40 con 0x7f0d0c0051d0 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240ccc90 con 0x7f0d0c003a10 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d0c00c100 con 0x7f0d0c004810 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 0x7f0d0c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d21d9b640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d2259c640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c003a10 0x7f0d0c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d0c004810 msgr2=0x7f0d0c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d0c004810 0x7f0d0c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c003a10 msgr2=0x7f0d0c003e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c003a10 0x7f0d0c003e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.163+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d0c003530 con 0x7f0d0c0051d0 2024-04-23T10:12:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.167+0000 7f0d22d9d640 1 -- 172.21.15.26:0/229694851 reap_dead start 2024-04-23T10:12:10.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.167+0000 7f0d22d9d640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 0x7f0d0c00b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009a40 tx=0x7f0d1c01d010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=143ea51c6899a628 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:10.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.167+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c009640 con 0x7f0d0c0051d0 2024-04-23T10:12:10.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.167+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d1c0ac640 con 0x7f0d0c0051d0 2024-04-23T10:12:10.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.167+0000 7f0d2159a640 1 -- 172.21.15.26:0/229694851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1c0aca30 con 0x7f0d0c0051d0 2024-04-23T10:12:10.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 msgr2=0x7f0d0c00b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 0x7f0d0c00b9d0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f0d1c009a40 tx=0x7f0d1c01d010 comp rx=0 tx=0).stop 2024-04-23T10:12:10.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- 172.21.15.26:0/229694851 shutdown_connections 2024-04-23T10:12:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 --2- 172.21.15.26:0/229694851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d0c0051d0 0x7f0d0c00b9d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- 172.21.15.26:0/229694851 >> 172.21.15.26:0/229694851 conn(0x7f0d2406cc30 msgr2=0x7f0d2406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- 172.21.15.26:0/229694851 shutdown_connections 2024-04-23T10:12:10.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- 172.21.15.26:0/229694851 wait complete. 2024-04-23T10:12:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 Processor -- start 2024-04-23T10:12:10.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.171+0000 7f0d28b00640 1 -- start start 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c0051d0 0x7f0d24149830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 0x7f0d2414a490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0d240cd530 con 0x7f0d2414b400 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0d2415c080 con 0x7f0d0c0051d0 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0d24155730 con 0x7f0d241f52a0 2024-04-23T10:12:10.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d22d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 0x7f0d2414a490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:36194/0 (socket says 172.21.15.26:36194) 2024-04-23T10:12:10.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d22d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 0x7f0d2414a490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41216/0 (socket says 172.21.15.26:41216) 2024-04-23T10:12:10.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 -- 172.21.15.26:0/2353528801 learned_addr learned my addr 172.21.15.26:0/2353528801 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:10.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d2259c640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c0051d0 0x7f0d24149830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 -- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c0051d0 msgr2=0x7f0d24149830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c0051d0 0x7f0d24149830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 -- 172.21.15.26:0/2353528801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 msgr2=0x7f0d2414a490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 0x7f0d2414a490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 -- 172.21.15.26:0/2353528801 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0d2415e610 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d21d9b640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d18004e80 tx=0x7f0d18007430 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800f750 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0d18018070 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0d1800fb70 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0d24149d70 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f0d2415c6b0 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f0d1800fd10 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7f0d180135c0 con 0x7f0d241f52a0 2024-04-23T10:12:10.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.175+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0d24075df0 con 0x7f0d241f52a0 2024-04-23T10:12:10.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.191+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f0d18013870 con 0x7f0d241f52a0 2024-04-23T10:12:10.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.255+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7f0d24152700 con 0x7f0d241f52a0 2024-04-23T10:12:10.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d12ffd640 1 -- 172.21.15.26:0/2353528801 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7f0d18013a50 con 0x7f0d241f52a0 2024-04-23T10:12:10.269 INFO:teuthology.orchestra.run.smithi026.stderr:adjusted tunables profile to default 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 msgr2=0x7f0d240cf1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0x7f0d18004e80 tx=0x7f0d18007430 comp rx=0 tx=0).stop 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 shutdown_connections 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0d2414b400 0x7f0d2414a490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0d241f52a0 0x7f0d240cf1b0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 --2- 172.21.15.26:0/2353528801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0d0c0051d0 0x7f0d24149830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 >> 172.21.15.26:0/2353528801 conn(0x7f0d2406cc30 msgr2=0x7f0d241595e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 shutdown_connections 2024-04-23T10:12:10.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:10.267+0000 7f0d28b00640 1 -- 172.21.15.26:0/2353528801 wait complete. 2024-04-23T10:12:10.288 INFO:tasks.ceph:check_enable_crimson: False 2024-04-23T10:12:10.288 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-23T10:12:10.289 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:10.289 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-23T10:12:10.299 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:10.299 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-23T10:12:10.349 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:10.349 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-23T10:12:10.400 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:10.401+0000 7f527d1cc180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:12:10.403 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:10.403 DEBUG:teuthology.orchestra.run.smithi026:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-23T10:12:10.454 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:10.454 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-23T10:12:10.467 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:10.467 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-23T10:12:10.520 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:10.520 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-23T10:12:10.575 DEBUG:teuthology.orchestra.run.smithi190:> set -ex 2024-04-23T10:12:10.575 DEBUG:teuthology.orchestra.run.smithi190:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-23T10:12:10.580 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:10.579+0000 7f1432e96180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-23T10:12:10.627 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 3b704f6e-2bbc-4b01-adb8-0852089ce65d 0 2024-04-23T10:12:10.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.785+0000 7fa67e540640 1 Processor -- start 2024-04-23T10:12:10.787 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.785+0000 7fa67e540640 1 -- start start 2024-04-23T10:12:10.789 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.789 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 0x7fa6780c8870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa678158210 con 0x7fa67815bf40 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa67815bab0 con 0x7fa67806cff0 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa67806d550 con 0x7fa678151f40 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54198/0 (socket says 172.21.15.190:54198) 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 -- 172.21.15.190:0/4056229669 learned_addr learned my addr 172.21.15.190:0/4056229669 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 -- 172.21.15.190:0/4056229669 >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 msgr2=0x7fa6780c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa6777fe640 1 --2- 172.21.15.190:0/4056229669 >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 0x7fa6780c8870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 --2- 172.21.15.190:0/4056229669 >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 0x7fa6780c8870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 -- 172.21.15.190:0/4056229669 >> v1:172.21.15.26:6789/0 conn(0x7fa67815bf40 legacy=0x7fa67806f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:10.790 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 -- 172.21.15.190:0/4056229669 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa67806d830 con 0x7fa678151f40 2024-04-23T10:12:10.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa6777fe640 1 --2- 172.21.15.190:0/4056229669 >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 0x7fa6780c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:10.791 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa677fff640 1 --2- 172.21.15.190:0/4056229669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa67815bc30 tx=0x7fa66801c540 comp rx=0 tx=0).ready entity=mon.2 client_cookie=46df58a1c6eb927a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:10.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa676ffd640 1 -- 172.21.15.190:0/4056229669 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6680b0070 con 0x7fa678151f40 2024-04-23T10:12:10.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa676ffd640 1 -- 172.21.15.190:0/4056229669 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6680ab600 con 0x7fa678151f40 2024-04-23T10:12:10.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa676ffd640 1 -- 172.21.15.190:0/4056229669 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6680ab9d0 con 0x7fa678151f40 2024-04-23T10:12:10.792 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- 172.21.15.190:0/4056229669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 msgr2=0x7fa678157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 --2- 172.21.15.190:0/4056229669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7fa67815bc30 tx=0x7fa66801c540 comp rx=0 tx=0).stop 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- 172.21.15.190:0/4056229669 shutdown_connections 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 --2- 172.21.15.190:0/4056229669 >> v2:172.21.15.26:3300/0 conn(0x7fa67806cff0 0x7fa6780c8870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 --2- 172.21.15.190:0/4056229669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa678157cd0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.789+0000 7fa67e540640 1 -- 172.21.15.190:0/4056229669 >> 172.21.15.190:0/4056229669 conn(0x7fa6780ca540 msgr2=0x7fa6780ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- 172.21.15.190:0/4056229669 shutdown_connections 2024-04-23T10:12:10.793 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- 172.21.15.190:0/4056229669 wait complete. 2024-04-23T10:12:10.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 Processor -- start 2024-04-23T10:12:10.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- start start 2024-04-23T10:12:10.796 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa67815bf40 0x7fa678144500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa6780720d0 con 0x7fa67815bf40 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6780c4670 con 0x7fa67806cff0 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa678072250 con 0x7fa678151f40 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa6777fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:52976/0 (socket says 172.21.15.190:52976) 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa6777fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54204/0 (socket says 172.21.15.190:54204) 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 -- 172.21.15.190:0/3548847145 learned_addr learned my addr 172.21.15.190:0/3548847145 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67cadd640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa67815bf40 0x7fa678144500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:10.797 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 -- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 msgr2=0x7fa6780cd320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 -- 172.21.15.190:0/3548847145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa67815bf40 msgr2=0x7fa678144500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa67815bf40 0x7fa678144500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 -- 172.21.15.190:0/3548847145 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa678147d40 con 0x7fa67806cff0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa6777fe640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa677fff640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa668097e10 tx=0x7fa6680192e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6680bb070 con 0x7fa67806cff0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6680b6640 con 0x7fa67806cff0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6780cb440 con 0x7fa67806cff0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6680b0040 con 0x7fa67806cff0 2024-04-23T10:12:10.798 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6780cba00 con 0x7fa67806cff0 2024-04-23T10:12:10.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa6680be070 con 0x7fa67806cff0 2024-04-23T10:12:10.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7fa6680c0b40 con 0x7fa67806cff0 2024-04-23T10:12:10.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.793+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa678075df0 con 0x7fa67806cff0 2024-04-23T10:12:10.799 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.797+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa6680c5020 con 0x7fa67806cff0 2024-04-23T10:12:10.868 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.865+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "3b704f6e-2bbc-4b01-adb8-0852089ce65d", "id": 0} v 0) -- 0x7fa6780c9440 con 0x7fa67806cff0 2024-04-23T10:12:10.873 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa674ff9640 1 -- 172.21.15.190:0/3548847145 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "3b704f6e-2bbc-4b01-adb8-0852089ce65d", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7fa678147d40 con 0x7fa67806cff0 2024-04-23T10:12:10.873 INFO:teuthology.orchestra.run.smithi190.stdout:0 2024-04-23T10:12:10.874 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 msgr2=0x7fa6781473b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fa668097e10 tx=0x7fa6680192e0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 shutdown_connections 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa67815bf40 0x7fa678144500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa678151f40 0x7fa6780cd320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 --2- 172.21.15.190:0/3548847145 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa67806cff0 0x7fa6781473b0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 >> 172.21.15.190:0/3548847145 conn(0x7fa6780ca540 msgr2=0x7fa67814c640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 shutdown_connections 2024-04-23T10:12:10.875 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:10.873+0000 7fa67e540640 1 -- 172.21.15.190:0/3548847145 wait complete. 2024-04-23T10:12:10.879 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:10.877+0000 7f527d1cc180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:12:10.891 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef 1 2024-04-23T10:12:11.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 Processor -- start 2024-04-23T10:12:11.005 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 -- start start 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffac8152240 0x7ffac80c25d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac8073d80 con 0x7ffac8067a90 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffac80c22f0 con 0x7ffac8158870 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffacda4d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ffac80734e0 con 0x7ffac8152240 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac6ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffac8152240 0x7ffac80c25d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac77fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7ffac8158870 0x7ffac81626b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:35160/0 (socket says 172.21.15.190:35160) 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac6ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffac8152240 0x7ffac80c25d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:52982/0 (socket says 172.21.15.190:52982) 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac77fe640 1 -- 172.21.15.190:0/1458822206 learned_addr learned my addr 172.21.15.190:0/1458822206 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac6ffd640 1 -- 172.21.15.190:0/1458822206 >> v1:172.21.15.190:6789/0 conn(0x7ffac8158870 legacy=0x7ffac81626b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.007 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac6ffd640 1 -- 172.21.15.190:0/1458822206 >> v1:172.21.15.26:6789/0 conn(0x7ffac8067a90 legacy=0x7ffac8158160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.008 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.005+0000 7ffac6ffd640 1 -- 172.21.15.190:0/1458822206 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac80737c0 con 0x7ffac8152240 2024-04-23T10:12:11.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac6ffd640 1 --2- 172.21.15.190:0/1458822206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8152240 0x7ffac80c25d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097c0 tx=0x7ffabc01ec50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=d3e19680af3cac78 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac5ffb640 1 -- 172.21.15.190:0/1458822206 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b5070 con 0x7ffac8152240 2024-04-23T10:12:11.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac5ffb640 1 -- 172.21.15.190:0/1458822206 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc0a8950 con 0x7ffac8152240 2024-04-23T10:12:11.009 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac5ffb640 1 -- 172.21.15.190:0/1458822206 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0a8d20 con 0x7ffac8152240 2024-04-23T10:12:11.010 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- 172.21.15.190:0/1458822206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8152240 msgr2=0x7ffac80c25d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.010 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 --2- 172.21.15.190:0/1458822206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8152240 0x7ffac80c25d0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7ffabc0097c0 tx=0x7ffabc01ec50 comp rx=0 tx=0).stop 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- 172.21.15.190:0/1458822206 shutdown_connections 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 --2- 172.21.15.190:0/1458822206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8152240 0x7ffac80c25d0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- 172.21.15.190:0/1458822206 >> 172.21.15.190:0/1458822206 conn(0x7ffac80c9a70 msgr2=0x7ffac80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- 172.21.15.190:0/1458822206 shutdown_connections 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- 172.21.15.190:0/1458822206 wait complete. 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 Processor -- start 2024-04-23T10:12:11.011 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- start start 2024-04-23T10:12:11.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 0x7ffac814b2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac8158870 0x7ffac8150f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.014 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80c1f90 con 0x7ffac8152240 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffac80731e0 con 0x7ffac8067a90 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffacda4d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffac80ca790 con 0x7ffac8158870 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac6ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:52998/0 (socket says 172.21.15.190:52998) 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac6ffd640 1 -- 172.21.15.190:0/931677004 learned_addr learned my addr 172.21.15.190:0/931677004 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.009+0000 7ffac77fe640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac8158870 0x7ffac8150f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac67fc640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 0x7ffac814b2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 -- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac8158870 msgr2=0x7ffac8150f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac8158870 0x7ffac8150f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 -- 172.21.15.190:0/931677004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 msgr2=0x7ffac814b2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.015 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 0x7ffac814b2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 -- 172.21.15.190:0/931677004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffac814a5b0 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac67fc640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 0x7ffac814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffac6ffd640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01b860 tx=0x7ffabc01b9f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0bf070 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffabc0b0900 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffabc0b5040 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffac814a890 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffac8153de0 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ffabc0c2070 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7ffabc0c4d90 con 0x7ffac8067a90 2024-04-23T10:12:11.016 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffac8075df0 con 0x7ffac8067a90 2024-04-23T10:12:11.017 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.013+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7ffabc0ca020 con 0x7ffac8067a90 2024-04-23T10:12:11.084 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.085+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef", "id": 1} v 0) -- 0x7ffac806d600 con 0x7ffac8067a90 2024-04-23T10:12:11.087 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.085+0000 7f527d1cc180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:12:11.090 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffaaffff640 1 -- 172.21.15.190:0/931677004 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7ffabc0187b0 con 0x7ffac8067a90 2024-04-23T10:12:11.090 INFO:teuthology.orchestra.run.smithi190.stdout:1 2024-04-23T10:12:11.091 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 msgr2=0x7ffac8149f90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.091 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7ffabc01b860 tx=0x7ffabc01b9f0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.091 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 shutdown_connections 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffac8158870 0x7ffac8150f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffac8152240 0x7ffac814b2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 --2- 172.21.15.190:0/931677004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffac8067a90 0x7ffac8149f90 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 >> 172.21.15.190:0/931677004 conn(0x7ffac80c9a70 msgr2=0x7ffac8157280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 shutdown_connections 2024-04-23T10:12:11.092 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.089+0000 7ffacda4d640 1 -- 172.21.15.190:0/931677004 wait complete. 2024-04-23T10:12:11.107 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6 2 2024-04-23T10:12:11.204 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:11.203+0000 7f1432e96180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-23T10:12:11.222 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 Processor -- start 2024-04-23T10:12:11.222 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 -- start start 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f26ac15bd90 0x7f26ac0cc810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ac15f550 con 0x7f26ac155260 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f26ac15e9d0 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b469c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f26ac15b1f0 con 0x7f26ac15bd90 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b2c39640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f26ac0c8ed0 0x7f26ac0ccd50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:35172/0 (socket says 172.21.15.190:35172) 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b2c39640 1 -- 172.21.15.190:0/2587787727 learned_addr learned my addr 172.21.15.190:0/2587787727 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1c37640 1 --2- 172.21.15.190:0/2587787727 >> v2:172.21.15.26:3300/0 conn(0x7f26ac15bd90 0x7f26ac0cc810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.225 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2935844057 0 0) 0x7f26ac15e9d0 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2698003530 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 629175210 0 0) 0x7f2698003530 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 >> v2:172.21.15.26:3300/0 conn(0x7f26ac15bd90 msgr2=0x7f26ac0cc810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 --2- 172.21.15.190:0/2587787727 >> v2:172.21.15.26:3300/0 conn(0x7f26ac15bd90 0x7f26ac0cc810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 >> v1:172.21.15.26:6789/0 conn(0x7f26ac155260 legacy=0x7f26ac15b680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac15ecb0 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f26a4001680 con 0x7f26ac0c8ed0 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1c37640 1 --2- 172.21.15.190:0/2587787727 >> v2:172.21.15.26:3300/0 conn(0x7f26ac15bd90 0x7f26ac0cc810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 >> v1:172.21.15.190:6789/0 conn(0x7f26ac0c8ed0 legacy=0x7f26ac0ccd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 0x7f2698003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.226 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698004810 0x7f2698004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980051d0 0x7f269800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f269800c0f0 con 0x7f26980051d0 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f269800c2a0 con 0x7f26980039c0 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f269800c4a0 con 0x7f2698004810 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b2438640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 0x7f2698003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.221+0000 7f26b1c37640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698004810 0x7f2698004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 -- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698004810 msgr2=0x7f2698004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2698004810 0x7f2698004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 -- 172.21.15.190:0/2587787727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980051d0 msgr2=0x7f269800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980051d0 0x7f269800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.227 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 -- 172.21.15.190:0/2587787727 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2698003530 con 0x7f26980039c0 2024-04-23T10:12:11.228 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2c39640 1 -- 172.21.15.190:0/2587787727 reap_dead start 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b2438640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 0x7f2698003de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f269c001780 tx=0x7f269c01c400 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e0e7990806450d25 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c0013a0 con 0x7f26980039c0 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f269c0052f0 con 0x7f26980039c0 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b1436640 1 -- 172.21.15.190:0/2587787727 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f269c003840 con 0x7f26980039c0 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 -- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 msgr2=0x7f2698003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 0x7f2698003de0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f269c001780 tx=0x7f269c01c400 comp rx=0 tx=0).stop 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 -- 172.21.15.190:0/2587787727 shutdown_connections 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 --2- 172.21.15.190:0/2587787727 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26980039c0 0x7f2698003de0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.231 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 -- 172.21.15.190:0/2587787727 >> 172.21.15.190:0/2587787727 conn(0x7f26ac06b9d0 msgr2=0x7f26ac06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 -- 172.21.15.190:0/2587787727 shutdown_connections 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 -- 172.21.15.190:0/2587787727 wait complete. 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.225+0000 7f26b469c640 1 Processor -- start 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- start start 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980039c0 0x7f26ac153b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 0x7f26ac14d5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 0x7f26ac14db30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac155640 con 0x7f26980039c0 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f26ac15f270 con 0x7f26ac152010 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f26ac15e5d0 con 0x7f26ac15b8f0 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b1c37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 0x7f26ac14d5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.232 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 0x7f26ac14db30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b1c37640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 0x7f26ac14d5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53020/0 (socket says 172.21.15.190:53020) 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b1c37640 1 -- 172.21.15.190:0/2549804206 learned_addr learned my addr 172.21.15.190:0/2549804206 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2438640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980039c0 0x7f26ac153b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 -- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 msgr2=0x7f26ac14d5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 0x7f26ac14d5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 -- 172.21.15.190:0/2549804206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980039c0 msgr2=0x7f26ac153b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980039c0 0x7f26ac153b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 -- 172.21.15.190:0/2549804206 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26ac15c490 con 0x7f26ac15b8f0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b2c39640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 0x7f26ac14db30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f26ac074590 tx=0x7f26a400c810 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4007440 con 0x7f26ac15b8f0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f26a4007620 con 0x7f26ac15b8f0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26ac1f1360 con 0x7f26ac15b8f0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f26a4004a30 con 0x7f26ac15b8f0 2024-04-23T10:12:11.233 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f26ac150400 con 0x7f26ac15b8f0 2024-04-23T10:12:11.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f26a4004bd0 con 0x7f26ac15b8f0 2024-04-23T10:12:11.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f26a4011770 con 0x7f26ac15b8f0 2024-04-23T10:12:11.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.229+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f26ac075df0 con 0x7f26ac15b8f0 2024-04-23T10:12:11.234 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.233+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f26a4011350 con 0x7f26ac15b8f0 2024-04-23T10:12:11.296 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.293+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6", "id": 2} v 0) -- 0x7f26ac1505d0 con 0x7f26ac15b8f0 2024-04-23T10:12:11.301 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26a2ffd640 1 -- 172.21.15.190:0/2549804206 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f26a40119c0 con 0x7f26ac15b8f0 2024-04-23T10:12:11.301 INFO:teuthology.orchestra.run.smithi190.stdout:2 2024-04-23T10:12:11.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 msgr2=0x7f26ac14db30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.302 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 0x7f26ac14db30 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f26ac074590 tx=0x7f26a400c810 comp rx=0 tx=0).stop 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 shutdown_connections 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f26ac15b8f0 0x7f26ac14db30 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f26ac152010 0x7f26ac14d5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 --2- 172.21.15.190:0/2549804206 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f26980039c0 0x7f26ac153b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 >> 172.21.15.190:0/2549804206 conn(0x7f26ac06b9d0 msgr2=0x7f26ac15ca30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 shutdown_connections 2024-04-23T10:12:11.303 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.301+0000 7f26b469c640 1 -- 172.21.15.190:0/2549804206 wait complete. 2024-04-23T10:12:11.318 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new a2b65a5e-e51d-4e44-82fe-c4838dec90fd 3 2024-04-23T10:12:11.426 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 Processor -- start 2024-04-23T10:12:11.426 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 -- start start 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd6200ca550 0x7fd6200cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd6200cada0 con 0x7fd620152ff0 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd6200cb080 con 0x7fd6200ca550 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd62786a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd6200c9360 con 0x7fd6200c7eb0 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.428 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54254/0 (socket says 172.21.15.190:54254) 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 -- 172.21.15.190:0/3724576489 learned_addr learned my addr 172.21.15.190:0/3724576489 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd625e07640 1 --2- 172.21.15.190:0/3724576489 >> v2:172.21.15.26:3300/0 conn(0x7fd6200ca550 0x7fd6200cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 -- 172.21.15.190:0/3724576489 >> v2:172.21.15.26:3300/0 conn(0x7fd6200ca550 msgr2=0x7fd6200cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 --2- 172.21.15.190:0/3724576489 >> v2:172.21.15.26:3300/0 conn(0x7fd6200ca550 0x7fd6200cb350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 -- 172.21.15.190:0/3724576489 >> v1:172.21.15.26:6789/0 conn(0x7fd620152ff0 legacy=0x7fd6200c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.429 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.425+0000 7fd624e05640 1 -- 172.21.15.190:0/3724576489 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6200c9640 con 0x7fd6200c7eb0 2024-04-23T10:12:11.430 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd624e05640 1 --2- 172.21.15.190:0/3724576489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd610009870 tx=0x7fd61001ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b1be10a9a37a5101 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.430 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd617fff640 1 -- 172.21.15.190:0/3724576489 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100b5070 con 0x7fd6200c7eb0 2024-04-23T10:12:11.430 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd617fff640 1 -- 172.21.15.190:0/3724576489 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6100a89d0 con 0x7fd6200c7eb0 2024-04-23T10:12:11.430 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd617fff640 1 -- 172.21.15.190:0/3724576489 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd6100a8da0 con 0x7fd6200c7eb0 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- 172.21.15.190:0/3724576489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 msgr2=0x7fd6200c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 --2- 172.21.15.190:0/3724576489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0x7fd610009870 tx=0x7fd61001ed10 comp rx=0 tx=0).stop 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- 172.21.15.190:0/3724576489 shutdown_connections 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 --2- 172.21.15.190:0/3724576489 >> v2:172.21.15.26:3300/0 conn(0x7fd6200ca550 0x7fd6200cb350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 --2- 172.21.15.190:0/3724576489 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd6200c7eb0 0x7fd6200c5730 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- 172.21.15.190:0/3724576489 >> 172.21.15.190:0/3724576489 conn(0x7fd6200676a0 msgr2=0x7fd620067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- 172.21.15.190:0/3724576489 shutdown_connections 2024-04-23T10:12:11.432 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- 172.21.15.190:0/3724576489 wait complete. 2024-04-23T10:12:11.433 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 Processor -- start 2024-04-23T10:12:11.433 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.429+0000 7fd62786a640 1 -- start start 2024-04-23T10:12:11.435 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6200c7eb0 0x7fd620159d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.435 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ca550 0x7fd6200cd400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.435 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.435 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd6200caaa0 con 0x7fd6200ca550 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd6200c5e60 con 0x7fd6200c7eb0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd6201533d0 con 0x7fd620152ff0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625606640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6200c7eb0 0x7fd620159d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54258/0 (socket says 172.21.15.190:54258) 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 -- 172.21.15.190:0/3220538258 learned_addr learned my addr 172.21.15.190:0/3220538258 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd624e05640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ca550 0x7fd6200cd400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 -- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6200c7eb0 msgr2=0x7fd620159d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6200c7eb0 0x7fd620159d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 -- 172.21.15.190:0/3220538258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ca550 msgr2=0x7fd6200cd400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ca550 0x7fd6200cd400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 -- 172.21.15.190:0/3220538258 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd6200ce090 con 0x7fd620152ff0 2024-04-23T10:12:11.436 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd625e07640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd618007e70 tx=0x7fd61800e4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618014420 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd618019070 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd620154060 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd618014820 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fd620155d20 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fd6180149c0 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7fd618014cb0 con 0x7fd620152ff0 2024-04-23T10:12:11.437 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.433+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd620075df0 con 0x7fd620152ff0 2024-04-23T10:12:11.438 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.437+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fd61801e460 con 0x7fd620152ff0 2024-04-23T10:12:11.449 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:11.447+0000 7f1432e96180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-23T10:12:11.505 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.505+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "a2b65a5e-e51d-4e44-82fe-c4838dec90fd", "id": 3} v 0) -- 0x7fd62014a2b0 con 0x7fd620152ff0 2024-04-23T10:12:11.511 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd615ffb640 1 -- 172.21.15.190:0/3220538258 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "a2b65a5e-e51d-4e44-82fe-c4838dec90fd", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7fd61801e6e0 con 0x7fd620152ff0 2024-04-23T10:12:11.511 INFO:teuthology.orchestra.run.smithi190.stdout:3 2024-04-23T10:12:11.512 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 msgr2=0x7fd620153690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.512 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7fd618007e70 tx=0x7fd61800e4b0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.512 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 shutdown_connections 2024-04-23T10:12:11.512 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd620152ff0 0x7fd620153690 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.512 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd6200ca550 0x7fd6200cd400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.513 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 --2- 172.21.15.190:0/3220538258 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd6200c7eb0 0x7fd620159d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.513 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 >> 172.21.15.190:0/3220538258 conn(0x7fd6200676a0 msgr2=0x7fd620146860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.513 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 shutdown_connections 2024-04-23T10:12:11.513 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.509+0000 7fd62786a640 1 -- 172.21.15.190:0/3220538258 wait complete. 2024-04-23T10:12:11.526 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080 4 2024-04-23T10:12:11.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 Processor -- start 2024-04-23T10:12:11.639 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 -- start start 2024-04-23T10:12:11.640 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43280cada0 0x7f432806cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.640 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43281556f0 con 0x7f4328155310 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f432815f2e0 con 0x7f43280cada0 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432e413640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f432806d4d0 con 0x7f432806d020 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432c9b0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432c9b0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54260/0 (socket says 172.21.15.190:54260) 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.637+0000 7f432c9b0640 1 -- 172.21.15.190:0/148660532 learned_addr learned my addr 172.21.15.190:0/148660532 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f431ffff640 1 --2- 172.21.15.190:0/148660532 >> v2:172.21.15.26:3300/0 conn(0x7f43280cada0 0x7f432806cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432c9b0640 1 -- 172.21.15.190:0/148660532 >> v2:172.21.15.26:3300/0 conn(0x7f43280cada0 msgr2=0x7f432806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432c9b0640 1 --2- 172.21.15.190:0/148660532 >> v2:172.21.15.26:3300/0 conn(0x7f43280cada0 0x7f432806cae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432c9b0640 1 -- 172.21.15.190:0/148660532 >> v1:172.21.15.26:6789/0 conn(0x7f4328155310 legacy=0x7f43280cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.641 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432c9b0640 1 -- 172.21.15.190:0/148660532 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f432815e6d0 con 0x7f432806d020 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432c9b0640 1 --2- 172.21.15.190:0/148660532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432001c9f0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dd627a73e324351b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f43277fe640 1 -- 172.21.15.190:0/148660532 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200a5670 con 0x7f432806d020 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f43277fe640 1 -- 172.21.15.190:0/148660532 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43200a5810 con 0x7f432806d020 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f43277fe640 1 -- 172.21.15.190:0/148660532 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43200a5be0 con 0x7f432806d020 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 -- 172.21.15.190:0/148660532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 msgr2=0x7f432815b200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 --2- 172.21.15.190:0/148660532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f4320009e50 tx=0x7f432001c9f0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 -- 172.21.15.190:0/148660532 shutdown_connections 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 --2- 172.21.15.190:0/148660532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f432806d020 0x7f432815b200 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 --2- 172.21.15.190:0/148660532 >> v2:172.21.15.26:3300/0 conn(0x7f43280cada0 0x7f432806cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.644 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 -- 172.21.15.190:0/148660532 >> 172.21.15.190:0/148660532 conn(0x7f43280676a0 msgr2=0x7f4328067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.645 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 -- 172.21.15.190:0/148660532 shutdown_connections 2024-04-23T10:12:11.645 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.641+0000 7f432e413640 1 -- 172.21.15.190:0/148660532 wait complete. 2024-04-23T10:12:11.645 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 Processor -- start 2024-04-23T10:12:11.645 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- start start 2024-04-23T10:12:11.647 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f432806d020 0x7f4328146f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328155310 0x7f432814ab40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43280cba60 con 0x7f4328155310 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f432815bb50 con 0x7f432806d020 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43280cbbe0 con 0x7f43280cada0 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f4327fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f432806d020 0x7f4328146f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54266/0 (socket says 172.21.15.190:54266) 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 -- 172.21.15.190:0/1338938501 learned_addr learned my addr 172.21.15.190:0/1338938501 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432c9b0640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328155310 0x7f432814ab40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 -- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f432806d020 msgr2=0x7f4328146f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f432806d020 0x7f4328146f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 -- 172.21.15.190:0/1338938501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328155310 msgr2=0x7f432814ab40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.648 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328155310 0x7f432814ab40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 -- 172.21.15.190:0/1338938501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43281f4000 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f431ffff640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f431000c820 tx=0x7f431000cce0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4310015070 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4310004220 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431000ce10 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43281f42e0 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f43281f48a0 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4310007830 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4328075df0 con 0x7f43280cada0 2024-04-23T10:12:11.649 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.645+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f4310019910 con 0x7f43280cada0 2024-04-23T10:12:11.650 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.649+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f4310019c80 con 0x7f43280cada0 2024-04-23T10:12:11.673 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.673+0000 7f527d1cc180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:12:11.713 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.713+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080", "id": 4} v 0) -- 0x7f4328074550 con 0x7f43280cada0 2024-04-23T10:12:11.720 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.717+0000 7f43257fa640 1 -- 172.21.15.190:0/1338938501 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080", "id": 4}]=0 v7) ==== 112+0+2 (secure 0 0 0) 0x7f4310007b20 con 0x7f43280cada0 2024-04-23T10:12:11.720 INFO:teuthology.orchestra.run.smithi190.stdout:4 2024-04-23T10:12:11.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 msgr2=0x7f432815de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0x7f431000c820 tx=0x7f431000cce0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 shutdown_connections 2024-04-23T10:12:11.721 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328155310 0x7f432814ab40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280cada0 0x7f432815de50 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 --2- 172.21.15.190:0/1338938501 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f432806d020 0x7f4328146f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 >> 172.21.15.190:0/1338938501 conn(0x7f43280676a0 msgr2=0x7f4328067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 shutdown_connections 2024-04-23T10:12:11.722 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.721+0000 7f432e413640 1 -- 172.21.15.190:0/1338938501 wait complete. 2024-04-23T10:12:11.729 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.729+0000 7f527d1cc180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:12:11.736 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new c732841b-0bfa-48aa-b8ee-1642f4aa7bbd 5 2024-04-23T10:12:11.784 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.785+0000 7f527d1cc180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:12:11.850 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 Processor -- start 2024-04-23T10:12:11.850 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 -- start start 2024-04-23T10:12:11.851 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 0x7fa6840c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6840cada0 con 0x7fa6840c7eb0 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa6840cb080 con 0x7fa684152ff0 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa689992640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6840c9360 con 0x7fa6840ca550 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa682ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 0x7fa6840c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54276/0 (socket says 172.21.15.190:54276) 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa682ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 0x7fa6840c5730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53064/0 (socket says 172.21.15.190:53064) 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 -- 172.21.15.190:0/736744848 learned_addr learned my addr 172.21.15.190:0/736744848 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 -- 172.21.15.190:0/736744848 >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 msgr2=0x7fa6840c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.852 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 --2- 172.21.15.190:0/736744848 >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 0x7fa6840c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 -- 172.21.15.190:0/736744848 >> v1:172.21.15.26:6789/0 conn(0x7fa6840c7eb0 legacy=0x7fa6840c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:11.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.849+0000 7fa6837fe640 1 -- 172.21.15.190:0/736744848 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6840c9640 con 0x7fa6840ca550 2024-04-23T10:12:11.853 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa6837fe640 1 --2- 172.21.15.190:0/736744848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009e50 tx=0x7fa67c01f1e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d0548c4a7c3e1338 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa6827fc640 1 -- 172.21.15.190:0/736744848 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0b4070 con 0x7fa6840ca550 2024-04-23T10:12:11.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa6827fc640 1 -- 172.21.15.190:0/736744848 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa67c0af400 con 0x7fa6840ca550 2024-04-23T10:12:11.854 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa6827fc640 1 -- 172.21.15.190:0/736744848 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa67c0af7d0 con 0x7fa6840ca550 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- 172.21.15.190:0/736744848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 msgr2=0x7fa6840cb350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 --2- 172.21.15.190:0/736744848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7fa67c009e50 tx=0x7fa67c01f1e0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- 172.21.15.190:0/736744848 shutdown_connections 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 --2- 172.21.15.190:0/736744848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa6840cb350 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 --2- 172.21.15.190:0/736744848 >> v2:172.21.15.190:3300/0 conn(0x7fa684152ff0 0x7fa6840c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- 172.21.15.190:0/736744848 >> 172.21.15.190:0/736744848 conn(0x7fa6840676a0 msgr2=0x7fa684067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- 172.21.15.190:0/736744848 shutdown_connections 2024-04-23T10:12:11.855 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- 172.21.15.190:0/736744848 wait complete. 2024-04-23T10:12:11.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 Processor -- start 2024-04-23T10:12:11.856 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.853+0000 7fa689992640 1 -- start start 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 0x7fa6841491e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa68406df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa684152ff0 0x7fa68414d070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa6840caaa0 con 0x7fa684152ff0 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6840c5e60 con 0x7fa6840c7eb0 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6841533d0 con 0x7fa6840ca550 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa682ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 0x7fa6841491e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa68406df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa682ffd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 0x7fa6841491e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53068/0 (socket says 172.21.15.190:53068) 2024-04-23T10:12:11.858 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa682ffd640 1 -- 172.21.15.190:0/1535319496 learned_addr learned my addr 172.21.15.190:0/1535319496 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa6837fe640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa684152ff0 0x7fa68414d070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 -- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 msgr2=0x7fa6841491e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 0x7fa6841491e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 -- 172.21.15.190:0/1535319496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa684152ff0 msgr2=0x7fa68414d070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa684152ff0 0x7fa68414d070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 -- 172.21.15.190:0/1535319496 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6841487a0 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa67bfff640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa68406df80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c410 tx=0x7fa66c00c8d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c017070 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa66c0069e0 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa68414da40 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa66c006dd0 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa684147cc0 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa66c01a070 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(7..7 src has 1..7) ==== 1300+0+0 (secure 0 0 0) 0x7fa66c011b30 con 0x7fa6840ca550 2024-04-23T10:12:11.859 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.857+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa684075df0 con 0x7fa6840ca550 2024-04-23T10:12:11.860 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.861+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fa66c021020 con 0x7fa6840ca550 2024-04-23T10:12:11.866 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.865+0000 7f527d1cc180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:12:11.918 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.917+0000 7f527d1cc180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:12:11.928 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.925+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd new", "uuid": "c732841b-0bfa-48aa-b8ee-1642f4aa7bbd", "id": 5} v 0) -- 0x7fa6840ca000 con 0x7fa6840ca550 2024-04-23T10:12:11.933 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa680ff9640 1 -- 172.21.15.190:0/1535319496 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "c732841b-0bfa-48aa-b8ee-1642f4aa7bbd", "id": 5}]=0 v8) ==== 112+0+2 (secure 0 0 0) 0x7fa66c011590 con 0x7fa6840ca550 2024-04-23T10:12:11.934 INFO:teuthology.orchestra.run.smithi190.stdout:5 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 msgr2=0x7fa68406df80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa68406df80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7fa66c00c410 tx=0x7fa66c00c8d0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 shutdown_connections 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa684152ff0 0x7fa68414d070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6840ca550 0x7fa68406df80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 --2- 172.21.15.190:0/1535319496 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6840c7eb0 0x7fa6841491e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 >> 172.21.15.190:0/1535319496 conn(0x7fa6840676a0 msgr2=0x7fa684070a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 shutdown_connections 2024-04-23T10:12:11.935 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:11.933+0000 7fa689992640 1 -- 172.21.15.190:0/1535319496 wait complete. 2024-04-23T10:12:11.950 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 67dde11b-3898-490a-b93e-3033850fdd79 6 2024-04-23T10:12:11.999 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:11.997+0000 7f527d1cc180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:12:12.054 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 Processor -- start 2024-04-23T10:12:12.055 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f527d1cc180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:12:12.055 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 -- start start 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5a580c8dd0 0x7f5a5806cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a580c6dc0 0x7f5a580c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5a580c7790 con 0x7f5a580c91b0 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5a580c5510 con 0x7f5a580c8dd0 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5f33e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5a5806d520 con 0x7f5a580c6dc0 2024-04-23T10:12:12.056 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a580c6dc0 0x7f5a580c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5a580c6dc0 0x7f5a580c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53072/0 (socket says 172.21.15.190:53072) 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 -- 172.21.15.190:0/1717000582 learned_addr learned my addr 172.21.15.190:0/1717000582 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d0da640 1 --2- 172.21.15.190:0/1717000582 >> v2:172.21.15.26:3300/0 conn(0x7f5a580c8dd0 0x7f5a5806cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 -- 172.21.15.190:0/1717000582 >> v2:172.21.15.26:3300/0 conn(0x7f5a580c8dd0 msgr2=0x7f5a5806cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 --2- 172.21.15.190:0/1717000582 >> v2:172.21.15.26:3300/0 conn(0x7f5a580c8dd0 0x7f5a5806cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 -- 172.21.15.190:0/1717000582 >> v1:172.21.15.26:6789/0 conn(0x7f5a580c91b0 legacy=0x7f5a5806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.057 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.053+0000 7f5a5d8db640 1 -- 172.21.15.190:0/1717000582 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a580c4be0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.059 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5d8db640 1 --2- 172.21.15.190:0/1717000582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a580c7250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a5806d450 tx=0x7f5a5001c8f0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=4698b9b30f2d95c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.059 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a4ffff640 1 -- 172.21.15.190:0/1717000582 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500a57b0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.059 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a4ffff640 1 -- 172.21.15.190:0/1717000582 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a500a5950 con 0x7f5a580c6dc0 2024-04-23T10:12:12.059 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a4ffff640 1 -- 172.21.15.190:0/1717000582 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a500a5d20 con 0x7f5a580c6dc0 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 -- 172.21.15.190:0/1717000582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 msgr2=0x7f5a580c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/1717000582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a580c7250 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0x7f5a5806d450 tx=0x7f5a5001c8f0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 -- 172.21.15.190:0/1717000582 shutdown_connections 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/1717000582 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a580c7250 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/1717000582 >> v2:172.21.15.26:3300/0 conn(0x7f5a580c8dd0 0x7f5a5806cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 -- 172.21.15.190:0/1717000582 >> 172.21.15.190:0/1717000582 conn(0x7f5a580ca540 msgr2=0x7f5a580ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 -- 172.21.15.190:0/1717000582 shutdown_connections 2024-04-23T10:12:12.060 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.057+0000 7f5a5f33e640 1 -- 172.21.15.190:0/1717000582 wait complete. 2024-04-23T10:12:12.061 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 Processor -- start 2024-04-23T10:12:12.061 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- start start 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 0x7f5a581594a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a580c91b0 0x7f5a5814d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5a58165770 con 0x7f5a580c91b0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5a580709c0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5a581658f0 con 0x7f5a580c8dd0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5c8d9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 0x7f5a581594a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.190:53078/0 (socket says 172.21.15.190:53078) 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 -- 172.21.15.190:0/2681101994 learned_addr learned my addr 172.21.15.190:0/2681101994 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d8db640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a580c91b0 0x7f5a5814d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.064 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 -- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 msgr2=0x7f5a581594a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 0x7f5a581594a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 -- 172.21.15.190:0/2681101994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a580c91b0 msgr2=0x7f5a5814d7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a580c91b0 0x7f5a5814d7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 -- 172.21.15.190:0/2681101994 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5a581f4c40 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5c8d9640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 0x7f5a581594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5d0da640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d800 tx=0x7f5a4800dcc0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800b660 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a48019070 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5a581f5ac0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5a4800ba00 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5a581f5190 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f5a4800bba0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(8..8 src has 1..8) ==== 1415+0+0 (secure 0 0 0) 0x7f5a48014a70 con 0x7f5a580c6dc0 2024-04-23T10:12:12.065 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.061+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5a58075df0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.066 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.065+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f5a48014db0 con 0x7f5a580c6dc0 2024-04-23T10:12:12.088 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.087+0000 7f1432e96180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-23T10:12:12.131 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.129+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "67dde11b-3898-490a-b93e-3033850fdd79", "id": 6} v 0) -- 0x7f5a580cab70 con 0x7f5a580c6dc0 2024-04-23T10:12:12.136 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a4dffb640 1 -- 172.21.15.190:0/2681101994 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "67dde11b-3898-490a-b93e-3033850fdd79", "id": 6}]=0 v9) ==== 112+0+2 (secure 0 0 0) 0x7f5a48014550 con 0x7f5a580c6dc0 2024-04-23T10:12:12.137 INFO:teuthology.orchestra.run.smithi190.stdout:6 2024-04-23T10:12:12.137 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 msgr2=0x7f5a58149670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f5a4800d800 tx=0x7f5a4800dcc0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 shutdown_connections 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5a580c91b0 0x7f5a5814d7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5a580c8dd0 0x7f5a581594a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 --2- 172.21.15.190:0/2681101994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5a580c6dc0 0x7f5a58149670 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 >> 172.21.15.190:0/2681101994 conn(0x7f5a580ca540 msgr2=0x7f5a58147d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 shutdown_connections 2024-04-23T10:12:12.138 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.137+0000 7f5a5f33e640 1 -- 172.21.15.190:0/2681101994 wait complete. 2024-04-23T10:12:12.145 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.143+0000 7f1432e96180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-23T10:12:12.152 DEBUG:teuthology.orchestra.run.smithi190:> sudo ceph --cluster ceph osd new 9d50cdc7-1954-4a67-be0f-81d1cb0d3efa 7 2024-04-23T10:12:12.200 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.199+0000 7f1432e96180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-23T10:12:12.212 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:12.209+0000 7f527d1cc180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:12:12.266 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 Processor -- start 2024-04-23T10:12:12.267 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 -- start start 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9c70159cf0 0x7f9c70071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c700c8080 con 0x7f9c700c6630 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c700c8360 con 0x7f9c700c6210 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c7500f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9c700c5d80 con 0x7f9c70159cf0 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c67fff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f9c700c6210 0x7f9c700c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.190:35178/0 (socket says 172.21.15.190:35178) 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c67fff640 1 -- 172.21.15.190:0/4039384061 learned_addr learned my addr 172.21.15.190:0/4039384061 (peer_addr_for_me v1:172.21.15.190:0/0) 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/4039384061 >> v2:172.21.15.26:3300/0 conn(0x7f9c70159cf0 0x7f9c70071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 977716562 0 0) 0x7f9c700c8360 con 0x7f9c700c6210 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.265+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c5c003530 con 0x7f9c700c6210 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3042611317 0 0) 0x7f9c5c003530 con 0x7f9c700c6210 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 >> v2:172.21.15.26:3300/0 conn(0x7f9c70159cf0 msgr2=0x7f9c70071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.270 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 --2- 172.21.15.190:0/4039384061 >> v2:172.21.15.26:3300/0 conn(0x7f9c70159cf0 0x7f9c70071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 >> v1:172.21.15.26:6789/0 conn(0x7f9c700c6630 legacy=0x7f9c700cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c700c8640 con 0x7f9c700c6210 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f9c58001680 con 0x7f9c700c6210 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 >> v1:172.21.15.190:6789/0 conn(0x7f9c700c6210 legacy=0x7f9c700c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 0x7f9c5c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c004810 0x7f9c5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0051d0 0x7f9c5c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700c5d80 con 0x7f9c5c0051d0 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c5c00c080 con 0x7f9c5c0039c0 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c5c00c280 con 0x7f9c5c004810 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 0x7f9c5c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c67fff640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c004810 0x7f9c5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.271 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6f59e640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0051d0 0x7f9c5c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 -- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c004810 msgr2=0x7f9c5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c5c004810 0x7f9c5c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 -- 172.21.15.190:0/4039384061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0051d0 msgr2=0x7f9c5c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0051d0 0x7f9c5c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 -- 172.21.15.190:0/4039384061 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c5c003530 con 0x7f9c5c0039c0 2024-04-23T10:12:12.272 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6f59e640 1 -- 172.21.15.190:0/4039384061 reap_dead start 2024-04-23T10:12:12.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 0x7f9c5c003de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ae0 tx=0x7f9c6001ca70 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f01a146ac000705a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.275 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600b2070 con 0x7f9c5c0039c0 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c600a5660 con 0x7f9c5c0039c0 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c6e59c640 1 -- 172.21.15.190:0/4039384061 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c600096b0 con 0x7f9c5c0039c0 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 -- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 msgr2=0x7f9c5c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 0x7f9c5c003de0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0x7f9c60009ae0 tx=0x7f9c6001ca70 comp rx=0 tx=0).stop 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 -- 172.21.15.190:0/4039384061 shutdown_connections 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 --2- 172.21.15.190:0/4039384061 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c5c0039c0 0x7f9c5c003de0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 -- 172.21.15.190:0/4039384061 >> 172.21.15.190:0/4039384061 conn(0x7f9c700676a0 msgr2=0x7f9c70067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 -- 172.21.15.190:0/4039384061 shutdown_connections 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.269+0000 7f9c7500f640 1 -- 172.21.15.190:0/4039384061 wait complete. 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 Processor -- start 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- start start 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 0x7f9c7013c710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.276 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 0x7f9c701f14c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9c70158f80 con 0x7f9c5c0039c0 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c700c8c00 con 0x7f9c700cb850 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c70071530 con 0x7f9c700cd940 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 0x7f9c701f14c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c67fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.190:54310/0 (socket says 172.21.15.190:54310) 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c67fff640 1 -- 172.21.15.190:0/2448010155 learned_addr learned my addr 172.21.15.190:0/2448010155 (peer_addr_for_me v2:172.21.15.190:0/0) 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 0x7f9c7013c710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 -- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 msgr2=0x7f9c701f0f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 -- 172.21.15.190:0/2448010155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 msgr2=0x7f9c7013c710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.277 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 0x7f9c7013c710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 -- 172.21.15.190:0/2448010155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c7015a2a0 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c67fff640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6ed9d640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 0x7f9c7013c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c6f59e640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 0x7f9c701f14c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c70071ea0 tx=0x7f9c6800e8a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68019070 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c68006e30 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c7015a540 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c68003ba0 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c7015ab00 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f9c6801c070 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1530+0+0 (secure 0 0 0) 0x7f9c68007730 con 0x7f9c700cb850 2024-04-23T10:12:12.278 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.273+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c70075df0 con 0x7f9c700cb850 2024-04-23T10:12:12.279 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:12.277+0000 7f527d1cc180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:12:12.279 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.277+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f9c68003d40 con 0x7f9c700cb850 2024-04-23T10:12:12.281 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.279+0000 7f1432e96180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-23T10:12:12.336 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.335+0000 7f1432e96180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-23T10:12:12.341 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.341+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd new", "uuid": "9d50cdc7-1954-4a67-be0f-81d1cb0d3efa", "id": 7} v 0) -- 0x7f9c700c9150 con 0x7f9c700cb850 2024-04-23T10:12:12.352 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c677fe640 1 -- 172.21.15.190:0/2448010155 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "9d50cdc7-1954-4a67-be0f-81d1cb0d3efa", "id": 7}]=0 v10) ==== 112+0+2 (secure 0 0 0) 0x7f9c680070d0 con 0x7f9c700cb850 2024-04-23T10:12:12.352 INFO:teuthology.orchestra.run.smithi190.stdout:7 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 msgr2=0x7f9c701f14c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 0x7f9c701f14c0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0x7f9c70071ea0 tx=0x7f9c6800e8a0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 shutdown_connections 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c700cb850 0x7f9c701f14c0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c700cd940 0x7f9c701f0f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 --2- 172.21.15.190:0/2448010155 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c5c0039c0 0x7f9c7013c710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 >> 172.21.15.190:0/2448010155 conn(0x7f9c700676a0 msgr2=0x7f9c700c9d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 shutdown_connections 2024-04-23T10:12:12.354 INFO:teuthology.orchestra.run.smithi190.stderr:2024-04-23T10:12:12.353+0000 7f9c7500f640 1 -- 172.21.15.190:0/2448010155 wait complete. 2024-04-23T10:12:12.369 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-23T10:12:12.369 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-23T10:12:12.371 INFO:tasks.ceph.osd.0:Started 2024-04-23T10:12:12.371 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-23T10:12:12.371 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-23T10:12:12.374 INFO:tasks.ceph.osd.1:Started 2024-04-23T10:12:12.374 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-23T10:12:12.374 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-23T10:12:12.376 INFO:tasks.ceph.osd.2:Started 2024-04-23T10:12:12.377 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-23T10:12:12.377 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-23T10:12:12.379 INFO:tasks.ceph.osd.3:Started 2024-04-23T10:12:12.379 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-23T10:12:12.379 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-23T10:12:12.381 INFO:tasks.ceph.osd.4:Started 2024-04-23T10:12:12.381 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-23T10:12:12.381 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-23T10:12:12.383 INFO:tasks.ceph.osd.5:Started 2024-04-23T10:12:12.383 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-23T10:12:12.383 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-23T10:12:12.385 INFO:tasks.ceph.osd.6:Started 2024-04-23T10:12:12.385 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-23T10:12:12.385 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-23T10:12:12.387 INFO:tasks.ceph.osd.7:Started 2024-04-23T10:12:12.387 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:12.423 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.419+0000 7f1432e96180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-23T10:12:12.494 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.491+0000 7f1432e96180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-23T10:12:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.511+0000 7f7d478ce640 1 Processor -- start 2024-04-23T10:12:12.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.511+0000 7f7d478ce640 1 -- start start 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d478ce640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d40072ae0 0x7f7d4015b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d478ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d4006cfd0 0x7f7d4006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d478ce640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d40157da0 con 0x7f7d40151f40 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d478ce640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7d400c89e0 con 0x7f7d4006cfd0 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d478ce640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d400c8c80 con 0x7f7d40072ae0 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d45e6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d4006cfd0 0x7f7d4006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d4566a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7d40151f40 0x7f7d400c9630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57000/0 (socket says 172.21.15.26:57000) 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d4566a640 1 -- 172.21.15.26:0/1514590398 learned_addr learned my addr 172.21.15.26:0/1514590398 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d44e69640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d40072ae0 0x7f7d4015b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d45e6b640 1 -- 172.21.15.26:0/1514590398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d40072ae0 msgr2=0x7f7d4015b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d45e6b640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d40072ae0 0x7f7d4015b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d45e6b640 1 -- 172.21.15.26:0/1514590398 >> v1:172.21.15.26:6789/0 conn(0x7f7d40151f40 legacy=0x7f7d400c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d33fff640 1 -- 172.21.15.26:0/1514590398 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1942655802 0 0) 0x7f7d3c001120 con 0x7f7d40151f40 2024-04-23T10:12:12.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.515+0000 7f7d45e6b640 1 -- 172.21.15.26:0/1514590398 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d40158020 con 0x7f7d4006cfd0 2024-04-23T10:12:12.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d45e6b640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4006cfd0 0x7f7d4006d420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d3801f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15a536e14cd7998a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d33fff640 1 -- 172.21.15.26:0/1514590398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380b4070 con 0x7f7d4006cfd0 2024-04-23T10:12:12.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d33fff640 1 -- 172.21.15.26:0/1514590398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d380af600 con 0x7f7d4006cfd0 2024-04-23T10:12:12.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d33fff640 1 -- 172.21.15.26:0/1514590398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d380af9d0 con 0x7f7d4006cfd0 2024-04-23T10:12:12.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- 172.21.15.26:0/1514590398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4006cfd0 msgr2=0x7f7d4006d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4006cfd0 0x7f7d4006d420 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f7d38009d90 tx=0x7f7d3801f150 comp rx=0 tx=0).stop 2024-04-23T10:12:12.521 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- 172.21.15.26:0/1514590398 shutdown_connections 2024-04-23T10:12:12.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d4006cfd0 0x7f7d4006d420 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- 172.21.15.26:0/1514590398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d40072ae0 0x7f7d4015b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- 172.21.15.26:0/1514590398 >> 172.21.15.26:0/1514590398 conn(0x7f7d400ca540 msgr2=0x7f7d400ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- 172.21.15.26:0/1514590398 shutdown_connections 2024-04-23T10:12:12.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- 172.21.15.26:0/1514590398 wait complete. 2024-04-23T10:12:12.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 Processor -- start 2024-04-23T10:12:12.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- start start 2024-04-23T10:12:12.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d4006cfd0 0x7f7d401eeae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d40151f40 0x7f7d40142160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7d400c9170 con 0x7f7d40072ae0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7d401585e0 con 0x7f7d40151f40 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d478ce640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d4015b8d0 con 0x7f7d4006cfd0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d44e69640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d44e69640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39750/0 (socket says 172.21.15.26:39750) 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d44e69640 1 -- 172.21.15.26:0/253919312 learned_addr learned my addr 172.21.15.26:0/253919312 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d4566a640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d4006cfd0 0x7f7d401eeae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.519+0000 7f7d45e6b640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d40151f40 0x7f7d40142160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 -- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d4006cfd0 msgr2=0x7f7d401eeae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d4006cfd0 0x7f7d401eeae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 -- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d40151f40 msgr2=0x7f7d40142160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d40151f40 0x7f7d40142160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 -- 172.21.15.26:0/253919312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d400c7160 con 0x7f7d40072ae0 2024-04-23T10:12:12.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d44e69640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400d620 tx=0x7f7d3400dae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400b620 con 0x7f7d40072ae0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d34019070 con 0x7f7d40072ae0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d400c7420 con 0x7f7d40072ae0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d3400b9e0 con 0x7f7d40072ae0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d401f2460 con 0x7f7d40072ae0 2024-04-23T10:12:12.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f7d3400bb80 con 0x7f7d40072ae0 2024-04-23T10:12:12.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d40075df0 con 0x7f7d40072ae0 2024-04-23T10:12:12.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7f7d34014b00 con 0x7f7d40072ae0 2024-04-23T10:12:12.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.523+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7f7d34014430 con 0x7f7d40072ae0 2024-04-23T10:12:12.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f7d400c4380 con 0x7f7d40072ae0 2024-04-23T10:12:12.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d31ffb640 1 -- 172.21.15.26:0/253919312 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7f7d34014610 con 0x7f7d40072ae0 2024-04-23T10:12:12.586 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:12.586 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":10,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:12.346164+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 msgr2=0x7f7d40141c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f7d3400d620 tx=0x7f7d3400dae0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 shutdown_connections 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d40151f40 0x7f7d40142160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d40072ae0 0x7f7d40141c20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 --2- 172.21.15.26:0/253919312 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d4006cfd0 0x7f7d401eeae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 >> 172.21.15.26:0/253919312 conn(0x7f7d400ca540 msgr2=0x7f7d4006f9b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 shutdown_connections 2024-04-23T10:12:12.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:12.583+0000 7f7d478ce640 1 -- 172.21.15.26:0/253919312 wait complete. 2024-04-23T10:12:12.602 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-23T10:12:12.602 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-23T10:12:12.656 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.655+0000 7f1432e96180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-23T10:12:12.721 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:12.719+0000 7f1432e96180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-23T10:12:12.734 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-04-23T10:12:12.733+0000 7f2518a647c0 -1 Falling back to public interface 2024-04-23T10:12:12.904 INFO:tasks.ceph.mgr.x.smithi190.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T10:12:12.904 INFO:tasks.ceph.mgr.x.smithi190.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T10:12:12.904 INFO:tasks.ceph.mgr.x.smithi190.stderr: from numpy import show_config as show_numpy_config 2024-04-23T10:12:12.978 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-04-23T10:12:12.977+0000 7f70a36cd7c0 -1 Falling back to public interface 2024-04-23T10:12:12.978 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:12.977+0000 7f527d1cc180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:12:13.000 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-23T10:12:12.999+0000 7f4557b677c0 -1 Falling back to public interface 2024-04-23T10:12:13.005 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-04-23T10:12:13.005+0000 7f4f8aec37c0 -1 Falling back to public interface 2024-04-23T10:12:13.006 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-04-23T10:12:13.005+0000 7fc1c21f27c0 -1 Falling back to public interface 2024-04-23T10:12:13.016 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-23T10:12:13.015+0000 7f2b08a4f7c0 -1 Falling back to public interface 2024-04-23T10:12:13.021 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-23T10:12:13.019+0000 7fb45bbd47c0 -1 Falling back to public interface 2024-04-23T10:12:13.021 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-23T10:12:13.019+0000 7f86295747c0 -1 Falling back to public interface 2024-04-23T10:12:13.165 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:13.165+0000 7f527d1cc180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:12:13.332 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:13.333+0000 7f527d1cc180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:12:13.402 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:13.401+0000 7f527d1cc180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:12:13.408 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:13.446 INFO:tasks.ceph.mgr.y.smithi026.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-23T10:12:13.446 INFO:tasks.ceph.mgr.y.smithi026.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-23T10:12:13.446 INFO:tasks.ceph.mgr.y.smithi026.stderr: from numpy import show_config as show_numpy_config 2024-04-23T10:12:13.510 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:13.507+0000 7f1432e96180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-23T10:12:13.532 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 Processor -- start 2024-04-23T10:12:13.532 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 -- start start 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe8141555b0 0x7fe81415ef50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe81406e320 0x7fe8140c2ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe81415f490 con 0x7fe8140c3220 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe8140c77d0 con 0x7fe81406e320 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe819423640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8140c2850 con 0x7fe8141555b0 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe81406e320 0x7fe8140c2ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe81406e320 0x7fe8140c2ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39760/0 (socket says 172.21.15.26:39760) 2024-04-23T10:12:13.534 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 -- 172.21.15.26:0/2715340978 learned_addr learned my addr 172.21.15.26:0/2715340978 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:13.535 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe812ffd640 1 --2- 172.21.15.26:0/2715340978 >> v2:172.21.15.190:3300/0 conn(0x7fe8141555b0 0x7fe81415ef50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:13.535 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 -- 172.21.15.26:0/2715340978 >> v2:172.21.15.190:3300/0 conn(0x7fe8141555b0 msgr2=0x7fe81415ef50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:13.535 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 --2- 172.21.15.26:0/2715340978 >> v2:172.21.15.190:3300/0 conn(0x7fe8141555b0 0x7fe81415ef50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.535 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 -- 172.21.15.26:0/2715340978 >> v1:172.21.15.190:6789/0 conn(0x7fe8140c3220 legacy=0x7fe81406c9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:13.535 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.531+0000 7fe8127fc640 1 -- 172.21.15.26:0/2715340978 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe814067bd0 con 0x7fe81406e320 2024-04-23T10:12:13.537 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe8127fc640 1 --2- 172.21.15.26:0/2715340978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe81406e320 0x7fe8140c2ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe804009870 tx=0x7fe80401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc9a59ad808589e5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:13.537 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe811ffb640 1 -- 172.21.15.26:0/2715340978 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b0070 con 0x7fe81406e320 2024-04-23T10:12:13.537 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe811ffb640 1 -- 172.21.15.26:0/2715340978 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8040ab600 con 0x7fe81406e320 2024-04-23T10:12:13.537 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe811ffb640 1 -- 172.21.15.26:0/2715340978 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040ab9d0 con 0x7fe81406e320 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- 172.21.15.26:0/2715340978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe81406e320 msgr2=0x7fe8140c2ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 --2- 172.21.15.26:0/2715340978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe81406e320 0x7fe8140c2ce0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7fe804009870 tx=0x7fe80401c520 comp rx=0 tx=0).stop 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- 172.21.15.26:0/2715340978 shutdown_connections 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 --2- 172.21.15.26:0/2715340978 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe81406e320 0x7fe8140c2ce0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 --2- 172.21.15.26:0/2715340978 >> v2:172.21.15.190:3300/0 conn(0x7fe8141555b0 0x7fe81415ef50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- 172.21.15.26:0/2715340978 >> 172.21.15.26:0/2715340978 conn(0x7fe81406d830 msgr2=0x7fe81406dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:13.538 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- 172.21.15.26:0/2715340978 shutdown_connections 2024-04-23T10:12:13.539 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- 172.21.15.26:0/2715340978 wait complete. 2024-04-23T10:12:13.539 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 Processor -- start 2024-04-23T10:12:13.539 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.535+0000 7fe819423640 1 -- start start 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe81406e320 0x7fe81415dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8141555b0 0x7fe8140c7960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe8140c24e0 con 0x7fe8140c3220 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe814068770 con 0x7fe8141555b0 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8140678b0 con 0x7fe81406e320 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39772/0 (socket says 172.21.15.26:39772) 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 -- 172.21.15.26:0/892458324 learned_addr learned my addr 172.21.15.26:0/892458324 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8137fe640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8141555b0 0x7fe8140c7960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:13.542 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe812ffd640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe81406e320 0x7fe81415dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 -- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe81406e320 msgr2=0x7fe81415dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe81406e320 0x7fe81415dc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 -- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8141555b0 msgr2=0x7fe8140c7960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8141555b0 0x7fe8140c7960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 -- 172.21.15.26:0/892458324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8140735e0 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe8127fc640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8040ae040 tx=0x7fe80401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b0040 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8040bc070 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe81414bf30 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8040b6880 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe814148230 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fe8040ab4c0 con 0x7fe8140c3220 2024-04-23T10:12:13.543 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(10..10 src has 1..10) ==== 1645+0+0 (secure 0 0 0) 0x7fe8040c03c0 con 0x7fe8140c3220 2024-04-23T10:12:13.544 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.539+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8140763e0 con 0x7fe8140c3220 2024-04-23T10:12:13.548 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.547+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+73265 (secure 0 0 0) 0x7fe804016110 con 0x7fe8140c3220 2024-04-23T10:12:13.550 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:13.549+0000 7f527d1cc180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:12:13.607 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.603+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe81415f270 con 0x7fe8140c3220 2024-04-23T10:12:13.608 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe7fb7fe640 1 -- 172.21.15.26:0/892458324 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v10) ==== 74+0+7058 (secure 0 0 0) 0x7fe8040b6a20 con 0x7fe8140c3220 2024-04-23T10:12:13.609 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-23T10:12:13.609 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":10,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:12.346164+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 msgr2=0x7fe814152430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7fe8040ae040 tx=0x7fe80401ad60 comp rx=0 tx=0).stop 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 shutdown_connections 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8141555b0 0x7fe8140c7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8140c3220 0x7fe814152430 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 --2- 172.21.15.26:0/892458324 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe81406e320 0x7fe81415dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 >> 172.21.15.26:0/892458324 conn(0x7fe81406d830 msgr2=0x7fe81406dc10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 shutdown_connections 2024-04-23T10:12:13.610 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:13.607+0000 7fe819423640 1 -- 172.21.15.26:0/892458324 wait complete. 2024-04-23T10:12:13.625 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T10:12:13.694 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:13.691+0000 7f1432e96180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:12:13.869 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:13.867+0000 7f1432e96180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-23T10:12:13.937 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:13.935+0000 7f1432e96180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-23T10:12:14.078 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:14.075+0000 7f1432e96180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-23T10:12:14.189 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.189+0000 7f527d1cc180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:12:14.265 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.265+0000 7f527d1cc180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:12:14.446 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.445+0000 7f527d1cc180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:12:14.520 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.517+0000 7f527d1cc180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:12:14.723 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:14.719+0000 7f1432e96180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-23T10:12:14.802 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:14.799+0000 7f1432e96180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-23T10:12:14.810 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.809+0000 7f527d1cc180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:12:14.872 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:14.869+0000 7f527d1cc180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:12:14.995 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:14.991+0000 7f1432e96180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-23T10:12:15.072 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:15.071+0000 7f1432e96180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-23T10:12:15.380 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:15.379+0000 7f1432e96180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-23T10:12:15.444 INFO:tasks.ceph.mgr.y.smithi026.stderr:2024-04-23T10:12:15.443+0000 7f1432e96180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-23T10:12:15.915 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:15.913+0000 7f5224619640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-23T10:12:15.915 INFO:tasks.ceph.mgr.x.smithi190.stderr:2024-04-23T10:12:15.913+0000 7f5224619640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-23T10:12:16.519 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-04-23T10:12:16.517+0000 7f2518a647c0 -1 osd.5 0 log_to_monitors true 2024-04-23T10:12:16.680 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-23T10:12:16.679+0000 7fb45bbd47c0 -1 osd.0 0 log_to_monitors true 2024-04-23T10:12:16.696 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-04-23T10:12:16.697+0000 7f70a36cd7c0 -1 osd.6 0 log_to_monitors true 2024-04-23T10:12:16.807 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-04-23T10:12:16.805+0000 7f4f8aec37c0 -1 osd.7 0 log_to_monitors true 2024-04-23T10:12:16.811 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-23T10:12:16.807+0000 7f86295747c0 -1 osd.1 0 log_to_monitors true 2024-04-23T10:12:16.823 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-04-23T10:12:16.821+0000 7fc1c21f27c0 -1 osd.4 0 log_to_monitors true 2024-04-23T10:12:16.896 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-23T10:12:16.895+0000 7f2b08a4f7c0 -1 osd.2 0 log_to_monitors true 2024-04-23T10:12:16.911 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-23T10:12:16.907+0000 7f4557b677c0 -1 osd.3 0 log_to_monitors true 2024-04-23T10:12:19.782 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-23T10:12:19.779+0000 7fb457b7d640 -1 osd.0 0 waiting for initial osdmap 2024-04-23T10:12:19.801 INFO:tasks.ceph.osd.0.smithi026.stderr:2024-04-23T10:12:19.799+0000 7fb44f9b1640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:19.809 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-23T10:12:19.807+0000 7f862551d640 -1 osd.1 0 waiting for initial osdmap 2024-04-23T10:12:19.828 INFO:tasks.ceph.osd.1.smithi026.stderr:2024-04-23T10:12:19.827+0000 7f861d351640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:19.882 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-23T10:12:19.879+0000 7f2b049f8640 -1 osd.2 0 waiting for initial osdmap 2024-04-23T10:12:19.887 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-23T10:12:19.883+0000 7f4553b10640 -1 osd.3 0 waiting for initial osdmap 2024-04-23T10:12:19.908 INFO:tasks.ceph.osd.2.smithi026.stderr:2024-04-23T10:12:19.907+0000 7f2afc82c640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:19.916 INFO:tasks.ceph.osd.3.smithi026.stderr:2024-04-23T10:12:19.915+0000 7f454b944640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:20.308 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-04-23T10:12:20.305+0000 7f2514a0d640 -1 osd.5 0 waiting for initial osdmap 2024-04-23T10:12:20.342 INFO:tasks.ceph.osd.5.smithi190.stderr:2024-04-23T10:12:20.341+0000 7f250c841640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:20.400 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-04-23T10:12:20.397+0000 7f4f86e6c640 -1 osd.7 0 waiting for initial osdmap 2024-04-23T10:12:20.421 INFO:tasks.ceph.osd.7.smithi190.stderr:2024-04-23T10:12:20.421+0000 7f4f7eca0640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:20.427 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-04-23T10:12:20.425+0000 7fc1be19b640 -1 osd.4 0 waiting for initial osdmap 2024-04-23T10:12:20.433 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:20.457 INFO:tasks.ceph.osd.4.smithi190.stderr:2024-04-23T10:12:20.457+0000 7fc1b5fcf640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:20.488 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-04-23T10:12:20.485+0000 7f709f676640 -1 osd.6 0 waiting for initial osdmap 2024-04-23T10:12:20.513 INFO:tasks.ceph.osd.6.smithi190.stderr:2024-04-23T10:12:20.513+0000 7f70974aa640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-23T10:12:20.558 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 Processor -- start 2024-04-23T10:12:20.558 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 -- start start 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb0c4151dd0 0x7fb0c40c4bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0c40c7a00 0x7fb0c4158890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c4158dd0 con 0x7fb0c4070e90 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c40c7570 con 0x7fb0c40c7a00 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0ca281640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c40c8240 con 0x7fb0c4151dd0 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0c40c7a00 0x7fb0c4158890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb0c40c7a00 0x7fb0c4158890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39816/0 (socket says 172.21.15.26:39816) 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 -- 172.21.15.26:0/1686277419 learned_addr learned my addr 172.21.15.26:0/1686277419 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0c3fff640 1 --2- 172.21.15.26:0/1686277419 >> v2:172.21.15.190:3300/0 conn(0x7fb0c4151dd0 0x7fb0c40c4bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 -- 172.21.15.26:0/1686277419 >> v2:172.21.15.190:3300/0 conn(0x7fb0c4151dd0 msgr2=0x7fb0c40c4bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 --2- 172.21.15.26:0/1686277419 >> v2:172.21.15.190:3300/0 conn(0x7fb0c4151dd0 0x7fb0c40c4bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.560 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 -- 172.21.15.26:0/1686277419 >> v1:172.21.15.190:6789/0 conn(0x7fb0c4070e90 legacy=0x7fb0c406b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:20.561 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.555+0000 7fb0bbfff640 1 -- 172.21.15.26:0/1686277419 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c40c84e0 con 0x7fb0c40c7a00 2024-04-23T10:12:20.562 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0bbfff640 1 --2- 172.21.15.26:0/1686277419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c40c7a00 0x7fb0c4158890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40cd590 tx=0x7fb0ac0211c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd600db364c99fd4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:20.562 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0c37fe640 1 -- 172.21.15.26:0/1686277419 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b6070 con 0x7fb0c40c7a00 2024-04-23T10:12:20.562 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0c37fe640 1 -- 172.21.15.26:0/1686277419 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0ac0b1600 con 0x7fb0c40c7a00 2024-04-23T10:12:20.562 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0c37fe640 1 -- 172.21.15.26:0/1686277419 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0ac0b19d0 con 0x7fb0c40c7a00 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 -- 172.21.15.26:0/1686277419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c40c7a00 msgr2=0x7fb0c4158890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 --2- 172.21.15.26:0/1686277419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c40c7a00 0x7fb0c4158890 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7fb0c40cd590 tx=0x7fb0ac0211c0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 -- 172.21.15.26:0/1686277419 shutdown_connections 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 --2- 172.21.15.26:0/1686277419 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c40c7a00 0x7fb0c4158890 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 --2- 172.21.15.26:0/1686277419 >> v2:172.21.15.190:3300/0 conn(0x7fb0c4151dd0 0x7fb0c40c4bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.563 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 -- 172.21.15.26:0/1686277419 >> 172.21.15.26:0/1686277419 conn(0x7fb0c40cc520 msgr2=0x7fb0c40cc930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:20.564 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 -- 172.21.15.26:0/1686277419 shutdown_connections 2024-04-23T10:12:20.564 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.559+0000 7fb0ca281640 1 -- 172.21.15.26:0/1686277419 wait complete. 2024-04-23T10:12:20.566 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 Processor -- start 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- start start 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c4070e90 0x7fb0c41ecad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c40c7a00 0x7fb0c4147e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c40c7200 con 0x7fb0c4151dd0 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c40c6f20 con 0x7fb0c4070e90 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c40c7de0 con 0x7fb0c40c7a00 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39830/0 (socket says 172.21.15.26:39830) 2024-04-23T10:12:20.567 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 -- 172.21.15.26:0/342790398 learned_addr learned my addr 172.21.15.26:0/342790398 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0bbfff640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c40c7a00 0x7fb0c4147e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c3fff640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c4070e90 0x7fb0c41ecad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 -- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c40c7a00 msgr2=0x7fb0c4147e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c40c7a00 0x7fb0c4147e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 -- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c4070e90 msgr2=0x7fb0c41ecad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c4070e90 0x7fb0c41ecad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 -- 172.21.15.26:0/342790398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c4159680 con 0x7fb0c4151dd0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c881e640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c780 tx=0x7fb0bc00cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc004b70 con 0x7fb0c4151dd0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0bc004d10 con 0x7fb0c4151dd0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c415a3b0 con 0x7fb0c4151dd0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0bc00aa30 con 0x7fb0c4151dd0 2024-04-23T10:12:20.568 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c41ed3f0 con 0x7fb0c4151dd0 2024-04-23T10:12:20.569 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c40763e0 con 0x7fb0c4151dd0 2024-04-23T10:12:20.569 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.563+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 4) ==== 87931+0+0 (secure 0 0 0) 0x7fb0bc00abd0 con 0x7fb0c4151dd0 2024-04-23T10:12:20.570 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.567+0000 7fb0c17fa640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 0x7fb0a406a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:20.570 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.567+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(12..12 src has 1..12) ==== 2231+0+0 (secure 0 0 0) 0x7fb0bc085d90 con 0x7fb0c4151dd0 2024-04-23T10:12:20.570 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.567+0000 7fb0c3fff640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 0x7fb0a406a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:20.570 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.567+0000 7fb0c3fff640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 0x7fb0a406a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400b930 tx=0x7fb0b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:20.573 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.571+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0bc089030 con 0x7fb0c4151dd0 2024-04-23T10:12:20.732 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0c4157bf0 con 0x7fb0c4151dd0 2024-04-23T10:12:20.750 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0c17fa640 1 -- 172.21.15.26:0/342790398 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v12) ==== 74+0+7058 (secure 0 0 0) 0x7fb0bc020070 con 0x7fb0c4151dd0 2024-04-23T10:12:20.750 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-23T10:12:20.750 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":12,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:18.179891+0000","last_up_change":"0.000000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 msgr2=0x7fb0a406a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 0x7fb0a406a7b0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fb0b400b930 tx=0x7fb0b4008040 comp rx=0 tx=0).stop 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 msgr2=0x7fb0c4148350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.731+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fb0bc00c780 tx=0x7fb0bc00cc40 comp rx=0 tx=0).stop 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 shutdown_connections 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0a40682f0 0x7fb0a406a7b0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c4151dd0 0x7fb0c4148350 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c40c7a00 0x7fb0c4147e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.752 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 --2- 172.21.15.26:0/342790398 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c4070e90 0x7fb0c41ecad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:20.753 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 >> 172.21.15.26:0/342790398 conn(0x7fb0c40cc520 msgr2=0x7fb0c40c5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:20.753 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 shutdown_connections 2024-04-23T10:12:20.753 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:20.735+0000 7fb0ca281640 1 -- 172.21.15.26:0/342790398 wait complete. 2024-04-23T10:12:20.753 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-23T10:12:27.558 DEBUG:teuthology.orchestra.run.smithi026:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:27.684 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.679+0000 7fd9410c6640 1 Processor -- start 2024-04-23T10:12:27.684 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.679+0000 7fd9410c6640 1 -- start start 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd9410c6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd9410c6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 0x7fd93c071d30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd9410c6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd93c0c2eb0 con 0x7fd93c072b20 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd9410c6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd93c0c67a0 con 0x7fd93c0718e0 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd9410c6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c0c3780 con 0x7fd93c151620 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:52988/0 (socket says 172.21.15.26:52988) 2024-04-23T10:12:27.685 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93b59e640 1 --2- 172.21.15.26:0/3102333881 >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 0x7fd93c071d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 -- 172.21.15.26:0/3102333881 learned_addr learned my addr 172.21.15.26:0/3102333881 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 -- 172.21.15.26:0/3102333881 >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 msgr2=0x7fd93c071d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 --2- 172.21.15.26:0/3102333881 >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 0x7fd93c071d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 -- 172.21.15.26:0/3102333881 >> v1:172.21.15.190:6789/0 conn(0x7fd93c072b20 legacy=0x7fd93c072f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93ad9d640 1 -- 172.21.15.26:0/3102333881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c0c28f0 con 0x7fd93c151620 2024-04-23T10:12:27.686 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.683+0000 7fd93b59e640 1 --2- 172.21.15.26:0/3102333881 >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 0x7fd93c071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:12:27.689 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd93ad9d640 1 --2- 172.21.15.26:0/3102333881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009870 tx=0x7fd92c01c4d0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4cea18d20662057 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:27.690 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd939d9b640 1 -- 172.21.15.26:0/3102333881 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b0070 con 0x7fd93c151620 2024-04-23T10:12:27.690 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd939d9b640 1 -- 172.21.15.26:0/3102333881 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0ab600 con 0x7fd93c151620 2024-04-23T10:12:27.690 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd939d9b640 1 -- 172.21.15.26:0/3102333881 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0ab9d0 con 0x7fd93c151620 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 -- 172.21.15.26:0/3102333881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 msgr2=0x7fd93c157f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 --2- 172.21.15.26:0/3102333881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7fd92c009870 tx=0x7fd92c01c4d0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 -- 172.21.15.26:0/3102333881 shutdown_connections 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 --2- 172.21.15.26:0/3102333881 >> v2:172.21.15.190:3300/0 conn(0x7fd93c0718e0 0x7fd93c071d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 --2- 172.21.15.26:0/3102333881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c157f00 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 -- 172.21.15.26:0/3102333881 >> 172.21.15.26:0/3102333881 conn(0x7fd93c0ccd60 msgr2=0x7fd93c0cd170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 -- 172.21.15.26:0/3102333881 shutdown_connections 2024-04-23T10:12:27.691 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.687+0000 7fd9410c6640 1 -- 172.21.15.26:0/3102333881 wait complete. 2024-04-23T10:12:27.692 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 Processor -- start 2024-04-23T10:12:27.692 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- start start 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c072b20 0x7fd93c146cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c0cab60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c166130 con 0x7fd93c0718e0 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd93c072680 con 0x7fd93c072b20 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd93c1662b0 con 0x7fd93c151620 2024-04-23T10:12:27.694 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39596/0 (socket says 172.21.15.26:39596) 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 -- 172.21.15.26:0/1379348085 learned_addr learned my addr 172.21.15.26:0/1379348085 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93a59c640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c072b20 0x7fd93c146cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93b59e640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c0cab60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 -- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 msgr2=0x7fd93c0cab60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c0cab60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 -- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c072b20 msgr2=0x7fd93c146cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c072b20 0x7fd93c146cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 -- 172.21.15.26:0/1379348085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd93c1f53d0 con 0x7fd93c0718e0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93b59e640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd93ad9d640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01a100 tx=0x7fd92c019270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b0040 con 0x7fd93c0718e0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd92c0bd070 con 0x7fd93c0718e0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd93c1f56b0 con 0x7fd93c0718e0 2024-04-23T10:12:27.695 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd92c0b66b0 con 0x7fd93c0718e0 2024-04-23T10:12:27.696 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd93c1f5c70 con 0x7fd93c0718e0 2024-04-23T10:12:27.696 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd93c149c50 con 0x7fd93c0718e0 2024-04-23T10:12:27.696 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.691+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd92c0b6850 con 0x7fd93c0718e0 2024-04-23T10:12:27.696 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.695+0000 7fd9237fe640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 0x7fd92806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:27.696 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.695+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fd92c1207e0 con 0x7fd93c0718e0 2024-04-23T10:12:27.697 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.695+0000 7fd93a59c640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 0x7fd92806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:27.697 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.695+0000 7fd93a59c640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 0x7fd92806a870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd93c14a960 tx=0x7fd930009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:27.700 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.699+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd92c016150 con 0x7fd93c0718e0 2024-04-23T10:12:27.862 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.859+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd93c075df0 con 0x7fd93c0718e0 2024-04-23T10:12:27.864 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9237fe640 1 -- 172.21.15.26:0/1379348085 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7fd92c0f1100 con 0x7fd93c0718e0 2024-04-23T10:12:27.864 INFO:teuthology.misc.health.smithi026.stdout: 2024-04-23T10:12:27.864 INFO:teuthology.misc.health.smithi026.stdout:{"epoch":16,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:23.830133+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:27.866 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 msgr2=0x7fd92806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.866 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 0x7fd92806a870 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fd93c14a960 tx=0x7fd930009040 comp rx=0 tx=0).stop 2024-04-23T10:12:27.866 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 msgr2=0x7fd93c1f2610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:27.866 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fd92c01a100 tx=0x7fd92c019270 comp rx=0 tx=0).stop 2024-04-23T10:12:27.866 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 shutdown_connections 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9280683b0 0x7fd92806a870 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd93c151620 0x7fd93c0cab60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd93c072b20 0x7fd93c146cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 --2- 172.21.15.26:0/1379348085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd93c0718e0 0x7fd93c1f2610 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 >> 172.21.15.26:0/1379348085 conn(0x7fd93c0ccd60 msgr2=0x7fd93c0cd140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 shutdown_connections 2024-04-23T10:12:27.867 INFO:teuthology.misc.health.smithi026.stderr:2024-04-23T10:12:27.863+0000 7fd9410c6640 1 -- 172.21.15.26:0/1379348085 wait complete. 2024-04-23T10:12:27.880 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-23T10:12:27.880 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-23T10:12:27.880 INFO:tasks.ceph.mds.a:Restarting daemon 2024-04-23T10:12:27.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i a 2024-04-23T10:12:27.883 INFO:tasks.ceph.mds.a:Started 2024-04-23T10:12:27.883 INFO:tasks.ceph.mds.c:Restarting daemon 2024-04-23T10:12:27.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i c 2024-04-23T10:12:27.885 INFO:tasks.ceph.mds.c:Started 2024-04-23T10:12:27.885 INFO:tasks.ceph.mds.e:Restarting daemon 2024-04-23T10:12:27.885 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i e 2024-04-23T10:12:27.887 INFO:tasks.ceph.mds.e:Started 2024-04-23T10:12:27.887 INFO:tasks.ceph.mds.b:Restarting daemon 2024-04-23T10:12:27.887 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i b 2024-04-23T10:12:27.890 INFO:tasks.ceph.mds.b:Started 2024-04-23T10:12:27.890 INFO:tasks.ceph.mds.d:Restarting daemon 2024-04-23T10:12:27.890 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i d 2024-04-23T10:12:27.893 INFO:tasks.ceph.mds.d:Started 2024-04-23T10:12:27.893 INFO:tasks.ceph.mds.f:Restarting daemon 2024-04-23T10:12:27.893 DEBUG:teuthology.orchestra.run.smithi190:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mds -f --cluster ceph -i f 2024-04-23T10:12:27.896 INFO:tasks.ceph.mds.f:Started 2024-04-23T10:12:27.896 INFO:tasks.ceph:Setting up CephFS filesystem(s)... 2024-04-23T10:12:27.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:27.955 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2024-04-23T10:12:27.965 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2024-04-23T10:12:27.965 INFO:tasks.ceph.mds.e.smithi026.stdout:starting mds.e at 2024-04-23T10:12:27.971 INFO:tasks.ceph.mds.f.smithi190.stdout:starting mds.f at 2024-04-23T10:12:27.971 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-04-23T10:12:27.972 INFO:tasks.ceph.mds.b.smithi190.stdout:starting mds.b at 2024-04-23T10:12:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 Processor -- start 2024-04-23T10:12:28.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 -- start start 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 0x7f891c0703c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f891c0709e0 con 0x7f891c06d5a0 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f891c15b350 con 0x7f891c0c8340 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8923b8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f891c15bf60 con 0x7f891c06d1c0 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f892212a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f891c06d5a0 0x7f891c154da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59888/0 (socket says 172.21.15.26:59888) 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f892212a640 1 -- 172.21.15.26:0/2450970021 learned_addr learned my addr 172.21.15.26:0/2450970021 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8921929640 1 --2- 172.21.15.26:0/2450970021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 0x7f891c0703c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4091965430 0 0) 0x7f891c0709e0 con 0x7f891c06d5a0 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8908003530 con 0x7f891c06d5a0 2024-04-23T10:12:28.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3313457528 0 0) 0x7f891c15b350 con 0x7f891c0c8340 2024-04-23T10:12:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f891c0709e0 con 0x7f891c0c8340 2024-04-23T10:12:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8921929640 1 -- 172.21.15.26:0/2450970021 >> v1:172.21.15.190:6789/0 conn(0x7f891c0c8340 legacy=0x7f891c15e8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8921929640 1 -- 172.21.15.26:0/2450970021 >> v1:172.21.15.26:6789/0 conn(0x7f891c06d5a0 legacy=0x7f891c154da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1047254809 0 0) 0x7f8908003530 con 0x7f891c06d5a0 2024-04-23T10:12:28.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.007+0000 7f8921929640 1 -- 172.21.15.26:0/2450970021 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c15b630 con 0x7f891c06d1c0 2024-04-23T10:12:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8921929640 1 --2- 172.21.15.26:0/2450970021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 0x7f891c0703c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89180097f0 tx=0x7f891801ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=653a895837356b84 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180b5070 con 0x7f891c06d1c0 2024-04-23T10:12:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180a8670 con 0x7f891c06d1c0 2024-04-23T10:12:28.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8920927640 1 -- 172.21.15.26:0/2450970021 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8914001a00 con 0x7f891c06d1c0 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- 172.21.15.26:0/2450970021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 msgr2=0x7f891c0703c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 --2- 172.21.15.26:0/2450970021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 0x7f891c0703c0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f89180097f0 tx=0x7f891801ebf0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- 172.21.15.26:0/2450970021 shutdown_connections 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 --2- 172.21.15.26:0/2450970021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c06d1c0 0x7f891c0703c0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- 172.21.15.26:0/2450970021 >> 172.21.15.26:0/2450970021 conn(0x7f891c0ca570 msgr2=0x7f891c0ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- 172.21.15.26:0/2450970021 shutdown_connections 2024-04-23T10:12:28.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- 172.21.15.26:0/2450970021 wait complete. 2024-04-23T10:12:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 Processor -- start 2024-04-23T10:12:28.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- start start 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 0x7f891c1f07e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c0c8340 0x7f891c148310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f891c15b000 con 0x7f891c06d1c0 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f891c15bbf0 con 0x7f891c06d5a0 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8923b8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f891c0c9db0 con 0x7f891c0c8340 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8921929640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8921929640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39646/0 (socket says 172.21.15.26:39646) 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8921929640 1 -- 172.21.15.26:0/3456321371 learned_addr learned my addr 172.21.15.26:0/3456321371 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:28.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f892212a640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c0c8340 0x7f891c148310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.011+0000 7f8921128640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 0x7f891c1f07e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 -- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c0c8340 msgr2=0x7f891c148310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c0c8340 0x7f891c148310 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 -- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 msgr2=0x7f891c1f07e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 0x7f891c1f07e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 -- 172.21.15.26:0/3456321371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f891c1f4bb0 con 0x7f891c06d1c0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921128640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 0x7f891c1f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921929640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8918000c10 tx=0x7f891801b990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f89180b5040 con 0x7f891c06d1c0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f89180bf070 con 0x7f891c06d1c0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8918006e20 con 0x7f891c06d1c0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f891c15e2b0 con 0x7f891c06d1c0 2024-04-23T10:12:28.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f891c1f3df0 con 0x7f891c06d1c0 2024-04-23T10:12:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f891c075df0 con 0x7f891c06d1c0 2024-04-23T10:12:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f89180b0840 con 0x7f891c06d1c0 2024-04-23T10:12:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 0x7f890006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f89181238b0 con 0x7f891c06d1c0 2024-04-23T10:12:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921128640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 0x7f890006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.015+0000 7f8921128640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 0x7f890006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f891c156150 tx=0x7f890c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.019+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8918018750 con 0x7f891c06d1c0 2024-04-23T10:12:28.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.179+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f891c154fb0 con 0x7f891c06d1c0 2024-04-23T10:12:28.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f89127fc640 1 -- 172.21.15.26:0/3456321371 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f89180f4120 con 0x7f891c06d1c0 2024-04-23T10:12:28.185 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:28.185 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:23.830133+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 msgr2=0x7f890006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 0x7f890006a840 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f891c156150 tx=0x7f890c009040 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 msgr2=0x7f891c14a730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f8918000c10 tx=0x7f891801b990 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 shutdown_connections 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8900068380 0x7f890006a840 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f891c0c8340 0x7f891c148310 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f891c06d5a0 0x7f891c1f07e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 --2- 172.21.15.26:0/3456321371 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f891c06d1c0 0x7f891c14a730 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 >> 172.21.15.26:0/3456321371 conn(0x7f891c0ca570 msgr2=0x7f891c155220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 shutdown_connections 2024-04-23T10:12:28.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.183+0000 7f8923b8d640 1 -- 172.21.15.26:0/3456321371 wait complete. 2024-04-23T10:12:28.202 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:12:28.203 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:12:28.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 Processor -- start 2024-04-23T10:12:28.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 -- start start 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34e00c9130 0x7f34e00676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f34e006e900 0x7f34e0155030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0155570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f34e00c2920 con 0x7f34e00c9130 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f34e00c2c00 con 0x7f34e006e900 2024-04-23T10:12:28.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.327+0000 7f34e7e46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f34e00c2ee0 con 0x7f34e00c9510 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34e00c9130 0x7f34e00676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f34e00c9130 0x7f34e00676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39650/0 (socket says 172.21.15.26:39650) 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 -- 172.21.15.26:0/2546406244 learned_addr learned my addr 172.21.15.26:0/2546406244 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e63e3640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0155570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e53e1640 1 --2- 172.21.15.26:0/2546406244 >> v2:172.21.15.190:3300/0 conn(0x7f34e006e900 0x7f34e0155030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 -- 172.21.15.26:0/2546406244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 msgr2=0x7f34e0155570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0155570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 -- 172.21.15.26:0/2546406244 >> v2:172.21.15.190:3300/0 conn(0x7f34e006e900 msgr2=0x7f34e0155030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 --2- 172.21.15.26:0/2546406244 >> v2:172.21.15.190:3300/0 conn(0x7f34e006e900 0x7f34e0155030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 -- 172.21.15.26:0/2546406244 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e00c31c0 con 0x7f34e00c9130 2024-04-23T10:12:28.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e5be2640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e00676a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34e0068fd0 tx=0x7f34dc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc1617e9cca2c7d3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e4be0640 1 -- 172.21.15.26:0/2546406244 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0b0070 con 0x7f34e00c9130 2024-04-23T10:12:28.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e4be0640 1 -- 172.21.15.26:0/2546406244 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34dc0ab600 con 0x7f34e00c9130 2024-04-23T10:12:28.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e4be0640 1 -- 172.21.15.26:0/2546406244 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34dc0ab9d0 con 0x7f34e00c9130 2024-04-23T10:12:28.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 -- 172.21.15.26:0/2546406244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 msgr2=0x7f34e00676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e00676a0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f34e0068fd0 tx=0x7f34dc01c520 comp rx=0 tx=0).stop 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 -- 172.21.15.26:0/2546406244 shutdown_connections 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0155570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 --2- 172.21.15.26:0/2546406244 >> v2:172.21.15.190:3300/0 conn(0x7f34e006e900 0x7f34e0155030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 --2- 172.21.15.26:0/2546406244 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e00676a0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 -- 172.21.15.26:0/2546406244 >> 172.21.15.26:0/2546406244 conn(0x7f34e00c9a70 msgr2=0x7f34e00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 -- 172.21.15.26:0/2546406244 shutdown_connections 2024-04-23T10:12:28.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.331+0000 7f34e7e46640 1 -- 172.21.15.26:0/2546406244 wait complete. 2024-04-23T10:12:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 Processor -- start 2024-04-23T10:12:28.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- start start 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e006e900 0x7f34e00cc9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f34e015ea50 con 0x7f34e00c9130 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f34e015e8d0 con 0x7f34e006e900 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f34e015ebd0 con 0x7f34e00c9510 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39666/0 (socket says 172.21.15.26:39666) 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 -- 172.21.15.26:0/4036074464 learned_addr learned my addr 172.21.15.26:0/4036074464 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:28.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e5be2640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e006e900 0x7f34e00cc9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e63e3640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 -- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 msgr2=0x7f34e0158c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 -- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e006e900 msgr2=0x7f34e00cc9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e006e900 0x7f34e00cc9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 -- 172.21.15.26:0/4036074464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f34e015c9a0 con 0x7f34e00c9130 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e53e1640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34d000d800 tx=0x7f34d000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d0004020 con 0x7f34e00c9130 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34d00041c0 con 0x7f34e00c9130 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f34d00043b0 con 0x7f34e00c9130 2024-04-23T10:12:28.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f34e0159160 con 0x7f34e00c9130 2024-04-23T10:12:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f34e015c350 con 0x7f34e00c9130 2024-04-23T10:12:28.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.335+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f34e0075df0 con 0x7f34e00c9130 2024-04-23T10:12:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.339+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f34d001b020 con 0x7f34e00c9130 2024-04-23T10:12:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.339+0000 7f34d67fc640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 0x7f34c406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.339+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f34d00863e0 con 0x7f34e00c9130 2024-04-23T10:12:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.339+0000 7f34e5be2640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 0x7f34c406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.339+0000 7f34e5be2640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 0x7f34c406a870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0ad000 tx=0x7f34dc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.343+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f34d0056d80 con 0x7f34e00c9130 2024-04-23T10:12:28.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.507+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f34e01505a0 con 0x7f34e00c9130 2024-04-23T10:12:28.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34d67fc640 1 -- 172.21.15.26:0/4036074464 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7f34d0056680 con 0x7f34e00c9130 2024-04-23T10:12:28.512 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 msgr2=0x7f34c406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 0x7f34c406a870 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f34dc0ad000 tx=0x7f34dc008040 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 msgr2=0x7f34e01f4a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f34d000d800 tx=0x7f34d000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 shutdown_connections 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f34c40683b0 0x7f34c406a870 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f34e00c9510 0x7f34e0158c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f34e00c9130 0x7f34e01f4a10 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 --2- 172.21.15.26:0/4036074464 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f34e006e900 0x7f34e00cc9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 >> 172.21.15.26:0/4036074464 conn(0x7f34e00c9a70 msgr2=0x7f34e015a770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.515 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 shutdown_connections 2024-04-23T10:12:28.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.511+0000 7f34e7e46640 1 -- 172.21.15.26:0/4036074464 wait complete. 2024-04-23T10:12:28.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:28.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.647+0000 7f76c7db2640 1 Processor -- start 2024-04-23T10:12:28.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.647+0000 7f76c7db2640 1 -- start start 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c7db2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76c0144570 0x7f76c0073990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c7db2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f76c00cee20 0x7f76c015b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c7db2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f76c0144950 con 0x7f76c0073ed0 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c7db2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f76c00cb3c0 con 0x7f76c0144570 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c7db2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f76c00cb6a0 con 0x7f76c00cee20 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76c0144570 0x7f76c0073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f76c0144570 0x7f76c0073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39678/0 (socket says 172.21.15.26:39678) 2024-04-23T10:12:28.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 -- 172.21.15.26:0/3285077242 learned_addr learned my addr 172.21.15.26:0/3285077242 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:28.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c634f640 1 --2- 172.21.15.26:0/3285077242 >> v2:172.21.15.190:3300/0 conn(0x7f76c00cee20 0x7f76c015b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 -- 172.21.15.26:0/3285077242 >> v2:172.21.15.190:3300/0 conn(0x7f76c00cee20 msgr2=0x7f76c015b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:28.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 --2- 172.21.15.26:0/3285077242 >> v2:172.21.15.190:3300/0 conn(0x7f76c00cee20 0x7f76c015b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 -- 172.21.15.26:0/3285077242 >> v1:172.21.15.190:6789/0 conn(0x7f76c0073ed0 legacy=0x7f76c00ce710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 -- 172.21.15.26:0/3285077242 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00cb980 con 0x7f76c0144570 2024-04-23T10:12:28.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c5b4e640 1 --2- 172.21.15.26:0/3285077242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0073990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76c00c9230 tx=0x7f76bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d2627e573746594 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c4b4c640 1 -- 172.21.15.26:0/3285077242 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0ab610 con 0x7f76c0144570 2024-04-23T10:12:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c4b4c640 1 -- 172.21.15.26:0/3285077242 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76bc0b0070 con 0x7f76c0144570 2024-04-23T10:12:28.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.651+0000 7f76c4b4c640 1 -- 172.21.15.26:0/3285077242 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76bc0ab9d0 con 0x7f76c0144570 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/3285077242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 msgr2=0x7f76c0073990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- 172.21.15.26:0/3285077242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0073990 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f76c00c9230 tx=0x7f76bc01c520 comp rx=0 tx=0).stop 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/3285077242 shutdown_connections 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- 172.21.15.26:0/3285077242 >> v2:172.21.15.190:3300/0 conn(0x7f76c00cee20 0x7f76c015b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- 172.21.15.26:0/3285077242 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0073990 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/3285077242 >> 172.21.15.26:0/3285077242 conn(0x7f76c0070ee0 msgr2=0x7f76c00712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/3285077242 shutdown_connections 2024-04-23T10:12:28.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/3285077242 wait complete. 2024-04-23T10:12:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 Processor -- start 2024-04-23T10:12:28.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- start start 2024-04-23T10:12:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76c0073ed0 0x7f76c00cc670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 0x7f76c0137da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f76c006d830 con 0x7f76c0144570 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f76c006d6b0 con 0x7f76c00cee20 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f76c0168370 con 0x7f76c0073ed0 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39682/0 (socket says 172.21.15.26:39682) 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 -- 172.21.15.26:0/641038107 learned_addr learned my addr 172.21.15.26:0/641038107 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c5b4e640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76c0073ed0 0x7f76c00cc670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c534d640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 0x7f76c0137da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 -- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76c0073ed0 msgr2=0x7f76c00cc670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76c0073ed0 0x7f76c00cc670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 -- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 msgr2=0x7f76c0137da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 0x7f76c0137da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 -- 172.21.15.26:0/641038107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f76c00cd6e0 con 0x7f76c0144570 2024-04-23T10:12:28.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c534d640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 0x7f76c0137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c634f640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76b8007e60 tx=0x7f76b800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8014620 con 0x7f76c0144570 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f76b8019070 con 0x7f76c0144570 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f76c00ccbb0 con 0x7f76c0144570 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f76b8014a00 con 0x7f76c0144570 2024-04-23T10:12:28.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.655+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f76c00cce40 con 0x7f76c0144570 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f76c0075df0 con 0x7f76c0144570 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f76b8014ba0 con 0x7f76c0144570 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76b67fc640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 0x7f76a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f76b8086f70 con 0x7f76c0144570 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76c5b4e640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 0x7f76a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:28.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.659+0000 7f76c5b4e640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 0x7f76a406a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0af000 tx=0x7f76bc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:28.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.663+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f76b8011260 con 0x7f76c0144570 2024-04-23T10:12:28.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.851+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f76c00c9290 con 0x7f76c0144570 2024-04-23T10:12:28.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76b67fc640 1 -- 172.21.15.26:0/641038107 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 2 v2) ==== 93+0+1392 (secure 0 0 0) 0x7f76b8057880 con 0x7f76c0144570 2024-04-23T10:12:28.856 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:28.856 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":2,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[]} 2024-04-23T10:12:28.857 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 2 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 msgr2=0x7f76a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 0x7f76a406a840 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7f76bc0af000 tx=0x7f76bc008040 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 msgr2=0x7f76c0140d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f76b8007e60 tx=0x7f76b800e4b0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 shutdown_connections 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f76a4068380 0x7f76a406a840 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f76c0144570 0x7f76c0140d10 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f76c00cee20 0x7f76c0137da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 --2- 172.21.15.26:0/641038107 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f76c0073ed0 0x7f76c00cc670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 >> 172.21.15.26:0/641038107 conn(0x7f76c0070ee0 msgr2=0x7f76c015a700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:28.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 shutdown_connections 2024-04-23T10:12:28.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:28.855+0000 7f76c7db2640 1 -- 172.21.15.26:0/641038107 wait complete. 2024-04-23T10:12:30.875 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:31.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 Processor -- start 2024-04-23T10:12:31.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 -- start start 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6288155300 0x7f62880c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 0x7f62880c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f62880c4e80 con 0x7f628806f700 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f62880c4230 con 0x7f6288155300 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f628d3ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f62880c5770 con 0x7f628815ee20 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f62867fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f628806f700 0x7f628815e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59892/0 (socket says 172.21.15.26:59892) 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.006+0000 7f62867fc640 1 -- 172.21.15.26:0/1068935827 learned_addr learned my addr 172.21.15.26:0/1068935827 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62877fe640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 0x7f62880c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6286ffd640 1 --2- 172.21.15.26:0/1068935827 >> v2:172.21.15.190:3300/0 conn(0x7f6288155300 0x7f62880c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 573699095 0 0) 0x7f62880c4e80 con 0x7f628806f700 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6274003530 con 0x7f628806f700 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3548129082 0 0) 0x7f6274003530 con 0x7f628806f700 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 msgr2=0x7f62880c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 0x7f62880c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 >> v2:172.21.15.190:3300/0 conn(0x7f6288155300 msgr2=0x7f62880c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 --2- 172.21.15.26:0/1068935827 >> v2:172.21.15.190:3300/0 conn(0x7f6288155300 0x7f62880c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f628815f320 con 0x7f628806f700 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f6270001680 con 0x7f628806f700 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 >> v1:172.21.15.26:6789/0 conn(0x7f628806f700 legacy=0x7f628815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62740039c0 0x7f6274003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6274004810 0x7f6274004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 0x7f62740051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f62880c4230 con 0x7f6274004810 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62880c5770 con 0x7f62740039c0 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f627400b9d0 con 0x7f628815ee20 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6274004810 0x7f6274004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6286ffd640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62740039c0 0x7f6274003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 -- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 msgr2=0x7f62740051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f628815ee20 0x7f62740051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 -- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62740039c0 msgr2=0x7f6274003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62740039c0 0x7f6274003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 -- 172.21.15.26:0/1068935827 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6274003530 con 0x7f6274004810 2024-04-23T10:12:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6286ffd640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f62740039c0 0x7f6274003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f62867fc640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6274004810 0x7f6274004c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6270001060 tx=0x7f627001f410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ef4d323ead0a492a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270007d80 con 0x7f6274004810 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6270005b00 con 0x7f6274004810 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.010+0000 7f6285ffb640 1 -- 172.21.15.26:0/1068935827 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6270007070 con 0x7f6274004810 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- 172.21.15.26:0/1068935827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6274004810 msgr2=0x7f6274004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 --2- 172.21.15.26:0/1068935827 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6274004810 0x7f6274004c90 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7f6270001060 tx=0x7f627001f410 comp rx=0 tx=0).stop 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 -- 172.21.15.26:0/1068935827 reap_dead start 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- 172.21.15.26:0/1068935827 shutdown_connections 2024-04-23T10:12:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- 172.21.15.26:0/1068935827 >> 172.21.15.26:0/1068935827 conn(0x7f628806b9d0 msgr2=0x7f628806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- 172.21.15.26:0/1068935827 shutdown_connections 2024-04-23T10:12:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- 172.21.15.26:0/1068935827 wait complete. 2024-04-23T10:12:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 Processor -- start 2024-04-23T10:12:31.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- start start 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6274004810 0x7f6288155a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 0x7f6288153c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f628815f600 con 0x7f62881581d0 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f62880c5400 con 0x7f6274004810 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f628d3ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f62880681d0 con 0x7f62881537d0 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39710/0 (socket says 172.21.15.26:39710) 2024-04-23T10:12:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 -- 172.21.15.26:0/3552991841 learned_addr learned my addr 172.21.15.26:0/3552991841 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f6286ffd640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6274004810 0x7f6288155a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62867fc640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 0x7f6288153c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 -- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 msgr2=0x7f6288153c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 0x7f6288153c30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 -- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6274004810 msgr2=0x7f6288155a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6274004810 0x7f6288155a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 -- 172.21.15.26:0/3552991841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f62881f0c60 con 0x7f62881581d0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62867fc640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 0x7f6288153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.014+0000 7f62877fe640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62880c3a90 tx=0x7f627800ec00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800c6b0 con 0x7f62881581d0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f627801a070 con 0x7f62881581d0 2024-04-23T10:12:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f627800cab0 con 0x7f62881581d0 2024-04-23T10:12:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f62881576f0 con 0x7f62881581d0 2024-04-23T10:12:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f628815e190 con 0x7f62881581d0 2024-04-23T10:12:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6288153130 con 0x7f62881581d0 2024-04-23T10:12:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f627800cc50 con 0x7f62881581d0 2024-04-23T10:12:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 0x7f626806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f62780861e0 con 0x7f62881581d0 2024-04-23T10:12:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f6286ffd640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 0x7f626806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.018+0000 7f6286ffd640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 0x7f626806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6280003bf0 tx=0x7f628000b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.022+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6278024020 con 0x7f62881581d0 2024-04-23T10:12:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.218+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f62881574e0 con 0x7f62881581d0 2024-04-23T10:12:31.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f627f7fe640 1 -- 172.21.15.26:0/3552991841 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 3 v3) ==== 93+0+5518 (secure 0 0 0) 0x7f6278056af0 con 0x7f62881581d0 2024-04-23T10:12:31.224 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:31.224 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":3,"default_fscid":-1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2},{"gid":4287,"name":"f","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[]} 2024-04-23T10:12:31.225 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 3 2024-04-23T10:12:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 msgr2=0x7f626806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 0x7f626806a840 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f6280003bf0 tx=0x7f628000b040 comp rx=0 tx=0).stop 2024-04-23T10:12:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 msgr2=0x7f6288158650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7f62880c3a90 tx=0x7f627800ec00 comp rx=0 tx=0).stop 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 shutdown_connections 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6268068380 0x7f626806a840 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f62881581d0 0x7f6288158650 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f62881537d0 0x7f6288153c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 --2- 172.21.15.26:0/3552991841 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6274004810 0x7f6288155a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 >> 172.21.15.26:0/3552991841 conn(0x7f628806b9d0 msgr2=0x7f62880c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 shutdown_connections 2024-04-23T10:12:31.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.222+0000 7f628d3ed640 1 -- 172.21.15.26:0/3552991841 wait complete. 2024-04-23T10:12:31.242 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:31.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 Processor -- start 2024-04-23T10:12:31.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 -- start start 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f478c0c8250 0x7f478c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f478c15b740 con 0x7f478c0c8a70 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f478c0c6490 con 0x7f478c0c8250 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4793f2f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f478c0c58c0 con 0x7f478c0c8630 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f478c0c8250 0x7f478c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f478c0c8250 0x7f478c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39728/0 (socket says 172.21.15.26:39728) 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 -- 172.21.15.26:0/2287871287 learned_addr learned my addr 172.21.15.26:0/2287871287 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f47914ca640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 -- 172.21.15.26:0/2287871287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 msgr2=0x7f478c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 -- 172.21.15.26:0/2287871287 >> v1:172.21.15.190:6789/0 conn(0x7f478c0c8a70 legacy=0x7f478c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.362+0000 7f4791ccb640 1 -- 172.21.15.26:0/2287871287 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c0c5b60 con 0x7f478c0c8250 2024-04-23T10:12:31.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8250 0x7f478c0c39e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47880098a0 tx=0x7f478801c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af252210a12d0b1d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4790cc9640 1 -- 172.21.15.26:0/2287871287 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47880b0070 con 0x7f478c0c8250 2024-04-23T10:12:31.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4790cc9640 1 -- 172.21.15.26:0/2287871287 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47880ab600 con 0x7f478c0c8250 2024-04-23T10:12:31.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4790cc9640 1 -- 172.21.15.26:0/2287871287 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f47880ab9d0 con 0x7f478c0c8250 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 -- 172.21.15.26:0/2287871287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8250 msgr2=0x7f478c0c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8250 0x7f478c0c39e0 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f47880098a0 tx=0x7f478801c470 comp rx=0 tx=0).stop 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 -- 172.21.15.26:0/2287871287 shutdown_connections 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2287871287 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8250 0x7f478c0c39e0 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 -- 172.21.15.26:0/2287871287 >> 172.21.15.26:0/2287871287 conn(0x7f478c06b9d0 msgr2=0x7f478c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 -- 172.21.15.26:0/2287871287 shutdown_connections 2024-04-23T10:12:31.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.366+0000 7f4793f2f640 1 -- 172.21.15.26:0/2287871287 wait complete. 2024-04-23T10:12:31.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 Processor -- start 2024-04-23T10:12:31.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- start start 2024-04-23T10:12:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 0x7f478c0cbc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c160960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f478c0c6920 con 0x7f478c0c8a70 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f478c15b400 con 0x7f478c0c8250 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f478c0681d0 con 0x7f478c0c8630 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39730/0 (socket says 172.21.15.26:39730) 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 -- 172.21.15.26:0/2444063139 learned_addr learned my addr 172.21.15.26:0/2444063139 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47914ca640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c160960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 0x7f478c0cbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 -- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 msgr2=0x7f478c160960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c160960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 -- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 msgr2=0x7f478c0cbc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 0x7f478c0cbc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 -- 172.21.15.26:0/2444063139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f478c073ce0 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 0x7f478c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47924cc640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f478400c7b0 tx=0x7f478400cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4784004b70 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4784004d10 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f478c154d60 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f478400aa90 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f478c152ae0 con 0x7f478c0c8a70 2024-04-23T10:12:31.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f478c075df0 con 0x7f478c0c8a70 2024-04-23T10:12:31.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f478400ac30 con 0x7f478c0c8a70 2024-04-23T10:12:31.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 0x7f477006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.370+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7f4784086c60 con 0x7f478c0c8a70 2024-04-23T10:12:31.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.374+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 0x7f477006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.374+0000 7f4791ccb640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 0x7f477006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47880ad000 tx=0x7f4788008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.378+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f47840574e0 con 0x7f478c0c8a70 2024-04-23T10:12:31.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f478c160610 con 0x7f478c0c8a70 2024-04-23T10:12:31.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f47827fc640 1 -- 172.21.15.26:0/2444063139 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v16) ==== 74+0+12872 (secure 0 0 0) 0x7f4784056de0 con 0x7f478c0c8a70 2024-04-23T10:12:31.545 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:31.546 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":16,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:23.830133+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 msgr2=0x7f477006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 0x7f477006a840 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f47880ad000 tx=0x7f4788008040 comp rx=0 tx=0).stop 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 msgr2=0x7f478c142d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f478400c7b0 tx=0x7f478400cc70 comp rx=0 tx=0).stop 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 shutdown_connections 2024-04-23T10:12:31.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4770068380 0x7f477006a840 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f478c0c8a70 0x7f478c142d00 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f478c0c8630 0x7f478c160960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 --2- 172.21.15.26:0/2444063139 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f478c0c8250 0x7f478c0cbc30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.542+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 >> 172.21.15.26:0/2444063139 conn(0x7f478c06b9d0 msgr2=0x7f478c0c7770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.546+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 shutdown_connections 2024-04-23T10:12:31.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.546+0000 7f4793f2f640 1 -- 172.21.15.26:0/2444063139 wait complete. 2024-04-23T10:12:31.565 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-04-23T10:12:31.565 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:12:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 Processor -- start 2024-04-23T10:12:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 -- start start 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa3b006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b00c5d70 con 0x7fa3b0074100 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3b00c6050 con 0x7fa3b014ffa0 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b833a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b00c6330 con 0x7fa3b014fbc0 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b68d7640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa3b0074100 0x7fa3b00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59904/0 (socket says 172.21.15.26:59904) 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b68d7640 1 -- 172.21.15.26:0/2822773007 learned_addr learned my addr 172.21.15.26:0/2822773007 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa3b006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1853847960 0 0) 0x7fa3b00c5d70 con 0x7fa3b0074100 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa39c003530 con 0x7fa3b0074100 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2556660005 0 0) 0x7fa39c003530 con 0x7fa3b0074100 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 msgr2=0x7fa3b006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa3b006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 >> v1:172.21.15.190:6789/0 conn(0x7fa3b014ffa0 legacy=0x7fa3b00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b00c6610 con 0x7fa3b0074100 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fa3a8001a00 con 0x7fa3b0074100 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 >> v1:172.21.15.26:6789/0 conn(0x7fa3b0074100 legacy=0x7fa3b00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa39c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa39c004810 0x7fa39c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa39c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b00c6330 con 0x7fa39c0039f0 2024-04-23T10:12:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa39c00ba80 con 0x7fa39c004810 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa39c00bc80 con 0x7fa3b014fbc0 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa39c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b58d5640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa39c004810 0x7fa39c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b68d7640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa39c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 -- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 msgr2=0x7fa39c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b014fbc0 0x7fa39c0051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 -- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa39c004810 msgr2=0x7fa39c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa39c004810 0x7fa39c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b60d6640 1 -- 172.21.15.26:0/2822773007 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa39c003530 con 0x7fa39c0039f0 2024-04-23T10:12:31.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.682+0000 7fa3b58d5640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa39c004810 0x7fa39c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa39c003e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009ab0 tx=0x7fa3ac01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d8b940e3749575 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0b2070 con 0x7fa39c0039f0 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0a5620 con 0x7fa39c0039f0 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b50d4640 1 -- 172.21.15.26:0/2822773007 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0096b0 con 0x7fa39c0039f0 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- 172.21.15.26:0/2822773007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 msgr2=0x7fa39c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 --2- 172.21.15.26:0/2822773007 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa39c003e10 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac009ab0 tx=0x7fa3ac01ca30 comp rx=0 tx=0).stop 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b68d7640 1 -- 172.21.15.26:0/2822773007 reap_dead start 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- 172.21.15.26:0/2822773007 shutdown_connections 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- 172.21.15.26:0/2822773007 >> 172.21.15.26:0/2822773007 conn(0x7fa3b006b9d0 msgr2=0x7fa3b006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- 172.21.15.26:0/2822773007 shutdown_connections 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- 172.21.15.26:0/2822773007 wait complete. 2024-04-23T10:12:31.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 Processor -- start 2024-04-23T10:12:31.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- start start 2024-04-23T10:12:31.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b0142a30 0x7fa3b01448b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b00c8220 0x7fa3b00c41e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b0165090 con 0x7fa39c0039f0 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa3b006fb10 con 0x7fa3b00c8220 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.686+0000 7fa3b833a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa3b0165210 con 0x7fa3b0142a30 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39752/0 (socket says 172.21.15.26:39752) 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 -- 172.21.15.26:0/1893274335 learned_addr learned my addr 172.21.15.26:0/1893274335 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 -- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b0142a30 msgr2=0x7fa3b01448b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b58d5640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b0142a30 0x7fa3b01448b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b68d7640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b00c8220 0x7fa3b00c41e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b0142a30 0x7fa3b01448b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 -- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b00c8220 msgr2=0x7fa3b00c41e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b00c8220 0x7fa3b00c41e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 -- 172.21.15.26:0/1893274335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3b00c8760 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b60d6640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac01c860 tx=0x7fa39c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac0b2040 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3ac0a5e50 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3b0143610 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa3ac004220 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3b015a4a0 con 0x7fa39c0039f0 2024-04-23T10:12:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3b0075df0 con 0x7fa39c0039f0 2024-04-23T10:12:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa3ac0c0060 con 0x7fa39c0039f0 2024-04-23T10:12:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 0x7fa39406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fa3ac11fe30 con 0x7fa39c0039f0 2024-04-23T10:12:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b58d5640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 0x7fa39406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:31.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.690+0000 7fa3b58d5640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 0x7fa39406a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3b014e610 tx=0x7fa3a0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:31.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.694+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa3ac016740 con 0x7fa39c0039f0 2024-04-23T10:12:31.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fa3b014c3c0 con 0x7fa39c0039f0 2024-04-23T10:12:31.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3a6ffd640 1 -- 172.21.15.26:0/1893274335 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v16) ==== 93+0+10 (secure 0 0 0) 0x7fa3ac0f0940 con 0x7fa39c0039f0 2024-04-23T10:12:31.861 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 msgr2=0x7fa39406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 0x7fa39406a870 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7fa3b014e610 tx=0x7fa3a0009040 comp rx=0 tx=0).stop 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 msgr2=0x7fa3b015b330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7fa3ac01c860 tx=0x7fa39c005840 comp rx=0 tx=0).stop 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 shutdown_connections 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa3940683b0 0x7fa39406a870 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa3b00c8220 0x7fa3b00c41e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa3b0142a30 0x7fa3b01448b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 --2- 172.21.15.26:0/1893274335 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa39c0039f0 0x7fa3b015b330 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:31.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.858+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 >> 172.21.15.26:0/1893274335 conn(0x7fa3b006b9d0 msgr2=0x7fa3b014bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:31.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.862+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 shutdown_connections 2024-04-23T10:12:31.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.862+0000 7fa3b833a640 1 -- 172.21.15.26:0/1893274335 wait complete. 2024-04-23T10:12:31.881 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph --format=json-pretty osd lspools 2024-04-23T10:12:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 Processor -- start 2024-04-23T10:12:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 -- start start 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb61c0c5f20 0x7fb61c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c6300 0x7fb61c152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb61c0ca960 con 0x7fb61c0c9c10 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb61c0c7f30 con 0x7fb61c0c5f20 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb623e2c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c0ca0c0 con 0x7fb61c0c6300 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb6213c7640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb61c0c9c10 0x7fb61c0c91c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50324/0 (socket says 172.21.15.26:50324) 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb6213c7640 1 -- 172.21.15.26:0/954908284 learned_addr learned my addr 172.21.15.26:0/954908284 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb621bc8640 1 --2- 172.21.15.26:0/954908284 >> v2:172.21.15.26:3300/0 conn(0x7fb61c0c5f20 0x7fb61c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb6223c9640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c6300 0x7fb61c152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb621bc8640 1 -- 172.21.15.26:0/954908284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c6300 msgr2=0x7fb61c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb621bc8640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c6300 0x7fb61c152c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb621bc8640 1 -- 172.21.15.26:0/954908284 >> v1:172.21.15.26:6789/0 conn(0x7fb61c0c9c10 legacy=0x7fb61c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb620bc6640 1 -- 172.21.15.26:0/954908284 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1783858412 0 0) 0x7fb61c0ca960 con 0x7fb61c0c9c10 2024-04-23T10:12:32.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:31.998+0000 7fb621bc8640 1 -- 172.21.15.26:0/954908284 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c0ca3a0 con 0x7fb61c0c5f20 2024-04-23T10:12:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb621bc8640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c5f20 0x7fb61c0c86f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097c0 tx=0x7fb61801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6df0d886066ce1c0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb620bc6640 1 -- 172.21.15.26:0/954908284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6180b5070 con 0x7fb61c0c5f20 2024-04-23T10:12:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb620bc6640 1 -- 172.21.15.26:0/954908284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb6180a8990 con 0x7fb61c0c5f20 2024-04-23T10:12:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb620bc6640 1 -- 172.21.15.26:0/954908284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb6180a8d60 con 0x7fb61c0c5f20 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- 172.21.15.26:0/954908284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c5f20 msgr2=0x7fb61c0c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c5f20 0x7fb61c0c86f0 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fb6180097c0 tx=0x7fb61801ec90 comp rx=0 tx=0).stop 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- 172.21.15.26:0/954908284 shutdown_connections 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c6300 0x7fb61c152c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- 172.21.15.26:0/954908284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c5f20 0x7fb61c0c86f0 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- 172.21.15.26:0/954908284 >> 172.21.15.26:0/954908284 conn(0x7fb61c0676a0 msgr2=0x7fb61c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- 172.21.15.26:0/954908284 shutdown_connections 2024-04-23T10:12:32.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- 172.21.15.26:0/954908284 wait complete. 2024-04-23T10:12:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 Processor -- start 2024-04-23T10:12:32.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- start start 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 0x7fb61c1ee730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c9c10 0x7fb61c14ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0c98d0 con 0x7fb61c0c6300 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb61c0c81d0 con 0x7fb61c0c5f20 2024-04-23T10:12:32.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb623e2c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb61c0c8c30 con 0x7fb61c0c9c10 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb6213c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb6213c7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51548/0 (socket says 172.21.15.26:51548) 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb6213c7640 1 -- 172.21.15.26:0/1388829842 learned_addr learned my addr 172.21.15.26:0/1388829842 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb6223c9640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c9c10 0x7fb61c14ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.002+0000 7fb621bc8640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 0x7fb61c1ee730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 -- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c9c10 msgr2=0x7fb61c14ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c9c10 0x7fb61c14ecb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 -- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 msgr2=0x7fb61c1ee730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 0x7fb61c1ee730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 -- 172.21.15.26:0/1388829842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb61c1eee50 con 0x7fb61c0c6300 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb621bc8640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 0x7fb61c1ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6213c7640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00c440 tx=0x7fb60c00c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c0074e0 con 0x7fb61c0c6300 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb60c0047f0 con 0x7fb61c0c6300 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb61c1ef130 con 0x7fb61c0c6300 2024-04-23T10:12:32.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb60c007680 con 0x7fb61c0c6300 2024-04-23T10:12:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb61c15bda0 con 0x7fb61c0c6300 2024-04-23T10:12:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb61c1ef650 con 0x7fb61c0c6300 2024-04-23T10:12:32.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb60c011070 con 0x7fb61c0c6300 2024-04-23T10:12:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 0x7fb60006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7fb60c086190 con 0x7fb61c0c6300 2024-04-23T10:12:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb621bc8640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 0x7fb60006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.006+0000 7fb621bc8640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 0x7fb60006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6180b2000 tx=0x7fb6180aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.010+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb61c1ef650 con 0x7fb61c0c6300 2024-04-23T10:12:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.174+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd lspools", "format": "json-pretty"} v 0) -- 0x7fb61c075df0 con 0x7fb61c0c6300 2024-04-23T10:12:32.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.174+0000 7fb6127fc640 1 -- 172.21.15.26:0/1388829842 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd lspools", "format": "json-pretty"}]=0 v16) ==== 84+0+65 (secure 0 0 0) 0x7fb60c056b30 con 0x7fb61c0c6300 2024-04-23T10:12:32.178 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout:[ 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout: { 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout: "poolnum": 1, 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout: "poolname": ".mgr" 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:12:32.179 INFO:teuthology.orchestra.run.smithi026.stdout:] 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 msgr2=0x7fb60006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 0x7fb60006a840 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7fb6180b2000 tx=0x7fb6180aa070 comp rx=0 tx=0).stop 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 msgr2=0x7fb61c14df30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7fb60c00c440 tx=0x7fb60c00c900 comp rx=0 tx=0).stop 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 shutdown_connections 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb600068380 0x7fb60006a840 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb61c0c9c10 0x7fb61c14ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb61c0c6300 0x7fb61c14df30 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 --2- 172.21.15.26:0/1388829842 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb61c0c5f20 0x7fb61c1ee730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 >> 172.21.15.26:0/1388829842 conn(0x7fb61c0676a0 msgr2=0x7fb61c0cced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 shutdown_connections 2024-04-23T10:12:32.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.178+0000 7fb623e2c640 1 -- 172.21.15.26:0/1388829842 wait complete. 2024-04-23T10:12:32.197 DEBUG:tasks.cephfs.filesystem:Creating filesystem 'cephfs' 2024-04-23T10:12:32.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_metadata --pg_num_min 64 2024-04-23T10:12:32.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 Processor -- start 2024-04-23T10:12:32.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 -- start start 2024-04-23T10:12:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb380c5fa0 0x7feb3815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb3815d340 0x7feb38152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb380c6380 0x7feb38153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7feb38153770 con 0x7feb380c6380 2024-04-23T10:12:32.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7feb380c8890 con 0x7feb3815d340 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3e6fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb3815c970 con 0x7feb380c5fa0 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb380c6380 0x7feb38153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7feb380c6380 0x7feb38153230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51552/0 (socket says 172.21.15.26:51552) 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 -- 172.21.15.26:0/788161249 learned_addr learned my addr 172.21.15.26:0/788161249 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb2ffff640 1 --2- 172.21.15.26:0/788161249 >> v2:172.21.15.190:3300/0 conn(0x7feb3815d340 0x7feb38152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb37fff640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb380c5fa0 0x7feb3815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 -- 172.21.15.26:0/788161249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb380c5fa0 msgr2=0x7feb3815ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb380c5fa0 0x7feb3815ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 -- 172.21.15.26:0/788161249 >> v2:172.21.15.190:3300/0 conn(0x7feb3815d340 msgr2=0x7feb38152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 --2- 172.21.15.26:0/788161249 >> v2:172.21.15.190:3300/0 conn(0x7feb3815d340 0x7feb38152cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.318+0000 7feb3cc97640 1 -- 172.21.15.26:0/788161249 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb3806ce60 con 0x7feb380c6380 2024-04-23T10:12:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3cc97640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb38153230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb380758d0 tx=0x7feb3001c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f2c525e90f782a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb377fe640 1 -- 172.21.15.26:0/788161249 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb300a5720 con 0x7feb380c6380 2024-04-23T10:12:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb377fe640 1 -- 172.21.15.26:0/788161249 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb300a58c0 con 0x7feb380c6380 2024-04-23T10:12:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb377fe640 1 -- 172.21.15.26:0/788161249 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb300a5c90 con 0x7feb380c6380 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 -- 172.21.15.26:0/788161249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 msgr2=0x7feb38153230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb38153230 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7feb380758d0 tx=0x7feb3001c8a0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 -- 172.21.15.26:0/788161249 shutdown_connections 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb38153230 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/788161249 >> v2:172.21.15.190:3300/0 conn(0x7feb3815d340 0x7feb38152cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/788161249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb380c5fa0 0x7feb3815ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 -- 172.21.15.26:0/788161249 >> 172.21.15.26:0/788161249 conn(0x7feb380c9130 msgr2=0x7feb380c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 -- 172.21.15.26:0/788161249 shutdown_connections 2024-04-23T10:12:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.322+0000 7feb3e6fa640 1 -- 172.21.15.26:0/788161249 wait complete. 2024-04-23T10:12:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 Processor -- start 2024-04-23T10:12:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- start start 2024-04-23T10:12:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb380c5fa0 0x7feb3814c030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb3815d340 0x7feb3814f190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feb3806ca90 con 0x7feb380c6380 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb38159010 con 0x7feb380c5fa0 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb3806cc10 con 0x7feb3815d340 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51560/0 (socket says 172.21.15.26:51560) 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 -- 172.21.15.26:0/1533857816 learned_addr learned my addr 172.21.15.26:0/1533857816 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb37fff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb380c5fa0 0x7feb3814c030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3cc97640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb3815d340 0x7feb3814f190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 -- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb3815d340 msgr2=0x7feb3814f190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb3815d340 0x7feb3814f190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 -- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb380c5fa0 msgr2=0x7feb3814c030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb380c5fa0 0x7feb3814c030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 -- 172.21.15.26:0/1533857816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb38157b70 con 0x7feb380c6380 2024-04-23T10:12:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb2ffff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d7d0 tx=0x7feb2000dc90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2000b6c0 con 0x7feb380c6380 2024-04-23T10:12:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb3815bfa0 con 0x7feb380c6380 2024-04-23T10:12:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb20019070 con 0x7feb380c6380 2024-04-23T10:12:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb2000ba80 con 0x7feb380c6380 2024-04-23T10:12:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb38157880 con 0x7feb380c6380 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb38146f20 con 0x7feb380c6380 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.326+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb2000bc20 con 0x7feb380c6380 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.330+0000 7feb357fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 0x7feb1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.330+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 4857+0+0 (secure 0 0 0) 0x7feb20086b60 con 0x7feb380c6380 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.330+0000 7feb37fff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 0x7feb1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.330+0000 7feb37fff640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 0x7feb1806a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb2800ba30 tx=0x7feb28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.334+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb200573e0 con 0x7feb380c6380 2024-04-23T10:12:32.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.490+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64} v 0) -- 0x7feb38075e60 con 0x7feb380c6380 2024-04-23T10:12:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.986+0000 7feb357fa640 1 -- 172.21.15.26:0/1533857816 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_metadata", "pg_num_min": 64}]=0 pool 'cephfs_metadata' created v17) ==== 138+0+0 (secure 0 0 0) 0x7feb20056ce0 con 0x7feb380c6380 2024-04-23T10:12:32.991 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' created 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 msgr2=0x7feb1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 0x7feb1806a840 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7feb2800ba30 tx=0x7feb28008040 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 msgr2=0x7feb381453f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7feb2000d7d0 tx=0x7feb2000dc90 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 shutdown_connections 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb18068380 0x7feb1806a840 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb3815d340 0x7feb3814f190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb380c6380 0x7feb381453f0 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 --2- 172.21.15.26:0/1533857816 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb380c5fa0 0x7feb3814c030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:32.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 >> 172.21.15.26:0/1533857816 conn(0x7feb380c9130 msgr2=0x7feb381508e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 shutdown_connections 2024-04-23T10:12:32.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:32.990+0000 7feb3e6fa640 1 -- 172.21.15.26:0/1533857816 wait complete. 2024-04-23T10:12:33.023 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data 64 --pg_num_min 64 --target_size_ratio 0.05 2024-04-23T10:12:33.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.154+0000 7fe2a52f6640 1 Processor -- start 2024-04-23T10:12:33.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.154+0000 7fe2a52f6640 1 -- start start 2024-04-23T10:12:33.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe2a52f6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe2a52f6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2a00c8630 0x7fe2a0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe2a52f6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe2a015b740 con 0x7fe2a00c8a70 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe2a52f6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe2a00c6490 con 0x7fe2a00c8630 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe2a52f6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a00c58c0 con 0x7fe2a00c8250 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29e7fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe2a00c8630 0x7fe2a0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29f7fe640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe2a00c8a70 0x7fe2a0152080 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:37192/0 (socket says 172.21.15.26:37192) 2024-04-23T10:12:33.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29f7fe640 1 -- 172.21.15.26:0/1566716787 learned_addr learned my addr 172.21.15.26:0/1566716787 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29effd640 1 -- 172.21.15.26:0/1566716787 >> v2:172.21.15.190:3300/0 conn(0x7fe2a00c8630 msgr2=0x7fe2a0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29effd640 1 --2- 172.21.15.26:0/1566716787 >> v2:172.21.15.190:3300/0 conn(0x7fe2a00c8630 0x7fe2a0151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29effd640 1 -- 172.21.15.26:0/1566716787 >> v1:172.21.15.190:6789/0 conn(0x7fe2a00c8a70 legacy=0x7fe2a0152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:33.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.158+0000 7fe29effd640 1 -- 172.21.15.26:0/1566716787 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a00c5b60 con 0x7fe2a00c8250 2024-04-23T10:12:33.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe29effd640 1 --2- 172.21.15.26:0/1566716787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a00c39e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097f0 tx=0x7fe29001c410 comp rx=0 tx=0).ready entity=mon.2 client_cookie=178a3d5e0b5d30f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe29dffb640 1 -- 172.21.15.26:0/1566716787 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900b0070 con 0x7fe2a00c8250 2024-04-23T10:12:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe29dffb640 1 -- 172.21.15.26:0/1566716787 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe2900ab600 con 0x7fe2a00c8250 2024-04-23T10:12:33.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe29dffb640 1 -- 172.21.15.26:0/1566716787 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe2900ab9d0 con 0x7fe2a00c8250 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- 172.21.15.26:0/1566716787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 msgr2=0x7fe2a00c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/1566716787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a00c39e0 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7fe2900097f0 tx=0x7fe29001c410 comp rx=0 tx=0).stop 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- 172.21.15.26:0/1566716787 shutdown_connections 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/1566716787 >> v2:172.21.15.190:3300/0 conn(0x7fe2a00c8630 0x7fe2a0151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/1566716787 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a00c39e0 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- 172.21.15.26:0/1566716787 >> 172.21.15.26:0/1566716787 conn(0x7fe2a006b9d0 msgr2=0x7fe2a006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- 172.21.15.26:0/1566716787 shutdown_connections 2024-04-23T10:12:33.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- 172.21.15.26:0/1566716787 wait complete. 2024-04-23T10:12:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 Processor -- start 2024-04-23T10:12:33.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.162+0000 7fe2a52f6640 1 -- start start 2024-04-23T10:12:33.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a0141150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2a00c8630 0x7fe2a01f53b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a00c6920 con 0x7fe2a00c8a70 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2a015b400 con 0x7fe2a00c8630 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2a00681d0 con 0x7fe2a00c8250 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51576/0 (socket says 172.21.15.26:51576) 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 -- 172.21.15.26:0/157730578 learned_addr learned my addr 172.21.15.26:0/157730578 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29effd640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a0141150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29e7fc640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2a00c8630 0x7fe2a01f53b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 -- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 msgr2=0x7fe2a0141150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:33.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a0141150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 -- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2a00c8630 msgr2=0x7fe2a01f53b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2a00c8630 0x7fe2a01f53b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 -- 172.21.15.26:0/157730578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2a0142620 con 0x7fe2a00c8a70 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe29f7fe640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe29800ca80 tx=0x7fe29800cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298017070 con 0x7fe2a00c8a70 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe29800ac30 con 0x7fe2a00c8a70 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe2a01f5f50 con 0x7fe2a00c8a70 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe298012400 con 0x7fe2a00c8a70 2024-04-23T10:12:33.171 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2a01531a0 con 0x7fe2a00c8a70 2024-04-23T10:12:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe2a0075df0 con 0x7fe2a00c8a70 2024-04-23T10:12:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe29801a070 con 0x7fe2a00c8a70 2024-04-23T10:12:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 0x7fe28c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.166+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(17..17 src has 1..17) ==== 5227+0+0 (secure 0 0 0) 0x7fe298086470 con 0x7fe2a00c8a70 2024-04-23T10:12:33.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.170+0000 7fe29effd640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 0x7fe28c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:33.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.170+0000 7fe29effd640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 0x7fe28c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:33.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.174+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe298056530 con 0x7fe2a00c8a70 2024-04-23T10:12:33.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.342+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05} v 0) -- 0x7fe2a0071e50 con 0x7fe2a00c8a70 2024-04-23T10:12:34.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:33.998+0000 7fe2877fe640 1 -- 172.21.15.26:0/157730578 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data", "pg_num": 64, "pg_num_min": 64, "target_size_ratio": 0.05}]=0 pool 'cephfs_data' created v18) ==== 171+0+0 (secure 0 0 0) 0x7fe29805a830 con 0x7fe2a00c8a70 2024-04-23T10:12:34.001 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' created 2024-04-23T10:12:34.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 msgr2=0x7fe28c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 0x7fe28c06a840 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x7fe2900ad000 tx=0x7fe290008040 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 msgr2=0x7fe2a01f58f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7fe29800ca80 tx=0x7fe29800cf40 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 shutdown_connections 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe28c068380 0x7fe28c06a840 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2a00c8a70 0x7fe2a01f58f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2a00c8630 0x7fe2a01f53b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 --2- 172.21.15.26:0/157730578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2a00c8250 0x7fe2a0141150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 >> 172.21.15.26:0/157730578 conn(0x7fe2a006b9d0 msgr2=0x7fe2a00c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 shutdown_connections 2024-04-23T10:12:34.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.002+0000 7fe2a52f6640 1 -- 172.21.15.26:0/157730578 wait complete. 2024-04-23T10:12:34.037 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs new cephfs cephfs_metadata cephfs_data 2024-04-23T10:12:34.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 Processor -- start 2024-04-23T10:12:34.165 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 -- start start 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c8800 0x7fab3c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fab3c0c4b40 0x7fab3c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab3c0c5780 0x7fab3c0c5c10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fab3c158090 con 0x7fab3c0c5780 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fab3c1585c0 con 0x7fab3c0c4b40 2024-04-23T10:12:34.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab40d97640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab3c0c52f0 con 0x7fab3c0c8800 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab3c0c5780 0x7fab3c0c5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fab3c0c5780 0x7fab3c0c5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51582/0 (socket says 172.21.15.26:51582) 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 -- 172.21.15.26:0/2036427882 learned_addr learned my addr 172.21.15.26:0/2036427882 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab39d9b640 1 --2- 172.21.15.26:0/2036427882 >> v2:172.21.15.190:3300/0 conn(0x7fab3c0c4b40 0x7fab3c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3a59c640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c8800 0x7fab3c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 -- 172.21.15.26:0/2036427882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c8800 msgr2=0x7fab3c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c8800 0x7fab3c0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 -- 172.21.15.26:0/2036427882 >> v2:172.21.15.190:3300/0 conn(0x7fab3c0c4b40 msgr2=0x7fab3c0c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 --2- 172.21.15.26:0/2036427882 >> v2:172.21.15.190:3300/0 conn(0x7fab3c0c4b40 0x7fab3c0c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.162+0000 7fab3ad9d640 1 -- 172.21.15.26:0/2036427882 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c0c6150 con 0x7fab3c0c5780 2024-04-23T10:12:34.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab3ad9d640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c0c5c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab3c06a030 tx=0x7fab3401ead0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=10b341168e1fa6c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:34.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab3959a640 1 -- 172.21.15.26:0/2036427882 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340ad070 con 0x7fab3c0c5780 2024-04-23T10:12:34.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab3959a640 1 -- 172.21.15.26:0/2036427882 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab340a7b00 con 0x7fab3c0c5780 2024-04-23T10:12:34.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab3959a640 1 -- 172.21.15.26:0/2036427882 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab340b1400 con 0x7fab3c0c5780 2024-04-23T10:12:34.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- 172.21.15.26:0/2036427882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 msgr2=0x7fab3c0c5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:34.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c0c5c10 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fab3c06a030 tx=0x7fab3401ead0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- 172.21.15.26:0/2036427882 shutdown_connections 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c0c5c10 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- 172.21.15.26:0/2036427882 >> v2:172.21.15.190:3300/0 conn(0x7fab3c0c4b40 0x7fab3c0c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- 172.21.15.26:0/2036427882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c8800 0x7fab3c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- 172.21.15.26:0/2036427882 >> 172.21.15.26:0/2036427882 conn(0x7fab3c06b9d0 msgr2=0x7fab3c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- 172.21.15.26:0/2036427882 shutdown_connections 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- 172.21.15.26:0/2036427882 wait complete. 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 Processor -- start 2024-04-23T10:12:34.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- start start 2024-04-23T10:12:34.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c4b40 0x7fab3c14cfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab3c0c8800 0x7fab3c14f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c074280 con 0x7fab3c0c5780 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fab3c073fa0 con 0x7fab3c0c8800 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab40d97640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fab3c068610 con 0x7fab3c0c4b40 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab39d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab39d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51586/0 (socket says 172.21.15.26:51586) 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab39d9b640 1 -- 172.21.15.26:0/1912863256 learned_addr learned my addr 172.21.15.26:0/1912863256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.166+0000 7fab3a59c640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c4b40 0x7fab3c14cfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 -- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c4b40 msgr2=0x7fab3c14cfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c4b40 0x7fab3c14cfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab3ad9d640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab3c0c8800 0x7fab3c14f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 -- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab3c0c8800 msgr2=0x7fab3c14f330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab3c0c8800 0x7fab3c14f330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 -- 172.21.15.26:0/1912863256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fab3c14c3a0 con 0x7fab3c0c5780 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab39d9b640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab3000d800 tx=0x7fab3000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30018030 con 0x7fab3c0c5780 2024-04-23T10:12:34.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab300096a0 con 0x7fab3c0c5780 2024-04-23T10:12:34.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fab3c1f3dd0 con 0x7fab3c0c5780 2024-04-23T10:12:34.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fab30009870 con 0x7fab3c0c5780 2024-04-23T10:12:34.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fab3c14c940 con 0x7fab3c0c5780 2024-04-23T10:12:34.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fab3c14cb80 con 0x7fab3c0c5780 2024-04-23T10:12:34.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fab3001b070 con 0x7fab3c0c5780 2024-04-23T10:12:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 0x7fab1c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(18..18 src has 1..18) ==== 5609+0+0 (secure 0 0 0) 0x7fab30086bb0 con 0x7fab3c0c5780 2024-04-23T10:12:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab3a59c640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 0x7fab1c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:34.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.170+0000 7fab3a59c640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 0x7fab1c06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0096f0 tx=0x7fab2c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:34.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.174+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fab3c14cb80 con 0x7fab3c0c5780 2024-04-23T10:12:34.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.374+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"} v 0) -- 0x7fab3c075df0 con 0x7fab3c0c5780 2024-04-23T10:12:35.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:34.998+0000 7fab2affd640 1 -- 172.21.15.26:0/1912863256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs_metadata", "data": "cephfs_data"}]=0 new fs with metadata pool 2 and data pool 3 v4) ==== 172+0+0 (secure 0 0 0) 0x7fab300571d0 con 0x7fab3c0c5780 2024-04-23T10:12:35.003 INFO:teuthology.orchestra.run.smithi026.stderr:new fs with metadata pool 2 and data pool 3 2024-04-23T10:12:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.006+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 msgr2=0x7fab1c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.006+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 0x7fab1c06a840 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fab2c0096f0 tx=0x7fab2c008040 comp rx=0 tx=0).stop 2024-04-23T10:12:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.006+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 msgr2=0x7fab3c14a820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.006+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7fab3000d800 tx=0x7fab3000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 shutdown_connections 2024-04-23T10:12:35.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fab1c068380 0x7fab1c06a840 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fab3c0c8800 0x7fab3c14f330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fab3c0c5780 0x7fab3c14a820 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 --2- 172.21.15.26:0/1912863256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fab3c0c4b40 0x7fab3c14cfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.010+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 >> 172.21.15.26:0/1912863256 conn(0x7fab3c06b9d0 msgr2=0x7fab3c155400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:35.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.014+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 shutdown_connections 2024-04-23T10:12:35.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.018+0000 7fab40d97640 1 -- 172.21.15.26:0/1912863256 wait complete. 2024-04-23T10:12:35.052 DEBUG:tasks.cephfs.filesystem:EC profile is ['m=2', 'k=2', 'crush-failure-domain=osd'] 2024-04-23T10:12:35.052 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd erasure-code-profile set cephfs_data_ec m=2 k=2 crush-failure-domain=osd 2024-04-23T10:12:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 Processor -- start 2024-04-23T10:12:35.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 -- start start 2024-04-23T10:12:35.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fed0c06cd40 0x7fed0c0736a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed0c073be0 0x7fed0c151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fed0c072620 con 0x7fed0c06d920 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c073210 con 0x7fed0c073be0 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.174+0000 7fed113ba640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fed0c158c60 con 0x7fed0c06cd40 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed0c073be0 0x7fed0c151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fed0c073be0 0x7fed0c151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51598/0 (socket says 172.21.15.26:51598) 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 -- 172.21.15.26:0/1371596323 learned_addr learned my addr 172.21.15.26:0/1371596323 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0affd640 1 --2- 172.21.15.26:0/1371596323 >> v2:172.21.15.190:3300/0 conn(0x7fed0c06cd40 0x7fed0c0736a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 -- 172.21.15.26:0/1371596323 >> v2:172.21.15.190:3300/0 conn(0x7fed0c06cd40 msgr2=0x7fed0c0736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 --2- 172.21.15.26:0/1371596323 >> v2:172.21.15.190:3300/0 conn(0x7fed0c06cd40 0x7fed0c0736a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 -- 172.21.15.26:0/1371596323 >> v1:172.21.15.190:6789/0 conn(0x7fed0c06d920 legacy=0x7fed0c151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 -- 172.21.15.26:0/1371596323 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c0728e0 con 0x7fed0c073be0 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed0a7fc640 1 --2- 172.21.15.26:0/1371596323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c151a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed0c06a0e0 tx=0x7fed0401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb160d4bdd308910 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed09ffb640 1 -- 172.21.15.26:0/1371596323 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed040a57a0 con 0x7fed0c073be0 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed09ffb640 1 -- 172.21.15.26:0/1371596323 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fed040a5940 con 0x7fed0c073be0 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed09ffb640 1 -- 172.21.15.26:0/1371596323 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fed040a5d10 con 0x7fed0c073be0 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 -- 172.21.15.26:0/1371596323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 msgr2=0x7fed0c151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 --2- 172.21.15.26:0/1371596323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c151a10 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7fed0c06a0e0 tx=0x7fed0401c9f0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 -- 172.21.15.26:0/1371596323 shutdown_connections 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 --2- 172.21.15.26:0/1371596323 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c151a10 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 --2- 172.21.15.26:0/1371596323 >> v2:172.21.15.190:3300/0 conn(0x7fed0c06cd40 0x7fed0c0736a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.178+0000 7fed113ba640 1 -- 172.21.15.26:0/1371596323 >> 172.21.15.26:0/1371596323 conn(0x7fed0c0ca0d0 msgr2=0x7fed0c0ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- 172.21.15.26:0/1371596323 shutdown_connections 2024-04-23T10:12:35.184 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- 172.21.15.26:0/1371596323 wait complete. 2024-04-23T10:12:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 Processor -- start 2024-04-23T10:12:35.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- start start 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed0c06cd40 0x7fed0c155070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed0c06d920 0x7fed0c14fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c0cafe0 con 0x7fed0c073be0 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fed0c0cae60 con 0x7fed0c06d920 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fed0c158820 con 0x7fed0c06cd40 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51610/0 (socket says 172.21.15.26:51610) 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 -- 172.21.15.26:0/2636805056 learned_addr learned my addr 172.21.15.26:0/2636805056 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:35.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0a7fc640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed0c06d920 0x7fed0c14fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0affd640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed0c06cd40 0x7fed0c155070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 -- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed0c06cd40 msgr2=0x7fed0c155070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed0c06cd40 0x7fed0c155070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 -- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed0c06d920 msgr2=0x7fed0c14fb70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed0c06d920 0x7fed0c14fb70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 -- 172.21.15.26:0/2636805056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fed0c156c00 con 0x7fed0c073be0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed0b7fe640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c3c0 tx=0x7fecf400c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4017070 con 0x7fed0c073be0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fecf40052d0 con 0x7fed0c073be0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fecf4003840 con 0x7fed0c073be0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fed0c1440e0 con 0x7fed0c073be0 2024-04-23T10:12:35.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.182+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fed0c156e70 con 0x7fed0c073be0 2024-04-23T10:12:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fed0c075e60 con 0x7fed0c073be0 2024-04-23T10:12:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fecf401a070 con 0x7fed0c073be0 2024-04-23T10:12:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed037fe640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 0x7fecec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 5709+0+0 (secure 0 0 0) 0x7fecf4085c90 con 0x7fed0c073be0 2024-04-23T10:12:35.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed0affd640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 0x7fecec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:35.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.186+0000 7fed0affd640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 0x7fecec06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009af0 tx=0x7fecfc008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:35.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.190+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fecf4005480 con 0x7fed0c073be0 2024-04-23T10:12:35.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:35.362+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]} v 0) -- 0x7fed0c0c9800 con 0x7fed0c073be0 2024-04-23T10:12:35.461 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:12:35.464 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:12:36.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.002+0000 7fed037fe640 1 -- 172.21.15.26:0/2636805056 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "cephfs_data_ec", "profile": ["m=2", "k=2", "crush-failure-domain=osd"]}]=0 v20) ==== 157+0+0 (secure 0 0 0) 0x7fecf4056240 con 0x7fed0c073be0 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 msgr2=0x7fecec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 0x7fecec06a840 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fecfc009af0 tx=0x7fecfc008040 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 msgr2=0x7fed0c1445c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fecf400c3c0 tx=0x7fecf400c880 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 shutdown_connections 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fecec068380 0x7fecec06a840 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fed0c073be0 0x7fed0c1445c0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fed0c06d920 0x7fed0c14fb70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 --2- 172.21.15.26:0/2636805056 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fed0c06cd40 0x7fed0c155070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 >> 172.21.15.26:0/2636805056 conn(0x7fed0c0ca0d0 msgr2=0x7fed0c1517e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:36.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 shutdown_connections 2024-04-23T10:12:36.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.006+0000 7fed113ba640 1 -- 172.21.15.26:0/2636805056 wait complete. 2024-04-23T10:12:36.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool create cephfs_data_ec erasure cephfs_data_ec --pg_num_min 64 --target_size_ratio 0.9 2024-04-23T10:12:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.162+0000 7f86c3fd8640 1 Processor -- start 2024-04-23T10:12:36.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.162+0000 7f86c3fd8640 1 -- start start 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86bc073360 0x7f86bc0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073740 0x7f86bc15b120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f86bc0cd490 0x7f86bc0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc0cc9d0 con 0x7f86bc073360 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f86bc073e30 con 0x7f86bc0cd490 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c3fd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc15ba20 con 0x7f86bc073740 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86bc073360 0x7f86bc0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f86bc073360 0x7f86bc0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51614/0 (socket says 172.21.15.26:51614) 2024-04-23T10:12:36.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 -- 172.21.15.26:0/2645902284 learned_addr learned my addr 172.21.15.26:0/2645902284 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 -- 172.21.15.26:0/2645902284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073740 msgr2=0x7f86bc15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 --2- 172.21.15.26:0/2645902284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073740 0x7f86bc15b120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c2575640 1 --2- 172.21.15.26:0/2645902284 >> v2:172.21.15.190:3300/0 conn(0x7f86bc0cd490 0x7f86bc0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 -- 172.21.15.26:0/2645902284 >> v2:172.21.15.190:3300/0 conn(0x7f86bc0cd490 msgr2=0x7f86bc0cd8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 --2- 172.21.15.26:0/2645902284 >> v2:172.21.15.190:3300/0 conn(0x7f86bc0cd490 0x7f86bc0cd8b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 -- 172.21.15.26:0/2645902284 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc15bd00 con 0x7f86bc073360 2024-04-23T10:12:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c1d74640 1 --2- 172.21.15.26:0/2645902284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073360 0x7f86bc0c58a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ce340 tx=0x7f86b801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=606a79afdb0da65f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c0d72640 1 -- 172.21.15.26:0/2645902284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b80b5070 con 0x7f86bc073360 2024-04-23T10:12:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c0d72640 1 -- 172.21.15.26:0/2645902284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86b80a89d0 con 0x7f86bc073360 2024-04-23T10:12:36.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.166+0000 7f86c0d72640 1 -- 172.21.15.26:0/2645902284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86b80a8da0 con 0x7f86bc073360 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/2645902284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073360 msgr2=0x7f86bc0c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/2645902284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073360 0x7f86bc0c58a0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f86bc0ce340 tx=0x7f86b801ed10 comp rx=0 tx=0).stop 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/2645902284 shutdown_connections 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/2645902284 >> v2:172.21.15.190:3300/0 conn(0x7f86bc0cd490 0x7f86bc0cd8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/2645902284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073740 0x7f86bc15b120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/2645902284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073360 0x7f86bc0c58a0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/2645902284 >> 172.21.15.26:0/2645902284 conn(0x7f86bc06cc30 msgr2=0x7f86bc06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/2645902284 shutdown_connections 2024-04-23T10:12:36.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/2645902284 wait complete. 2024-04-23T10:12:36.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 Processor -- start 2024-04-23T10:12:36.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- start start 2024-04-23T10:12:36.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073360 0x7f86bc0b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86bc0cd490 0x7f86bc0d0fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0ccf70 con 0x7f86bc073740 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f86bc0ccc90 con 0x7f86bc0cd490 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f86bc15b660 con 0x7f86bc073360 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51624/0 (socket says 172.21.15.26:51624) 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 -- 172.21.15.26:0/3240890102 learned_addr learned my addr 172.21.15.26:0/3240890102 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c2575640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86bc0cd490 0x7f86bc0d0fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1d74640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073360 0x7f86bc0b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 -- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073360 msgr2=0x7f86bc0b5590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073360 0x7f86bc0b5590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 -- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86bc0cd490 msgr2=0x7f86bc0d0fa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86bc0cd490 0x7f86bc0d0fa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 -- 172.21.15.26:0/3240890102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f86bc1f15b0 con 0x7f86bc073740 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c1573640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b580 tx=0x7f86ac00ba40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac014070 con 0x7f86bc073740 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f86ac010610 con 0x7f86bc073740 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f86bc1f1870 con 0x7f86bc073740 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f86ac0109e0 con 0x7f86bc073740 2024-04-23T10:12:36.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.170+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f86bc1f1e30 con 0x7f86bc073740 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f86bc075df0 con 0x7f86bc073740 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f86ac017070 con 0x7f86bc073740 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86b27fc640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 0x7f86a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(20..20 src has 1..20) ==== 6007+0+0 (secure 0 0 0) 0x7f86ac0865b0 con 0x7f86bc073740 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86c1d74640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 0x7f86a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:36.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.174+0000 7f86c1d74640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 0x7f86a006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b2000 tx=0x7f86b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:36.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.178+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f86ac056a50 con 0x7f86bc073740 2024-04-23T10:12:36.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:36.346+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9} v 0) -- 0x7f86bc0b3680 con 0x7f86bc073740 2024-04-23T10:12:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.042+0000 7f86b27fc640 1 -- 172.21.15.26:0/3240890102 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "cephfs_data_ec", "pool_type": "erasure", "erasure_code_profile": "cephfs_data_ec", "pg_num_min": 64, "target_size_ratio": 0.9}]=0 pool 'cephfs_data_ec' created v22) ==== 228+0+0 (secure 0 0 0) 0x7f86ac056350 con 0x7f86bc073740 2024-04-23T10:12:38.047 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' created 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 msgr2=0x7f86a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 0x7f86a006a840 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f86b80b2000 tx=0x7f86b8008040 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 msgr2=0x7f86bc0d0a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f86ac00b580 tx=0x7f86ac00ba40 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 shutdown_connections 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f86a0068380 0x7f86a006a840 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f86bc0cd490 0x7f86bc0d0fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f86bc073740 0x7f86bc0d0a60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 --2- 172.21.15.26:0/3240890102 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f86bc073360 0x7f86bc0b5590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 >> 172.21.15.26:0/3240890102 conn(0x7f86bc06cc30 msgr2=0x7f86bc0c6a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 shutdown_connections 2024-04-23T10:12:38.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.046+0000 7f86c3fd8640 1 -- 172.21.15.26:0/3240890102 wait complete. 2024-04-23T10:12:38.078 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool set cephfs_data_ec allow_ec_overwrites true 2024-04-23T10:12:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 Processor -- start 2024-04-23T10:12:38.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 -- start start 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36081552d0 0x7f360815af10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36081556b0 con 0x7f36080cc550 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f360815e4a0 con 0x7f36080cde10 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f3610658640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f360815e760 con 0x7f36081552d0 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360ebf5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f36080cc550 0x7f36080cc950 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50340/0 (socket says 172.21.15.26:50340) 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360ebf5640 1 -- 172.21.15.26:0/3675353334 learned_addr learned my addr 172.21.15.26:0/3675353334 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3675353334 >> v2:172.21.15.190:3300/0 conn(0x7f36081552d0 0x7f360815af10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2257988955 0 0) 0x7f36081556b0 con 0x7f36080cc550 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35f4003530 con 0x7f36080cc550 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 195309552 0 0) 0x7f35f4003530 con 0x7f36080cc550 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 >> v2:172.21.15.190:3300/0 conn(0x7f36081552d0 msgr2=0x7f360815af10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:38.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 --2- 172.21.15.26:0/3675353334 >> v2:172.21.15.190:3300/0 conn(0x7f36081552d0 0x7f360815af10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 >> v1:172.21.15.190:6789/0 conn(0x7f36080cde10 legacy=0x7f360806d5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f360815ea40 con 0x7f36080cc550 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f3600001a00 con 0x7f36080cc550 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 >> v1:172.21.15.26:6789/0 conn(0x7f36080cc550 legacy=0x7f36080cc950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 0x7f35f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.202+0000 7f360d3f2640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35f40051d0 0x7f35f400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f360815e760 con 0x7f35f40039c0 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35f400c070 con 0x7f35f40051d0 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35f400c270 con 0x7f35f4004810 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 0x7f35f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360ebf5640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35f40051d0 0x7f35f400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 -- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f4004810 msgr2=0x7f35f4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f4004810 0x7f35f4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 -- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35f40051d0 msgr2=0x7f35f400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35f40051d0 0x7f35f400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360ebf5640 1 -- 172.21.15.26:0/3675353334 reap_dead start 2024-04-23T10:12:38.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 -- 172.21.15.26:0/3675353334 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35f4003530 con 0x7f35f40039c0 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 0x7f35f4003de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3604009ae0 tx=0x7f360401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e1e0fa5a6b2825d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36040b2070 con 0x7f35f40039c0 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36040a5550 con 0x7f35f40039c0 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f360d3f2640 1 -- 172.21.15.26:0/3675353334 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36040096b0 con 0x7f35f40039c0 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 -- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 msgr2=0x7f35f4003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 0x7f35f4003de0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f3604009ae0 tx=0x7f360401ca70 comp rx=0 tx=0).stop 2024-04-23T10:12:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 -- 172.21.15.26:0/3675353334 shutdown_connections 2024-04-23T10:12:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 --2- 172.21.15.26:0/3675353334 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35f40039c0 0x7f35f4003de0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 -- 172.21.15.26:0/3675353334 >> 172.21.15.26:0/3675353334 conn(0x7f3608067ca0 msgr2=0x7f360806bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 -- 172.21.15.26:0/3675353334 shutdown_connections 2024-04-23T10:12:38.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.206+0000 7f3610658640 1 -- 172.21.15.26:0/3675353334 wait complete. 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 Processor -- start 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- start start 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f40039c0 0x7f3608158e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 0x7f36081497b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f360806ddb0 con 0x7f36081f8260 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f36080cc030 con 0x7f3608153b70 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36080ccd40 con 0x7f35f40039c0 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51636/0 (socket says 172.21.15.26:51636) 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 -- 172.21.15.26:0/3926507031 learned_addr learned my addr 172.21.15.26:0/3926507031 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f40039c0 0x7f3608158e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360ebf5640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 0x7f36081497b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 -- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f40039c0 msgr2=0x7f3608158e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f40039c0 0x7f3608158e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 -- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 msgr2=0x7f36081497b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 0x7f36081497b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 -- 172.21.15.26:0/3926507031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36081f8780 con 0x7f36081f8260 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360ebf5640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 0x7f36081497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f360dbf3640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c470 tx=0x7f35f800c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f80052d0 con 0x7f36081f8260 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35f8005470 con 0x7f36081f8260 2024-04-23T10:12:38.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3608154480 con 0x7f36081f8260 2024-04-23T10:12:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35f8003890 con 0x7f36081f8260 2024-04-23T10:12:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3608154720 con 0x7f36081f8260 2024-04-23T10:12:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.210+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3608075e60 con 0x7f36081f8260 2024-04-23T10:12:38.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.214+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35f8003a30 con 0x7f36081f8260 2024-04-23T10:12:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.214+0000 7f35feffd640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 0x7f35ec06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.214+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(22..22 src has 1..22) ==== 6500+0+0 (secure 0 0 0) 0x7f35f80872b0 con 0x7f36081f8260 2024-04-23T10:12:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.214+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 0x7f35ec06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:38.219 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.214+0000 7f360e3f4640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 0x7f35ec06a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36040af000 tx=0x7f3604008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:38.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.218+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35f80576c0 con 0x7f36081f8260 2024-04-23T10:12:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:38.382+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"} v 0) -- 0x7f3608069600 con 0x7f36081f8260 2024-04-23T10:12:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.046+0000 7f35feffd640 1 -- 172.21.15.26:0/3926507031 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool set", "pool": "cephfs_data_ec", "var": "allow_ec_overwrites", "val": "true"}]=0 set pool 4 allow_ec_overwrites to true v23) ==== 169+0+0 (secure 0 0 0) 0x7f35f8056fc0 con 0x7f36081f8260 2024-04-23T10:12:39.050 INFO:teuthology.orchestra.run.smithi026.stderr:set pool 4 allow_ec_overwrites to true 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.050+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 msgr2=0x7f35ec06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.050+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 0x7f35ec06a870 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f36040af000 tx=0x7f3604008040 comp rx=0 tx=0).stop 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.050+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 msgr2=0x7f3608149270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.050+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f35f800c470 tx=0x7f35f800c930 comp rx=0 tx=0).stop 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.050+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 shutdown_connections 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35ec0683b0 0x7f35ec06a870 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3608153b70 0x7f36081497b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36081f8260 0x7f3608149270 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 --2- 172.21.15.26:0/3926507031 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35f40039c0 0x7f3608158e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 >> 172.21.15.26:0/3926507031 conn(0x7f3608067ca0 msgr2=0x7f360814b520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 shutdown_connections 2024-04-23T10:12:39.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.054+0000 7f3610658640 1 -- 172.21.15.26:0/3926507031 wait complete. 2024-04-23T10:12:39.093 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs add_data_pool cephfs cephfs_data_ec 2024-04-23T10:12:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 Processor -- start 2024-04-23T10:12:39.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 -- start start 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80e806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e80c5d70 con 0x7f80e814ffa0 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80e80c6050 con 0x7f80e814fbc0 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80f049d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f80e80c6330 con 0x7f80e8074100 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eda38640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f80e814ffa0 0x7f80e80c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50344/0 (socket says 172.21.15.26:50344) 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eda38640 1 -- 172.21.15.26:0/3497337469 learned_addr learned my addr 172.21.15.26:0/3497337469 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eea3a640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80e806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1521109266 0 0) 0x7f80e80c5d70 con 0x7f80e814ffa0 2024-04-23T10:12:39.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f80d4003530 con 0x7f80e814ffa0 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1747343409 0 0) 0x7f80d4003530 con 0x7f80e814ffa0 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 msgr2=0x7f80e806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80e806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 >> v1:172.21.15.190:6789/0 conn(0x7f80e814fbc0 legacy=0x7f80e80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e80c6610 con 0x7f80e814ffa0 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f80e4001680 con 0x7f80e814ffa0 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 >> v1:172.21.15.26:6789/0 conn(0x7f80e814ffa0 legacy=0x7f80e80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80d4003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d4004810 0x7f80d4004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80d40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f80e80c6330 con 0x7f80d40039f0 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f80d400bab0 con 0x7f80d4004810 2024-04-23T10:12:39.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f80d400bcb0 con 0x7f80e8074100 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80d4003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eda38640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d4004810 0x7f80d4004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 -- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 msgr2=0x7f80d40051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eea3a640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80d40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80d40051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 -- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d4004810 msgr2=0x7f80d4004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80d4004810 0x7f80d4004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80ee239640 1 -- 172.21.15.26:0/3497337469 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80d4003530 con 0x7f80d40039f0 2024-04-23T10:12:39.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.218+0000 7f80eea3a640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8074100 0x7f80d40051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:39.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80ee239640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80d4003e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001750 tx=0x7f80d801c3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c8e56a1177b14b9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:39.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80013a0 con 0x7f80d40039f0 2024-04-23T10:12:39.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d80052f0 con 0x7f80d40039f0 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80ed237640 1 -- 172.21.15.26:0/3497337469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8003840 con 0x7f80d40039f0 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- 172.21.15.26:0/3497337469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 msgr2=0x7f80d4003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 --2- 172.21.15.26:0/3497337469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80d4003e10 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f80d8001750 tx=0x7f80d801c3c0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80eea3a640 1 -- 172.21.15.26:0/3497337469 reap_dead start 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- 172.21.15.26:0/3497337469 shutdown_connections 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- 172.21.15.26:0/3497337469 >> 172.21.15.26:0/3497337469 conn(0x7f80e806b9d0 msgr2=0x7f80e806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- 172.21.15.26:0/3497337469 shutdown_connections 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- 172.21.15.26:0/3497337469 wait complete. 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 Processor -- start 2024-04-23T10:12:39.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.222+0000 7f80f049d640 1 -- start start 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 0x7f80e81f57a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 0x7f80e8141300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f80e8165090 con 0x7f80d40039f0 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f80e806fb10 con 0x7f80e8140e80 2024-04-23T10:12:39.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f80e8165210 con 0x7f80e8150380 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51652/0 (socket says 172.21.15.26:51652) 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 -- 172.21.15.26:0/3767603725 learned_addr learned my addr 172.21.15.26:0/3767603725 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80eea3a640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 0x7f80e8141300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80eda38640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 0x7f80e81f57a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 -- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 msgr2=0x7f80e81f57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 0x7f80e81f57a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 -- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 msgr2=0x7f80e8141300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 0x7f80e8141300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:39.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 -- 172.21.15.26:0/3767603725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80e81f6070 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80eea3a640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 0x7f80e8141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80eda38640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 0x7f80e81f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80ee239640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005040 tx=0x7f80d4005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d80ba020 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80d8000ee0 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f80d8007a40 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80e81f6350 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80e8145070 con 0x7f80d40039f0 2024-04-23T10:12:39.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f80e8075df0 con 0x7f80d40039f0 2024-04-23T10:12:39.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f80d80bd020 con 0x7f80d40039f0 2024-04-23T10:12:39.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 0x7f80cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:39.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 6500+0+0 (secure 0 0 0) 0x7f80d8120a80 con 0x7f80d40039f0 2024-04-23T10:12:39.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.226+0000 7f80eda38640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 0x7f80cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:39.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.230+0000 7f80eda38640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 0x7f80cc06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80e814ead0 tx=0x7f80e4000ee0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:39.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.230+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f80d8122e20 con 0x7f80d40039f0 2024-04-23T10:12:39.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:39.430+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"} v 0) -- 0x7f80e806bf70 con 0x7f80d40039f0 2024-04-23T10:12:40.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80deffd640 1 -- 172.21.15.26:0/3767603725 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs add_data_pool", "fs_name": "cephfs", "pool": "cephfs_data_ec"}]=0 added data pool 4 to fsmap v5) ==== 137+0+0 (secure 0 0 0) 0x7f80d80c4030 con 0x7f80d40039f0 2024-04-23T10:12:40.073 INFO:teuthology.orchestra.run.smithi026.stderr:added data pool 4 to fsmap 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 msgr2=0x7f80cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 0x7f80cc06a870 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f80e814ead0 tx=0x7f80e4000ee0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 msgr2=0x7f80e8152cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f80d8005040 tx=0x7f80d4005840 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 shutdown_connections 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f80cc0683b0 0x7f80cc06a870 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f80e8140e80 0x7f80e8141300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80e8150380 0x7f80e81f57a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 --2- 172.21.15.26:0/3767603725 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80d40039f0 0x7f80e8152cd0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 >> 172.21.15.26:0/3767603725 conn(0x7f80e806b9d0 msgr2=0x7f80e814a530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 shutdown_connections 2024-04-23T10:12:40.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.074+0000 7f80f049d640 1 -- 172.21.15.26:0/3767603725 wait complete. 2024-04-23T10:12:40.100 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:40.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 Processor -- start 2024-04-23T10:12:40.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 -- start start 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f334c15b7c0 0x7f334c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334c15bc10 con 0x7f334c0cda50 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f334c15beb0 con 0x7f334c155350 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3352fa9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f334c0cca40 con 0x7f334c15b7c0 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f334c0cda50 0x7f334c15b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50360/0 (socket says 172.21.15.26:50360) 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 -- 172.21.15.26:0/1925809807 learned_addr learned my addr 172.21.15.26:0/1925809807 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3351546640 1 --2- 172.21.15.26:0/1925809807 >> v2:172.21.15.190:3300/0 conn(0x7f334c15b7c0 0x7f334c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3735261051 0 0) 0x7f334c15bc10 con 0x7f334c0cda50 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f333c003530 con 0x7f334c0cda50 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 383988535 0 0) 0x7f333c003530 con 0x7f334c0cda50 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 >> v2:172.21.15.190:3300/0 conn(0x7f334c15b7c0 msgr2=0x7f334c0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.232 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 --2- 172.21.15.26:0/1925809807 >> v2:172.21.15.190:3300/0 conn(0x7f334c15b7c0 0x7f334c0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 >> v1:172.21.15.190:6789/0 conn(0x7f334c155350 legacy=0x7f334c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0ccc90 con 0x7f334c0cda50 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f33380016a0 con 0x7f334c0cda50 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 >> v1:172.21.15.26:6789/0 conn(0x7f334c0cda50 legacy=0x7f334c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c0039c0 0x7f333c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 0x7f333c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f333c0051d0 0x7f333c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0cca40 con 0x7f333c004810 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f333c00c080 con 0x7f333c0039c0 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f333c00c280 con 0x7f333c0051d0 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 0x7f333c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3350d45640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c0039c0 0x7f333c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 -- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f333c0051d0 msgr2=0x7f333c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3351546640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f333c0051d0 0x7f333c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.233 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f333c0051d0 0x7f333c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 -- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c0039c0 msgr2=0x7f333c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c0039c0 0x7f333c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f334bfff640 1 -- 172.21.15.26:0/1925809807 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f333c003530 con 0x7f333c004810 2024-04-23T10:12:40.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3351546640 1 -- 172.21.15.26:0/1925809807 reap_dead start 2024-04-23T10:12:40.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.226+0000 7f3350d45640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c0039c0 0x7f333c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f334bfff640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 0x7f333c004c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f333800c210 tx=0x7f333801cba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceeb2cc927e931d6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338007d40 con 0x7f333c004810 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380a9070 con 0x7f333c004810 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f334b7fe640 1 -- 172.21.15.26:0/1925809807 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338005d40 con 0x7f333c004810 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 msgr2=0x7f333c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 0x7f333c004c90 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f333800c210 tx=0x7f333801cba0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- 172.21.15.26:0/1925809807 shutdown_connections 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 --2- 172.21.15.26:0/1925809807 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f333c004810 0x7f333c004c90 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- 172.21.15.26:0/1925809807 >> 172.21.15.26:0/1925809807 conn(0x7f334c06cc30 msgr2=0x7f334c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.235 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- 172.21.15.26:0/1925809807 shutdown_connections 2024-04-23T10:12:40.236 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- 172.21.15.26:0/1925809807 wait complete. 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 Processor -- start 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.230+0000 7f3352fa9640 1 -- start start 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c004810 0x7f334c1f5320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f334c0c7cc0 0x7f334c14b270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0cd530 con 0x7f334c1f2650 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f334c0cd250 con 0x7f333c004810 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f334c155730 con 0x7f334c0c7cc0 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51668/0 (socket says 172.21.15.26:51668) 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 -- 172.21.15.26:0/270830440 learned_addr learned my addr 172.21.15.26:0/270830440 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3350d45640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c004810 0x7f334c1f5320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3351546640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f334c0c7cc0 0x7f334c14b270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 -- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f334c0c7cc0 msgr2=0x7f334c14b270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f334c0c7cc0 0x7f334c14b270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 -- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c004810 msgr2=0x7f334c1f5320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c004810 0x7f334c1f5320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 -- 172.21.15.26:0/270830440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f334c0b6c40 con 0x7f334c1f2650 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f334bfff640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f333801c610 tx=0x7f333c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33380a5a70 con 0x7f334c1f2650 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33380a5c10 con 0x7f334c1f2650 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f334c1f4880 con 0x7f334c1f2650 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3338007140 con 0x7f334c1f2650 2024-04-23T10:12:40.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f334c0b60f0 con 0x7f334c1f2650 2024-04-23T10:12:40.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f334c075df0 con 0x7f334c1f2650 2024-04-23T10:12:40.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.234+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33380072e0 con 0x7f334c1f2650 2024-04-23T10:12:40.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.238+0000 7f33497fa640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 0x7f333006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.238+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3338120cf0 con 0x7f334c1f2650 2024-04-23T10:12:40.240 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.238+0000 7f3350d45640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 0x7f333006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.241 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.238+0000 7f3350d45640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 0x7f333006a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f334c069360 tx=0x7f3340009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.238+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33380168f0 con 0x7f334c1f2650 2024-04-23T10:12:40.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.438+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f334c0cc610 con 0x7f334c1f2650 2024-04-23T10:12:40.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.438+0000 7f33497fa640 1 -- 172.21.15.26:0/270830440 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7f33380f5e20 con 0x7f334c1f2650 2024-04-23T10:12:40.443 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:40.443 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:12:39.438478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T10:12:40.443 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2024-04-23T10:12:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 msgr2=0x7f333006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 0x7f333006a870 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f334c069360 tx=0x7f3340009040 comp rx=0 tx=0).stop 2024-04-23T10:12:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 msgr2=0x7f334c0c9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7f333801c610 tx=0x7f333c005840 comp rx=0 tx=0).stop 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 shutdown_connections 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33300683b0 0x7f333006a870 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f334c0c7cc0 0x7f334c14b270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f334c1f2650 0x7f334c0c9c20 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 --2- 172.21.15.26:0/270830440 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f333c004810 0x7f334c1f5320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 >> 172.21.15.26:0/270830440 conn(0x7f334c06cc30 msgr2=0x7f334c0cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 shutdown_connections 2024-04-23T10:12:40.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.442+0000 7f3352fa9640 1 -- 172.21.15.26:0/270830440 wait complete. 2024-04-23T10:12:40.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.582+0000 7f10512b3640 1 Processor -- start 2024-04-23T10:12:40.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.582+0000 7f10512b3640 1 -- start start 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f10512b3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f104c0c5f20 0x7f104c0c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f10512b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f104c0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f10512b3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f104c0ca960 con 0x7f104c0c9700 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f10512b3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f104c0c7f30 con 0x7f104c0c5f20 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f10512b3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f104c0ca0c0 con 0x7f104c0c9c10 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f104c0c9700 0x7f104c152c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50368/0 (socket says 172.21.15.26:50368) 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 -- 172.21.15.26:0/3672027218 learned_addr learned my addr 172.21.15.26:0/3672027218 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104a7fc640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f104c0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104affd640 1 --2- 172.21.15.26:0/3672027218 >> v2:172.21.15.190:3300/0 conn(0x7f104c0c5f20 0x7f104c0c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2152064377 0 0) 0x7f104c0ca960 con 0x7f104c0c9700 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1034003530 con 0x7f104c0c9700 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 83693690 0 0) 0x7f1034003530 con 0x7f104c0c9700 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 msgr2=0x7f104c0c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f104c0c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 >> v2:172.21.15.190:3300/0 conn(0x7f104c0c5f20 msgr2=0x7f104c0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 --2- 172.21.15.26:0/3672027218 >> v2:172.21.15.190:3300/0 conn(0x7f104c0c5f20 0x7f104c0c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c0ca3a0 con 0x7f104c0c9700 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f1044001680 con 0x7f104c0c9700 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 >> v1:172.21.15.26:6789/0 conn(0x7f104c0c9700 legacy=0x7f104c152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f10340039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1034003f40 0x7f1034004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1034004d50 0x7f10340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0c7f30 con 0x7f1034004d50 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0ca0c0 con 0x7f1034003f40 2024-04-23T10:12:40.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f103400ba00 con 0x7f104c0c9c10 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1034004d50 0x7f10340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104affd640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f10340039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104a7fc640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1034003f40 0x7f1034004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 -- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 msgr2=0x7f10340039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c0c9c10 0x7f10340039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 -- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1034003f40 msgr2=0x7f1034004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1034003f40 0x7f1034004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 -- 172.21.15.26:0/3672027218 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1034003530 con 0x7f1034004d50 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f104b7fe640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1034004d50 0x7f10340051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104c159ef0 tx=0x7f104401cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763b78919be51014 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1044007d40 con 0x7f1034004d50 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10440a9020 con 0x7f1034004d50 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.586+0000 7f1049ffb640 1 -- 172.21.15.26:0/3672027218 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10440a5b60 con 0x7f1034004d50 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/3672027218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1034004d50 msgr2=0x7f10340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 --2- 172.21.15.26:0/3672027218 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1034004d50 0x7f10340051d0 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f104c159ef0 tx=0x7f104401cc40 comp rx=0 tx=0).stop 2024-04-23T10:12:40.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104b7fe640 1 -- 172.21.15.26:0/3672027218 reap_dead start 2024-04-23T10:12:40.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/3672027218 shutdown_connections 2024-04-23T10:12:40.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/3672027218 >> 172.21.15.26:0/3672027218 conn(0x7f104c0676a0 msgr2=0x7f104c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/3672027218 shutdown_connections 2024-04-23T10:12:40.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/3672027218 wait complete. 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 Processor -- start 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- start start 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c1507d0 0x7f104c1f4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f104c1f4540 0x7f104c146ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0c8c30 con 0x7f104c148f60 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f104c0c81d0 con 0x7f104c1f4540 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f104c0c5830 con 0x7f104c1507d0 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51694/0 (socket says 172.21.15.26:51694) 2024-04-23T10:12:40.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 -- 172.21.15.26:0/1786151663 learned_addr learned my addr 172.21.15.26:0/1786151663 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104a7fc640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c1507d0 0x7f104c1f4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104b7fe640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f104c1f4540 0x7f104c146ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 -- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c1507d0 msgr2=0x7f104c1f4000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c1507d0 0x7f104c1f4000 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 -- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f104c1f4540 msgr2=0x7f104c146ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f104c1f4540 0x7f104c146ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 -- 172.21.15.26:0/1786151663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f104c14aee0 con 0x7f104c148f60 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f104affd640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f103c007f60 tx=0x7f103c007f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c01a020 con 0x7f104c148f60 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f103c016470 con 0x7f104c148f60 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f104c1481e0 con 0x7f104c148f60 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f103c016860 con 0x7f104c148f60 2024-04-23T10:12:40.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.590+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f104c149880 con 0x7f104c148f60 2024-04-23T10:12:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f104c075df0 con 0x7f104c148f60 2024-04-23T10:12:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f103c01d020 con 0x7f104c148f60 2024-04-23T10:12:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f10337fe640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 0x7f103806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f103c087c10 con 0x7f104c148f60 2024-04-23T10:12:40.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f104a7fc640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 0x7f103806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.594+0000 7f104a7fc640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 0x7f103806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f104c067fb0 tx=0x7f1040008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.598+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f103c024030 con 0x7f104c148f60 2024-04-23T10:12:40.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.762+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f104c0c94e0 con 0x7f104c148f60 2024-04-23T10:12:40.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.766+0000 7f10337fe640 1 -- 172.21.15.26:0/1786151663 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f103c057f20 con 0x7f104c148f60 2024-04-23T10:12:40.771 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:40.771 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:40.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 msgr2=0x7f103806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 0x7f103806a840 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f104c067fb0 tx=0x7f1040008040 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 msgr2=0x7f104c149340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7f103c007f60 tx=0x7f103c007f90 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 shutdown_connections 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1038068380 0x7f103806a840 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f104c1f4540 0x7f104c146ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f104c1507d0 0x7f104c1f4000 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 --2- 172.21.15.26:0/1786151663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f104c148f60 0x7f104c149340 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 >> 172.21.15.26:0/1786151663 conn(0x7f104c0676a0 msgr2=0x7f104c15cab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 shutdown_connections 2024-04-23T10:12:40.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.770+0000 7f10512b3640 1 -- 172.21.15.26:0/1786151663 wait complete. 2024-04-23T10:12:40.791 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 Processor -- start 2024-04-23T10:12:40.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- start start 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f70f40c5e90 0x7f70f4162ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f40c8be0 con 0x7f70f40c8800 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f70f40c4790 con 0x7f70f40c4b40 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f70f4158090 con 0x7f70f40c5e90 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f70f40c8800 0x7f70f40c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50378/0 (socket says 172.21.15.26:50378) 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f37fe640 1 -- 172.21.15.26:0/1447952752 learned_addr learned my addr 172.21.15.26:0/1447952752 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 --2- 172.21.15.26:0/1447952752 >> v2:172.21.15.26:3300/0 conn(0x7f70f40c5e90 0x7f70f4162ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f27fc640 1 -- 172.21.15.26:0/1447952752 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2284964416 0 0) 0x7f70f40c8be0 con 0x7f70f40c8800 2024-04-23T10:12:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f27fc640 1 -- 172.21.15.26:0/1447952752 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f70d4003530 con 0x7f70f40c8800 2024-04-23T10:12:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 -- 172.21.15.26:0/1447952752 >> v1:172.21.15.190:6789/0 conn(0x7f70f40c4b40 legacy=0x7f70f40c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 -- 172.21.15.26:0/1447952752 >> v1:172.21.15.26:6789/0 conn(0x7f70f40c8800 legacy=0x7f70f40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 -- 172.21.15.26:0/1447952752 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f41582e0 con 0x7f70f40c5e90 2024-04-23T10:12:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 --2- 172.21.15.26:0/1447952752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c5e90 0x7f70f4162ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009d90 tx=0x7f70ec01c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8e320c58b6cb387b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f27fc640 1 -- 172.21.15.26:0/1447952752 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0b2070 con 0x7f70f40c5e90 2024-04-23T10:12:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f27fc640 1 -- 172.21.15.26:0/1447952752 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70ec0a58b0 con 0x7f70f40c5e90 2024-04-23T10:12:40.920 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f27fc640 1 -- 172.21.15.26:0/1447952752 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70ec0a5c80 con 0x7f70f40c5e90 2024-04-23T10:12:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- 172.21.15.26:0/1447952752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c5e90 msgr2=0x7f70f4162ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.921 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1447952752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c5e90 0x7f70f4162ec0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f70ec009d90 tx=0x7f70ec01c850 comp rx=0 tx=0).stop 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- 172.21.15.26:0/1447952752 shutdown_connections 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1447952752 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c5e90 0x7f70f4162ec0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- 172.21.15.26:0/1447952752 >> 172.21.15.26:0/1447952752 conn(0x7f70f406b9d0 msgr2=0x7f70f406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- 172.21.15.26:0/1447952752 shutdown_connections 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- 172.21.15.26:0/1447952752 wait complete. 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 Processor -- start 2024-04-23T10:12:40.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- start start 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 0x7f70f414b3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70f40c8800 0x7f70f413fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f70f40c52f0 con 0x7f70f40c4b40 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f70f41585c0 con 0x7f70f40c8800 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70fa18f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f70f40681d0 con 0x7f70f40c5e90 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51718/0 (socket says 172.21.15.26:51718) 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f37fe640 1 -- 172.21.15.26:0/1975939298 learned_addr learned my addr 172.21.15.26:0/1975939298 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f3fff640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70f40c8800 0x7f70f413fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.918+0000 7f70f2ffd640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 0x7f70f414b3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 -- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 msgr2=0x7f70f414b3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 0x7f70f414b3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 -- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70f40c8800 msgr2=0x7f70f413fab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70f40c8800 0x7f70f413fab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 -- 172.21.15.26:0/1975939298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f70f41f4ac0 con 0x7f70f40c4b40 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f2ffd640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 0x7f70f414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f37fe640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4017070 con 0x7f70f40c4b40 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f70e4005cf0 con 0x7f70f40c4b40 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f70e4007270 con 0x7f70f40c4b40 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f70f41417b0 con 0x7f70f40c4b40 2024-04-23T10:12:40.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f70f41f3d00 con 0x7f70f40c4b40 2024-04-23T10:12:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f4075df0 con 0x7f70f40c4b40 2024-04-23T10:12:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f70e401a070 con 0x7f70f40c4b40 2024-04-23T10:12:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 0x7f70d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:40.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f70e4085f90 con 0x7f70f40c4b40 2024-04-23T10:12:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f2ffd640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 0x7f70d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:40.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.922+0000 7f70f2ffd640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 0x7f70d806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70f4140c00 tx=0x7f70dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:40.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:40.926+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f70e4055b30 con 0x7f70f40c4b40 2024-04-23T10:12:41.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.094+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f70f4074550 con 0x7f70f40c4b40 2024-04-23T10:12:41.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.094+0000 7f70ebfff640 1 -- 172.21.15.26:0/1975939298 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f70e4059e30 con 0x7f70f40c4b40 2024-04-23T10:12:41.100 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:41.100 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 msgr2=0x7f70d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 0x7f70d806a840 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f70f4140c00 tx=0x7f70dc009040 comp rx=0 tx=0).stop 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 msgr2=0x7f70f4143270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f70e400c450 tx=0x7f70e400c910 comp rx=0 tx=0).stop 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 shutdown_connections 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70d8068380 0x7f70d806a840 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f70f40c8800 0x7f70f413fab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f70f40c5e90 0x7f70f414b3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 --2- 172.21.15.26:0/1975939298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f70f40c4b40 0x7f70f4143270 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 >> 172.21.15.26:0/1975939298 conn(0x7f70f406b9d0 msgr2=0x7f70f406bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 shutdown_connections 2024-04-23T10:12:41.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.098+0000 7f70fa18f640 1 -- 172.21.15.26:0/1975939298 wait complete. 2024-04-23T10:12:41.135 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:41.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 Processor -- start 2024-04-23T10:12:41.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- start start 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776806d1c0 0x7f77680c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f776806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f77680c6d50 0x7f77680c71c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f77680c8de0 con 0x7f776806d1c0 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f77680c4be0 con 0x7f77680c6d50 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7768070490 con 0x7f776806d5a0 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776806d1c0 0x7f77680c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f776806d1c0 0x7f77680c88a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51728/0 (socket says 172.21.15.26:51728) 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 -- 172.21.15.26:0/2567851592 learned_addr learned my addr 172.21.15.26:0/2567851592 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f77667fc640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f776806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f77677fe640 1 --2- 172.21.15.26:0/2567851592 >> v2:172.21.15.190:3300/0 conn(0x7f77680c6d50 0x7f77680c71c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 -- 172.21.15.26:0/2567851592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 msgr2=0x7f776806ff50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f776806ff50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 -- 172.21.15.26:0/2567851592 >> v2:172.21.15.190:3300/0 conn(0x7f77680c6d50 msgr2=0x7f77680c71c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- 172.21.15.26:0/2567851592 >> v2:172.21.15.190:3300/0 conn(0x7f77680c6d50 0x7f77680c71c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 -- 172.21.15.26:0/2567851592 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77680c7700 con 0x7f776806d1c0 2024-04-23T10:12:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f77680c88a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77680cb4f0 tx=0x7f775801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a03c2b7f1e6e91 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7765ffb640 1 -- 172.21.15.26:0/2567851592 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b0070 con 0x7f776806d1c0 2024-04-23T10:12:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7765ffb640 1 -- 172.21.15.26:0/2567851592 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580ab600 con 0x7f776806d1c0 2024-04-23T10:12:41.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7765ffb640 1 -- 172.21.15.26:0/2567851592 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580ab9d0 con 0x7f776806d1c0 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- 172.21.15.26:0/2567851592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 msgr2=0x7f77680c88a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f77680c88a0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f77680cb4f0 tx=0x7f775801c520 comp rx=0 tx=0).stop 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- 172.21.15.26:0/2567851592 shutdown_connections 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- 172.21.15.26:0/2567851592 >> v2:172.21.15.190:3300/0 conn(0x7f77680c6d50 0x7f77680c71c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f776806ff50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- 172.21.15.26:0/2567851592 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f77680c88a0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- 172.21.15.26:0/2567851592 >> 172.21.15.26:0/2567851592 conn(0x7f77680ca570 msgr2=0x7f77680ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:41.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- 172.21.15.26:0/2567851592 shutdown_connections 2024-04-23T10:12:41.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- 172.21.15.26:0/2567851592 wait complete. 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 Processor -- start 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- start start 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f7768073210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 0x7f77681f71f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f77681531d0 con 0x7f776806d1c0 2024-04-23T10:12:41.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7768070a00 con 0x7f77680c6d50 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f776d9e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7768153350 con 0x7f776806d5a0 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51742/0 (socket says 172.21.15.26:51742) 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.350+0000 7f7766ffd640 1 -- 172.21.15.26:0/500260082 learned_addr learned my addr 172.21.15.26:0/500260082 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f77667fc640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f7768073210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f77677fe640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 0x7f77681f71f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 -- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 msgr2=0x7f7768073210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f7768073210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 -- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 msgr2=0x7f77681f71f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 0x7f77681f71f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 -- 172.21.15.26:0/500260082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77681f50f0 con 0x7f776806d1c0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f77677fe640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 0x7f77681f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f7766ffd640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77580ae040 tx=0x7f77580192c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b0040 con 0x7f776806d1c0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77580b4620 con 0x7f776806d1c0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77681f4b40 con 0x7f776806d1c0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77580b4a10 con 0x7f776806d1c0 2024-04-23T10:12:41.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7768072450 con 0x7f776806d1c0 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7768075df0 con 0x7f776806d1c0 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77580ab4c0 con 0x7f776806d1c0 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 0x7f775406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7758120890 con 0x7f776806d1c0 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f77667fc640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 0x7f775406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.354+0000 7f77667fc640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 0x7f775406a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7768159f00 tx=0x7f775c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.358+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7758016110 con 0x7f776806d1c0 2024-04-23T10:12:41.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.558+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f77680cac10 con 0x7f776806d1c0 2024-04-23T10:12:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f774ffff640 1 -- 172.21.15.26:0/500260082 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 5 v5) ==== 93+0+6826 (secure 0 0 0) 0x7f77580f0550 con 0x7f776806d1c0 2024-04-23T10:12:41.565 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:41.565 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":5,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:12:39.438478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:creating","state_seq":1,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":0,"qdb_cluster":[]},"id":1}]} 2024-04-23T10:12:41.565 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 5 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 msgr2=0x7f775406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 0x7f775406a870 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7f7768159f00 tx=0x7f775c008040 comp rx=0 tx=0).stop 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 msgr2=0x7f7768157cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f77580ae040 tx=0x7f77580192c0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 shutdown_connections 2024-04-23T10:12:41.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77540683b0 0x7f775406a870 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77680c6d50 0x7f77681f71f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f776806d5a0 0x7f7768073210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 --2- 172.21.15.26:0/500260082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f776806d1c0 0x7f7768157cd0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 >> 172.21.15.26:0/500260082 conn(0x7f77680ca570 msgr2=0x7f77680ccbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 shutdown_connections 2024-04-23T10:12:41.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.566+0000 7f776d9e7640 1 -- 172.21.15.26:0/500260082 wait complete. 2024-04-23T10:12:41.584 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.702+0000 7f5fbc819640 1 Processor -- start 2024-04-23T10:12:41.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.702+0000 7f5fbc819640 1 -- start start 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f5fb8152270 0x7f5fb81587b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fb8072700 0x7f5fb8072b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5fb8073090 con 0x7f5fb806d690 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb80c81e0 con 0x7f5fb8072700 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f5fb80c84c0 con 0x7f5fb8152270 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5fb8072700 0x7f5fb8072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb5d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5fb806d690 0x7f5fb806cae0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50388/0 (socket says 172.21.15.26:50388) 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb5d9b640 1 -- 172.21.15.26:0/2748737706 learned_addr learned my addr 172.21.15.26:0/2748737706 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb659c640 1 --2- 172.21.15.26:0/2748737706 >> v2:172.21.15.190:3300/0 conn(0x7f5fb8152270 0x7f5fb81587b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/2748737706 >> v2:172.21.15.190:3300/0 conn(0x7f5fb8152270 msgr2=0x7f5fb81587b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 --2- 172.21.15.26:0/2748737706 >> v2:172.21.15.190:3300/0 conn(0x7f5fb8152270 0x7f5fb81587b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/2748737706 >> v1:172.21.15.26:6789/0 conn(0x7f5fb806d690 legacy=0x7f5fb806cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/2748737706 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb80c87a0 con 0x7f5fb8072700 2024-04-23T10:12:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb6d9d640 1 --2- 172.21.15.26:0/2748737706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8072700 0x7f5fb8072b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8070a30 tx=0x7f5fb001c280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e59dac5e0ecbaad6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb559a640 1 -- 172.21.15.26:0/2748737706 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b0070 con 0x7f5fb8072700 2024-04-23T10:12:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb559a640 1 -- 172.21.15.26:0/2748737706 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb00ab600 con 0x7f5fb8072700 2024-04-23T10:12:41.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fb559a640 1 -- 172.21.15.26:0/2748737706 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00ab9d0 con 0x7f5fb8072700 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- 172.21.15.26:0/2748737706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8072700 msgr2=0x7f5fb8072b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 --2- 172.21.15.26:0/2748737706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8072700 0x7f5fb8072b50 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f5fb8070a30 tx=0x7f5fb001c280 comp rx=0 tx=0).stop 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- 172.21.15.26:0/2748737706 shutdown_connections 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 --2- 172.21.15.26:0/2748737706 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8072700 0x7f5fb8072b50 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 --2- 172.21.15.26:0/2748737706 >> v2:172.21.15.190:3300/0 conn(0x7f5fb8152270 0x7f5fb81587b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- 172.21.15.26:0/2748737706 >> 172.21.15.26:0/2748737706 conn(0x7f5fb80ca0d0 msgr2=0x7f5fb80ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:41.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- 172.21.15.26:0/2748737706 shutdown_connections 2024-04-23T10:12:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.706+0000 7f5fbc819640 1 -- 172.21.15.26:0/2748737706 wait complete. 2024-04-23T10:12:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 Processor -- start 2024-04-23T10:12:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- start start 2024-04-23T10:12:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 0x7f5fb81f41d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb8072700 0x7f5fb814e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb80724e0 con 0x7f5fb8152270 2024-04-23T10:12:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5fb8072360 con 0x7f5fb8072700 2024-04-23T10:12:41.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5fb806d1f0 con 0x7f5fb806d690 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:51752/0 (socket says 172.21.15.26:51752) 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/989036219 learned_addr learned my addr 172.21.15.26:0/989036219 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb659c640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 0x7f5fb81f41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb5d9b640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb8072700 0x7f5fb814e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 msgr2=0x7f5fb81f41d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 0x7f5fb81f41d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb8072700 msgr2=0x7f5fb814e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb8072700 0x7f5fb814e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 -- 172.21.15.26:0/989036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5fb815bcd0 con 0x7f5fb8152270 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb659c640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 0x7f5fb81f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:41.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fb6d9d640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5fb001a930 tx=0x7f5fb0019020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b0040 con 0x7f5fb8152270 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5fb00b9070 con 0x7f5fb8152270 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5fb815bfb0 con 0x7f5fb8152270 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5fb00b4650 con 0x7f5fb8152270 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5fb814c7c0 con 0x7f5fb8152270 2024-04-23T10:12:41.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.710+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5fb8075df0 con 0x7f5fb8152270 2024-04-23T10:12:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.714+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5fb00b47f0 con 0x7f5fb8152270 2024-04-23T10:12:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.714+0000 7f5faeffd640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 0x7f5f9806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.714+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f5fb0120bc0 con 0x7f5fb8152270 2024-04-23T10:12:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.714+0000 7f5fb659c640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 0x7f5f9806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:41.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.714+0000 7f5fb659c640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 0x7f5f9806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b9f0 tx=0x7f5fa8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:41.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.718+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5fb0015f90 con 0x7f5fb8152270 2024-04-23T10:12:41.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.882+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f5fb806dd50 con 0x7f5fb8152270 2024-04-23T10:12:41.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.882+0000 7f5faeffd640 1 -- 172.21.15.26:0/989036219 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f5fb00f0da0 con 0x7f5fb8152270 2024-04-23T10:12:41.883 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:41.884 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 msgr2=0x7f5f9806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 0x7f5f9806a840 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f5fa800b9f0 tx=0x7f5fa8008040 comp rx=0 tx=0).stop 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 msgr2=0x7f5fb8150d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f5fb001a930 tx=0x7f5fb0019020 comp rx=0 tx=0).stop 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 shutdown_connections 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5f98068380 0x7f5f9806a840 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5fb8152270 0x7f5fb8150d40 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5fb8072700 0x7f5fb814e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 --2- 172.21.15.26:0/989036219 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5fb806d690 0x7f5fb81f41d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 >> 172.21.15.26:0/989036219 conn(0x7f5fb80ca0d0 msgr2=0x7f5fb80c5b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 shutdown_connections 2024-04-23T10:12:41.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:41.886+0000 7f5fbc819640 1 -- 172.21.15.26:0/989036219 wait complete. 2024-04-23T10:12:42.506 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 5, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:12:34.380485+0000', 'modified': '2024-04-23T10:12:39.438478+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.190:6838/585421961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 585421961}, {'type': 'v1', 'addr': '172.21.15.190:6838', 'nonce': 585421961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 0, 'qdb_cluster': []} 2024-04-23T10:12:42.506 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4287:up:creating 2024-04-23T10:12:43.507 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:43.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 Processor -- start 2024-04-23T10:12:43.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 -- start start 2024-04-23T10:12:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe2406c980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbe2406b9d0 0x7fbe240c4ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe2415d2d0 con 0x7fbe2406dad0 2024-04-23T10:12:43.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbe2415cda0 con 0x7fbe2406b9d0 2024-04-23T10:12:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2be88640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe2415cff0 con 0x7fbe24152f30 2024-04-23T10:12:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2a425640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbe2406dad0 0x7fbe241590f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39040/0 (socket says 172.21.15.26:39040) 2024-04-23T10:12:43.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2a425640 1 -- 172.21.15.26:0/1670273790 learned_addr learned my addr 172.21.15.26:0/1670273790 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 --2- 172.21.15.26:0/1670273790 >> v2:172.21.15.190:3300/0 conn(0x7fbe2406b9d0 0x7fbe240c4ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe2406c980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 727709336 0 0) 0x7fbe2415d2d0 con 0x7fbe2406dad0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbe10003530 con 0x7fbe2406dad0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1564207405 0 0) 0x7fbe10003530 con 0x7fbe2406dad0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 msgr2=0x7fbe2406c980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe2406c980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 >> v2:172.21.15.190:3300/0 conn(0x7fbe2406b9d0 msgr2=0x7fbe240c4ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 --2- 172.21.15.26:0/1670273790 >> v2:172.21.15.190:3300/0 conn(0x7fbe2406b9d0 0x7fbe240c4ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe2406d200 con 0x7fbe2406dad0 2024-04-23T10:12:43.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fbe1c001a00 con 0x7fbe2406dad0 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 >> v1:172.21.15.26:6789/0 conn(0x7fbe2406dad0 legacy=0x7fbe241590f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe100039c0 0x7fbe10003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe10004810 0x7fbe10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2415cda0 con 0x7fbe10004810 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2415cff0 con 0x7fbe100039c0 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe1000b9d0 con 0x7fbe24152f30 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe10004810 0x7fbe10004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe100039c0 0x7fbe10003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe2a425640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 -- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 msgr2=0x7fbe100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe24152f30 0x7fbe100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 -- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe100039c0 msgr2=0x7fbe10003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:43.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe100039c0 0x7fbe10003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.646+0000 7fbe29423640 1 -- 172.21.15.26:0/1670273790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe10003530 con 0x7fbe10004810 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe29423640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe10004810 0x7fbe10004c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009ae0 tx=0x7fbe2001cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1b20bc1417b538e8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200096b0 con 0x7fbe10004810 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe200a64c0 con 0x7fbe10004810 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe28c22640 1 -- 172.21.15.26:0/1670273790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe200a68b0 con 0x7fbe10004810 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- 172.21.15.26:0/1670273790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe10004810 msgr2=0x7fbe10004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1670273790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe10004810 0x7fbe10004c90 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fbe20009ae0 tx=0x7fbe2001cab0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2a425640 1 -- 172.21.15.26:0/1670273790 reap_dead start 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- 172.21.15.26:0/1670273790 shutdown_connections 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- 172.21.15.26:0/1670273790 >> 172.21.15.26:0/1670273790 conn(0x7fbe240ca0d0 msgr2=0x7fbe240ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- 172.21.15.26:0/1670273790 shutdown_connections 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- 172.21.15.26:0/1670273790 wait complete. 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 Processor -- start 2024-04-23T10:12:43.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.650+0000 7fbe2be88640 1 -- start start 2024-04-23T10:12:43.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 0x7fbe241583a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe24156c10 0x7fbe240c8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe24153310 con 0x7fbe24072960 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe2406d7c0 con 0x7fbe24156c10 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe24153490 con 0x7fbe10004810 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44622/0 (socket says 172.21.15.26:44622) 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 -- 172.21.15.26:0/1960200395 learned_addr learned my addr 172.21.15.26:0/1960200395 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 0x7fbe241583a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe29423640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe24156c10 0x7fbe240c8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 -- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 msgr2=0x7fbe241583a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 0x7fbe241583a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 -- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe24156c10 msgr2=0x7fbe240c8fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe24156c10 0x7fbe240c8fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 -- 172.21.15.26:0/1960200395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe241588e0 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 0x7fbe241583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2a425640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe2406efa0 tx=0x7fbe1c011c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c010040 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe1c01a070 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe241571e0 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe1c00fb60 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe24157ba0 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe24075df0 con 0x7fbe24072960 2024-04-23T10:12:43.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe1c00fd00 con 0x7fbe24072960 2024-04-23T10:12:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 0x7fbe0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbe1c089bf0 con 0x7fbe24072960 2024-04-23T10:12:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.654+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 0x7fbe0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:43.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.658+0000 7fbe29c24640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 0x7fbe0806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009a10 tx=0x7fbe14008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:43.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.658+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe1c059e70 con 0x7fbe24072960 2024-04-23T10:12:43.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbe241567c0 con 0x7fbe24072960 2024-04-23T10:12:43.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe1a7fc640 1 -- 172.21.15.26:0/1960200395 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 7 v7) ==== 93+0+6831 (secure 0 0 0) 0x7fbe1c059770 con 0x7fbe24072960 2024-04-23T10:12:43.862 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:43.862 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":7,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4284,"name":"a","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":2}],"filesystems":[{"mdsmap":{"epoch":6,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:12:42.095089+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":1,"in":[0],"up":{"mds_0":4287},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-23T10:12:43.863 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 7 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 msgr2=0x7fbe0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 0x7fbe0806a870 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe14009a10 tx=0x7fbe14008040 comp rx=0 tx=0).stop 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 msgr2=0x7fbe241430b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fbe2406efa0 tx=0x7fbe1c011c20 comp rx=0 tx=0).stop 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 shutdown_connections 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe080683b0 0x7fbe0806a870 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe24072960 0x7fbe241430b0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe24156c10 0x7fbe240c8fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 --2- 172.21.15.26:0/1960200395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe10004810 0x7fbe241583a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 >> 172.21.15.26:0/1960200395 conn(0x7fbe240ca0d0 msgr2=0x7fbe2414d470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 shutdown_connections 2024-04-23T10:12:43.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:43.862+0000 7fbe2be88640 1 -- 172.21.15.26:0/1960200395 wait complete. 2024-04-23T10:12:44.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 6, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:12:34.380485+0000', 'modified': '2024-04-23T10:12:42.095089+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 60, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 1, 'in': [0], 'up': {'mds_0': 4287}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4287': {'gid': 4287, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.190:6838/585421961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 585421961}, {'type': 'v1', 'addr': '172.21.15.190:6838', 'nonce': 585421961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 1, 'qdb_leader': 4287, 'qdb_cluster': [4287]} 2024-04-23T10:12:44.483 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 1/1 2024-04-23T10:12:44.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:12:44.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 Processor -- start 2024-04-23T10:12:44.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 -- start start 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c0703c0 0x7f405c15b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f405c06cee0 0x7f405c06d370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f405c0c8570 con 0x7f405c144580 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f405c15f420 con 0x7f405c06cee0 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f406370c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0c8040 con 0x7f405c0703c0 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f405c06cee0 0x7f405c06d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f405c06cee0 0x7f405c06d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44628/0 (socket says 172.21.15.26:44628) 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 -- 172.21.15.26:0/4032765444 learned_addr learned my addr 172.21.15.26:0/4032765444 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4060ca7640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c0703c0 0x7f405c15b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 -- 172.21.15.26:0/4032765444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c0703c0 msgr2=0x7f405c15b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c0703c0 0x7f405c15b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 -- 172.21.15.26:0/4032765444 >> v1:172.21.15.190:6789/0 conn(0x7f405c144580 legacy=0x7f405c0c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:44.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.622+0000 7f4061ca9640 1 -- 172.21.15.26:0/4032765444 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c0c8290 con 0x7f405c06cee0 2024-04-23T10:12:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4061ca9640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c06cee0 0x7f405c06d370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4058009870 tx=0x7f405801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=711299a6b40259db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4053fff640 1 -- 172.21.15.26:0/4032765444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580a9620 con 0x7f405c06cee0 2024-04-23T10:12:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4053fff640 1 -- 172.21.15.26:0/4032765444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40580a97c0 con 0x7f405c06cee0 2024-04-23T10:12:44.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4053fff640 1 -- 172.21.15.26:0/4032765444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580a9b90 con 0x7f405c06cee0 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- 172.21.15.26:0/4032765444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c06cee0 msgr2=0x7f405c06d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c06cee0 0x7f405c06d370 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f4058009870 tx=0x7f405801c560 comp rx=0 tx=0).stop 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- 172.21.15.26:0/4032765444 shutdown_connections 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c06cee0 0x7f405c06d370 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- 172.21.15.26:0/4032765444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c0703c0 0x7f405c15b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- 172.21.15.26:0/4032765444 >> 172.21.15.26:0/4032765444 conn(0x7f405c0ca540 msgr2=0x7f405c0ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- 172.21.15.26:0/4032765444 shutdown_connections 2024-04-23T10:12:44.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- 172.21.15.26:0/4032765444 wait complete. 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 Processor -- start 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- start start 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 0x7f405c15ab50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 0x7f405c138900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f405c0c8cb0 con 0x7f405c0703c0 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f405c15ef00 con 0x7f405c06cee0 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f406370c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f405c0c9720 con 0x7f405c144580 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4060ca7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4060ca7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44630/0 (socket says 172.21.15.26:44630) 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4060ca7640 1 -- 172.21.15.26:0/1869814890 learned_addr learned my addr 172.21.15.26:0/1869814890 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f4061ca9640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 0x7f405c138900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.626+0000 7f40614a8640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 0x7f405c15ab50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 -- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 msgr2=0x7f405c138900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 0x7f405c138900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 -- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 msgr2=0x7f405c15ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 0x7f405c15ab50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 -- 172.21.15.26:0/1869814890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f405c1391a0 con 0x7f405c0703c0 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f40614a8640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 0x7f405c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4061ca9640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 0x7f405c138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4060ca7640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d800 tx=0x7f404c00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:44.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 -- 172.21.15.26:0/1869814890 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c00b660 con 0x7f405c0703c0 2024-04-23T10:12:44.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 -- 172.21.15.26:0/1869814890 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f404c019070 con 0x7f405c0703c0 2024-04-23T10:12:44.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f405c139480 con 0x7f405c0703c0 2024-04-23T10:12:44.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 -- 172.21.15.26:0/1869814890 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f404c00ba00 con 0x7f405c0703c0 2024-04-23T10:12:44.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f405c138e40 con 0x7f405c0703c0 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 -- 172.21.15.26:0/1869814890 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f404c00bba0 con 0x7f405c0703c0 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 0x7f404006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f4051ffb640 1 -- 172.21.15.26:0/1869814890 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f404c087070 con 0x7f405c0703c0 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f40614a8640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 0x7f404006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f406688e000 1 Processor -- start 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.630+0000 7f406688e000 1 -- start start 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 0x7f404006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4054007fd0 tx=0x7f4054009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x556651801080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566518015c0 0x5566518019a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55665160f420 con 0x5566517c6190 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5566515a9bf0 con 0x5566517c6ab0 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55665160b3e0 con 0x5566518015c0 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44636/0 (socket says 172.21.15.26:44636) 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/309707661 learned_addr learned my addr 172.21.15.26:0/309707661 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4061ca9640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566518015c0 0x5566518019a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4060ca7640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x556651801080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566518015c0 msgr2=0x5566518019a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:44.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566518015c0 0x5566518019a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 msgr2=0x556651801080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x556651801080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/309707661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566516b7450 con 0x5566517c6190 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4060ca7640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x556651801080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4054001440 tx=0x7f4054010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ea3abe42c45ac91e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4046ffd640 1 -- 172.21.15.26:0/309707661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4054024070 con 0x5566517c6190 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4046ffd640 1 -- 172.21.15.26:0/309707661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405401f400 con 0x5566517c6190 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4046ffd640 1 -- 172.21.15.26:0/309707661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405401f7d0 con 0x5566517c6190 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- 172.21.15.26:0/309707661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 msgr2=0x5566517c6570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f4054001440 tx=0x7f4054010000 comp rx=0 tx=0).stop 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- 172.21.15.26:0/309707661 shutdown_connections 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566518015c0 0x5566518019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x556651801080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- 172.21.15.26:0/309707661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c6570 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- 172.21.15.26:0/309707661 >> 172.21.15.26:0/309707661 conn(0x5566517fde40 msgr2=0x556651800260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:44.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- 172.21.15.26:0/309707661 shutdown_connections 2024-04-23T10:12:44.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- 172.21.15.26:0/309707661 wait complete. 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- start start 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 Processor -- start 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566517c3120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 0x5566517c3660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5566515afec0 con 0x5566517c6190 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556651690120 con 0x5566518015c0 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55665161a350 con 0x5566517c6ab0 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f406688e000 10 client.0 _ll_register_callbacks cb 0x5566515ec4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:12:44.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44640/0 (socket says 172.21.15.26:44640) 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/909646996 learned_addr learned my addr 172.21.15.26:0/909646996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4060ca7640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566517c3120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4061ca9640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 0x5566517c3660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 msgr2=0x5566517c3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566517c3120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 msgr2=0x5566517c3660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 0x5566517c3660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 -- 172.21.15.26:0/909646996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556651654f80 con 0x5566517c6190 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4060ca7640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566517c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f4061ca9640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 0x5566517c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f40614a8640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4054009010 tx=0x7f4054014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fc63eaa315f752ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:44.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.634+0000 7f403bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f405402f020 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f405401fdf0 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f405401f400 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f4054024050 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 10 client.4428 fetch_fsmap learned FSMap version 7 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5566515e8f00 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f405401f400 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f4054006b60 con 0x5566517c6190 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 10 client.4428 fetch_fsmap finished waiting for FSMap version 7 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 10 client.4428 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 20 client.4428 populate_metadata read hostname 'smithi026' 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651815d90 0x556651818180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 4 client.4428 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:12:44.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5566515a8bc0 con 0x556651815d90 2024-04-23T10:12:44.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f4060ca7640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651815d90 0x556651818180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:44.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f4060ca7640 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651815d90 0x556651818180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa481ca09f8123c0 server_cookie=9d21e85fc5b8b879 in_seq=0 out_seq=0 2024-04-23T10:12:44.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:44.638+0000 7f403bfff640 10 client.4428 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:12:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f403bfff640 1 -- 172.21.15.26:0/909646996 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5566515a8bc0 con 0x556651815d90 2024-04-23T10:12:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f403bfff640 10 client.4428 handle_command_reply: tid=0 2024-04-23T10:12:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 client.4428 shutdown 2024-04-23T10:12:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 msgr2=0x5566517c2be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f4054009010 tx=0x7f4054014000 comp rx=0 tx=0).stop 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 shutdown_connections 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651815d90 0x556651818180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566518015c0 0x5566517c3660 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566517c3120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 --2- 172.21.15.26:0/909646996 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566517c6190 0x5566517c2be0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f403bfff640 0 client.4428 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 >> 172.21.15.26:0/909646996 conn(0x5566517fde40 msgr2=0x5566517ff1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 shutdown_connections 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 1 -- 172.21.15.26:0/909646996 wait complete. 2024-04-23T10:12:47.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.106+0000 7f406688e000 20 client.4428 trim_cache size 0 max 16384 2024-04-23T10:12:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.142+0000 7f406688e000 1 Processor -- start 2024-04-23T10:12:47.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.142+0000 7f406688e000 1 -- start start 2024-04-23T10:12:47.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6190 0x5566517fbe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x5566517fc3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f405c200710 con 0x5566518015c0 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5566515db9e0 con 0x5566517c6ab0 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55665160e730 con 0x5566517c6190 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44642/0 (socket says 172.21.15.26:44642) 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 -- 172.21.15.26:0/1971066988 learned_addr learned my addr 172.21.15.26:0/1971066988 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f40614a8640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6190 0x5566517fbe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4060ca7640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x5566517fc3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 -- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6190 msgr2=0x5566517fbe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6190 0x5566517fbe90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 -- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 msgr2=0x5566517fc3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x5566517fc3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 -- 172.21.15.26:0/1971066988 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556651595e80 con 0x5566518015c0 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4060ca7640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x5566517fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f4061ca9640 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40580ab040 tx=0x7f40580a7000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f5f30a4af6892919 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f40467fc640 1 -- 172.21.15.26:0/1971066988 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580a9980 con 0x5566518015c0 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f40467fc640 1 -- 172.21.15.26:0/1971066988 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40580c0070 con 0x5566518015c0 2024-04-23T10:12:47.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f40467fc640 1 -- 172.21.15.26:0/1971066988 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580a9d40 con 0x5566518015c0 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- 172.21.15.26:0/1971066988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 msgr2=0x556651872510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f40580ab040 tx=0x7f40580a7000 comp rx=0 tx=0).stop 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- 172.21.15.26:0/1971066988 shutdown_connections 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651872510 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6ab0 0x5566517fc3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 --2- 172.21.15.26:0/1971066988 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6190 0x5566517fbe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- 172.21.15.26:0/1971066988 >> 172.21.15.26:0/1971066988 conn(0x5566517fde40 msgr2=0x5566517bfcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- 172.21.15.26:0/1971066988 shutdown_connections 2024-04-23T10:12:47.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.146+0000 7f406688e000 1 -- 172.21.15.26:0/1971066988 wait complete. 2024-04-23T10:12:47.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- start start 2024-04-23T10:12:47.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 Processor -- start 2024-04-23T10:12:47.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6190 0x55665186f2a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566518702e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55665161c630 con 0x5566518015c0 2024-04-23T10:12:47.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556651613a50 con 0x5566517c6190 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5566515afa40 con 0x5566517c6ab0 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 10 client.0 _ll_register_callbacks cb 0x7f4054022070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44646/0 (socket says 172.21.15.26:44646) 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 -- 172.21.15.26:0/2200146506 learned_addr learned my addr 172.21.15.26:0/2200146506 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4060ca7640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566518702e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6190 0x55665186f2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 -- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 msgr2=0x5566518702e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566518702e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 -- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6190 msgr2=0x55665186f2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:47.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6190 0x55665186f2a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 -- 172.21.15.26:0/2200146506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566515d7b30 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f4061ca9640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f405801ac10 tx=0x7f405801ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e65f1ebf444130d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f40580cc610 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f40580b2de0 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f40580c0070 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=7) ==== 24+0+0 (secure 0 0 0) 0x7f40580d2050 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 10 client.4434 fetch_fsmap learned FSMap version 7 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=7,monmap=2+}) -- 0x5566516905b0 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40580c0070 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 7) ==== 4712+0+0 (secure 0 0 0) 0x7f40580d5020 con 0x5566518015c0 2024-04-23T10:12:47.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 10 client.4434 fetch_fsmap finished waiting for FSMap version 7 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 10 client.4434 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 20 client.4434 populate_metadata read hostname 'smithi026' 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 4 client.4434 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.150+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "status"}) -- 0x55665161ce40 con 0x556651870d60 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.154+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.154+0000 7f40614a8640 1 -- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 msgr2=0x556651871140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 18 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.154+0000 7f40614a8640 1 -- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 msgr2=0x556651871140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.154+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:12:47.156 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.154+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:12:47.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f40614a8640 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=161915c53964b3e9 server_cookie=dfbc3f4680ced3dd in_seq=0 out_seq=0 2024-04-23T10:12:47.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f403bfff640 10 client.4434 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:12:47.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f403bfff640 1 -- 172.21.15.26:0/2200146506 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55665161ce40 con 0x556651870d60 2024-04-23T10:12:47.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f403bfff640 10 client.4434 handle_command_reply: tid=0 2024-04-23T10:12:47.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 client.4434 shutdown 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 msgr2=0x556651870820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f405801ac10 tx=0x7f405801ada0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 shutdown_connections 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556651870d60 0x556651871140 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5566518015c0 0x556651870820 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5566517c6ab0 0x5566518702e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f403bfff640 0 client.4434 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 --2- 172.21.15.26:0/2200146506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5566517c6190 0x55665186f2a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 >> 172.21.15.26:0/2200146506 conn(0x5566517fde40 msgr2=0x5566517be880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 shutdown_connections 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 1 -- 172.21.15.26:0/2200146506 wait complete. 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.358+0000 7f406688e000 20 client.4434 trim_cache size 0 max 16384 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:12:47.360 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4287, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 12.353348119, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 6, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 24, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 24, 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 19.384603449 2024-04-23T10:12:47.361 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 msgr2=0x7f404006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 0x7f404006a840 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f4054007fd0 tx=0x7f4054009040 comp rx=0 tx=0).stop 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 msgr2=0x7f405c0cbf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f404c00d800 tx=0x7f404c00dcc0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 shutdown_connections 2024-04-23T10:12:47.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4040068380 0x7f404006a840 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f405c144580 0x7f405c138900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f405c0703c0 0x7f405c0cbf40 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 --2- 172.21.15.26:0/1869814890 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f405c06cee0 0x7f405c15ab50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 >> 172.21.15.26:0/1869814890 conn(0x7f405c0ca540 msgr2=0x7f405c06f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 shutdown_connections 2024-04-23T10:12:47.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.362+0000 7f406370c640 1 -- 172.21.15.26:0/1869814890 wait complete. 2024-04-23T10:12:47.391 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T10:12:47.391 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:47.391 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T10:12:47.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 Processor -- start 2024-04-23T10:12:47.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 -- start start 2024-04-23T10:12:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9d740c5d70 con 0x7f9d7414fbc0 2024-04-23T10:12:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9d740c6050 con 0x7f9d74074100 2024-04-23T10:12:47.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d79ce2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d740c6330 con 0x7f9d7414ffa0 2024-04-23T10:12:47.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d73fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:40088/0 (socket says 172.21.15.26:40088) 2024-04-23T10:12:47.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d73fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:57486/0 (socket says 172.21.15.26:57486) 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3020520667 learned_addr learned my addr 172.21.15.26:0/3020520667 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d737fe640 1 --1- 172.21.15.26:0/3020520667 >> v1:172.21.15.190:6789/0 conn(0x7f9d7414fbc0 0x7f9d740c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:59700/0 (socket says 172.21.15.26:59700) 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3020520667 >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 msgr2=0x7f9d740c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 --2- 172.21.15.26:0/3020520667 >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3020520667 >> v1:172.21.15.190:6789/0 conn(0x7f9d7414fbc0 legacy=0x7f9d740c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3020520667 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d740c6610 con 0x7f9d7414ffa0 2024-04-23T10:12:47.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.526+0000 7f9d73fff640 1 --2- 172.21.15.26:0/3020520667 >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:12:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d72ffd640 1 --2- 172.21.15.26:0/3020520667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d6401c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1dfea2f4f8feda3d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d727fc640 1 -- 172.21.15.26:0/3020520667 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640a9640 con 0x7f9d7414ffa0 2024-04-23T10:12:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d727fc640 1 -- 172.21.15.26:0/3020520667 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d640a97e0 con 0x7f9d7414ffa0 2024-04-23T10:12:47.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d727fc640 1 -- 172.21.15.26:0/3020520667 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640a9bb0 con 0x7f9d7414ffa0 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3020520667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 msgr2=0x7f9d7406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3020520667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f9d64009870 tx=0x7f9d6401c560 comp rx=0 tx=0).stop 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3020520667 shutdown_connections 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3020520667 >> v2:172.21.15.190:3300/0 conn(0x7f9d74074100 0x7f9d740c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3020520667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d7414ffa0 0x7f9d7406f700 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3020520667 >> 172.21.15.26:0/3020520667 conn(0x7f9d7406b9d0 msgr2=0x7f9d7406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3020520667 shutdown_connections 2024-04-23T10:12:47.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3020520667 wait complete. 2024-04-23T10:12:47.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 Processor -- start 2024-04-23T10:12:47.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.530+0000 7f9d79ce2640 1 -- start start 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d74074100 0x7f9d740bd090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7414ffa0 0x7f9d740bde80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740c8ab0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9d740c8930 con 0x7f9d7414ffa0 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d74166090 con 0x7f9d74074100 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44656/0 (socket says 172.21.15.26:44656) 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3116453689 learned_addr learned my addr 172.21.15.26:0/3116453689 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d737fe640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d74074100 0x7f9d740bd090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d73fff640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7414ffa0 0x7f9d740bde80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d74074100 msgr2=0x7f9d740bd090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d74074100 0x7f9d740bd090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7414ffa0 msgr2=0x7f9d740bde80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7414ffa0 0x7f9d740bde80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 -- 172.21.15.26:0/3116453689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d740bb4a0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d72ffd640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d6401ce00 tx=0x7f9d64019300 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640b15f0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d640b1790 con 0x7f9d7414fbc0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d740bb740 con 0x7f9d7414fbc0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d640b1b80 con 0x7f9d7414fbc0 2024-04-23T10:12:47.535 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d740bc5b0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d74075df0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d640a83a0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 0x7f9d5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.534+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9d641211c0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.538+0000 7f9d737fe640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 0x7f9d5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:47.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.538+0000 7f9d737fe640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 0x7f9d5406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c000f70 tx=0x7f9d5c007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:47.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.542+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d640c0070 con 0x7f9d7414fbc0 2024-04-23T10:12:47.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.746+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f9d740cc2e0 con 0x7f9d7414fbc0 2024-04-23T10:12:47.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.746+0000 7f9d6bfff640 1 -- 172.21.15.26:0/3116453689 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v7) ==== 53+0+88 (secure 0 0 0) 0x7f9d640ad020 con 0x7f9d7414fbc0 2024-04-23T10:12:47.746 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 msgr2=0x7f9d5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 0x7f9d5406a870 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f9d5c000f70 tx=0x7f9d5c007cd0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 msgr2=0x7f9d740ba180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7f9d6401ce00 tx=0x7f9d64019300 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 shutdown_connections 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d540683b0 0x7f9d5406a870 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d7414ffa0 0x7f9d740bde80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d7414fbc0 0x7f9d740ba180 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 --2- 172.21.15.26:0/3116453689 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d74074100 0x7f9d740bd090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 >> 172.21.15.26:0/3116453689 conn(0x7f9d7406b9d0 msgr2=0x7f9d7414e910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 shutdown_connections 2024-04-23T10:12:47.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47.750+0000 7f9d79ce2640 1 -- 172.21.15.26:0/3116453689 wait complete. 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:Mounting Ceph FS cephfs; just confirmed its presence on cluster 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:self.client.name = client.admin 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:self.cephfs_name = cephfs 2024-04-23T10:12:47.766 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T10:12:47.767 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T10:12:47.767 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T10:12:47.767 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:47.767 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-04-23T10:12:47.773 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42491sec preferred_lft 42491sec 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:12:47.774 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-04-23T10:12:47.775 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T10:12:47.775 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:59:f5:18:b3 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:12:47.775 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T10:12:47.775 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:12:47.775 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T10:12:47.775 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:12:47.775 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:12:47.775 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-04-23T10:12:47.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-04-23T10:12:47.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-04-23T10:12:47.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T10:12:47.776 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:12:47.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:12:47.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:47 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:47.902 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:47.902 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T10:12:47.912 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-04-23T10:12:47.913 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:47.913 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-04-23T10:12:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-04-23T10:12:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T10:12:47.979 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T10:12:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T10:12:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T10:12:47.980 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T10:12:47.980 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:12:48.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:12:48.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:48.101 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:48.101 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-23T10:12:48.107 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:48.107 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-04-23T10:12:48.153 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:12:48.153 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:12:48.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:48.154 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.admin 0 2024-04-23T10:12:48.154 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:12:48.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:12:48.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:48.268 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.admin' with 192.168.0.1/16 2024-04-23T10:12:48.268 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:12:48.268 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:12:48.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.admin type veth peer name brx.0 2024-04-23T10:12:48.268 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T10:12:48.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set veth0 up 2024-04-23T10:12:48.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip link set lo up 2024-04-23T10:12:48.269 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.admin ip route add default via 192.168.255.254 2024-04-23T10:12:48.269 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:12:48.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:12:48.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:48.376 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:12:48.376 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:12:48.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-04-23T10:12:48.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T10:12:48.376 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:12:48.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:12:48.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:48 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:48.435 INFO:tasks.cephfs.fuse_mount:Client client.admin config is {} 2024-04-23T10:12:48.435 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:12:48.435 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:48.485 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.admin' 2024-04-23T10:12:48.486 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:12:48.486 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:48.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:12:48.590 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:12:48.638 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:12:48.639 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:48.640 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:48.641 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:48.641 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:12:48.689 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T10:12:48.689 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.admin --id admin --client_fs=cephfs) 2024-04-23T10:12:48.734 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:12:48.749 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:12:48.797 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:12:48.797 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:12:48.797 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:12:48.798 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:12:48.799 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:12:48.800 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:48.800 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:48.800 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:48.800 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:12:48.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:2024-04-23T10:12:48.818+0000 7f3e238e3580 -1 init, newargv = 0x55783b9ae760 newargc=15 2024-04-23T10:12:48.820 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[33409]: starting ceph client 2024-04-23T10:12:48.829 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[33409]: starting fuse 2024-04-23T10:12:49.926 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:12:49.942 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:12:49.990 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:12:49.991 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:12:49.992 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:49.993 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:12:49.993 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:49.993 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:49.994 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:12:50.041 INFO:teuthology.orchestra.run.smithi026.stdout:45 2024-04-23T10:12:50.041 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> import re 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> import os 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.admin.*.asok" 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.admin" 2024-04-23T10:12:50.042 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> return f 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:12:50.043 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.admin")) 2024-04-23T10:12:50.044 DEBUG:teuthology.orchestra.run.smithi026:> ' 2024-04-23T10:12:50.167 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.admin.33409.asok 2024-04-23T10:12:50.170 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:50.178 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.admin.33409.asok 2024-04-23T10:12:50.178 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:50.178 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.admin.33409.asok status 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "admin", 2024-04-23T10:12:50.327 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.admin", 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "33409", 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4443, 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4443 2024-04-23T10:12:50.328 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2231088609 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 2231088609 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:12:50.329 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4443 192.168.0.1:0/2231088609", 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/2231088609", 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 6, 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 24, 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2024-04-23T10:12:50.330 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:12:50.340 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:50.341 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2024-04-23T10:12:50.341 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:50.347 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2024-04-23T10:12:50.347 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:50.347 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:50.347 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:50.402 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest/mnt.admin && exec stdin-killer --timeout=900 -- bash -c 'setfattr -n ceph.dir.layout.pool -v cephfs_data_ec . && getfattr -n ceph.dir.layout .') 2024-04-23T10:12:50.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50 stdin-killer INFO: expiration expected; waiting 900 seconds for command to complete 2024-04-23T10:12:50.539 INFO:teuthology.orchestra.run.smithi026.stdout:# file: . 2024-04-23T10:12:50.539 INFO:teuthology.orchestra.run.smithi026.stdout:ceph.dir.layout="stripe_unit=4194304 stripe_count=1 object_size=4194304 pool=cephfs_data_ec" 2024-04-23T10:12:50.540 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:50.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:12:50.546 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:50.546 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:12:50.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.718+0000 7fe5e7210640 1 Processor -- start 2024-04-23T10:12:50.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.718+0000 7fe5e7210640 1 -- start start 2024-04-23T10:12:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe5e014fbc0 0x7fe5e006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e014ffa0 0x7fe5e00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e00c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00c5d70 con 0x7fe5e014ffa0 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe5e00c6050 con 0x7fe5e014fbc0 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e7210640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e00c6330 con 0x7fe5e0074100 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e014ffa0 0x7fe5e00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5e014ffa0 0x7fe5e00c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44658/0 (socket says 172.21.15.26:44658) 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 -- 172.21.15.26:0/3264338859 learned_addr learned my addr 172.21.15.26:0/3264338859 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e4fac640 1 --2- 172.21.15.26:0/3264338859 >> v2:172.21.15.190:3300/0 conn(0x7fe5e014fbc0 0x7fe5e006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e57ad640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e00c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 -- 172.21.15.26:0/3264338859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 msgr2=0x7fe5e00c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e00c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 -- 172.21.15.26:0/3264338859 >> v2:172.21.15.190:3300/0 conn(0x7fe5e014fbc0 msgr2=0x7fe5e006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:50.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 --2- 172.21.15.26:0/3264338859 >> v2:172.21.15.190:3300/0 conn(0x7fe5e014fbc0 0x7fe5e006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 -- 172.21.15.26:0/3264338859 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e00c6610 con 0x7fe5e014ffa0 2024-04-23T10:12:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5e57ad640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5dffff640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e00c8220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0050430 tx=0x7fe5d401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdff350b23ed59f8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:50.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5df7fe640 1 -- 172.21.15.26:0/3264338859 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40aa660 con 0x7fe5e014ffa0 2024-04-23T10:12:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5df7fe640 1 -- 172.21.15.26:0/3264338859 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d40af070 con 0x7fe5e014ffa0 2024-04-23T10:12:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.722+0000 7fe5df7fe640 1 -- 172.21.15.26:0/3264338859 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d40aaa20 con 0x7fe5e014ffa0 2024-04-23T10:12:50.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- 172.21.15.26:0/3264338859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 msgr2=0x7fe5e00c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e00c8220 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7fe5e0050430 tx=0x7fe5d401c520 comp rx=0 tx=0).stop 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- 172.21.15.26:0/3264338859 shutdown_connections 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e00c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- 172.21.15.26:0/3264338859 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e00c8220 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- 172.21.15.26:0/3264338859 >> v2:172.21.15.190:3300/0 conn(0x7fe5e014fbc0 0x7fe5e006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- 172.21.15.26:0/3264338859 >> 172.21.15.26:0/3264338859 conn(0x7fe5e006b9d0 msgr2=0x7fe5e006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- 172.21.15.26:0/3264338859 shutdown_connections 2024-04-23T10:12:50.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- 172.21.15.26:0/3264338859 wait complete. 2024-04-23T10:12:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 Processor -- start 2024-04-23T10:12:50.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- start start 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e01520f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e014fbc0 0x7fe5e0141760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e01592e0 con 0x7fe5e014ffa0 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe5e0159160 con 0x7fe5e014fbc0 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e7210640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5e0159460 con 0x7fe5e0074100 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44668/0 (socket says 172.21.15.26:44668) 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 -- 172.21.15.26:0/1615785862 learned_addr learned my addr 172.21.15.26:0/1615785862 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5dffff640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e014fbc0 0x7fe5e0141760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e4fac640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e01520f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 -- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 msgr2=0x7fe5e01520f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e01520f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 -- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e014fbc0 msgr2=0x7fe5e0141760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e014fbc0 0x7fe5e0141760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 -- 172.21.15.26:0/1615785862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5e0150420 con 0x7fe5e014ffa0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.726+0000 7fe5e57ad640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800ce20 tx=0x7fe5d800a710 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d8003ba0 con 0x7fe5e014ffa0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5d8003d60 con 0x7fe5e014ffa0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5d800d880 con 0x7fe5e014ffa0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe5e01429c0 con 0x7fe5e014ffa0 2024-04-23T10:12:50.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5e01443e0 con 0x7fe5e014ffa0 2024-04-23T10:12:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5e0075df0 con 0x7fe5e014ffa0 2024-04-23T10:12:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5d800da20 con 0x7fe5e014ffa0 2024-04-23T10:12:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 0x7fe5cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe5d8087690 con 0x7fe5e014ffa0 2024-04-23T10:12:50.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5e4fac640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 0x7fe5cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:50.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.730+0000 7fe5e4fac640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 0x7fe5cc06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b9d0 tx=0x7fe5d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:50.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.734+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe5d8057870 con 0x7fe5e014ffa0 2024-04-23T10:12:50.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.894+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe5e0072b60 con 0x7fe5e014ffa0 2024-04-23T10:12:50.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.894+0000 7fe5dd7fa640 1 -- 172.21.15.26:0/1615785862 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fe5d8057170 con 0x7fe5e014ffa0 2024-04-23T10:12:50.896 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:50.896 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 msgr2=0x7fe5cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 0x7fe5cc06a840 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x7fe5d000b9d0 tx=0x7fe5d0008040 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 msgr2=0x7fe5e0150be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7fe5d800ce20 tx=0x7fe5d800a710 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 shutdown_connections 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5cc068380 0x7fe5cc06a840 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5e014ffa0 0x7fe5e0150be0 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe5e014fbc0 0x7fe5e0141760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 --2- 172.21.15.26:0/1615785862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5e0074100 0x7fe5e01520f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 >> 172.21.15.26:0/1615785862 conn(0x7fe5e006b9d0 msgr2=0x7fe5e00718c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 shutdown_connections 2024-04-23T10:12:50.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:50.898+0000 7fe5e7210640 1 -- 172.21.15.26:0/1615785862 wait complete. 2024-04-23T10:12:50.914 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:12:50.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:12:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 Processor -- start 2024-04-23T10:12:51.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 -- start start 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c153100 0x7f677c0676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f677c06db60 0x7f677c06dff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f677c06e530 con 0x7f677c0742b0 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f677c067c80 con 0x7f677c06db60 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f67826e9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f677c159c40 con 0x7f677c153100 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f677c06db60 0x7f677c06dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f677c06db60 0x7f677c06dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44670/0 (socket says 172.21.15.26:44670) 2024-04-23T10:12:51.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 -- 172.21.15.26:0/1103894152 learned_addr learned my addr 172.21.15.26:0/1103894152 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f677bfff640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c153100 0x7f677c0676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 -- 172.21.15.26:0/1103894152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c153100 msgr2=0x7f677c0676a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c153100 0x7f677c0676a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 -- 172.21.15.26:0/1103894152 >> v1:172.21.15.190:6789/0 conn(0x7f677c0742b0 legacy=0x7f677c0c8e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.034+0000 7f6780c86640 1 -- 172.21.15.26:0/1103894152 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c159030 con 0x7f677c06db60 2024-04-23T10:12:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f6780c86640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c06db60 0x7f677c06dff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6774009e50 tx=0x7f677401c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98cf5e3a492b94b3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f677affd640 1 -- 172.21.15.26:0/1103894152 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740a56d0 con 0x7f677c06db60 2024-04-23T10:12:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f677affd640 1 -- 172.21.15.26:0/1103894152 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67740a5870 con 0x7f677c06db60 2024-04-23T10:12:51.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f677affd640 1 -- 172.21.15.26:0/1103894152 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740a5c40 con 0x7f677c06db60 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- 172.21.15.26:0/1103894152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c06db60 msgr2=0x7f677c06dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c06db60 0x7f677c06dff0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6774009e50 tx=0x7f677401c960 comp rx=0 tx=0).stop 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- 172.21.15.26:0/1103894152 shutdown_connections 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c06db60 0x7f677c06dff0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- 172.21.15.26:0/1103894152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c153100 0x7f677c0676a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- 172.21.15.26:0/1103894152 >> 172.21.15.26:0/1103894152 conn(0x7f677c0cd050 msgr2=0x7f677c0cd460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- 172.21.15.26:0/1103894152 shutdown_connections 2024-04-23T10:12:51.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- 172.21.15.26:0/1103894152 wait complete. 2024-04-23T10:12:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 Processor -- start 2024-04-23T10:12:51.039 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- start start 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c06db60 0x7f677c0b1af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f677c0742b0 0x7f677c148f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f677c153660 con 0x7f677c153100 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f677c1534e0 con 0x7f677c0742b0 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.038+0000 7f67826e9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f677c0c9540 con 0x7f677c06db60 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44682/0 (socket says 172.21.15.26:44682) 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 -- 172.21.15.26:0/843839314 learned_addr learned my addr 172.21.15.26:0/843839314 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f677bfff640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c06db60 0x7f677c0b1af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f677b7fe640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f677c0742b0 0x7f677c148f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 -- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c06db60 msgr2=0x7f677c0b1af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c06db60 0x7f677c0b1af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 -- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f677c0742b0 msgr2=0x7f677c148f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f677c0742b0 0x7f677c148f40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 -- 172.21.15.26:0/843839314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f677c0c3a20 con 0x7f677c153100 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6780c86640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f677401b010 tx=0x7f6774019700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740b8670 con 0x7f677c153100 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f67740be070 con 0x7f677c153100 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f677c157700 con 0x7f677c153100 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f67740b8a50 con 0x7f677c153100 2024-04-23T10:12:51.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f677c14a900 con 0x7f677c153100 2024-04-23T10:12:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f677c075df0 con 0x7f677c153100 2024-04-23T10:12:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f67740b8bf0 con 0x7f677c153100 2024-04-23T10:12:51.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 0x7f676806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6774122900 con 0x7f677c153100 2024-04-23T10:12:51.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.042+0000 7f677bfff640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 0x7f676806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.046+0000 7f677bfff640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 0x7f676806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b930 tx=0x7f676c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.046+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f67740165e0 con 0x7f677c153100 2024-04-23T10:12:51.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f677c06e190 con 0x7f677c153100 2024-04-23T10:12:51.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f6778ff9640 1 -- 172.21.15.26:0/843839314 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7f67740f2db0 con 0x7f677c153100 2024-04-23T10:12:51.213 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 msgr2=0x7f676806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 0x7f676806a840 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f676c00b930 tx=0x7f676c008040 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 msgr2=0x7f677c1f6b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f677401b010 tx=0x7f6774019700 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 shutdown_connections 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6768068380 0x7f676806a840 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f677c153100 0x7f677c1f6b40 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f677c0742b0 0x7f677c148f40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 --2- 172.21.15.26:0/843839314 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f677c06db60 0x7f677c0b1af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 >> 172.21.15.26:0/843839314 conn(0x7f677c0cd050 msgr2=0x7f677c14d5d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 shutdown_connections 2024-04-23T10:12:51.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.214+0000 7f67826e9640 1 -- 172.21.15.26:0/843839314 wait complete. 2024-04-23T10:12:51.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:12:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.362+0000 7f77d6ed5640 1 Processor -- start 2024-04-23T10:12:51.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.362+0000 7f77d6ed5640 1 -- start start 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f77d006dce0 0x7f77d015a430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00676a0 0x7f77d015a970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f77d00ca950 con 0x7f77d006e0c0 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f77d0158fc0 con 0x7f77d006dce0 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77d006e950 con 0x7f77d00676a0 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f77d006dce0 0x7f77d015a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f77d006e0c0 0x7f77d0152e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39046/0 (socket says 172.21.15.26:39046) 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cffff640 1 -- 172.21.15.26:0/1995982606 learned_addr learned my addr 172.21.15.26:0/1995982606 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d5472640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00676a0 0x7f77d015a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 -- 172.21.15.26:0/1995982606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00676a0 msgr2=0x7f77d015a970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00676a0 0x7f77d015a970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 -- 172.21.15.26:0/1995982606 >> v1:172.21.15.26:6789/0 conn(0x7f77d006e0c0 legacy=0x7f77d0152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cf7fe640 1 -- 172.21.15.26:0/1995982606 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2218040048 0 0) 0x7f77d00ca950 con 0x7f77d006e0c0 2024-04-23T10:12:51.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 -- 172.21.15.26:0/1995982606 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d0159280 con 0x7f77d006dce0 2024-04-23T10:12:51.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d4c71640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d006dce0 0x7f77d015a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af968322c6ab5e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cf7fe640 1 -- 172.21.15.26:0/1995982606 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40a7070 con 0x7f77d006dce0 2024-04-23T10:12:51.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cf7fe640 1 -- 172.21.15.26:0/1995982606 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c40b0070 con 0x7f77d006dce0 2024-04-23T10:12:51.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77cf7fe640 1 -- 172.21.15.26:0/1995982606 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40ab890 con 0x7f77d006dce0 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1995982606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d006dce0 msgr2=0x7f77d015a430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d006dce0 0x7f77d015a430 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f77c40097c0 tx=0x7f77c401c470 comp rx=0 tx=0).stop 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1995982606 shutdown_connections 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00676a0 0x7f77d015a970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1995982606 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d006dce0 0x7f77d015a430 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1995982606 >> 172.21.15.26:0/1995982606 conn(0x7f77d00c9a70 msgr2=0x7f77d00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1995982606 shutdown_connections 2024-04-23T10:12:51.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.366+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1995982606 wait complete. 2024-04-23T10:12:51.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 Processor -- start 2024-04-23T10:12:51.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- start start 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d006e0c0 0x7f77d0142a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00c2350 0x7f77d0142f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f77d006e5a0 con 0x7f77d00676a0 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f77d0067bb0 con 0x7f77d006e0c0 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f77d01f8450 con 0x7f77d00c2350 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44706/0 (socket says 172.21.15.26:44706) 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 -- 172.21.15.26:0/1124932587 learned_addr learned my addr 172.21.15.26:0/1124932587 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 -- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00c2350 msgr2=0x7f77d0142f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d5472640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00c2350 0x7f77d0142f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00c2350 0x7f77d0142f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 -- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d006e0c0 msgr2=0x7f77d0142a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d006e0c0 0x7f77d0142a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 -- 172.21.15.26:0/1124932587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f77d01f75a0 con 0x7f77d00676a0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d4c71640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77c40ad040 tx=0x7f77c401acb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40bf610 con 0x7f77d00676a0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f77c40bf7d0 con 0x7f77d00676a0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f77d01f7840 con 0x7f77d00676a0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f77c40bfbc0 con 0x7f77d00676a0 2024-04-23T10:12:51.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f77d01f7e00 con 0x7f77d00676a0 2024-04-23T10:12:51.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.370+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f77d0075df0 con 0x7f77d00676a0 2024-04-23T10:12:51.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.374+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f77c40bd020 con 0x7f77d00676a0 2024-04-23T10:12:51.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.374+0000 7f77cd7fa640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 0x7f77b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.374+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f77c4121a20 con 0x7f77d00676a0 2024-04-23T10:12:51.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.374+0000 7f77cffff640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 0x7f77b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.374+0000 7f77cffff640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 0x7f77b406a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0011f0 tx=0x7f77bc007930 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.378+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f77c4016090 con 0x7f77d00676a0 2024-04-23T10:12:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.538+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f77d0072fe0 con 0x7f77d00676a0 2024-04-23T10:12:51.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77cd7fa640 1 -- 172.21.15.26:0/1124932587 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f77c40f1e30 con 0x7f77d00676a0 2024-04-23T10:12:51.541 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 msgr2=0x7f77b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 0x7f77b406a870 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f77bc0011f0 tx=0x7f77bc007930 comp rx=0 tx=0).stop 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 msgr2=0x7f77d006f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f77c40ad040 tx=0x7f77c401acb0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 shutdown_connections 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f77b40683b0 0x7f77b406a870 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f77d00c2350 0x7f77d0142f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f77d006e0c0 0x7f77d0142a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 --2- 172.21.15.26:0/1124932587 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f77d00676a0 0x7f77d006f4f0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 >> 172.21.15.26:0/1124932587 conn(0x7f77d00c9a70 msgr2=0x7f77d00cc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 shutdown_connections 2024-04-23T10:12:51.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.542+0000 7f77d6ed5640 1 -- 172.21.15.26:0/1124932587 wait complete. 2024-04-23T10:12:51.560 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:12:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 Processor -- start 2024-04-23T10:12:51.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 -- start start 2024-04-23T10:12:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1700c9c10 0x7fa1700c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1700ca960 con 0x7fa1700c9700 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1700c7f30 con 0x7fa1700c5f20 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa175710640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa1700ca0c0 con 0x7fa1700c9c10 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16f7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa1700c9700 0x7fa170152c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39060/0 (socket says 172.21.15.26:39060) 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16f7fe640 1 -- 172.21.15.26:0/3475352185 learned_addr learned my addr 172.21.15.26:0/3475352185 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3475352185 >> v2:172.21.15.190:3300/0 conn(0x7fa1700c9c10 0x7fa1700c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3261395573 0 0) 0x7fa1700ca960 con 0x7fa1700c9700 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa15c003530 con 0x7fa1700c9700 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3739780925 0 0) 0x7fa15c003530 con 0x7fa1700c9700 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 >> v2:172.21.15.190:3300/0 conn(0x7fa1700c9c10 msgr2=0x7fa1700c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 --2- 172.21.15.26:0/3475352185 >> v2:172.21.15.190:3300/0 conn(0x7fa1700c9c10 0x7fa1700c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 >> v1:172.21.15.190:6789/0 conn(0x7fa1700c5f20 legacy=0x7fa1700c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1700ca3a0 con 0x7fa1700c9700 2024-04-23T10:12:51.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fa160001a00 con 0x7fa1700c9700 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 >> v1:172.21.15.26:6789/0 conn(0x7fa1700c9700 legacy=0x7fa170152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 0x7fa15c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c004810 0x7fa15c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa15c0051d0 0x7fa15c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1700ca0c0 con 0x7fa15c0039c0 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa15c00c080 con 0x7fa15c004810 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa15c00c280 con 0x7fa15c0051d0 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 0x7fa15c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16f7fe640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa15c0051d0 0x7fa15c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c004810 0x7fa15c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 -- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa15c0051d0 msgr2=0x7fa15c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa15c0051d0 0x7fa15c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 -- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c004810 msgr2=0x7fa15c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:51.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c004810 0x7fa15c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16effd640 1 -- 172.21.15.26:0/3475352185 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa15c003530 con 0x7fa15c0039c0 2024-04-23T10:12:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c004810 0x7fa15c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16f7fe640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa15c0051d0 0x7fa15c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:51.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.686+0000 7fa16f7fe640 1 -- 172.21.15.26:0/3475352185 reap_dead start 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16effd640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 0x7fa15c003de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa168001780 tx=0x7fa16801c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85cdb1d9ef7a4bcf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1680013a0 con 0x7fa15c0039c0 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1680052f0 con 0x7fa15c0039c0 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16dffb640 1 -- 172.21.15.26:0/3475352185 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa168003840 con 0x7fa15c0039c0 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 msgr2=0x7fa15c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 0x7fa15c003de0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fa168001780 tx=0x7fa16801c400 comp rx=0 tx=0).stop 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- 172.21.15.26:0/3475352185 shutdown_connections 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 --2- 172.21.15.26:0/3475352185 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa15c0039c0 0x7fa15c003de0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- 172.21.15.26:0/3475352185 >> 172.21.15.26:0/3475352185 conn(0x7fa1700676a0 msgr2=0x7fa170067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- 172.21.15.26:0/3475352185 shutdown_connections 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- 172.21.15.26:0/3475352185 wait complete. 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 Processor -- start 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- start start 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 0x7fa1701f26e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 0x7fa17014bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1700c5830 con 0x7fa1701e20a0 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1700c81d0 con 0x7fa15c0039c0 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa175710640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1700c59b0 con 0x7fa1701efbd0 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16e7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:44720/0 (socket says 172.21.15.26:44720) 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.690+0000 7fa16e7fc640 1 -- 172.21.15.26:0/3147602084 learned_addr learned my addr 172.21.15.26:0/3147602084 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16f7fe640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 0x7fa17014bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16effd640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 0x7fa1701f26e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 -- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 msgr2=0x7fa17014bb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 0x7fa17014bb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 -- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 msgr2=0x7fa1701f26e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 0x7fa1701f26e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 -- 172.21.15.26:0/3147602084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1701ee870 con 0x7fa1701e20a0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16effd640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 0x7fa1701f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16f7fe640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 0x7fa17014bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16e7fc640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa158010980 tx=0x7fa158010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15800f040 con 0x7fa1701e20a0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa158004220 con 0x7fa1701e20a0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa170156840 con 0x7fa1701e20a0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa15800e9c0 con 0x7fa1701e20a0 2024-04-23T10:12:51.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1701eedc0 con 0x7fa1701e20a0 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa170075df0 con 0x7fa1701e20a0 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa15800eb60 con 0x7fa1701e20a0 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 0x7fa15006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa158087000 con 0x7fa1701e20a0 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16effd640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 0x7fa15006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:51.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.694+0000 7fa16effd640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 0x7fa15006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa168004000 tx=0x7fa1680011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:51.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.698+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa158018030 con 0x7fa1701e20a0 2024-04-23T10:12:51.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa170067f80 con 0x7fa1701e20a0 2024-04-23T10:12:51.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa1677fe640 1 -- 172.21.15.26:0/3147602084 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7fa1580571f0 con 0x7fa1701e20a0 2024-04-23T10:12:51.865 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 msgr2=0x7fa15006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 0x7fa15006a870 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7fa168004000 tx=0x7fa1680011a0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 msgr2=0x7fa1700cee40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7fa158010980 tx=0x7fa158010e40 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 shutdown_connections 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1500683b0 0x7fa15006a870 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1701efbd0 0x7fa17014bb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1701e20a0 0x7fa1700cee40 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 --2- 172.21.15.26:0/3147602084 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa15c0039c0 0x7fa1701f26e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:51.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 >> 172.21.15.26:0/3147602084 conn(0x7fa1700676a0 msgr2=0x7fa170071160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:51.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 shutdown_connections 2024-04-23T10:12:51.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:51.866+0000 7fa175710640 1 -- 172.21.15.26:0/3147602084 wait complete. 2024-04-23T10:12:51.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:12:52.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 Processor -- start 2024-04-23T10:12:52.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 -- start start 2024-04-23T10:12:52.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 0x7f6d1806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6d18074100 0x7f6d180c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d180c5d70 con 0x7f6d1814fbc0 2024-04-23T10:12:52.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6d180c6050 con 0x7f6d18074100 2024-04-23T10:12:52.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.002+0000 7f6d1d018640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d180c6330 con 0x7f6d1814ffa0 2024-04-23T10:12:52.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1759e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6d18074100 0x7f6d180c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d16d9d640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f6d1814fbc0 0x7f6d180c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:60326/0 (socket says 172.21.15.26:60326) 2024-04-23T10:12:52.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 0x7f6d1806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d16d9d640 1 -- 172.21.15.26:0/2286064536 learned_addr learned my addr 172.21.15.26:0/2286064536 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d15d9b640 1 -- 172.21.15.26:0/2286064536 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1437174636 0 0) 0x7f6d180c5d70 con 0x7f6d1814fbc0 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d15d9b640 1 -- 172.21.15.26:0/2286064536 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6d00003530 con 0x7f6d1814fbc0 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 -- 172.21.15.26:0/2286064536 >> v2:172.21.15.190:3300/0 conn(0x7f6d18074100 msgr2=0x7f6d180c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 --2- 172.21.15.26:0/2286064536 >> v2:172.21.15.190:3300/0 conn(0x7f6d18074100 0x7f6d180c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 -- 172.21.15.26:0/2286064536 >> v1:172.21.15.190:6789/0 conn(0x7f6d1814fbc0 legacy=0x7f6d180c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 -- 172.21.15.26:0/2286064536 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d180c6610 con 0x7f6d1814ffa0 2024-04-23T10:12:52.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d1659c640 1 --2- 172.21.15.26:0/2286064536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 0x7f6d1806f700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0097c0 tx=0x7f6d0c01c4a0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f56541953fd84391 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d15d9b640 1 -- 172.21.15.26:0/2286064536 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0aa620 con 0x7f6d1814ffa0 2024-04-23T10:12:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d15d9b640 1 -- 172.21.15.26:0/2286064536 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d0c0af070 con 0x7f6d1814ffa0 2024-04-23T10:12:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.006+0000 7f6d15d9b640 1 -- 172.21.15.26:0/2286064536 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d0c0aa9c0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2286064536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 msgr2=0x7f6d1806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2286064536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 0x7f6d1806f700 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7f6d0c0097c0 tx=0x7f6d0c01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2286064536 shutdown_connections 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2286064536 >> v2:172.21.15.190:3300/0 conn(0x7f6d18074100 0x7f6d180c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2286064536 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814ffa0 0x7f6d1806f700 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2286064536 >> 172.21.15.26:0/2286064536 conn(0x7f6d1806b9d0 msgr2=0x7f6d1806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2286064536 shutdown_connections 2024-04-23T10:12:52.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2286064536 wait complete. 2024-04-23T10:12:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 Processor -- start 2024-04-23T10:12:52.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- start start 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 0x7f6d180cb690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814fbc0 0x7f6d1815b360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180c8ab0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6d180c8930 con 0x7f6d18074100 2024-04-23T10:12:52.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d18166090 con 0x7f6d1814fbc0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37616/0 (socket says 172.21.15.26:37616) 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 -- 172.21.15.26:0/2133915604 learned_addr learned my addr 172.21.15.26:0/2133915604 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1659c640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814fbc0 0x7f6d1815b360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d16d9d640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 0x7f6d180cb690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 -- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814fbc0 msgr2=0x7f6d1815b360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814fbc0 0x7f6d1815b360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 -- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 msgr2=0x7f6d180cb690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 0x7f6d180cb690 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 -- 172.21.15.26:0/2133915604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d181f7c90 con 0x7f6d1814ffa0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d16d9d640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 0x7f6d180cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1759e640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000efc0 tx=0x7f6d1000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10018020 con 0x7f6d1814ffa0 2024-04-23T10:12:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d10014480 con 0x7f6d1814ffa0 2024-04-23T10:12:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d181f39e0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d10014870 con 0x7f6d1814ffa0 2024-04-23T10:12:52.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.010+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d181f3fa0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d18075df0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d1001b020 con 0x7f6d1814ffa0 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6cff7fe640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 0x7f6d0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6d10087b80 con 0x7f6d1814ffa0 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6d16d9d640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 0x7f6d0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.014+0000 7f6d16d9d640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 0x7f6d0406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d08005890 tx=0x7f6d08009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.018+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d10022030 con 0x7f6d1814ffa0 2024-04-23T10:12:52.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.174+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f6d1806bdb0 con 0x7f6d1814ffa0 2024-04-23T10:12:52.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.174+0000 7f6cff7fe640 1 -- 172.21.15.26:0/2133915604 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f6d10010040 con 0x7f6d1814ffa0 2024-04-23T10:12:52.175 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 msgr2=0x7f6d0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 0x7f6d0406a840 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f6d08005890 tx=0x7f6d08009040 comp rx=0 tx=0).stop 2024-04-23T10:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 msgr2=0x7f6d1815b8a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6d1000efc0 tx=0x7f6d1000c490 comp rx=0 tx=0).stop 2024-04-23T10:12:52.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 shutdown_connections 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d04068380 0x7f6d0406a840 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d1814ffa0 0x7f6d1815b8a0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d1814fbc0 0x7f6d1815b360 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 --2- 172.21.15.26:0/2133915604 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d18074100 0x7f6d180cb690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 >> 172.21.15.26:0/2133915604 conn(0x7f6d1806b9d0 msgr2=0x7f6d18162e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 shutdown_connections 2024-04-23T10:12:52.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.178+0000 7f6d1d018640 1 -- 172.21.15.26:0/2133915604 wait complete. 2024-04-23T10:12:52.193 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 Processor -- start 2024-04-23T10:12:52.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 -- start start 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc14ffa0 0x7f95cc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f95cc074100 0x7f95cc0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0c5d70 con 0x7f95cc14ffa0 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f95cc0c6050 con 0x7f95cc074100 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d2da8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc0c6330 con 0x7f95cc14fbc0 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc14ffa0 0x7f95cc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d0b44640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f95cc14ffa0 0x7f95cc0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37618/0 (socket says 172.21.15.26:37618) 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 -- 172.21.15.26:0/1457509847 learned_addr learned my addr 172.21.15.26:0/1457509847 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:52.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95d1345640 1 --2- 172.21.15.26:0/1457509847 >> v2:172.21.15.190:3300/0 conn(0x7f95cc074100 0x7f95cc0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 -- 172.21.15.26:0/1457509847 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 msgr2=0x7f95cc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 --2- 172.21.15.26:0/1457509847 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 -- 172.21.15.26:0/1457509847 >> v2:172.21.15.190:3300/0 conn(0x7f95cc074100 msgr2=0x7f95cc0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 --2- 172.21.15.26:0/1457509847 >> v2:172.21.15.190:3300/0 conn(0x7f95cc074100 0x7f95cc0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.318+0000 7f95cbfff640 1 -- 172.21.15.26:0/1457509847 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0c6610 con 0x7f95cc14ffa0 2024-04-23T10:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95cbfff640 1 --2- 172.21.15.26:0/1457509847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc14ffa0 0x7f95cc0c8220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0744e0 tx=0x7f95b801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7e8acc311a9e24db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95cb7fe640 1 -- 172.21.15.26:0/1457509847 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80aa660 con 0x7f95cc14ffa0 2024-04-23T10:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95cb7fe640 1 -- 172.21.15.26:0/1457509847 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95b80af070 con 0x7f95cc14ffa0 2024-04-23T10:12:52.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95cb7fe640 1 -- 172.21.15.26:0/1457509847 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95b80aaa20 con 0x7f95cc14ffa0 2024-04-23T10:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 -- 172.21.15.26:0/1457509847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc14ffa0 msgr2=0x7f95cc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 --2- 172.21.15.26:0/1457509847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc14ffa0 0x7f95cc0c8220 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f95cc0744e0 tx=0x7f95b801c520 comp rx=0 tx=0).stop 2024-04-23T10:12:52.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 -- 172.21.15.26:0/1457509847 shutdown_connections 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 --2- 172.21.15.26:0/1457509847 >> v2:172.21.15.190:3300/0 conn(0x7f95cc074100 0x7f95cc0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 --2- 172.21.15.26:0/1457509847 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc14ffa0 0x7f95cc0c8220 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 --2- 172.21.15.26:0/1457509847 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 -- 172.21.15.26:0/1457509847 >> 172.21.15.26:0/1457509847 conn(0x7f95cc06b9d0 msgr2=0x7f95cc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 -- 172.21.15.26:0/1457509847 shutdown_connections 2024-04-23T10:12:52.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.322+0000 7f95d2da8640 1 -- 172.21.15.26:0/1457509847 wait complete. 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 Processor -- start 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- start start 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95cc15a0b0 0x7f95cc13ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc1592e0 con 0x7f95cc074100 2024-04-23T10:12:52.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f95cc159160 con 0x7f95cc15a0b0 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f95cc159460 con 0x7f95cc14fbc0 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37632/0 (socket says 172.21.15.26:37632) 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 -- 172.21.15.26:0/3746114902 learned_addr learned my addr 172.21.15.26:0/3746114902 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 -- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 msgr2=0x7f95cc15be70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 -- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95cc15a0b0 msgr2=0x7f95cc13ddb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95cc15a0b0 0x7f95cc13ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 -- 172.21.15.26:0/3746114902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f95cc0723d0 con 0x7f95cc074100 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d0b44640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009d10 tx=0x7f95bc00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc018020 con 0x7f95cc074100 2024-04-23T10:12:52.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95bc014480 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95bc014830 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f95cc15d3d0 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f95cc141240 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.326+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f95cc075df0 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.330+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95bc01b020 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.330+0000 7f95c97fa640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 0x7f95b406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.330+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f95bc087a30 con 0x7f95cc074100 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.330+0000 7f95cbfff640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 0x7f95b406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.330+0000 7f95cbfff640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 0x7f95b406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95b80ae000 tx=0x7f95b8004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.334+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95bc022030 con 0x7f95cc074100 2024-04-23T10:12:52.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f95cc0c7df0 con 0x7f95cc074100 2024-04-23T10:12:52.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95c97fa640 1 -- 172.21.15.26:0/3746114902 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7f95bc010040 con 0x7f95cc074100 2024-04-23T10:12:52.501 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-23T10:12:52.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 msgr2=0x7f95b406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 0x7f95b406a870 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f95b80ae000 tx=0x7f95b8004740 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 msgr2=0x7f95cc0ca8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f95bc009d10 tx=0x7f95bc00c490 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 shutdown_connections 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f95b40683b0 0x7f95b406a870 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f95cc15a0b0 0x7f95cc13ddb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f95cc14fbc0 0x7f95cc15be70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 --2- 172.21.15.26:0/3746114902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f95cc074100 0x7f95cc0ca8c0 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 >> 172.21.15.26:0/3746114902 conn(0x7f95cc06b9d0 msgr2=0x7f95cc073760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 shutdown_connections 2024-04-23T10:12:52.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.502+0000 7f95d2da8640 1 -- 172.21.15.26:0/3746114902 wait complete. 2024-04-23T10:12:52.519 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:12:52.519 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:12:52.525 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:52.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.694+0000 7f9591a01640 1 Processor -- start 2024-04-23T10:12:52.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.694+0000 7f9591a01640 1 -- start start 2024-04-23T10:12:52.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f958c14fbc0 0x7f958c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 0x7f958c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f958c074100 0x7f958c0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f958c0c5d70 con 0x7f958c074100 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f958c0c6050 con 0x7f958c14fbc0 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9591a01640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f958c0c6330 con 0x7f958c14ffa0 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f958c074100 0x7f958c0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f958c074100 0x7f958c0c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37634/0 (socket says 172.21.15.26:37634) 2024-04-23T10:12:52.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 -- 172.21.15.26:0/4258621235 learned_addr learned my addr 172.21.15.26:0/4258621235 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958affd640 1 --2- 172.21.15.26:0/4258621235 >> v2:172.21.15.190:3300/0 conn(0x7f958c14fbc0 0x7f958c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958a7fc640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 0x7f958c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 -- 172.21.15.26:0/4258621235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 msgr2=0x7f958c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 0x7f958c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 -- 172.21.15.26:0/4258621235 >> v2:172.21.15.190:3300/0 conn(0x7f958c14fbc0 msgr2=0x7f958c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:52.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 --2- 172.21.15.26:0/4258621235 >> v2:172.21.15.190:3300/0 conn(0x7f958c14fbc0 0x7f958c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 -- 172.21.15.26:0/4258621235 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c0c6610 con 0x7f958c074100 2024-04-23T10:12:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958a7fc640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 0x7f958c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f958b7fe640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c074100 0x7f958c0c8760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f958c050430 tx=0x7f958401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e247140947d01fd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9589ffb640 1 -- 172.21.15.26:0/4258621235 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840a5890 con 0x7f958c074100 2024-04-23T10:12:52.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9589ffb640 1 -- 172.21.15.26:0/4258621235 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840a5a30 con 0x7f958c074100 2024-04-23T10:12:52.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.698+0000 7f9589ffb640 1 -- 172.21.15.26:0/4258621235 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840a5e00 con 0x7f958c074100 2024-04-23T10:12:52.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/4258621235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c074100 msgr2=0x7f958c0c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c074100 0x7f958c0c8760 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f958c050430 tx=0x7f958401c9f0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/4258621235 shutdown_connections 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c074100 0x7f958c0c8760 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- 172.21.15.26:0/4258621235 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14ffa0 0x7f958c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- 172.21.15.26:0/4258621235 >> v2:172.21.15.190:3300/0 conn(0x7f958c14fbc0 0x7f958c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/4258621235 >> 172.21.15.26:0/4258621235 conn(0x7f958c06b9d0 msgr2=0x7f958c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/4258621235 shutdown_connections 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/4258621235 wait complete. 2024-04-23T10:12:52.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 Processor -- start 2024-04-23T10:12:52.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- start start 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 0x7f958c145af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 0x7f958c15c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f958c1592e0 con 0x7f958c14ffa0 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f958c159160 con 0x7f958c074100 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f958c159460 con 0x7f958c14fbc0 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37644/0 (socket says 172.21.15.26:37644) 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 -- 172.21.15.26:0/2339786647 learned_addr learned my addr 172.21.15.26:0/2339786647 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958affd640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 0x7f958c145af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 -- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 msgr2=0x7f958c15c6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958a7fc640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 0x7f958c15c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 0x7f958c15c6f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 -- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 msgr2=0x7f958c145af0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 0x7f958c145af0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 -- 172.21.15.26:0/2339786647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f958c15d290 con 0x7f958c14ffa0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958affd640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 0x7f958c145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958a7fc640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 0x7f958c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f958b7fe640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95840af040 tx=0x7f9584019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9584009250 con 0x7f958c14ffa0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f95840be070 con 0x7f958c14ffa0 2024-04-23T10:12:52.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f958c1f2140 con 0x7f958c14ffa0 2024-04-23T10:12:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f95840b86b0 con 0x7f958c14ffa0 2024-04-23T10:12:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.702+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f958c1f2700 con 0x7f958c14ffa0 2024-04-23T10:12:52.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f958c075df0 con 0x7f958c14ffa0 2024-04-23T10:12:52.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f95840b8850 con 0x7f958c14ffa0 2024-04-23T10:12:52.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f9573fff640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 0x7f957806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:52.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9584121ad0 con 0x7f958c14ffa0 2024-04-23T10:12:52.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f958affd640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 0x7f957806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:52.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.706+0000 7f958affd640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 0x7f957806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:52.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.710+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f95840165e0 con 0x7f958c14ffa0 2024-04-23T10:12:52.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.874+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f958c06dee0 con 0x7f958c14ffa0 2024-04-23T10:12:52.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.874+0000 7f9573fff640 1 -- 172.21.15.26:0/2339786647 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f95840f1e70 con 0x7f958c14ffa0 2024-04-23T10:12:52.875 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:52.875 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:52.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 msgr2=0x7f957806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 0x7f957806a840 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f957c0097c0 tx=0x7f957c008040 comp rx=0 tx=0).stop 2024-04-23T10:12:52.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 msgr2=0x7f958c144d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f95840af040 tx=0x7f9584019790 comp rx=0 tx=0).stop 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 shutdown_connections 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9578068380 0x7f957806a840 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f958c14ffa0 0x7f958c144d90 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f958c14fbc0 0x7f958c15c6f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 --2- 172.21.15.26:0/2339786647 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f958c074100 0x7f958c145af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 >> 172.21.15.26:0/2339786647 conn(0x7f958c06b9d0 msgr2=0x7f958c071650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 shutdown_connections 2024-04-23T10:12:52.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:52.878+0000 7f9591a01640 1 -- 172.21.15.26:0/2339786647 wait complete. 2024-04-23T10:12:52.895 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:12:52.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:12:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 Processor -- start 2024-04-23T10:12:53.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 -- start start 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb94014fbc0 0x7fb94006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb940074100 0x7fb9400c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb9400c5d70 con 0x7fb94014ffa0 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb9400c6050 con 0x7fb94014fbc0 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb945ecd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb9400c6330 con 0x7fb940074100 2024-04-23T10:12:53.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb94014fbc0 0x7fb94006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb94014fbc0 0x7fb94006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37648/0 (socket says 172.21.15.26:37648) 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 -- 172.21.15.26:0/617135728 learned_addr learned my addr 172.21.15.26:0/617135728 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93ffff640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb940074100 0x7fb9400c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 -- 172.21.15.26:0/617135728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb940074100 msgr2=0x7fb9400c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb940074100 0x7fb9400c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 -- 172.21.15.26:0/617135728 >> v1:172.21.15.190:6789/0 conn(0x7fb94014ffa0 legacy=0x7fb9400c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.026+0000 7fb93f7fe640 1 -- 172.21.15.26:0/617135728 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9400c6610 con 0x7fb94014fbc0 2024-04-23T10:12:53.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb93f7fe640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014fbc0 0x7fb94006f700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=980753fcb21b259f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb93e7fc640 1 -- 172.21.15.26:0/617135728 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300a9640 con 0x7fb94014fbc0 2024-04-23T10:12:53.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb93e7fc640 1 -- 172.21.15.26:0/617135728 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb9300a97e0 con 0x7fb94014fbc0 2024-04-23T10:12:53.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb93e7fc640 1 -- 172.21.15.26:0/617135728 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb9300a9bb0 con 0x7fb94014fbc0 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 -- 172.21.15.26:0/617135728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014fbc0 msgr2=0x7fb94006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014fbc0 0x7fb94006f700 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fb930009870 tx=0x7fb93001c560 comp rx=0 tx=0).stop 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 -- 172.21.15.26:0/617135728 shutdown_connections 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb940074100 0x7fb9400c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 --2- 172.21.15.26:0/617135728 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014fbc0 0x7fb94006f700 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 -- 172.21.15.26:0/617135728 >> 172.21.15.26:0/617135728 conn(0x7fb94006b9d0 msgr2=0x7fb94006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 -- 172.21.15.26:0/617135728 shutdown_connections 2024-04-23T10:12:53.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.030+0000 7fb945ecd640 1 -- 172.21.15.26:0/617135728 wait complete. 2024-04-23T10:12:53.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 Processor -- start 2024-04-23T10:12:53.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- start start 2024-04-23T10:12:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb940074100 0x7fb9401463e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb94014fbc0 0x7fb94014b5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb9400c8ab0 con 0x7fb94014ffa0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb9400c8930 con 0x7fb940074100 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb940166090 con 0x7fb94014fbc0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37654/0 (socket says 172.21.15.26:37654) 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 -- 172.21.15.26:0/176728767 learned_addr learned my addr 172.21.15.26:0/176728767 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93f7fe640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb940074100 0x7fb9401463e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93effd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb94014fbc0 0x7fb94014b5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 -- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb94014fbc0 msgr2=0x7fb94014b5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb94014fbc0 0x7fb94014b5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 -- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb940074100 msgr2=0x7fb9401463e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb940074100 0x7fb9401463e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 -- 172.21.15.26:0/176728767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb9401f4350 con 0x7fb94014ffa0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb93ffff640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93800efc0 tx=0x7fb93800c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938018020 con 0x7fb94014ffa0 2024-04-23T10:12:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb938014480 con 0x7fb94014ffa0 2024-04-23T10:12:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb9400cad30 con 0x7fb94014ffa0 2024-04-23T10:12:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb938014870 con 0x7fb94014ffa0 2024-04-23T10:12:53.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb9401f48f0 con 0x7fb94014ffa0 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb940075df0 con 0x7fb94014ffa0 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.034+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb93801b020 con 0x7fb94014ffa0 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.038+0000 7fb927fff640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 0x7fb92c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.038+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb938087b00 con 0x7fb94014ffa0 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.038+0000 7fb93f7fe640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 0x7fb92c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.038+0000 7fb93f7fe640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 0x7fb92c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb9300ae000 tx=0x7fb9300b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.040 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.042+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb938022030 con 0x7fb94014ffa0 2024-04-23T10:12:53.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb9400caf90 con 0x7fb94014ffa0 2024-04-23T10:12:53.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb927fff640 1 -- 172.21.15.26:0/176728767 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v24) ==== 93+0+10 (secure 0 0 0) 0x7fb938010040 con 0x7fb94014ffa0 2024-04-23T10:12:53.205 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:12:53.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 msgr2=0x7fb92c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 0x7fb92c06a840 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7fb9300ae000 tx=0x7fb9300b3040 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 msgr2=0x7fb94015b680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7fb93800efc0 tx=0x7fb93800c490 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 shutdown_connections 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb92c068380 0x7fb92c06a840 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb94014ffa0 0x7fb94015b680 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb94014fbc0 0x7fb94014b5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 --2- 172.21.15.26:0/176728767 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb940074100 0x7fb9401463e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 >> 172.21.15.26:0/176728767 conn(0x7fb94006b9d0 msgr2=0x7fb94006ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 shutdown_connections 2024-04-23T10:12:53.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.206+0000 7fb945ecd640 1 -- 172.21.15.26:0/176728767 wait complete. 2024-04-23T10:12:53.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:12:53.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 Processor -- start 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 -- start start 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8848155300 0x7f88480c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884815ee20 0x7f88480c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f88480c4e80 con 0x7f884806f700 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f88480c4230 con 0x7f884815ee20 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884cc8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f88480c5770 con 0x7f8848155300 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884815ee20 0x7f88480c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f884815ee20 0x7f88480c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37668/0 (socket says 172.21.15.26:37668) 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 -- 172.21.15.26:0/3882749755 learned_addr learned my addr 172.21.15.26:0/3882749755 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f884659c640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8848155300 0x7f88480c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 -- 172.21.15.26:0/3882749755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8848155300 msgr2=0x7f88480c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8848155300 0x7f88480c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 -- 172.21.15.26:0/3882749755 >> v1:172.21.15.190:6789/0 conn(0x7f884806f700 legacy=0x7f884815e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.362+0000 7f8846d9d640 1 -- 172.21.15.26:0/3882749755 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f884815f320 con 0x7f884815ee20 2024-04-23T10:12:53.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f8846d9d640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884815ee20 0x7f88480c6f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8838009870 tx=0x7f883801c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629eb1c936daec81 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884559a640 1 -- 172.21.15.26:0/3882749755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88380b2070 con 0x7f884815ee20 2024-04-23T10:12:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884559a640 1 -- 172.21.15.26:0/3882749755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88380a9070 con 0x7f884815ee20 2024-04-23T10:12:53.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884559a640 1 -- 172.21.15.26:0/3882749755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88380ad880 con 0x7f884815ee20 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- 172.21.15.26:0/3882749755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884815ee20 msgr2=0x7f88480c6f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884815ee20 0x7f88480c6f70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f8838009870 tx=0x7f883801c560 comp rx=0 tx=0).stop 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- 172.21.15.26:0/3882749755 shutdown_connections 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f884815ee20 0x7f88480c6f70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 --2- 172.21.15.26:0/3882749755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8848155300 0x7f88480c3cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- 172.21.15.26:0/3882749755 >> 172.21.15.26:0/3882749755 conn(0x7f884806b9d0 msgr2=0x7f884806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- 172.21.15.26:0/3882749755 shutdown_connections 2024-04-23T10:12:53.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- 172.21.15.26:0/3882749755 wait complete. 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 Processor -- start 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.366+0000 7f884cc8d640 1 -- start start 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f884806f700 0x7f8848073ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 0x7f884814a320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88480681d0 con 0x7f8848155300 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f884815f600 con 0x7f884815ee20 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8848068350 con 0x7f884806f700 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37678/0 (socket says 172.21.15.26:37678) 2024-04-23T10:12:53.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 -- 172.21.15.26:0/778774986 learned_addr learned my addr 172.21.15.26:0/778774986 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8846d9d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 0x7f884814a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884659c640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f884806f700 0x7f8848073ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 -- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f884806f700 msgr2=0x7f8848073ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f884806f700 0x7f8848073ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 -- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 msgr2=0x7f884814a320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 0x7f884814a320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 -- 172.21.15.26:0/778774986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8848158ca0 con 0x7f8848155300 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8846d9d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 0x7f884814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8845d9b640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f883c00c420 tx=0x7f883c00c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c0052d0 con 0x7f8848155300 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f883c005470 con 0x7f8848155300 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8848159220 con 0x7f8848155300 2024-04-23T10:12:53.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f883c007260 con 0x7f8848155300 2024-04-23T10:12:53.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8848071450 con 0x7f8848155300 2024-04-23T10:12:53.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8848075df0 con 0x7f8848155300 2024-04-23T10:12:53.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f883c007400 con 0x7f8848155300 2024-04-23T10:12:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 0x7f882806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f883c086200 con 0x7f8848155300 2024-04-23T10:12:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.370+0000 7f884659c640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 0x7f882806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.374+0000 7f884659c640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 0x7f882806a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8840003fd0 tx=0x7f88400039a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.374+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f883c056480 con 0x7f8848155300 2024-04-23T10:12:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.534+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f8848152d30 con 0x7f8848155300 2024-04-23T10:12:53.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f8836ffd640 1 -- 172.21.15.26:0/778774986 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v24) ==== 104+0+11 (secure 0 0 0) 0x7f883c055d80 con 0x7f8848155300 2024-04-23T10:12:53.537 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 msgr2=0x7f882806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 0x7f882806a840 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f8840003fd0 tx=0x7f88400039a0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 msgr2=0x7f8848149de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f883c00c420 tx=0x7f883c00c8e0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 shutdown_connections 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8828068380 0x7f882806a840 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f884815ee20 0x7f884814a320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8848155300 0x7f8848149de0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 --2- 172.21.15.26:0/778774986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f884806f700 0x7f8848073ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 >> 172.21.15.26:0/778774986 conn(0x7f884806b9d0 msgr2=0x7f88481534a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 shutdown_connections 2024-04-23T10:12:53.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.538+0000 7f884cc8d640 1 -- 172.21.15.26:0/778774986 wait complete. 2024-04-23T10:12:53.555 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:12:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 Processor -- start 2024-04-23T10:12:53.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 -- start start 2024-04-23T10:12:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ee8072470 0x7f8ee8072890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee8067740 con 0x7f8ee815bcc0 2024-04-23T10:12:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8ee8072dd0 con 0x7f8ee815c490 2024-04-23T10:12:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8eed450640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8ee8071fe0 con 0x7f8ee8072470 2024-04-23T10:12:53.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ee8072470 0x7f8ee8072890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8ee8072470 0x7f8ee8072890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37690/0 (socket says 172.21.15.26:37690) 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 -- 172.21.15.26:0/849110181 learned_addr learned my addr 172.21.15.26:0/849110181 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 -- 172.21.15.26:0/849110181 >> v1:172.21.15.190:6789/0 conn(0x7f8ee815c490 legacy=0x7f8ee815c900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 -- 172.21.15.26:0/849110181 >> v1:172.21.15.26:6789/0 conn(0x7f8ee815bcc0 legacy=0x7f8ee806e490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee67fc640 1 -- 172.21.15.26:0/849110181 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee80679b0 con 0x7f8ee8072470 2024-04-23T10:12:53.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.678+0000 7f8ee5ffb640 1 -- 172.21.15.26:0/849110181 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 793023985 0 0) 0x7f8ee8067740 con 0x7f8ee815bcc0 2024-04-23T10:12:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8ee67fc640 1 --2- 172.21.15.26:0/849110181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee8072470 0x7f8ee8072890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009870 tx=0x7f8edc01c4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5495372ace96383 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8ee5ffb640 1 -- 172.21.15.26:0/849110181 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0b0070 con 0x7f8ee8072470 2024-04-23T10:12:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8ee5ffb640 1 -- 172.21.15.26:0/849110181 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8edc0ab600 con 0x7f8ee8072470 2024-04-23T10:12:53.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8ee5ffb640 1 -- 172.21.15.26:0/849110181 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8edc0ab9d0 con 0x7f8ee8072470 2024-04-23T10:12:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- 172.21.15.26:0/849110181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee8072470 msgr2=0x7f8ee8072890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 --2- 172.21.15.26:0/849110181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee8072470 0x7f8ee8072890 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f8edc009870 tx=0x7f8edc01c4d0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- 172.21.15.26:0/849110181 shutdown_connections 2024-04-23T10:12:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 --2- 172.21.15.26:0/849110181 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee8072470 0x7f8ee8072890 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- 172.21.15.26:0/849110181 >> 172.21.15.26:0/849110181 conn(0x7f8ee80c9a70 msgr2=0x7f8ee80c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- 172.21.15.26:0/849110181 shutdown_connections 2024-04-23T10:12:53.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- 172.21.15.26:0/849110181 wait complete. 2024-04-23T10:12:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 Processor -- start 2024-04-23T10:12:53.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- start start 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 0x7f8ee813ebe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee815bcc0 0x7f8ee814cab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee815c0a0 con 0x7f8ee815c490 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8ee8067c90 con 0x7f8ee8072470 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.682+0000 7f8eed450640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8ee815c220 con 0x7f8ee815bcc0 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37700/0 (socket says 172.21.15.26:37700) 2024-04-23T10:12:53.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 -- 172.21.15.26:0/676701026 learned_addr learned my addr 172.21.15.26:0/676701026 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee6ffd640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 0x7f8ee813ebe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee67fc640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee815bcc0 0x7f8ee814cab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 -- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee815bcc0 msgr2=0x7f8ee814cab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee815bcc0 0x7f8ee814cab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 -- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 msgr2=0x7f8ee813ebe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 0x7f8ee813ebe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 -- 172.21.15.26:0/676701026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8ee81f71d0 con 0x7f8ee815c490 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee6ffd640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 0x7f8ee813ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee77fe640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c340 tx=0x7f8ed800c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8005220 con 0x7f8ee815c490 2024-04-23T10:12:53.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ed80053c0 con 0x7f8ee815c490 2024-04-23T10:12:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8ee813d3d0 con 0x7f8ee815c490 2024-04-23T10:12:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8ed8007270 con 0x7f8ee815c490 2024-04-23T10:12:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8ee81f7720 con 0x7f8ee815c490 2024-04-23T10:12:53.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8ee8075df0 con 0x7f8ee815c490 2024-04-23T10:12:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8ed8019020 con 0x7f8ee815c490 2024-04-23T10:12:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 0x7f8ed406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8ed8086040 con 0x7f8ee815c490 2024-04-23T10:12:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee6ffd640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 0x7f8ed406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.686+0000 7f8ee6ffd640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 0x7f8ed406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0007fd0 tx=0x7f8ee0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:53.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.690+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8ed80562c0 con 0x7f8ee815c490 2024-04-23T10:12:53.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f8ee814b890 con 0x7f8ee815c490 2024-04-23T10:12:53.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8ecf7fe640 1 -- 172.21.15.26:0/676701026 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v24) ==== 100+0+11 (secure 0 0 0) 0x7f8ed8055bc0 con 0x7f8ee815c490 2024-04-23T10:12:53.853 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 msgr2=0x7f8ed406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 0x7f8ed406a840 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f8ee0007fd0 tx=0x7f8ee0009040 comp rx=0 tx=0).stop 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 msgr2=0x7f8ee814cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f8ed800c340 tx=0x7f8ed800c800 comp rx=0 tx=0).stop 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 shutdown_connections 2024-04-23T10:12:53.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8ed4068380 0x7f8ed406a840 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8ee815c490 0x7f8ee814cff0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8ee815bcc0 0x7f8ee814cab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 --2- 172.21.15.26:0/676701026 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8ee8072470 0x7f8ee813ebe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 >> 172.21.15.26:0/676701026 conn(0x7f8ee80c9a70 msgr2=0x7f8ee806f9e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 shutdown_connections 2024-04-23T10:12:53.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.854+0000 7f8eed450640 1 -- 172.21.15.26:0/676701026 wait complete. 2024-04-23T10:12:53.873 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:12:53.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.994+0000 7f82704d6640 1 Processor -- start 2024-04-23T10:12:53.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.994+0000 7f82704d6640 1 -- start start 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f82704d6640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8268155350 0x7f82680c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f82704d6640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f826815b0b0 0x7f826815b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f82704d6640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f826815beb0 con 0x7f82680cda50 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f82704d6640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f82680cca40 con 0x7f8268155350 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f82704d6640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f82680ccc90 con 0x7f826815b0b0 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8268155350 0x7f82680c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8268155350 0x7f82680c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37704/0 (socket says 172.21.15.26:37704) 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 -- 172.21.15.26:0/4259476417 learned_addr learned my addr 172.21.15.26:0/4259476417 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:53.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826ea73640 1 --2- 172.21.15.26:0/4259476417 >> v2:172.21.15.190:3300/0 conn(0x7f826815b0b0 0x7f826815b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:53.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 -- 172.21.15.26:0/4259476417 >> v2:172.21.15.190:3300/0 conn(0x7f826815b0b0 msgr2=0x7f826815b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 --2- 172.21.15.26:0/4259476417 >> v2:172.21.15.190:3300/0 conn(0x7f826815b0b0 0x7f826815b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:53.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 -- 172.21.15.26:0/4259476417 >> v1:172.21.15.190:6789/0 conn(0x7f82680cda50 legacy=0x7f82680cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:53.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 -- 172.21.15.26:0/4259476417 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82680ccf70 con 0x7f8268155350 2024-04-23T10:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826e272640 1 --2- 172.21.15.26:0/4259476417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8268155350 0x7f82680c59c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82680b44e0 tx=0x7f826401ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=125c307c7b760df9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:53.998+0000 7f826d270640 1 -- 172.21.15.26:0/4259476417 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640b5070 con 0x7f8268155350 2024-04-23T10:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826d270640 1 -- 172.21.15.26:0/4259476417 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82640a89d0 con 0x7f8268155350 2024-04-23T10:12:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826d270640 1 -- 172.21.15.26:0/4259476417 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640a8da0 con 0x7f8268155350 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- 172.21.15.26:0/4259476417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8268155350 msgr2=0x7f82680c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- 172.21.15.26:0/4259476417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8268155350 0x7f82680c59c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f82680b44e0 tx=0x7f826401ecd0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- 172.21.15.26:0/4259476417 shutdown_connections 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- 172.21.15.26:0/4259476417 >> v2:172.21.15.190:3300/0 conn(0x7f826815b0b0 0x7f826815b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- 172.21.15.26:0/4259476417 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8268155350 0x7f82680c59c0 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- 172.21.15.26:0/4259476417 >> 172.21.15.26:0/4259476417 conn(0x7f826806cc30 msgr2=0x7f826806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- 172.21.15.26:0/4259476417 shutdown_connections 2024-04-23T10:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- 172.21.15.26:0/4259476417 wait complete. 2024-04-23T10:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 Processor -- start 2024-04-23T10:12:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- start start 2024-04-23T10:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8268155350 0x7f826815d920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f826815b0b0 0x7f82680b5130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8268155730 con 0x7f82680cda50 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82680cd530 con 0x7f8268155350 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f82704d6640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f826815e860 con 0x7f826815b0b0 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37710/0 (socket says 172.21.15.26:37710) 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 -- 172.21.15.26:0/247714122 learned_addr learned my addr 172.21.15.26:0/247714122 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826da71640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8268155350 0x7f826815d920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826ea73640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f826815b0b0 0x7f82680b5130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 -- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f826815b0b0 msgr2=0x7f82680b5130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f826815b0b0 0x7f82680b5130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 -- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8268155350 msgr2=0x7f826815d920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8268155350 0x7f826815d920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.002+0000 7f826e272640 1 -- 172.21.15.26:0/247714122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82681f1a70 con 0x7f82680cda50 2024-04-23T10:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f826e272640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82640b3040 tx=0x7f826401ba70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640c0070 con 0x7f82680cda50 2024-04-23T10:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82640b0a50 con 0x7f82680cda50 2024-04-23T10:12:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82640b5070 con 0x7f82680cda50 2024-04-23T10:12:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f82681f1d50 con 0x7f82680cda50 2024-04-23T10:12:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f82680cab30 con 0x7f82680cda50 2024-04-23T10:12:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8268075df0 con 0x7f82680cda50 2024-04-23T10:12:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82640ba3e0 con 0x7f82680cda50 2024-04-23T10:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8264123ed0 con 0x7f82680cda50 2024-04-23T10:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f826da71640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.006+0000 7f826da71640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 0x7f824c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82680b65e0 tx=0x7f8258009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.010+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8264018830 con 0x7f82680cda50 2024-04-23T10:12:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.174+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f826814f3e0 con 0x7f82680cda50 2024-04-23T10:12:54.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.174+0000 7f825effd640 1 -- 172.21.15.26:0/247714122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v24) ==== 103+0+11 (secure 0 0 0) 0x7f82640f41e0 con 0x7f82680cda50 2024-04-23T10:12:54.176 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 msgr2=0x7f824c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 0x7f824c06a840 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x7f82680b65e0 tx=0x7f8258009040 comp rx=0 tx=0).stop 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 msgr2=0x7f826815d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f82640b3040 tx=0x7f826401ba70 comp rx=0 tx=0).stop 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 shutdown_connections 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f824c068380 0x7f824c06a840 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f826815b0b0 0x7f82680b5130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8268155350 0x7f826815d920 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 --2- 172.21.15.26:0/247714122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82680cda50 0x7f826815d3e0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 >> 172.21.15.26:0/247714122 conn(0x7f826806cc30 msgr2=0x7f82681523f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 shutdown_connections 2024-04-23T10:12:54.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.178+0000 7f82704d6640 1 -- 172.21.15.26:0/247714122 wait complete. 2024-04-23T10:12:54.195 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:12:54.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 Processor -- start 2024-04-23T10:12:54.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 -- start start 2024-04-23T10:12:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 0x7fcc1806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc18074100 0x7fcc180c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcc180c5d70 con 0x7fcc1814fbc0 2024-04-23T10:12:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcc180c6050 con 0x7fcc18074100 2024-04-23T10:12:54.314 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc1dc2f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcc180c6330 con 0x7fcc1814ffa0 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc18074100 0x7fcc180c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcc18074100 0x7fcc180c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37722/0 (socket says 172.21.15.26:37722) 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 -- 172.21.15.26:0/396311546 learned_addr learned my addr 172.21.15.26:0/396311546 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc16ffd640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 0x7fcc1806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 -- 172.21.15.26:0/396311546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 msgr2=0x7fcc1806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 0x7fcc1806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 -- 172.21.15.26:0/396311546 >> v1:172.21.15.190:6789/0 conn(0x7fcc1814fbc0 legacy=0x7fcc180c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 -- 172.21.15.26:0/396311546 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc180c6610 con 0x7fcc18074100 2024-04-23T10:12:54.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc16ffd640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 0x7fcc1806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.314+0000 7fcc17fff640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc18074100 0x7fcc180c7250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009e50 tx=0x7fcc1001c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=176ec8fcf6dfe9d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc167fc640 1 -- 172.21.15.26:0/396311546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100a5890 con 0x7fcc18074100 2024-04-23T10:12:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc167fc640 1 -- 172.21.15.26:0/396311546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc100a5a30 con 0x7fcc18074100 2024-04-23T10:12:54.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc167fc640 1 -- 172.21.15.26:0/396311546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100a5e00 con 0x7fcc18074100 2024-04-23T10:12:54.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/396311546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc18074100 msgr2=0x7fcc180c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc18074100 0x7fcc180c7250 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fcc10009e50 tx=0x7fcc1001c9f0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/396311546 shutdown_connections 2024-04-23T10:12:54.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc18074100 0x7fcc180c7250 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/396311546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814ffa0 0x7fcc1806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/396311546 >> 172.21.15.26:0/396311546 conn(0x7fcc1806b9d0 msgr2=0x7fcc1806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/396311546 shutdown_connections 2024-04-23T10:12:54.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/396311546 wait complete. 2024-04-23T10:12:54.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 Processor -- start 2024-04-23T10:12:54.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- start start 2024-04-23T10:12:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc18074100 0x7fcc1815cdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814fbc0 0x7fcc180cad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcc180c8ab0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcc180c8930 con 0x7fcc18074100 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc1dc2f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcc18166090 con 0x7fcc1814fbc0 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37728/0 (socket says 172.21.15.26:37728) 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 -- 172.21.15.26:0/3541922975 learned_addr learned my addr 172.21.15.26:0/3541922975 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc16ffd640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814fbc0 0x7fcc180cad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc177fe640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc18074100 0x7fcc1815cdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 -- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814fbc0 msgr2=0x7fcc180cad00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814fbc0 0x7fcc180cad00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 -- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc18074100 msgr2=0x7fcc1815cdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc18074100 0x7fcc1815cdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.318+0000 7fcc17fff640 1 -- 172.21.15.26:0/3541922975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcc18148e10 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc17fff640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc1001b0a0 tx=0x7fcc10019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100b8680 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcc100b8840 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcc181f5530 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcc100b8c70 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcc181f5af0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcc18075df0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcc100c0020 con 0x7fcc1814ffa0 2024-04-23T10:12:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fcc101217e0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc177fe640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.324 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.322+0000 7fcc177fe640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 0x7fcc0406a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c004e30 tx=0x7fcc0c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.326+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcc18148e10 con 0x7fcc1814ffa0 2024-04-23T10:12:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.498+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7fcc180c7df0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcbfffff640 1 -- 172.21.15.26:0/3541922975 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v24) ==== 80+0+0 (secure 0 0 0) 0x7fcc100165e0 con 0x7fcc1814ffa0 2024-04-23T10:12:54.500 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 msgr2=0x7fcc0406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 0x7fcc0406a870 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7fcc0c004e30 tx=0x7fcc0c009040 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 msgr2=0x7fcc18146e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fcc1001b0a0 tx=0x7fcc10019790 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 shutdown_connections 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcc040683b0 0x7fcc0406a870 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcc1814ffa0 0x7fcc18146e60 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcc1814fbc0 0x7fcc180cad00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 --2- 172.21.15.26:0/3541922975 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcc18074100 0x7fcc1815cdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 >> 172.21.15.26:0/3541922975 conn(0x7fcc1806b9d0 msgr2=0x7fcc1814e8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 shutdown_connections 2024-04-23T10:12:54.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.502+0000 7fcc1dc2f640 1 -- 172.21.15.26:0/3541922975 wait complete. 2024-04-23T10:12:54.519 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2024-04-23T10:12:54.520 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:54.520 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.admin 2024-04-23T10:12:54.543 INFO:tasks.cephfs.fuse_mount.ceph-fuse.admin.smithi026.stderr:ceph-fuse[33409]: fuse finished with error 0 and tester_r 0 2024-04-23T10:12:54.544 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:12:54.609 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:12:54.609 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:12:54.609 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.admin) 2024-04-23T10:12:54.622 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:54.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.786+0000 7f28a22f4640 1 Processor -- start 2024-04-23T10:12:54.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.786+0000 7f28a22f4640 1 -- start start 2024-04-23T10:12:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a22f4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f289c14fbc0 0x7f289c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a22f4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f289c14ffa0 0x7f289c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a22f4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f289c0c5d70 con 0x7f289c074100 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a22f4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f289c0c6050 con 0x7f289c14fbc0 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a22f4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f289c0c6330 con 0x7f289c14ffa0 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f289c14fbc0 0x7f289c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a0891640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f289c074100 0x7f289c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60688/0 (socket says 172.21.15.26:60688) 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f28a0891640 1 -- 172.21.15.26:0/1788972750 learned_addr learned my addr 172.21.15.26:0/1788972750 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289b7fe640 1 --2- 172.21.15.26:0/1788972750 >> v2:172.21.15.190:3300/0 conn(0x7f289c14ffa0 0x7f289c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 -- 172.21.15.26:0/1788972750 >> v2:172.21.15.190:3300/0 conn(0x7f289c14ffa0 msgr2=0x7f289c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 --2- 172.21.15.26:0/1788972750 >> v2:172.21.15.190:3300/0 conn(0x7f289c14ffa0 0x7f289c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 -- 172.21.15.26:0/1788972750 >> v1:172.21.15.26:6789/0 conn(0x7f289c074100 legacy=0x7f289c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 -- 172.21.15.26:0/1788972750 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c0c6610 con 0x7f289c14fbc0 2024-04-23T10:12:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289bfff640 1 --2- 172.21.15.26:0/1788972750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c14fbc0 0x7f289c06f700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097c0 tx=0x7f288c01c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3dd87aee277c572e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289affd640 1 -- 172.21.15.26:0/1788972750 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0ab680 con 0x7f289c14fbc0 2024-04-23T10:12:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289affd640 1 -- 172.21.15.26:0/1788972750 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0b0070 con 0x7f289c14fbc0 2024-04-23T10:12:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.790+0000 7f289affd640 1 -- 172.21.15.26:0/1788972750 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0aba40 con 0x7f289c14fbc0 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1788972750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c14fbc0 msgr2=0x7f289c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1788972750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c14fbc0 0x7f289c06f700 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f288c0097c0 tx=0x7f288c01c460 comp rx=0 tx=0).stop 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1788972750 shutdown_connections 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1788972750 >> v2:172.21.15.190:3300/0 conn(0x7f289c14ffa0 0x7f289c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1788972750 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c14fbc0 0x7f289c06f700 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1788972750 >> 172.21.15.26:0/1788972750 conn(0x7f289c06b9d0 msgr2=0x7f289c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1788972750 shutdown_connections 2024-04-23T10:12:54.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1788972750 wait complete. 2024-04-23T10:12:54.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 Processor -- start 2024-04-23T10:12:54.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- start start 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f289c14fbc0 0x7f289c15b4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 0x7f289c142d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f289c166420 con 0x7f289c074100 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f289c1662a0 con 0x7f289c14ffa0 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f289c1665a0 con 0x7f289c14fbc0 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37750/0 (socket says 172.21.15.26:37750) 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 -- 172.21.15.26:0/1397311756 learned_addr learned my addr 172.21.15.26:0/1397311756 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:54.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a0891640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 0x7f289c142d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 -- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f289c14fbc0 msgr2=0x7f289c15b4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289b7fe640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f289c14fbc0 0x7f289c15b4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f289c14fbc0 0x7f289c15b4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 -- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 msgr2=0x7f289c142d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 0x7f289c142d70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 -- 172.21.15.26:0/1397311756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f289c14e5e0 con 0x7f289c074100 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a0891640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 0x7f289c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f289bfff640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f288c0ad040 tx=0x7f288c01aca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0bf610 con 0x7f289c074100 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f288c0a7070 con 0x7f289c074100 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f288c0bf9d0 con 0x7f289c074100 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f289c0c41c0 con 0x7f289c074100 2024-04-23T10:12:54.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.794+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f289c15a150 con 0x7f289c074100 2024-04-23T10:12:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f289c075df0 con 0x7f289c074100 2024-04-23T10:12:54.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f288c0bd020 con 0x7f289c074100 2024-04-23T10:12:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f2898ff9640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f288c121560 con 0x7f289c074100 2024-04-23T10:12:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f289b7fe640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:54.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.798+0000 7f289b7fe640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 0x7f288806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f289c06fbb0 tx=0x7f2890008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:54.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.802+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f288c016050 con 0x7f289c074100 2024-04-23T10:12:54.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.962+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f289c0c7df0 con 0x7f289c074100 2024-04-23T10:12:54.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.962+0000 7f2898ff9640 1 -- 172.21.15.26:0/1397311756 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f288c0f1990 con 0x7f289c074100 2024-04-23T10:12:54.963 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:54.963 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 msgr2=0x7f288806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 0x7f288806a840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f289c06fbb0 tx=0x7f2890008040 comp rx=0 tx=0).stop 2024-04-23T10:12:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 msgr2=0x7f289c15cad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f288c0ad040 tx=0x7f288c01aca0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 shutdown_connections 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2888068380 0x7f288806a840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f289c14ffa0 0x7f289c142d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f289c14fbc0 0x7f289c15b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 --2- 172.21.15.26:0/1397311756 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f289c074100 0x7f289c15cad0 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 >> 172.21.15.26:0/1397311756 conn(0x7f289c06b9d0 msgr2=0x7f289c0719a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 shutdown_connections 2024-04-23T10:12:54.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:54.966+0000 7f28a22f4640 1 -- 172.21.15.26:0/1397311756 wait complete. 2024-04-23T10:12:54.981 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:55.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 Processor -- start 2024-04-23T10:12:55.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 -- start start 2024-04-23T10:12:55.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0c3c152140 0x7f0c3c072f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c3c06cc30 con 0x7f0c3c15b930 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3c0c0790 con 0x7f0c3c0c7800 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c435e7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3c072a70 con 0x7f0c3c152140 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37762/0 (socket says 172.21.15.26:37762) 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 -- 172.21.15.26:0/521164134 learned_addr learned my addr 172.21.15.26:0/521164134 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c41383640 1 --2- 172.21.15.26:0/521164134 >> v2:172.21.15.190:3300/0 conn(0x7f0c3c152140 0x7f0c3c072f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 -- 172.21.15.26:0/521164134 >> v2:172.21.15.190:3300/0 conn(0x7f0c3c152140 msgr2=0x7f0c3c072f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 --2- 172.21.15.26:0/521164134 >> v2:172.21.15.190:3300/0 conn(0x7f0c3c152140 0x7f0c3c072f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 -- 172.21.15.26:0/521164134 >> v1:172.21.15.190:6789/0 conn(0x7f0c3c15b930 legacy=0x7f0c3c157e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:55.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.106+0000 7f0c40b82640 1 -- 172.21.15.26:0/521164134 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c0c09e0 con 0x7f0c3c0c7800 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c40b82640 1 --2- 172.21.15.26:0/521164134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0b3250 tx=0x7f0c2c01eb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d279af561be9193e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c33fff640 1 -- 172.21.15.26:0/521164134 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0b4070 con 0x7f0c3c0c7800 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c33fff640 1 -- 172.21.15.26:0/521164134 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c0a7ac0 con 0x7f0c3c0c7800 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c33fff640 1 -- 172.21.15.26:0/521164134 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c2c0af440 con 0x7f0c3c0c7800 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/521164134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c0c7800 msgr2=0x7f0c3c15b3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- 172.21.15.26:0/521164134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f0c3c0b3250 tx=0x7f0c2c01eb00 comp rx=0 tx=0).stop 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/521164134 shutdown_connections 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- 172.21.15.26:0/521164134 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c0c7800 0x7f0c3c15b3f0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- 172.21.15.26:0/521164134 >> v2:172.21.15.190:3300/0 conn(0x7f0c3c152140 0x7f0c3c072f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/521164134 >> 172.21.15.26:0/521164134 conn(0x7f0c3c06f280 msgr2=0x7f0c3c06f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/521164134 shutdown_connections 2024-04-23T10:12:55.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/521164134 wait complete. 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 Processor -- start 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- start start 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c3c0c7800 0x7f0c3c1570d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c3c152140 0x7f0c3c0c0e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c06e4e0 con 0x7f0c3c15b930 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c152520 con 0x7f0c3c152140 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0c3c06e660 con 0x7f0c3c0c7800 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37778/0 (socket says 172.21.15.26:37778) 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 -- 172.21.15.26:0/1737509616 learned_addr learned my addr 172.21.15.26:0/1737509616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41383640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c3c0c7800 0x7f0c3c1570d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c40b82640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c3c152140 0x7f0c3c0c0e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 -- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c3c0c7800 msgr2=0x7f0c3c1570d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c3c0c7800 0x7f0c3c1570d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 -- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c3c152140 msgr2=0x7f0c3c0c0e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c3c152140 0x7f0c3c0c0e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 -- 172.21.15.26:0/1737509616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c1f7900 con 0x7f0c3c15b930 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c41b84640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400b970 tx=0x7f0c3400be30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34019070 con 0x7f0c3c15b930 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c3400cb40 con 0x7f0c3c15b930 2024-04-23T10:12:55.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0c34014440 con 0x7f0c3c15b930 2024-04-23T10:12:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c1f7be0 con 0x7f0c3c15b930 2024-04-23T10:12:55.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.110+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c1f81a0 con 0x7f0c3c15b930 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c075df0 con 0x7f0c3c15b930 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0c3401c070 con 0x7f0c3c15b930 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c31ffb640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 0x7f0c2006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0c34086880 con 0x7f0c3c15b930 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c41383640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 0x7f0c2006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.114+0000 7f0c41383640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 0x7f0c2006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800b9d0 tx=0x7f0c38008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.118+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0c34056b90 con 0x7f0c3c15b930 2024-04-23T10:12:55.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.282+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0c3c0c40e0 con 0x7f0c3c15b930 2024-04-23T10:12:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c31ffb640 1 -- 172.21.15.26:0/1737509616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f0c34056490 con 0x7f0c3c15b930 2024-04-23T10:12:55.285 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:55.285 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 msgr2=0x7f0c2006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 0x7f0c2006a840 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f0c3800b9d0 tx=0x7f0c38008040 comp rx=0 tx=0).stop 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 msgr2=0x7f0c3c14f200 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f0c3400b970 tx=0x7f0c3400be30 comp rx=0 tx=0).stop 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 shutdown_connections 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0c20068380 0x7f0c2006a840 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0c3c15b930 0x7f0c3c14f200 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0c3c152140 0x7f0c3c0c0e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 --2- 172.21.15.26:0/1737509616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0c3c0c7800 0x7f0c3c1570d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 >> 172.21.15.26:0/1737509616 conn(0x7f0c3c06f280 msgr2=0x7f0c3c0cb630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 shutdown_connections 2024-04-23T10:12:55.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.286+0000 7f0c435e7640 1 -- 172.21.15.26:0/1737509616 wait complete. 2024-04-23T10:12:55.304 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs standby_count_wanted 0 2024-04-23T10:12:55.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.426+0000 7fe528757640 1 Processor -- start 2024-04-23T10:12:55.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.426+0000 7fe528757640 1 -- start start 2024-04-23T10:12:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 0x7fe52015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5200703c0 0x7fe5200c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 0x7fe52006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe52015f420 con 0x7fe5200703c0 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe5200c8040 con 0x7fe5200c9550 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe528757640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe5200c8570 con 0x7fe520144580 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5200703c0 0x7fe5200c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe5200703c0 0x7fe5200c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37784/0 (socket says 172.21.15.26:37784) 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 -- 172.21.15.26:0/2149671306 learned_addr learned my addr 172.21.15.26:0/2149671306 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe5264f3640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 0x7fe52015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe526cf4640 1 --2- 172.21.15.26:0/2149671306 >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 0x7fe52006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 -- 172.21.15.26:0/2149671306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 msgr2=0x7fe52015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:55.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 0x7fe52015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 -- 172.21.15.26:0/2149671306 >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 msgr2=0x7fe52006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 --2- 172.21.15.26:0/2149671306 >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 0x7fe52006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 -- 172.21.15.26:0/2149671306 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe5200c8290 con 0x7fe5200703c0 2024-04-23T10:12:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe5264f3640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 0x7fe52015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:55.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe526cf4640 1 --2- 172.21.15.26:0/2149671306 >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 0x7fe52006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:55.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe525cf2640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200703c0 0x7fe5200c9010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5200c99e0 tx=0x7fe51001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922fb72b2c8854ec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe5254f1640 1 -- 172.21.15.26:0/2149671306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5100ab5f0 con 0x7fe5200703c0 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe5254f1640 1 -- 172.21.15.26:0/2149671306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5100b0070 con 0x7fe5200703c0 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.430+0000 7fe5254f1640 1 -- 172.21.15.26:0/2149671306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5100ab9b0 con 0x7fe5200703c0 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/2149671306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200703c0 msgr2=0x7fe5200c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200703c0 0x7fe5200c9010 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe5200c99e0 tx=0x7fe51001c520 comp rx=0 tx=0).stop 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/2149671306 shutdown_connections 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- 172.21.15.26:0/2149671306 >> v2:172.21.15.190:3300/0 conn(0x7fe5200c9550 0x7fe52006cee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200703c0 0x7fe5200c9010 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- 172.21.15.26:0/2149671306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe520144580 0x7fe52015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/2149671306 >> 172.21.15.26:0/2149671306 conn(0x7fe5200ca540 msgr2=0x7fe5200ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/2149671306 shutdown_connections 2024-04-23T10:12:55.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/2149671306 wait complete. 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 Processor -- start 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- start start 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5200703c0 0x7fe520158db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 0x7fe520072230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe5200c8cb0 con 0x7fe5200c9550 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe52015ef00 con 0x7fe520144580 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe52006c1e0 con 0x7fe5200703c0 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37796/0 (socket says 172.21.15.26:37796) 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 -- 172.21.15.26:0/440391684 learned_addr learned my addr 172.21.15.26:0/440391684 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe526cf4640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 0x7fe520072230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe5264f3640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5200703c0 0x7fe520158db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 -- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5200703c0 msgr2=0x7fe520158db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5200703c0 0x7fe520158db0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 -- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 msgr2=0x7fe520072230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 0x7fe520072230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 -- 172.21.15.26:0/440391684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe520159460 con 0x7fe5200c9550 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe526cf4640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 0x7fe520072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe525cf2640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe51001ca00 tx=0x7fe51001ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5100be5f0 con 0x7fe5200c9550 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5100be7b0 con 0x7fe5200c9550 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe5100beba0 con 0x7fe5200c9550 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe520159740 con 0x7fe5200c9550 2024-04-23T10:12:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.434+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe5201f3dc0 con 0x7fe5200c9550 2024-04-23T10:12:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe5201f38d0 con 0x7fe5200c9550 2024-04-23T10:12:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe5100b43f0 con 0x7fe5200c9550 2024-04-23T10:12:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe516ffd640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 0x7fe50406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe510120c60 con 0x7fe5200c9550 2024-04-23T10:12:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe5264f3640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 0x7fe50406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.438+0000 7fe5264f3640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 0x7fe50406a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006fd0 tx=0x7fe51c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.442+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe510016110 con 0x7fe5200c9550 2024-04-23T10:12:55.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:55.642+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"} v 0) -- 0x7fe520075df0 con 0x7fe5200c9550 2024-04-23T10:12:56.161 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.162+0000 7fe516ffd640 1 -- 172.21.15.26:0/440391684 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "standby_count_wanted", "val": "0"}]=0 v8) ==== 118+0+0 (secure 0 0 0) 0x7fe5100f09a0 con 0x7fe5200c9550 2024-04-23T10:12:56.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 msgr2=0x7fe50406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.166 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 0x7fe50406a870 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fe51c006fd0 tx=0x7fe51c008040 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 msgr2=0x7fe52013d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe51001ca00 tx=0x7fe51001ad60 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 shutdown_connections 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe5040683b0 0x7fe50406a870 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe520144580 0x7fe520072230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe5200c9550 0x7fe52013d390 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 --2- 172.21.15.26:0/440391684 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe5200703c0 0x7fe520158db0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 >> 172.21.15.26:0/440391684 conn(0x7fe5200ca540 msgr2=0x7fe5200ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:56.167 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 shutdown_connections 2024-04-23T10:12:56.168 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.166+0000 7fe528757640 1 -- 172.21.15.26:0/440391684 wait complete. 2024-04-23T10:12:56.188 DEBUG:tasks.cephfs.filesystem:fs_config: {'ec_profile': ['m=2', 'k=2', 'crush-failure-domain=osd'], 'max_mds': 5, 'session_timeout': 300} 2024-04-23T10:12:56.188 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs max_mds 5 2024-04-23T10:12:56.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.314+0000 7f0eb706b640 1 Processor -- start 2024-04-23T10:12:56.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.314+0000 7f0eb706b640 1 -- start start 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb706b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0eb00c8250 0x7f0eb00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb706b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb015b740 con 0x7f0eb00c8a70 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb706b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0eb00c58c0 con 0x7f0eb00c8630 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb706b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0eb00c6490 con 0x7f0eb00c8250 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f0eb00c8a70 0x7f0eb0162790 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60696/0 (socket says 172.21.15.26:60696) 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 -- 172.21.15.26:0/4192013591 learned_addr learned my addr 172.21.15.26:0/4192013591 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb4e07640 1 --2- 172.21.15.26:0/4192013591 >> v2:172.21.15.190:3300/0 conn(0x7f0eb00c8250 0x7f0eb00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 482456755 0 0) 0x7f0eb015b740 con 0x7f0eb00c8a70 2024-04-23T10:12:56.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0e98003530 con 0x7f0eb00c8a70 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2972931495 0 0) 0x7f0e98003530 con 0x7f0eb00c8a70 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 >> v2:172.21.15.190:3300/0 conn(0x7f0eb00c8250 msgr2=0x7f0eb00c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 --2- 172.21.15.26:0/4192013591 >> v2:172.21.15.190:3300/0 conn(0x7f0eb00c8250 0x7f0eb00c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 >> v1:172.21.15.190:6789/0 conn(0x7f0eb00c8630 legacy=0x7f0eb0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb00c5b60 con 0x7f0eb00c8a70 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f0ea8001a00 con 0x7f0eb00c8a70 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 >> v1:172.21.15.26:6789/0 conn(0x7f0eb00c8a70 legacy=0x7f0eb0162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e980039c0 0x7f0e98003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e98004810 0x7f0e98004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0e9800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c6490 con 0x7f0e980051d0 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0e9800c170 con 0x7f0e980039c0 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0e9800c370 con 0x7f0e98004810 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0e9800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb4e07640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e980039c0 0x7f0e98003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eaffff640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e98004810 0x7f0e98004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 -- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e98004810 msgr2=0x7f0e98004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:56.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0e98004810 0x7f0e98004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 -- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e980039c0 msgr2=0x7f0e98003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0e980039c0 0x7f0e98003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.318+0000 7f0eb5608640 1 -- 172.21.15.26:0/4192013591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0e98003530 con 0x7f0e980051d0 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb5608640 1 -- 172.21.15.26:0/4192013591 reap_dead start 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb5608640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0e9800b9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800a840 tx=0x7f0ea801fac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ce36ec45b6d43a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea800a460 con 0x7f0e980051d0 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea80aa710 con 0x7f0e980051d0 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eaf7fe640 1 -- 172.21.15.26:0/4192013591 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea80aab00 con 0x7f0e980051d0 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 msgr2=0x7f0e9800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0e9800b9d0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f0ea800a840 tx=0x7f0ea801fac0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- 172.21.15.26:0/4192013591 shutdown_connections 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 --2- 172.21.15.26:0/4192013591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0e9800b9d0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- 172.21.15.26:0/4192013591 >> 172.21.15.26:0/4192013591 conn(0x7f0eb006b9d0 msgr2=0x7f0eb006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- 172.21.15.26:0/4192013591 shutdown_connections 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- 172.21.15.26:0/4192013591 wait complete. 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 Processor -- start 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- start start 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 0x7f0eb0157280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 0x7f0eb01460f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c6120 con 0x7f0e980051d0 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0eb00c5710 con 0x7f0eb0155a90 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb706b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0eb00721a0 con 0x7f0eb01577c0 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37812/0 (socket says 172.21.15.26:37812) 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 -- 172.21.15.26:0/3879852868 learned_addr learned my addr 172.21.15.26:0/3879852868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eaffff640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 0x7f0eb0157280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb5608640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 0x7f0eb01460f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 -- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 msgr2=0x7f0eb01460f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 0x7f0eb01460f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 -- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 msgr2=0x7f0eb0157280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.322+0000 7f0eb4e07640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 0x7f0eb0157280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb4e07640 1 -- 172.21.15.26:0/3879852868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0eb0157c40 con 0x7f0e980051d0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb5608640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 0x7f0eb01460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eaffff640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 0x7f0eb0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb4e07640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00115f0 tx=0x7f0ea0011ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0015870 con 0x7f0e980051d0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0ea0015a10 con 0x7f0e980051d0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0eb01ef3d0 con 0x7f0e980051d0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0ea0015e00 con 0x7f0e980051d0 2024-04-23T10:12:56.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0eb01565b0 con 0x7f0e980051d0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0eb0075df0 con 0x7f0e980051d0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0ea001d400 con 0x7f0e980051d0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 0x7f0e9c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0ea0087580 con 0x7f0e980051d0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eaffff640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 0x7f0e9c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.326+0000 7f0eaffff640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 0x7f0e9c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0eb014ccb0 tx=0x7f0ea4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:56.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.330+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0eb0157c40 con 0x7f0e980051d0 2024-04-23T10:12:56.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:56.530+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"} v 0) -- 0x7f0eb0150740 con 0x7f0e980051d0 2024-04-23T10:12:57.169 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.170+0000 7f0ead7fa640 1 -- 172.21.15.26:0/3879852868 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "5"}]=0 v9) ==== 105+0+0 (secure 0 0 0) 0x7f0ea0019030 con 0x7f0e980051d0 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 msgr2=0x7f0e9c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 0x7f0e9c06a840 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f0eb014ccb0 tx=0x7f0ea4009040 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 msgr2=0x7f0eb014c2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f0ea00115f0 tx=0x7f0ea0011ab0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 shutdown_connections 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0e9c068380 0x7f0e9c06a840 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0eb01577c0 0x7f0eb01460f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0eb0155a90 0x7f0eb0157280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 --2- 172.21.15.26:0/3879852868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0e980051d0 0x7f0eb014c2b0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 >> 172.21.15.26:0/3879852868 conn(0x7f0eb006b9d0 msgr2=0x7f0eb014f4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:57.173 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 shutdown_connections 2024-04-23T10:12:57.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.174+0000 7f0eb706b640 1 -- 172.21.15.26:0/3879852868 wait complete. 2024-04-23T10:12:57.196 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs allow_standby_replay false 2024-04-23T10:12:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 Processor -- start 2024-04-23T10:12:57.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 -- start start 2024-04-23T10:12:57.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69ac0c9c10 0x7f69ac0c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac0ca960 con 0x7f69ac0c9700 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69ac0c7f30 con 0x7f69ac0c5f20 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69b2170640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f69ac0ca0c0 con 0x7f69ac0c9c10 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69aaffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f69ac0c9c10 0x7f69ac0c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69abfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69ac0c9700 0x7f69ac152c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60706/0 (socket says 172.21.15.26:60706) 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69abfff640 1 -- 172.21.15.26:0/3687465456 learned_addr learned my addr 172.21.15.26:0/3687465456 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69aaffd640 1 -- 172.21.15.26:0/3687465456 >> v1:172.21.15.190:6789/0 conn(0x7f69ac0c5f20 legacy=0x7f69ac0c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69aaffd640 1 -- 172.21.15.26:0/3687465456 >> v1:172.21.15.26:6789/0 conn(0x7f69ac0c9700 legacy=0x7f69ac152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.326+0000 7f69aaffd640 1 -- 172.21.15.26:0/3687465456 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac0ca3a0 con 0x7f69ac0c9c10 2024-04-23T10:12:57.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69aaffd640 1 --2- 172.21.15.26:0/3687465456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c9c10 0x7f69ac0c91c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a00097c0 tx=0x7f69a001ec50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13136a7bf31a9110 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:57.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69aa7fc640 1 -- 172.21.15.26:0/3687465456 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a00b5070 con 0x7f69ac0c9c10 2024-04-23T10:12:57.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69aa7fc640 1 -- 172.21.15.26:0/3687465456 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a00a8950 con 0x7f69ac0c9c10 2024-04-23T10:12:57.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69aa7fc640 1 -- 172.21.15.26:0/3687465456 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a00a8d20 con 0x7f69ac0c9c10 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- 172.21.15.26:0/3687465456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c9c10 msgr2=0x7f69ac0c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 --2- 172.21.15.26:0/3687465456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c9c10 0x7f69ac0c91c0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f69a00097c0 tx=0x7f69a001ec50 comp rx=0 tx=0).stop 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- 172.21.15.26:0/3687465456 shutdown_connections 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 --2- 172.21.15.26:0/3687465456 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c9c10 0x7f69ac0c91c0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- 172.21.15.26:0/3687465456 >> 172.21.15.26:0/3687465456 conn(0x7f69ac0676a0 msgr2=0x7f69ac067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- 172.21.15.26:0/3687465456 shutdown_connections 2024-04-23T10:12:57.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- 172.21.15.26:0/3687465456 wait complete. 2024-04-23T10:12:57.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 Processor -- start 2024-04-23T10:12:57.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- start start 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69ac0c9700 0x7f69ac0ce990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69ac0c9c10 0x7f69ac149b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0c5830 con 0x7f69ac0c5f20 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f69ac0c81d0 con 0x7f69ac0c9c10 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69b2170640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69ac0c59b0 con 0x7f69ac0c9700 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69ab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69ab7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37826/0 (socket says 172.21.15.26:37826) 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.330+0000 7f69ab7fe640 1 -- 172.21.15.26:0/3023403357 learned_addr learned my addr 172.21.15.26:0/3023403357 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69abfff640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69ac0c9c10 0x7f69ac149b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69aaffd640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69ac0c9700 0x7f69ac0ce990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 -- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69ac0c9700 msgr2=0x7f69ac0ce990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69ac0c9700 0x7f69ac0ce990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 -- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69ac0c9c10 msgr2=0x7f69ac149b00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69ac0c9c10 0x7f69ac149b00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 -- 172.21.15.26:0/3023403357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69ac1ef0b0 con 0x7f69ac0c5f20 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69ab7fe640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69a400c7c0 tx=0x7f69a400cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4016020 con 0x7f69ac0c5f20 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69a400aa50 con 0x7f69ac0c5f20 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69ac1ef390 con 0x7f69ac0c5f20 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69a4012420 con 0x7f69ac0c5f20 2024-04-23T10:12:57.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69ac149300 con 0x7f69ac0c5f20 2024-04-23T10:12:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69ac075df0 con 0x7f69ac0c5f20 2024-04-23T10:12:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69a4019020 con 0x7f69ac0c5f20 2024-04-23T10:12:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 0x7f699806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f69a4086cc0 con 0x7f69ac0c5f20 2024-04-23T10:12:57.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69aaffd640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 0x7f699806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:57.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.334+0000 7f69aaffd640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 0x7f699806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69a00b2000 tx=0x7f69a00aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:57.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.338+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69a4020030 con 0x7f69ac0c5f20 2024-04-23T10:12:57.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:57.530+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) -- 0x7f69ac0c6d20 con 0x7f69ac0c5f20 2024-04-23T10:12:58.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.178+0000 7f6993fff640 1 -- 172.21.15.26:0/3023403357 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v11) ==== 122+0+0 (secure 0 0 0) 0x7f69a4056fd0 con 0x7f69ac0c5f20 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 msgr2=0x7f699806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 0x7f699806a840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f69a00b2000 tx=0x7f69a00aa070 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 msgr2=0x7f69ac1ee9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7f69a400c7c0 tx=0x7f69a400cc80 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 shutdown_connections 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6998068380 0x7f699806a840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69ac0c9c10 0x7f69ac149b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69ac0c9700 0x7f69ac0ce990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 --2- 172.21.15.26:0/3023403357 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69ac0c5f20 0x7f69ac1ee9b0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 >> 172.21.15.26:0/3023403357 conn(0x7f69ac0676a0 msgr2=0x7f69ac152a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:58.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 shutdown_connections 2024-04-23T10:12:58.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.182+0000 7f69b2170640 1 -- 172.21.15.26:0/3023403357 wait complete. 2024-04-23T10:12:58.204 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs set cephfs session_timeout 300 2024-04-23T10:12:58.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 Processor -- start 2024-04-23T10:12:58.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 -- start start 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99c14fbc0 0x7fd99c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 0x7fd99c0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 0x7fd99c0c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd99c0c5d70 con 0x7fd99c14fbc0 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd99c0c6050 con 0x7fd99c14ffa0 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd9a1042640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c0c6330 con 0x7fd99c074100 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99c14fbc0 0x7fd99c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd99c14fbc0 0x7fd99c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37830/0 (socket says 172.21.15.26:37830) 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 -- 172.21.15.26:0/2919320799 learned_addr learned my addr 172.21.15.26:0/2919320799 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99a59c640 1 --2- 172.21.15.26:0/2919320799 >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 0x7fd99c0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99b59e640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 0x7fd99c0c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 -- 172.21.15.26:0/2919320799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 msgr2=0x7fd99c0c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:58.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 0x7fd99c0c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 -- 172.21.15.26:0/2919320799 >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 msgr2=0x7fd99c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:58.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/2919320799 >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 0x7fd99c0c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99ad9d640 1 -- 172.21.15.26:0/2919320799 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c0c6610 con 0x7fd99c14fbc0 2024-04-23T10:12:58.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99a59c640 1 --2- 172.21.15.26:0/2919320799 >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 0x7fd99c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:58.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.330+0000 7fd99b59e640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 0x7fd99c0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:58.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c14fbc0 0x7fd99c06f700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0691a0 tx=0x7fd98c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77af17d331cfe0a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd999d9b640 1 -- 172.21.15.26:0/2919320799 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0aa660 con 0x7fd99c14fbc0 2024-04-23T10:12:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd999d9b640 1 -- 172.21.15.26:0/2919320799 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c0af070 con 0x7fd99c14fbc0 2024-04-23T10:12:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd999d9b640 1 -- 172.21.15.26:0/2919320799 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0aaa20 con 0x7fd99c14fbc0 2024-04-23T10:12:58.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- 172.21.15.26:0/2919320799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c14fbc0 msgr2=0x7fd99c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c14fbc0 0x7fd99c06f700 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fd99c0691a0 tx=0x7fd98c01c520 comp rx=0 tx=0).stop 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- 172.21.15.26:0/2919320799 shutdown_connections 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c074100 0x7fd99c0c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 --2- 172.21.15.26:0/2919320799 >> v2:172.21.15.190:3300/0 conn(0x7fd99c14ffa0 0x7fd99c0c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 --2- 172.21.15.26:0/2919320799 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c14fbc0 0x7fd99c06f700 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- 172.21.15.26:0/2919320799 >> 172.21.15.26:0/2919320799 conn(0x7fd99c06b9d0 msgr2=0x7fd99c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- 172.21.15.26:0/2919320799 shutdown_connections 2024-04-23T10:12:58.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- 172.21.15.26:0/2919320799 wait complete. 2024-04-23T10:12:58.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 Processor -- start 2024-04-23T10:12:58.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.334+0000 7fd9a1042640 1 -- start start 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 0x7fd99c1494b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c14ffa0 0x7fd99c151930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c1592e0 con 0x7fd99c074100 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd99c159160 con 0x7fd99c14fbc0 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd99c159460 con 0x7fd99c14ffa0 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37840/0 (socket says 172.21.15.26:37840) 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 -- 172.21.15.26:0/3548160256 learned_addr learned my addr 172.21.15.26:0/3548160256 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99a59c640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 0x7fd99c1494b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99b59e640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c14ffa0 0x7fd99c151930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 -- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c14ffa0 msgr2=0x7fd99c151930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c14ffa0 0x7fd99c151930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 -- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 msgr2=0x7fd99c1494b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 0x7fd99c1494b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 -- 172.21.15.26:0/3548160256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd99c148780 con 0x7fd99c074100 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99a59c640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 0x7fd99c1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd99ad9d640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ac040 tx=0x7fd98c01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0b3800 con 0x7fd99c074100 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd98c0b39a0 con 0x7fd99c074100 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd99c152550 con 0x7fd99c074100 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd98c0b3d90 con 0x7fd99c074100 2024-04-23T10:12:58.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd99c1489f0 con 0x7fd99c074100 2024-04-23T10:12:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd99c075df0 con 0x7fd99c074100 2024-04-23T10:12:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd98c0c6440 con 0x7fd99c074100 2024-04-23T10:12:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 0x7fd98806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.338+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd98c121af0 con 0x7fd99c074100 2024-04-23T10:12:58.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.342+0000 7fd99a59c640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 0x7fd98806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:58.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.342+0000 7fd99a59c640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 0x7fd98806a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd99c1504e0 tx=0x7fd990008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:58.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.342+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd98c016110 con 0x7fd99c074100 2024-04-23T10:12:58.546 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:58.546+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"} v 0) -- 0x7fd99c0c7df0 con 0x7fd99c074100 2024-04-23T10:12:59.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.186+0000 7fd9837fe640 1 -- 172.21.15.26:0/3548160256 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "session_timeout", "val": "300"}]=0 v12) ==== 115+0+0 (secure 0 0 0) 0x7fd98c0f1f00 con 0x7fd99c074100 2024-04-23T10:12:59.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 msgr2=0x7fd98806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 0x7fd98806a870 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7fd99c1504e0 tx=0x7fd990008040 comp rx=0 tx=0).stop 2024-04-23T10:12:59.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 msgr2=0x7fd99c1f2760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fd98c0ac040 tx=0x7fd98c01ad60 comp rx=0 tx=0).stop 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 shutdown_connections 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd9880683b0 0x7fd98806a870 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd99c14ffa0 0x7fd99c151930 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd99c14fbc0 0x7fd99c1494b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 --2- 172.21.15.26:0/3548160256 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd99c074100 0x7fd99c1f2760 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 >> 172.21.15.26:0/3548160256 conn(0x7fd99c06b9d0 msgr2=0x7fd99c14e5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 shutdown_connections 2024-04-23T10:12:59.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.190+0000 7fd9a1042640 1 -- 172.21.15.26:0/3548160256 wait complete. 2024-04-23T10:12:59.210 DEBUG:tasks.cephfs.filesystem:Not Creating any subvols for filesystem 'cephfs' 2024-04-23T10:12:59.210 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 Processor -- start 2024-04-23T10:12:59.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 -- start start 2024-04-23T10:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb800cda50 0x7fbb800c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 0x7fbb8015b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8015beb0 con 0x7fbb80155350 2024-04-23T10:12:59.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800cca40 con 0x7fbb800cda50 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb86399640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbb800ccc90 con 0x7fbb8015b0b0 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb800cda50 0x7fbb800c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb800cda50 0x7fbb800c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37848/0 (socket says 172.21.15.26:37848) 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 -- 172.21.15.26:0/926967298 learned_addr learned my addr 172.21.15.26:0/926967298 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb84936640 1 --2- 172.21.15.26:0/926967298 >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 0x7fbb8015b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 -- 172.21.15.26:0/926967298 >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 msgr2=0x7fbb8015b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 --2- 172.21.15.26:0/926967298 >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 0x7fbb8015b500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 -- 172.21.15.26:0/926967298 >> v1:172.21.15.190:6789/0 conn(0x7fbb80155350 legacy=0x7fbb800cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb7f7fe640 1 -- 172.21.15.26:0/926967298 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb800ccf70 con 0x7fbb800cda50 2024-04-23T10:12:59.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.338+0000 7fbb84936640 1 --2- 172.21.15.26:0/926967298 >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 0x7fbb8015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7f7fe640 1 --2- 172.21.15.26:0/926967298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb800cda50 0x7fbb800c59c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb800b44e0 tx=0x7fbb7401f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c15b1be583b93ae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7effd640 1 -- 172.21.15.26:0/926967298 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740b4070 con 0x7fbb800cda50 2024-04-23T10:12:59.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7effd640 1 -- 172.21.15.26:0/926967298 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb740af400 con 0x7fbb800cda50 2024-04-23T10:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7effd640 1 -- 172.21.15.26:0/926967298 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb740af7d0 con 0x7fbb800cda50 2024-04-23T10:12:59.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- 172.21.15.26:0/926967298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb800cda50 msgr2=0x7fbb800c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- 172.21.15.26:0/926967298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb800cda50 0x7fbb800c59c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7fbb800b44e0 tx=0x7fbb7401f1a0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- 172.21.15.26:0/926967298 shutdown_connections 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- 172.21.15.26:0/926967298 >> v2:172.21.15.190:3300/0 conn(0x7fbb8015b0b0 0x7fbb8015b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- 172.21.15.26:0/926967298 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb800cda50 0x7fbb800c59c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- 172.21.15.26:0/926967298 >> 172.21.15.26:0/926967298 conn(0x7fbb8006cc30 msgr2=0x7fbb8006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- 172.21.15.26:0/926967298 shutdown_connections 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- 172.21.15.26:0/926967298 wait complete. 2024-04-23T10:12:59.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 Processor -- start 2024-04-23T10:12:59.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- start start 2024-04-23T10:12:59.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 0x7fbb801f16a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80155350 0x7fbb80150be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbb80155730 con 0x7fbb8015b0b0 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb800cd530 con 0x7fbb800cda50 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb86399640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8015e860 con 0x7fbb80155350 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37858/0 (socket says 172.21.15.26:37858) 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 -- 172.21.15.26:0/625078527 learned_addr learned my addr 172.21.15.26:0/625078527 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7ffff640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 0x7fbb801f16a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7f7fe640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80155350 0x7fbb80150be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 -- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80155350 msgr2=0x7fbb80150be0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80155350 0x7fbb80150be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 -- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 msgr2=0x7fbb801f16a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 0x7fbb801f16a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb84936640 1 -- 172.21.15.26:0/625078527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb801f0c00 con 0x7fbb8015b0b0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.342+0000 7fbb7ffff640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 0x7fbb801f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb84936640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c570 tx=0x7fbb7800ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78015020 con 0x7fbb8015b0b0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb78004460 con 0x7fbb8015b0b0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb800b4fd0 con 0x7fbb8015b0b0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb78003860 con 0x7fbb8015b0b0 2024-04-23T10:12:59.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb801f0ea0 con 0x7fbb8015b0b0 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb80075df0 con 0x7fbb8015b0b0 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb78018020 con 0x7fbb8015b0b0 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 0x7fbb6c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fbb78086cc0 con 0x7fbb8015b0b0 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7ffff640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 0x7fbb6c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.346+0000 7fbb7ffff640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 0x7fbb6c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb70003e40 tx=0x7fbb70009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.350+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb7801f020 con 0x7fbb8015b0b0 2024-04-23T10:12:59.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.550+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbb800cc610 con 0x7fbb8015b0b0 2024-04-23T10:12:59.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.550+0000 7fbb7cff9640 1 -- 172.21.15.26:0/625078527 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) ==== 94+0+6851 (secure 0 0 0) 0x7fbb78056f40 con 0x7fbb8015b0b0 2024-04-23T10:12:59.550 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:59.550 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4260,"name":"c","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4275,"name":"e","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3},{"gid":4282,"name":"d","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:12:58.549316+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1],"up":{"mds_0":4287,"mds_1":4284},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:creating","state_seq":1,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287]},"id":1}]} 2024-04-23T10:12:59.551 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 12 2024-04-23T10:12:59.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 msgr2=0x7fbb6c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 0x7fbb6c06a870 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7fbb70003e40 tx=0x7fbb70009040 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 msgr2=0x7fbb800b5590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fbb7800c570 tx=0x7fbb7800ca30 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 shutdown_connections 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c0683b0 0x7fbb6c06a870 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8015b0b0 0x7fbb800b5590 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb80155350 0x7fbb80150be0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 --2- 172.21.15.26:0/625078527 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb800cda50 0x7fbb801f16a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 >> 172.21.15.26:0/625078527 conn(0x7fbb8006cc30 msgr2=0x7fbb8014b5a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 shutdown_connections 2024-04-23T10:12:59.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.554+0000 7fbb86399640 1 -- 172.21.15.26:0/625078527 wait complete. 2024-04-23T10:12:59.569 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:12:59.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 Processor -- start 2024-04-23T10:12:59.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 -- start start 2024-04-23T10:12:59.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feee00718f0 0x7feee00ca590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0067a00 0x7feee00c2350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feee0158000 con 0x7feee0152010 2024-04-23T10:12:59.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7feee01582e0 con 0x7feee00718f0 2024-04-23T10:12:59.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feee5e4b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feee01585c0 con 0x7feee0067a00 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feee00718f0 0x7feee00ca590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feedffff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0067a00 0x7feee00c2350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feee00718f0 0x7feee00ca590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:43594/0 (socket says 172.21.15.26:43594) 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 -- 172.21.15.26:0/2780741600 learned_addr learned my addr 172.21.15.26:0/2780741600 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 -- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0067a00 msgr2=0x7feee00c2350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 --2- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0067a00 0x7feee00c2350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 -- 172.21.15.26:0/2780741600 >> v1:172.21.15.190:6789/0 conn(0x7feee0152010 legacy=0x7feee00b2730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.690+0000 7feed6ffd640 1 -- 172.21.15.26:0/2780741600 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee01588a0 con 0x7feee00718f0 2024-04-23T10:12:59.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feed6ffd640 1 --2- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee00718f0 0x7feee00ca590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec8009870 tx=0x7feec801c440 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ea753502c0055cda server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feedeffd640 1 -- 172.21.15.26:0/2780741600 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80b0070 con 0x7feee00718f0 2024-04-23T10:12:59.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feedeffd640 1 -- 172.21.15.26:0/2780741600 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec80ab600 con 0x7feee00718f0 2024-04-23T10:12:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feedeffd640 1 -- 172.21.15.26:0/2780741600 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80ab9d0 con 0x7feee00718f0 2024-04-23T10:12:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee00718f0 msgr2=0x7feee00ca590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee00718f0 0x7feee00ca590 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7feec8009870 tx=0x7feec801c440 comp rx=0 tx=0).stop 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- 172.21.15.26:0/2780741600 shutdown_connections 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0067a00 0x7feee00c2350 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2780741600 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee00718f0 0x7feee00ca590 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- 172.21.15.26:0/2780741600 >> 172.21.15.26:0/2780741600 conn(0x7feee00c9a70 msgr2=0x7feee00c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- 172.21.15.26:0/2780741600 shutdown_connections 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- 172.21.15.26:0/2780741600 wait complete. 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 Processor -- start 2024-04-23T10:12:59.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.694+0000 7feee5e4b640 1 -- start start 2024-04-23T10:12:59.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee0067a00 0x7feee013f960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 0x7feee01f7ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feee0152570 con 0x7feee00718f0 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feee01523f0 con 0x7feee0067a00 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feee0162ec0 con 0x7feee0152010 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37870/0 (socket says 172.21.15.26:37870) 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 -- 172.21.15.26:0/2834452833 learned_addr learned my addr 172.21.15.26:0/2834452833 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedf7fe640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee0067a00 0x7feee013f960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedffff640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 0x7feee01f7ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 -- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 msgr2=0x7feee01f7ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 0x7feee01f7ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 -- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee0067a00 msgr2=0x7feee013f960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee0067a00 0x7feee013f960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 -- 172.21.15.26:0/2834452833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feee013ed20 con 0x7feee00718f0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedffff640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 0x7feee01f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feed6ffd640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feec80ae040 tx=0x7feec80191e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80b0040 con 0x7feee00718f0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feec80b9070 con 0x7feee00718f0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feee013e480 con 0x7feee00718f0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feec80b4680 con 0x7feee00718f0 2024-04-23T10:12:59.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feee013ea40 con 0x7feee00718f0 2024-04-23T10:12:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feee0075df0 con 0x7feee00718f0 2024-04-23T10:12:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feec80b4820 con 0x7feee00718f0 2024-04-23T10:12:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 0x7feec006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:12:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feec8120870 con 0x7feee00718f0 2024-04-23T10:12:59.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.698+0000 7feedf7fe640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 0x7feec006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:12:59.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.702+0000 7feedf7fe640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 0x7feec006a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feed00015b0 tx=0x7feed0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:12:59.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.702+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feec8016150 con 0x7feee00718f0 2024-04-23T10:12:59.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.866+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7feee0145210 con 0x7feee00718f0 2024-04-23T10:12:59.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feedcff9640 1 -- 172.21.15.26:0/2834452833 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7feec80f0b80 con 0x7feee00718f0 2024-04-23T10:12:59.869 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:12:59.869 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 msgr2=0x7feec006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 0x7feec006a870 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7feed00015b0 tx=0x7feed0009040 comp rx=0 tx=0).stop 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 msgr2=0x7feee00cc660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7feec80ae040 tx=0x7feec80191e0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 shutdown_connections 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feec00683b0 0x7feec006a870 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feee0152010 0x7feee01f7ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feee00718f0 0x7feee00cc660 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 --2- 172.21.15.26:0/2834452833 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feee0067a00 0x7feee013f960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:12:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 >> 172.21.15.26:0/2834452833 conn(0x7feee00c9a70 msgr2=0x7feee01407f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:12:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 shutdown_connections 2024-04-23T10:12:59.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:12:59.870+0000 7feee5e4b640 1 -- 172.21.15.26:0/2834452833 wait complete. 2024-04-23T10:12:59.888 INFO:tasks.cephfs.filesystem.ceph_manager:waiting for clean 2024-04-23T10:12:59.888 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:00.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.002+0000 7efe43535640 1 Processor -- start 2024-04-23T10:13:00.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.002+0000 7efe43535640 1 -- start start 2024-04-23T10:13:00.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe43535640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3c14fbc0 0x7efe3c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe43535640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efe3c074100 0x7efe3c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe43535640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efe3c0c5d70 con 0x7efe3c14ffa0 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe43535640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c0c6050 con 0x7efe3c14fbc0 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe43535640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efe3c0c6330 con 0x7efe3c074100 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3c14fbc0 0x7efe3c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efe3c14fbc0 0x7efe3c06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37872/0 (socket says 172.21.15.26:37872) 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 -- 172.21.15.26:0/1976837491 learned_addr learned my addr 172.21.15.26:0/1976837491 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe41ad2640 1 --2- 172.21.15.26:0/1976837491 >> v2:172.21.15.190:3300/0 conn(0x7efe3c074100 0x7efe3c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 -- 172.21.15.26:0/1976837491 >> v2:172.21.15.190:3300/0 conn(0x7efe3c074100 msgr2=0x7efe3c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 --2- 172.21.15.26:0/1976837491 >> v2:172.21.15.190:3300/0 conn(0x7efe3c074100 0x7efe3c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 -- 172.21.15.26:0/1976837491 >> v1:172.21.15.190:6789/0 conn(0x7efe3c14ffa0 legacy=0x7efe3c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 -- 172.21.15.26:0/1976837491 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c0c6610 con 0x7efe3c14fbc0 2024-04-23T10:13:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe412d1640 1 --2- 172.21.15.26:0/1976837491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c06f700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe34009e50 tx=0x7efe3401c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4345c58826754d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe33fff640 1 -- 172.21.15.26:0/1976837491 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340a58e0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe33fff640 1 -- 172.21.15.26:0/1976837491 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe340a5a80 con 0x7efe3c14fbc0 2024-04-23T10:13:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.006+0000 7efe33fff640 1 -- 172.21.15.26:0/1976837491 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe340a5e50 con 0x7efe3c14fbc0 2024-04-23T10:13:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/1976837491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 msgr2=0x7efe3c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- 172.21.15.26:0/1976837491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c06f700 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7efe34009e50 tx=0x7efe3401c9f0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/1976837491 shutdown_connections 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- 172.21.15.26:0/1976837491 >> v2:172.21.15.190:3300/0 conn(0x7efe3c074100 0x7efe3c0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- 172.21.15.26:0/1976837491 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c06f700 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/1976837491 >> 172.21.15.26:0/1976837491 conn(0x7efe3c06b9d0 msgr2=0x7efe3c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/1976837491 shutdown_connections 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/1976837491 wait complete. 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 Processor -- start 2024-04-23T10:13:00.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- start start 2024-04-23T10:13:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c074100 0x7efe3c0c4dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 0x7efe3c1443f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0c8ab0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efe3c0c8930 con 0x7efe3c074100 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efe3c166090 con 0x7efe3c14ffa0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37884/0 (socket says 172.21.15.26:37884) 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 -- 172.21.15.26:0/3775754887 learned_addr learned my addr 172.21.15.26:0/3775754887 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe412d1640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c074100 0x7efe3c0c4dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe41ad2640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 0x7efe3c1443f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 -- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 msgr2=0x7efe3c1443f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 0x7efe3c1443f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 -- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c074100 msgr2=0x7efe3c0c4dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c074100 0x7efe3c0c4dc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 -- 172.21.15.26:0/3775754887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efe3c15cf10 con 0x7efe3c14fbc0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe41ad2640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 0x7efe3c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe40ad0640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c3c0 tx=0x7efe2c00c880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c017070 con 0x7efe3c14fbc0 2024-04-23T10:13:00.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efe2c0052d0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efe2c003840 con 0x7efe3c14fbc0 2024-04-23T10:13:00.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efe3c15d1b0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.010+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efe3c1f8420 con 0x7efe3c14fbc0 2024-04-23T10:13:00.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efe3c075df0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efe2c01a070 con 0x7efe3c14fbc0 2024-04-23T10:13:00.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe31ffb640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efe2c085fe0 con 0x7efe3c14fbc0 2024-04-23T10:13:00.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe412d1640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.014+0000 7efe412d1640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 0x7efe2006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efe340ae000 tx=0x7efe340a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.018+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efe2c005480 con 0x7efe3c14fbc0 2024-04-23T10:13:00.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.178+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7efe3c0c7df0 con 0x7efe200683b0 2024-04-23T10:13:00.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.198+0000 7efe31ffb640 1 -- 172.21.15.26:0/3775754887 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7efe3c0c7df0 con 0x7efe200683b0 2024-04-23T10:13:00.201 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:00.203 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 msgr2=0x7efe2006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 0x7efe2006a870 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7efe340ae000 tx=0x7efe340a7070 comp rx=0 tx=0).stop 2024-04-23T10:13:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 msgr2=0x7efe3c143eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7efe2c00c3c0 tx=0x7efe2c00c880 comp rx=0 tx=0).stop 2024-04-23T10:13:00.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 shutdown_connections 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe200683b0 0x7efe2006a870 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efe3c14ffa0 0x7efe3c1443f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efe3c14fbc0 0x7efe3c143eb0 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 --2- 172.21.15.26:0/3775754887 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efe3c074100 0x7efe3c0c4dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 >> 172.21.15.26:0/3775754887 conn(0x7efe3c06b9d0 msgr2=0x7efe3c14db40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 shutdown_connections 2024-04-23T10:13:00.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.202+0000 7efe43535640 1 -- 172.21.15.26:0/3775754887 wait complete. 2024-04-23T10:13:00.220 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-23T10:12:58.922947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005389"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694720+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:12:40.694720+0000","last_peered":"2024-04-23T10:12:40.694720+0000","last_clean":"2024-04-23T10:12:40.694720+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:12:40.694720+0000","last_undegraded":"2024-04-23T10:12:40.694720+0000","last_fullsized":"2024-04-23T10:12:40.694720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227927+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:12:40.227927+0000","last_peered":"2024-04-23T10:12:40.227927+0000","last_clean":"2024-04-23T10:12:40.227927+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:12:40.227927+0000","last_undegraded":"2024-04-23T10:12:40.227927+0000","last_fullsized":"2024-04-23T10:12:40.227927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227263+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:12:40.227263+0000","last_peered":"2024-04-23T10:12:40.227263+0000","last_clean":"2024-04-23T10:12:40.227263+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:12:40.227263+0000","last_undegraded":"2024-04-23T10:12:40.227263+0000","last_fullsized":"2024-04-23T10:12:40.227263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228161+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:12:40.228161+0000","last_peered":"2024-04-23T10:12:40.228161+0000","last_clean":"2024-04-23T10:12:40.228161+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:12:40.228161+0000","last_undegraded":"2024-04-23T10:12:40.228161+0000","last_fullsized":"2024-04-23T10:12:40.228161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694410+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:12:40.694410+0000","last_peered":"2024-04-23T10:12:40.694410+0000","last_clean":"2024-04-23T10:12:40.694410+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:12:40.694410+0000","last_undegraded":"2024-04-23T10:12:40.694410+0000","last_fullsized":"2024-04-23T10:12:40.694410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081420+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:12:40.081420+0000","last_peered":"2024-04-23T10:12:40.081420+0000","last_clean":"2024-04-23T10:12:40.081420+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:12:40.081420+0000","last_undegraded":"2024-04-23T10:12:40.081420+0000","last_fullsized":"2024-04-23T10:12:40.081420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736750+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:12:40.736750+0000","last_peered":"2024-04-23T10:12:40.736750+0000","last_clean":"2024-04-23T10:12:40.736750+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:12:40.736750+0000","last_undegraded":"2024-04-23T10:12:40.736750+0000","last_fullsized":"2024-04-23T10:12:40.736750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084060+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:12:40.084060+0000","last_peered":"2024-04-23T10:12:40.084060+0000","last_clean":"2024-04-23T10:12:40.084060+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:12:40.084060+0000","last_undegraded":"2024-04-23T10:12:40.084060+0000","last_fullsized":"2024-04-23T10:12:40.084060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084168+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:12:40.084168+0000","last_peered":"2024-04-23T10:12:40.084168+0000","last_clean":"2024-04-23T10:12:40.084168+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:12:40.084168+0000","last_undegraded":"2024-04-23T10:12:40.084168+0000","last_fullsized":"2024-04-23T10:12:40.084168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736000+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:12:40.736000+0000","last_peered":"2024-04-23T10:12:40.736000+0000","last_clean":"2024-04-23T10:12:40.736000+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:12:40.736000+0000","last_undegraded":"2024-04-23T10:12:40.736000+0000","last_fullsized":"2024-04-23T10:12:40.736000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085309+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:12:40.085309+0000","last_peered":"2024-04-23T10:12:40.085309+0000","last_clean":"2024-04-23T10:12:40.085309+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:12:40.085309+0000","last_undegraded":"2024-04-23T10:12:40.085309+0000","last_fullsized":"2024-04-23T10:12:40.085309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083415+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:12:40.083415+0000","last_peered":"2024-04-23T10:12:40.083415+0000","last_clean":"2024-04-23T10:12:40.083415+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:12:40.083415+0000","last_undegraded":"2024-04-23T10:12:40.083415+0000","last_fullsized":"2024-04-23T10:12:40.083415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222560+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:12:40.222560+0000","last_peered":"2024-04-23T10:12:40.222560+0000","last_clean":"2024-04-23T10:12:40.222560+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:12:40.222560+0000","last_undegraded":"2024-04-23T10:12:40.222560+0000","last_fullsized":"2024-04-23T10:12:40.222560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736705+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:12:40.736705+0000","last_peered":"2024-04-23T10:12:40.736705+0000","last_clean":"2024-04-23T10:12:40.736705+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:12:40.736705+0000","last_undegraded":"2024-04-23T10:12:40.736705+0000","last_fullsized":"2024-04-23T10:12:40.736705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082157+0000","last_change":"2024-04-23T10:12:39.086678+0000","last_active":"2024-04-23T10:12:40.082157+0000","last_peered":"2024-04-23T10:12:40.082157+0000","last_clean":"2024-04-23T10:12:40.082157+0000","last_became_active":"2024-04-23T10:12:39.085373+0000","last_became_peered":"2024-04-23T10:12:39.085373+0000","last_unstale":"2024-04-23T10:12:40.082157+0000","last_undegraded":"2024-04-23T10:12:40.082157+0000","last_fullsized":"2024-04-23T10:12:40.082157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:40.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227424+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:12:40.227424+0000","last_peered":"2024-04-23T10:12:40.227424+0000","last_clean":"2024-04-23T10:12:40.227424+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:12:40.227424+0000","last_undegraded":"2024-04-23T10:12:40.227424+0000","last_fullsized":"2024-04-23T10:12:40.227424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424566+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:12:40.424566+0000","last_peered":"2024-04-23T10:12:40.424566+0000","last_clean":"2024-04-23T10:12:40.424566+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:12:40.424566+0000","last_undegraded":"2024-04-23T10:12:40.424566+0000","last_fullsized":"2024-04-23T10:12:40.424566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082075+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:12:40.082075+0000","last_peered":"2024-04-23T10:12:40.082075+0000","last_clean":"2024-04-23T10:12:40.082075+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:12:40.082075+0000","last_undegraded":"2024-04-23T10:12:40.082075+0000","last_fullsized":"2024-04-23T10:12:40.082075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227769+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:12:40.227769+0000","last_peered":"2024-04-23T10:12:40.227769+0000","last_clean":"2024-04-23T10:12:40.227769+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:12:40.227769+0000","last_undegraded":"2024-04-23T10:12:40.227769+0000","last_fullsized":"2024-04-23T10:12:40.227769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423933+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:12:40.423933+0000","last_peered":"2024-04-23T10:12:40.423933+0000","last_clean":"2024-04-23T10:12:40.423933+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:12:40.423933+0000","last_undegraded":"2024-04-23T10:12:40.423933+0000","last_fullsized":"2024-04-23T10:12:40.423933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425198+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:12:40.425198+0000","last_peered":"2024-04-23T10:12:40.425198+0000","last_clean":"2024-04-23T10:12:40.425198+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:12:40.425198+0000","last_undegraded":"2024-04-23T10:12:40.425198+0000","last_fullsized":"2024-04-23T10:12:40.425198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082399+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:12:40.082399+0000","last_peered":"2024-04-23T10:12:40.082399+0000","last_clean":"2024-04-23T10:12:40.082399+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:12:40.082399+0000","last_undegraded":"2024-04-23T10:12:40.082399+0000","last_fullsized":"2024-04-23T10:12:40.082399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735517+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:12:40.735517+0000","last_peered":"2024-04-23T10:12:40.735517+0000","last_clean":"2024-04-23T10:12:40.735517+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:12:40.735517+0000","last_undegraded":"2024-04-23T10:12:40.735517+0000","last_fullsized":"2024-04-23T10:12:40.735517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081599+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:12:40.081599+0000","last_peered":"2024-04-23T10:12:40.081599+0000","last_clean":"2024-04-23T10:12:40.081599+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:12:40.081599+0000","last_undegraded":"2024-04-23T10:12:40.081599+0000","last_fullsized":"2024-04-23T10:12:40.081599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695149+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:12:40.695149+0000","last_peered":"2024-04-23T10:12:40.695149+0000","last_clean":"2024-04-23T10:12:40.695149+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:12:40.695149+0000","last_undegraded":"2024-04-23T10:12:40.695149+0000","last_fullsized":"2024-04-23T10:12:40.695149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224406+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:12:40.224406+0000","last_peered":"2024-04-23T10:12:40.224406+0000","last_clean":"2024-04-23T10:12:40.224406+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:12:40.224406+0000","last_undegraded":"2024-04-23T10:12:40.224406+0000","last_fullsized":"2024-04-23T10:12:40.224406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081842+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:12:40.081842+0000","last_peered":"2024-04-23T10:12:40.081842+0000","last_clean":"2024-04-23T10:12:40.081842+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:12:40.081842+0000","last_undegraded":"2024-04-23T10:12:40.081842+0000","last_fullsized":"2024-04-23T10:12:40.081842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228252+0000","last_change":"2024-04-23T10:12:35.046012+0000","last_active":"2024-04-23T10:12:40.228252+0000","last_peered":"2024-04-23T10:12:40.228252+0000","last_clean":"2024-04-23T10:12:40.228252+0000","last_became_active":"2024-04-23T10:12:35.045699+0000","last_became_peered":"2024-04-23T10:12:35.045699+0000","last_unstale":"2024-04-23T10:12:40.228252+0000","last_undegraded":"2024-04-23T10:12:40.228252+0000","last_fullsized":"2024-04-23T10:12:40.228252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:23.156695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425569+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:12:40.425569+0000","last_peered":"2024-04-23T10:12:40.425569+0000","last_clean":"2024-04-23T10:12:40.425569+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:12:40.425569+0000","last_undegraded":"2024-04-23T10:12:40.425569+0000","last_fullsized":"2024-04-23T10:12:40.425569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227374+0000","last_change":"2024-04-23T10:12:39.140751+0000","last_active":"2024-04-23T10:12:40.227374+0000","last_peered":"2024-04-23T10:12:40.227374+0000","last_clean":"2024-04-23T10:12:40.227374+0000","last_became_active":"2024-04-23T10:12:39.140324+0000","last_became_peered":"2024-04-23T10:12:39.140324+0000","last_unstale":"2024-04-23T10:12:40.227374+0000","last_undegraded":"2024-04-23T10:12:40.227374+0000","last_fullsized":"2024-04-23T10:12:40.227374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:14:47.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425248+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:12:40.425248+0000","last_peered":"2024-04-23T10:12:40.425248+0000","last_clean":"2024-04-23T10:12:40.425248+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:12:40.425248+0000","last_undegraded":"2024-04-23T10:12:40.425248+0000","last_fullsized":"2024-04-23T10:12:40.425248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736899+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:12:40.736899+0000","last_peered":"2024-04-23T10:12:40.736899+0000","last_clean":"2024-04-23T10:12:40.736899+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:12:40.736899+0000","last_undegraded":"2024-04-23T10:12:40.736899+0000","last_fullsized":"2024-04-23T10:12:40.736899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694067+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:12:40.694067+0000","last_peered":"2024-04-23T10:12:40.694067+0000","last_clean":"2024-04-23T10:12:40.694067+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:12:40.694067+0000","last_undegraded":"2024-04-23T10:12:40.694067+0000","last_fullsized":"2024-04-23T10:12:40.694067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085565+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:12:40.085565+0000","last_peered":"2024-04-23T10:12:40.085565+0000","last_clean":"2024-04-23T10:12:40.085565+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:12:40.085565+0000","last_undegraded":"2024-04-23T10:12:40.085565+0000","last_fullsized":"2024-04-23T10:12:40.085565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425505+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:12:40.425505+0000","last_peered":"2024-04-23T10:12:40.425505+0000","last_clean":"2024-04-23T10:12:40.425505+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:12:40.425505+0000","last_undegraded":"2024-04-23T10:12:40.425505+0000","last_fullsized":"2024-04-23T10:12:40.425505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424225+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:12:40.424225+0000","last_peered":"2024-04-23T10:12:40.424225+0000","last_clean":"2024-04-23T10:12:40.424225+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:12:40.424225+0000","last_undegraded":"2024-04-23T10:12:40.424225+0000","last_fullsized":"2024-04-23T10:12:40.424225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084798+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:12:40.084798+0000","last_peered":"2024-04-23T10:12:40.084798+0000","last_clean":"2024-04-23T10:12:40.084798+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:12:40.084798+0000","last_undegraded":"2024-04-23T10:12:40.084798+0000","last_fullsized":"2024-04-23T10:12:40.084798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082819+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:12:40.082819+0000","last_peered":"2024-04-23T10:12:40.082819+0000","last_clean":"2024-04-23T10:12:40.082819+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:12:40.082819+0000","last_undegraded":"2024-04-23T10:12:40.082819+0000","last_fullsized":"2024-04-23T10:12:40.082819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425110+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:12:40.425110+0000","last_peered":"2024-04-23T10:12:40.425110+0000","last_clean":"2024-04-23T10:12:40.425110+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:12:40.425110+0000","last_undegraded":"2024-04-23T10:12:40.425110+0000","last_fullsized":"2024-04-23T10:12:40.425110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424421+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:12:40.424421+0000","last_peered":"2024-04-23T10:12:40.424421+0000","last_clean":"2024-04-23T10:12:40.424421+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:12:40.424421+0000","last_undegraded":"2024-04-23T10:12:40.424421+0000","last_fullsized":"2024-04-23T10:12:40.424421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080451+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:12:40.080451+0000","last_peered":"2024-04-23T10:12:40.080451+0000","last_clean":"2024-04-23T10:12:40.080451+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:12:40.080451+0000","last_undegraded":"2024-04-23T10:12:40.080451+0000","last_fullsized":"2024-04-23T10:12:40.080451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425432+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:12:40.425432+0000","last_peered":"2024-04-23T10:12:40.425432+0000","last_clean":"2024-04-23T10:12:40.425432+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:12:40.425432+0000","last_undegraded":"2024-04-23T10:12:40.425432+0000","last_fullsized":"2024-04-23T10:12:40.425432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.693709+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:12:40.693709+0000","last_peered":"2024-04-23T10:12:40.693709+0000","last_clean":"2024-04-23T10:12:40.693709+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:12:40.693709+0000","last_undegraded":"2024-04-23T10:12:40.693709+0000","last_fullsized":"2024-04-23T10:12:40.693709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735754+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:12:40.735754+0000","last_peered":"2024-04-23T10:12:40.735754+0000","last_clean":"2024-04-23T10:12:40.735754+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:12:40.735754+0000","last_undegraded":"2024-04-23T10:12:40.735754+0000","last_fullsized":"2024-04-23T10:12:40.735754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695103+0000","last_change":"2024-04-23T10:12:39.144005+0000","last_active":"2024-04-23T10:12:40.695103+0000","last_peered":"2024-04-23T10:12:40.695103+0000","last_clean":"2024-04-23T10:12:40.695103+0000","last_became_active":"2024-04-23T10:12:39.143429+0000","last_became_peered":"2024-04-23T10:12:39.143429+0000","last_unstale":"2024-04-23T10:12:40.695103+0000","last_undegraded":"2024-04-23T10:12:40.695103+0000","last_fullsized":"2024-04-23T10:12:40.695103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:28:05.706347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227291+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:12:40.227291+0000","last_peered":"2024-04-23T10:12:40.227291+0000","last_clean":"2024-04-23T10:12:40.227291+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:12:40.227291+0000","last_undegraded":"2024-04-23T10:12:40.227291+0000","last_fullsized":"2024-04-23T10:12:40.227291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083722+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:12:40.083722+0000","last_peered":"2024-04-23T10:12:40.083722+0000","last_clean":"2024-04-23T10:12:40.083722+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:12:40.083722+0000","last_undegraded":"2024-04-23T10:12:40.083722+0000","last_fullsized":"2024-04-23T10:12:40.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736031+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:12:40.736031+0000","last_peered":"2024-04-23T10:12:40.736031+0000","last_clean":"2024-04-23T10:12:40.736031+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:12:40.736031+0000","last_undegraded":"2024-04-23T10:12:40.736031+0000","last_fullsized":"2024-04-23T10:12:40.736031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222912+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:12:40.222912+0000","last_peered":"2024-04-23T10:12:40.222912+0000","last_clean":"2024-04-23T10:12:40.222912+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:12:40.222912+0000","last_undegraded":"2024-04-23T10:12:40.222912+0000","last_fullsized":"2024-04-23T10:12:40.222912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736371+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:12:40.736371+0000","last_peered":"2024-04-23T10:12:40.736371+0000","last_clean":"2024-04-23T10:12:40.736371+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:12:40.736371+0000","last_undegraded":"2024-04-23T10:12:40.736371+0000","last_fullsized":"2024-04-23T10:12:40.736371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080981+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:12:40.080981+0000","last_peered":"2024-04-23T10:12:40.080981+0000","last_clean":"2024-04-23T10:12:40.080981+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:12:40.080981+0000","last_undegraded":"2024-04-23T10:12:40.080981+0000","last_fullsized":"2024-04-23T10:12:40.080981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224993+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:12:40.224993+0000","last_peered":"2024-04-23T10:12:40.224993+0000","last_clean":"2024-04-23T10:12:40.224993+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:12:40.224993+0000","last_undegraded":"2024-04-23T10:12:40.224993+0000","last_fullsized":"2024-04-23T10:12:40.224993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084202+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:12:40.084202+0000","last_peered":"2024-04-23T10:12:40.084202+0000","last_clean":"2024-04-23T10:12:40.084202+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:12:40.084202+0000","last_undegraded":"2024-04-23T10:12:40.084202+0000","last_fullsized":"2024-04-23T10:12:40.084202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425618+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:12:40.425618+0000","last_peered":"2024-04-23T10:12:40.425618+0000","last_clean":"2024-04-23T10:12:40.425618+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:12:40.425618+0000","last_undegraded":"2024-04-23T10:12:40.425618+0000","last_fullsized":"2024-04-23T10:12:40.425618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694791+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:12:40.694791+0000","last_peered":"2024-04-23T10:12:40.694791+0000","last_clean":"2024-04-23T10:12:40.694791+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:12:40.694791+0000","last_undegraded":"2024-04-23T10:12:40.694791+0000","last_fullsized":"2024-04-23T10:12:40.694791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737351+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:12:40.737351+0000","last_peered":"2024-04-23T10:12:40.737351+0000","last_clean":"2024-04-23T10:12:40.737351+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:12:40.737351+0000","last_undegraded":"2024-04-23T10:12:40.737351+0000","last_fullsized":"2024-04-23T10:12:40.737351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081400+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:12:40.081400+0000","last_peered":"2024-04-23T10:12:40.081400+0000","last_clean":"2024-04-23T10:12:40.081400+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:12:40.081400+0000","last_undegraded":"2024-04-23T10:12:40.081400+0000","last_fullsized":"2024-04-23T10:12:40.081400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080961+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:12:40.080961+0000","last_peered":"2024-04-23T10:12:40.080961+0000","last_clean":"2024-04-23T10:12:40.080961+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:12:40.080961+0000","last_undegraded":"2024-04-23T10:12:40.080961+0000","last_fullsized":"2024-04-23T10:12:40.080961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736518+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:12:40.736518+0000","last_peered":"2024-04-23T10:12:40.736518+0000","last_clean":"2024-04-23T10:12:40.736518+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:12:40.736518+0000","last_undegraded":"2024-04-23T10:12:40.736518+0000","last_fullsized":"2024-04-23T10:12:40.736518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085364+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:12:40.085364+0000","last_peered":"2024-04-23T10:12:40.085364+0000","last_clean":"2024-04-23T10:12:40.085364+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:12:40.085364+0000","last_undegraded":"2024-04-23T10:12:40.085364+0000","last_fullsized":"2024-04-23T10:12:40.085364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081041+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:12:40.081041+0000","last_peered":"2024-04-23T10:12:40.081041+0000","last_clean":"2024-04-23T10:12:40.081041+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:12:40.081041+0000","last_undegraded":"2024-04-23T10:12:40.081041+0000","last_fullsized":"2024-04-23T10:12:40.081041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736041+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:12:40.736041+0000","last_peered":"2024-04-23T10:12:40.736041+0000","last_clean":"2024-04-23T10:12:40.736041+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:12:40.736041+0000","last_undegraded":"2024-04-23T10:12:40.736041+0000","last_fullsized":"2024-04-23T10:12:40.736041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080265+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:12:40.080265+0000","last_peered":"2024-04-23T10:12:40.080265+0000","last_clean":"2024-04-23T10:12:40.080265+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:12:40.080265+0000","last_undegraded":"2024-04-23T10:12:40.080265+0000","last_fullsized":"2024-04-23T10:12:40.080265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694649+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:12:40.694649+0000","last_peered":"2024-04-23T10:12:40.694649+0000","last_clean":"2024-04-23T10:12:40.694649+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:12:40.694649+0000","last_undegraded":"2024-04-23T10:12:40.694649+0000","last_fullsized":"2024-04-23T10:12:40.694649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222505+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:12:40.222505+0000","last_peered":"2024-04-23T10:12:40.222505+0000","last_clean":"2024-04-23T10:12:40.222505+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:12:40.222505+0000","last_undegraded":"2024-04-23T10:12:40.222505+0000","last_fullsized":"2024-04-23T10:12:40.222505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223019+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:12:40.223019+0000","last_peered":"2024-04-23T10:12:40.223019+0000","last_clean":"2024-04-23T10:12:40.223019+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:12:40.223019+0000","last_undegraded":"2024-04-23T10:12:40.223019+0000","last_fullsized":"2024-04-23T10:12:40.223019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228197+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:12:40.228197+0000","last_peered":"2024-04-23T10:12:40.228197+0000","last_clean":"2024-04-23T10:12:40.228197+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:12:40.228197+0000","last_undegraded":"2024-04-23T10:12:40.228197+0000","last_fullsized":"2024-04-23T10:12:40.228197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736505+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:12:40.736505+0000","last_peered":"2024-04-23T10:12:40.736505+0000","last_clean":"2024-04-23T10:12:40.736505+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:12:40.736505+0000","last_undegraded":"2024-04-23T10:12:40.736505+0000","last_fullsized":"2024-04-23T10:12:40.736505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083055+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:12:40.083055+0000","last_peered":"2024-04-23T10:12:40.083055+0000","last_clean":"2024-04-23T10:12:40.083055+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:12:40.083055+0000","last_undegraded":"2024-04-23T10:12:40.083055+0000","last_fullsized":"2024-04-23T10:12:40.083055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228406+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:12:40.228406+0000","last_peered":"2024-04-23T10:12:40.228406+0000","last_clean":"2024-04-23T10:12:40.228406+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:12:40.228406+0000","last_undegraded":"2024-04-23T10:12:40.228406+0000","last_fullsized":"2024-04-23T10:12:40.228406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694309+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:12:40.694309+0000","last_peered":"2024-04-23T10:12:40.694309+0000","last_clean":"2024-04-23T10:12:40.694309+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:12:40.694309+0000","last_undegraded":"2024-04-23T10:12:40.694309+0000","last_fullsized":"2024-04-23T10:12:40.694309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694950+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:12:40.694950+0000","last_peered":"2024-04-23T10:12:40.694950+0000","last_clean":"2024-04-23T10:12:40.694950+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:12:40.694950+0000","last_undegraded":"2024-04-23T10:12:40.694950+0000","last_fullsized":"2024-04-23T10:12:40.694950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085118+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:12:40.085118+0000","last_peered":"2024-04-23T10:12:40.085118+0000","last_clean":"2024-04-23T10:12:40.085118+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:12:40.085118+0000","last_undegraded":"2024-04-23T10:12:40.085118+0000","last_fullsized":"2024-04-23T10:12:40.085118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736101+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:12:40.736101+0000","last_peered":"2024-04-23T10:12:40.736101+0000","last_clean":"2024-04-23T10:12:40.736101+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:12:40.736101+0000","last_undegraded":"2024-04-23T10:12:40.736101+0000","last_fullsized":"2024-04-23T10:12:40.736101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:50.524048+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:12:50.524048+0000","last_peered":"2024-04-23T10:12:50.524048+0000","last_clean":"2024-04-23T10:12:50.524048+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:12:50.524048+0000","last_undegraded":"2024-04-23T10:12:50.524048+0000","last_fullsized":"2024-04-23T10:12:50.524048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424501+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:12:40.424501+0000","last_peered":"2024-04-23T10:12:40.424501+0000","last_clean":"2024-04-23T10:12:40.424501+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:12:40.424501+0000","last_undegraded":"2024-04-23T10:12:40.424501+0000","last_fullsized":"2024-04-23T10:12:40.424501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083129+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:12:40.083129+0000","last_peered":"2024-04-23T10:12:40.083129+0000","last_clean":"2024-04-23T10:12:40.083129+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:12:40.083129+0000","last_undegraded":"2024-04-23T10:12:40.083129+0000","last_fullsized":"2024-04-23T10:12:40.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425386+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:12:40.425386+0000","last_peered":"2024-04-23T10:12:40.425386+0000","last_clean":"2024-04-23T10:12:40.425386+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:12:40.425386+0000","last_undegraded":"2024-04-23T10:12:40.425386+0000","last_fullsized":"2024-04-23T10:12:40.425386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083595+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:12:40.083595+0000","last_peered":"2024-04-23T10:12:40.083595+0000","last_clean":"2024-04-23T10:12:40.083595+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:12:40.083595+0000","last_undegraded":"2024-04-23T10:12:40.083595+0000","last_fullsized":"2024-04-23T10:12:40.083595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694569+0000","last_change":"2024-04-23T10:12:35.029157+0000","last_active":"2024-04-23T10:12:40.694569+0000","last_peered":"2024-04-23T10:12:40.694569+0000","last_clean":"2024-04-23T10:12:40.694569+0000","last_became_active":"2024-04-23T10:12:35.028122+0000","last_became_peered":"2024-04-23T10:12:35.028122+0000","last_unstale":"2024-04-23T10:12:40.694569+0000","last_undegraded":"2024-04-23T10:12:40.694569+0000","last_fullsized":"2024-04-23T10:12:40.694569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:58:30.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085259+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:12:40.085259+0000","last_peered":"2024-04-23T10:12:40.085259+0000","last_clean":"2024-04-23T10:12:40.085259+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:12:40.085259+0000","last_undegraded":"2024-04-23T10:12:40.085259+0000","last_fullsized":"2024-04-23T10:12:40.085259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227674+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:12:40.227674+0000","last_peered":"2024-04-23T10:12:40.227674+0000","last_clean":"2024-04-23T10:12:40.227674+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:12:40.227674+0000","last_undegraded":"2024-04-23T10:12:40.227674+0000","last_fullsized":"2024-04-23T10:12:40.227674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085010+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:12:40.085010+0000","last_peered":"2024-04-23T10:12:40.085010+0000","last_clean":"2024-04-23T10:12:40.085010+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:12:40.085010+0000","last_undegraded":"2024-04-23T10:12:40.085010+0000","last_fullsized":"2024-04-23T10:12:40.085010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224170+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:12:40.224170+0000","last_peered":"2024-04-23T10:12:40.224170+0000","last_clean":"2024-04-23T10:12:40.224170+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:12:40.224170+0000","last_undegraded":"2024-04-23T10:12:40.224170+0000","last_fullsized":"2024-04-23T10:12:40.224170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227262+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:12:40.227262+0000","last_peered":"2024-04-23T10:12:40.227262+0000","last_clean":"2024-04-23T10:12:40.227262+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:12:40.227262+0000","last_undegraded":"2024-04-23T10:12:40.227262+0000","last_fullsized":"2024-04-23T10:12:40.227262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423747+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:12:40.423747+0000","last_peered":"2024-04-23T10:12:40.423747+0000","last_clean":"2024-04-23T10:12:40.423747+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:12:40.423747+0000","last_undegraded":"2024-04-23T10:12:40.423747+0000","last_fullsized":"2024-04-23T10:12:40.423747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081194+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:12:40.081194+0000","last_peered":"2024-04-23T10:12:40.081194+0000","last_clean":"2024-04-23T10:12:40.081194+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:12:40.081194+0000","last_undegraded":"2024-04-23T10:12:40.081194+0000","last_fullsized":"2024-04-23T10:12:40.081194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224019+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:12:40.224019+0000","last_peered":"2024-04-23T10:12:40.224019+0000","last_clean":"2024-04-23T10:12:40.224019+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:12:40.224019+0000","last_undegraded":"2024-04-23T10:12:40.224019+0000","last_fullsized":"2024-04-23T10:12:40.224019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227536+0000","last_change":"2024-04-23T10:12:35.031938+0000","last_active":"2024-04-23T10:12:40.227536+0000","last_peered":"2024-04-23T10:12:40.227536+0000","last_clean":"2024-04-23T10:12:40.227536+0000","last_became_active":"2024-04-23T10:12:35.031645+0000","last_became_peered":"2024-04-23T10:12:35.031645+0000","last_unstale":"2024-04-23T10:12:40.227536+0000","last_undegraded":"2024-04-23T10:12:40.227536+0000","last_fullsized":"2024-04-23T10:12:40.227536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:26.960607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:12:40.227565+0000","last_peered":"2024-04-23T10:12:40.227565+0000","last_clean":"2024-04-23T10:12:40.227565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:12:40.227565+0000","last_undegraded":"2024-04-23T10:12:40.227565+0000","last_fullsized":"2024-04-23T10:12:40.227565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223106+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:12:40.223106+0000","last_peered":"2024-04-23T10:12:40.223106+0000","last_clean":"2024-04-23T10:12:40.223106+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:12:40.223106+0000","last_undegraded":"2024-04-23T10:12:40.223106+0000","last_fullsized":"2024-04-23T10:12:40.223106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081034+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:12:40.081034+0000","last_peered":"2024-04-23T10:12:40.081034+0000","last_clean":"2024-04-23T10:12:40.081034+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:12:40.081034+0000","last_undegraded":"2024-04-23T10:12:40.081034+0000","last_fullsized":"2024-04-23T10:12:40.081034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227530+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:12:40.227530+0000","last_peered":"2024-04-23T10:12:40.227530+0000","last_clean":"2024-04-23T10:12:40.227530+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:12:40.227530+0000","last_undegraded":"2024-04-23T10:12:40.227530+0000","last_fullsized":"2024-04-23T10:12:40.227530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083585+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:12:40.083585+0000","last_peered":"2024-04-23T10:12:40.083585+0000","last_clean":"2024-04-23T10:12:40.083585+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:12:40.083585+0000","last_undegraded":"2024-04-23T10:12:40.083585+0000","last_fullsized":"2024-04-23T10:12:40.083585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227924+0000","last_change":"2024-04-23T10:12:39.089619+0000","last_active":"2024-04-23T10:12:40.227924+0000","last_peered":"2024-04-23T10:12:40.227924+0000","last_clean":"2024-04-23T10:12:40.227924+0000","last_became_active":"2024-04-23T10:12:39.080595+0000","last_became_peered":"2024-04-23T10:12:39.080595+0000","last_unstale":"2024-04-23T10:12:40.227924+0000","last_undegraded":"2024-04-23T10:12:40.227924+0000","last_fullsized":"2024-04-23T10:12:40.227924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:22.568699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222192+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:12:40.222192+0000","last_peered":"2024-04-23T10:12:40.222192+0000","last_clean":"2024-04-23T10:12:40.222192+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:12:40.222192+0000","last_undegraded":"2024-04-23T10:12:40.222192+0000","last_fullsized":"2024-04-23T10:12:40.222192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080449+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:12:40.080449+0000","last_peered":"2024-04-23T10:12:40.080449+0000","last_clean":"2024-04-23T10:12:40.080449+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:12:40.080449+0000","last_undegraded":"2024-04-23T10:12:40.080449+0000","last_fullsized":"2024-04-23T10:12:40.080449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082564+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:12:40.082564+0000","last_peered":"2024-04-23T10:12:40.082564+0000","last_clean":"2024-04-23T10:12:40.082564+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:12:40.082564+0000","last_undegraded":"2024-04-23T10:12:40.082564+0000","last_fullsized":"2024-04-23T10:12:40.082564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694554+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:12:40.694554+0000","last_peered":"2024-04-23T10:12:40.694554+0000","last_clean":"2024-04-23T10:12:40.694554+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:12:40.694554+0000","last_undegraded":"2024-04-23T10:12:40.694554+0000","last_fullsized":"2024-04-23T10:12:40.694554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228250+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:12:40.228250+0000","last_peered":"2024-04-23T10:12:40.228250+0000","last_clean":"2024-04-23T10:12:40.228250+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:12:40.228250+0000","last_undegraded":"2024-04-23T10:12:40.228250+0000","last_fullsized":"2024-04-23T10:12:40.228250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424882+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:12:40.424882+0000","last_peered":"2024-04-23T10:12:40.424882+0000","last_clean":"2024-04-23T10:12:40.424882+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:12:40.424882+0000","last_undegraded":"2024-04-23T10:12:40.424882+0000","last_fullsized":"2024-04-23T10:12:40.424882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223845+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:12:40.223845+0000","last_peered":"2024-04-23T10:12:40.223845+0000","last_clean":"2024-04-23T10:12:40.223845+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:12:40.223845+0000","last_undegraded":"2024-04-23T10:12:40.223845+0000","last_fullsized":"2024-04-23T10:12:40.223845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228257+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:12:40.228257+0000","last_peered":"2024-04-23T10:12:40.228257+0000","last_clean":"2024-04-23T10:12:40.228257+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:12:40.228257+0000","last_undegraded":"2024-04-23T10:12:40.228257+0000","last_fullsized":"2024-04-23T10:12:40.228257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081108+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:12:40.081108+0000","last_peered":"2024-04-23T10:12:40.081108+0000","last_clean":"2024-04-23T10:12:40.081108+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:12:40.081108+0000","last_undegraded":"2024-04-23T10:12:40.081108+0000","last_fullsized":"2024-04-23T10:12:40.081108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227349+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:12:40.227349+0000","last_peered":"2024-04-23T10:12:40.227349+0000","last_clean":"2024-04-23T10:12:40.227349+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:12:40.227349+0000","last_undegraded":"2024-04-23T10:12:40.227349+0000","last_fullsized":"2024-04-23T10:12:40.227349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082447+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:12:40.082447+0000","last_peered":"2024-04-23T10:12:40.082447+0000","last_clean":"2024-04-23T10:12:40.082447+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:12:40.082447+0000","last_undegraded":"2024-04-23T10:12:40.082447+0000","last_fullsized":"2024-04-23T10:12:40.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223339+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:12:40.223339+0000","last_peered":"2024-04-23T10:12:40.223339+0000","last_clean":"2024-04-23T10:12:40.223339+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:12:40.223339+0000","last_undegraded":"2024-04-23T10:12:40.223339+0000","last_fullsized":"2024-04-23T10:12:40.223339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736824+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:12:40.736824+0000","last_peered":"2024-04-23T10:12:40.736824+0000","last_clean":"2024-04-23T10:12:40.736824+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:12:40.736824+0000","last_undegraded":"2024-04-23T10:12:40.736824+0000","last_fullsized":"2024-04-23T10:12:40.736824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081276+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:12:40.081276+0000","last_peered":"2024-04-23T10:12:40.081276+0000","last_clean":"2024-04-23T10:12:40.081276+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:12:40.081276+0000","last_undegraded":"2024-04-23T10:12:40.081276+0000","last_fullsized":"2024-04-23T10:12:40.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.086183+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:12:40.086183+0000","last_peered":"2024-04-23T10:12:40.086183+0000","last_clean":"2024-04-23T10:12:40.086183+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:12:40.086183+0000","last_undegraded":"2024-04-23T10:12:40.086183+0000","last_fullsized":"2024-04-23T10:12:40.086183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080933+0000","last_change":"2024-04-23T10:12:35.032838+0000","last_active":"2024-04-23T10:12:40.080933+0000","last_peered":"2024-04-23T10:12:40.080933+0000","last_clean":"2024-04-23T10:12:40.080933+0000","last_became_active":"2024-04-23T10:12:35.032273+0000","last_became_peered":"2024-04-23T10:12:35.032273+0000","last_unstale":"2024-04-23T10:12:40.080933+0000","last_undegraded":"2024-04-23T10:12:40.080933+0000","last_fullsized":"2024-04-23T10:12:40.080933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:24:44.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423818+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:12:40.423818+0000","last_peered":"2024-04-23T10:12:40.423818+0000","last_clean":"2024-04-23T10:12:40.423818+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:12:40.423818+0000","last_undegraded":"2024-04-23T10:12:40.423818+0000","last_fullsized":"2024-04-23T10:12:40.423818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694211+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:12:40.694211+0000","last_peered":"2024-04-23T10:12:40.694211+0000","last_clean":"2024-04-23T10:12:40.694211+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:12:40.694211+0000","last_undegraded":"2024-04-23T10:12:40.694211+0000","last_fullsized":"2024-04-23T10:12:40.694211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227425+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:12:40.227425+0000","last_peered":"2024-04-23T10:12:40.227425+0000","last_clean":"2024-04-23T10:12:40.227425+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:12:40.227425+0000","last_undegraded":"2024-04-23T10:12:40.227425+0000","last_fullsized":"2024-04-23T10:12:40.227425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082582+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:12:40.082582+0000","last_peered":"2024-04-23T10:12:40.082582+0000","last_clean":"2024-04-23T10:12:40.082582+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:12:40.082582+0000","last_undegraded":"2024-04-23T10:12:40.082582+0000","last_fullsized":"2024-04-23T10:12:40.082582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223336+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:12:40.223336+0000","last_peered":"2024-04-23T10:12:40.223336+0000","last_clean":"2024-04-23T10:12:40.223336+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:12:40.223336+0000","last_undegraded":"2024-04-23T10:12:40.223336+0000","last_fullsized":"2024-04-23T10:12:40.223336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223648+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:12:40.223648+0000","last_peered":"2024-04-23T10:12:40.223648+0000","last_clean":"2024-04-23T10:12:40.223648+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:12:40.223648+0000","last_undegraded":"2024-04-23T10:12:40.223648+0000","last_fullsized":"2024-04-23T10:12:40.223648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737307+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:12:40.737307+0000","last_peered":"2024-04-23T10:12:40.737307+0000","last_clean":"2024-04-23T10:12:40.737307+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:12:40.737307+0000","last_undegraded":"2024-04-23T10:12:40.737307+0000","last_fullsized":"2024-04-23T10:12:40.737307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227175+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:12:40.227175+0000","last_peered":"2024-04-23T10:12:40.227175+0000","last_clean":"2024-04-23T10:12:40.227175+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:12:40.227175+0000","last_undegraded":"2024-04-23T10:12:40.227175+0000","last_fullsized":"2024-04-23T10:12:40.227175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735764+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:12:40.735764+0000","last_peered":"2024-04-23T10:12:40.735764+0000","last_clean":"2024-04-23T10:12:40.735764+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:12:40.735764+0000","last_undegraded":"2024-04-23T10:12:40.735764+0000","last_fullsized":"2024-04-23T10:12:40.735764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082310+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:12:40.082310+0000","last_peered":"2024-04-23T10:12:40.082310+0000","last_clean":"2024-04-23T10:12:40.082310+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:12:40.082310+0000","last_undegraded":"2024-04-23T10:12:40.082310+0000","last_fullsized":"2024-04-23T10:12:40.082310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735994+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:12:40.735994+0000","last_peered":"2024-04-23T10:12:40.735994+0000","last_clean":"2024-04-23T10:12:40.735994+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:12:40.735994+0000","last_undegraded":"2024-04-23T10:12:40.735994+0000","last_fullsized":"2024-04-23T10:12:40.735994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083953+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:12:40.083953+0000","last_peered":"2024-04-23T10:12:40.083953+0000","last_clean":"2024-04-23T10:12:40.083953+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:12:40.083953+0000","last_undegraded":"2024-04-23T10:12:40.083953+0000","last_fullsized":"2024-04-23T10:12:40.083953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425202+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:12:40.425202+0000","last_peered":"2024-04-23T10:12:40.425202+0000","last_clean":"2024-04-23T10:12:40.425202+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:12:40.425202+0000","last_undegraded":"2024-04-23T10:12:40.425202+0000","last_fullsized":"2024-04-23T10:12:40.425202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737045+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:12:40.737045+0000","last_peered":"2024-04-23T10:12:40.737045+0000","last_clean":"2024-04-23T10:12:40.737045+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:12:40.737045+0000","last_undegraded":"2024-04-23T10:12:40.737045+0000","last_fullsized":"2024-04-23T10:12:40.737045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:00.226 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 Processor -- start 2024-04-23T10:13:00.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 -- start start 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b00c8250 0x7f98b00c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8630 0x7f98b0151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f98b00c8a70 0x7f98b0152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f98b00c6490 con 0x7f98b00c8250 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f98b015b740 con 0x7f98b00c8a70 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98b55ab640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f98b01525c0 con 0x7f98b00c8630 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b00c8250 0x7f98b00c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f98b00c8250 0x7f98b00c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37900/0 (socket says 172.21.15.26:37900) 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 -- 172.21.15.26:0/385567568 learned_addr learned my addr 172.21.15.26:0/385567568 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:00.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98ae7fc640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8630 0x7f98b0151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98af7fe640 1 --2- 172.21.15.26:0/385567568 >> v2:172.21.15.190:3300/0 conn(0x7f98b00c8a70 0x7f98b0152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 -- 172.21.15.26:0/385567568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8630 msgr2=0x7f98b0151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8630 0x7f98b0151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 -- 172.21.15.26:0/385567568 >> v2:172.21.15.190:3300/0 conn(0x7f98b00c8a70 msgr2=0x7f98b0152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 --2- 172.21.15.26:0/385567568 >> v2:172.21.15.190:3300/0 conn(0x7f98b00c8a70 0x7f98b0152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 -- 172.21.15.26:0/385567568 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b00c58c0 con 0x7f98b00c8250 2024-04-23T10:13:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.390+0000 7f98aeffd640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b00c39e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98a000bb10 tx=0x7f98a001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3e1a76137e4b083 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98adffb640 1 -- 172.21.15.26:0/385567568 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00b4070 con 0x7f98b00c8250 2024-04-23T10:13:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98adffb640 1 -- 172.21.15.26:0/385567568 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a00a7ae0 con 0x7f98b00c8250 2024-04-23T10:13:00.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98adffb640 1 -- 172.21.15.26:0/385567568 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00af440 con 0x7f98b00c8250 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- 172.21.15.26:0/385567568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 msgr2=0x7f98b00c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b00c39e0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f98a000bb10 tx=0x7f98a001eb60 comp rx=0 tx=0).stop 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- 172.21.15.26:0/385567568 shutdown_connections 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- 172.21.15.26:0/385567568 >> v2:172.21.15.190:3300/0 conn(0x7f98b00c8a70 0x7f98b0152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8630 0x7f98b0151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- 172.21.15.26:0/385567568 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b00c39e0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- 172.21.15.26:0/385567568 >> 172.21.15.26:0/385567568 conn(0x7f98b006b9d0 msgr2=0x7f98b006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- 172.21.15.26:0/385567568 shutdown_connections 2024-04-23T10:13:00.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- 172.21.15.26:0/385567568 wait complete. 2024-04-23T10:13:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 Processor -- start 2024-04-23T10:13:00.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- start start 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b00c8630 0x7f98b01414a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 0x7f98b0159950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f98b015b400 con 0x7f98b00c8250 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f98b00721a0 con 0x7f98b00c8630 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98b55ab640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f98b00c6920 con 0x7f98b00c8a70 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37906/0 (socket says 172.21.15.26:37906) 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 -- 172.21.15.26:0/1864275387 learned_addr learned my addr 172.21.15.26:0/1864275387 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98af7fe640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 0x7f98b0159950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98ae7fc640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b00c8630 0x7f98b01414a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 -- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 msgr2=0x7f98b0159950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 0x7f98b0159950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 -- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b00c8630 msgr2=0x7f98b01414a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b00c8630 0x7f98b01414a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 -- 172.21.15.26:0/1864275387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f98b01419e0 con 0x7f98b00c8250 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98af7fe640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 0x7f98b0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98aeffd640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98a001d210 tx=0x7f98b0158e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00b4030 con 0x7f98b00c8250 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98a00b6070 con 0x7f98b00c8250 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.394+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f98a00ad550 con 0x7f98b00c8250 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f98b00c5490 con 0x7f98b00c8250 2024-04-23T10:13:00.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f98b0140780 con 0x7f98b00c8250 2024-04-23T10:13:00.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f98b0075df0 con 0x7f98b00c8250 2024-04-23T10:13:00.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f98a00c1060 con 0x7f98b00c8250 2024-04-23T10:13:00.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98977fe640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 0x7f989c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f98a0121140 con 0x7f98b00c8250 2024-04-23T10:13:00.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98ae7fc640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 0x7f989c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.398+0000 7f98ae7fc640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 0x7f989c06a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f98b015a370 tx=0x7f98a4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.402+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f98a00187e0 con 0x7f98b00c8250 2024-04-23T10:13:00.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.554+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f98b0071e50 con 0x7f989c068380 2024-04-23T10:13:00.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.570+0000 7f98977fe640 1 -- 172.21.15.26:0/1864275387 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332558 (secure 0 0 0) 0x7f98b0071e50 con 0x7f989c068380 2024-04-23T10:13:00.575 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:00.576 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 msgr2=0x7f989c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.577 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 0x7f989c06a840 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f98b015a370 tx=0x7f98a4008040 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 msgr2=0x7f98b014b850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f98a001d210 tx=0x7f98b0158e40 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 shutdown_connections 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f989c068380 0x7f989c06a840 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f98b00c8a70 0x7f98b0159950 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f98b00c8630 0x7f98b01414a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 --2- 172.21.15.26:0/1864275387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f98b00c8250 0x7f98b014b850 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 >> 172.21.15.26:0/1864275387 conn(0x7f98b006b9d0 msgr2=0x7f98b006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 shutdown_connections 2024-04-23T10:13:00.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.574+0000 7f98b55ab640 1 -- 172.21.15.26:0/1864275387 wait complete. 2024-04-23T10:13:00.591 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":36,"stamp":"2024-04-23T10:12:58.922947+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005389"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694720+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:12:40.694720+0000","last_peered":"2024-04-23T10:12:40.694720+0000","last_clean":"2024-04-23T10:12:40.694720+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:12:40.694720+0000","last_undegraded":"2024-04-23T10:12:40.694720+0000","last_fullsized":"2024-04-23T10:12:40.694720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227927+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:12:40.227927+0000","last_peered":"2024-04-23T10:12:40.227927+0000","last_clean":"2024-04-23T10:12:40.227927+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:12:40.227927+0000","last_undegraded":"2024-04-23T10:12:40.227927+0000","last_fullsized":"2024-04-23T10:12:40.227927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227263+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:12:40.227263+0000","last_peered":"2024-04-23T10:12:40.227263+0000","last_clean":"2024-04-23T10:12:40.227263+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:12:40.227263+0000","last_undegraded":"2024-04-23T10:12:40.227263+0000","last_fullsized":"2024-04-23T10:12:40.227263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228161+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:12:40.228161+0000","last_peered":"2024-04-23T10:12:40.228161+0000","last_clean":"2024-04-23T10:12:40.228161+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:12:40.228161+0000","last_undegraded":"2024-04-23T10:12:40.228161+0000","last_fullsized":"2024-04-23T10:12:40.228161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694410+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:12:40.694410+0000","last_peered":"2024-04-23T10:12:40.694410+0000","last_clean":"2024-04-23T10:12:40.694410+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:12:40.694410+0000","last_undegraded":"2024-04-23T10:12:40.694410+0000","last_fullsized":"2024-04-23T10:12:40.694410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081420+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:12:40.081420+0000","last_peered":"2024-04-23T10:12:40.081420+0000","last_clean":"2024-04-23T10:12:40.081420+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:12:40.081420+0000","last_undegraded":"2024-04-23T10:12:40.081420+0000","last_fullsized":"2024-04-23T10:12:40.081420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736750+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:12:40.736750+0000","last_peered":"2024-04-23T10:12:40.736750+0000","last_clean":"2024-04-23T10:12:40.736750+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:12:40.736750+0000","last_undegraded":"2024-04-23T10:12:40.736750+0000","last_fullsized":"2024-04-23T10:12:40.736750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084060+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:12:40.084060+0000","last_peered":"2024-04-23T10:12:40.084060+0000","last_clean":"2024-04-23T10:12:40.084060+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:12:40.084060+0000","last_undegraded":"2024-04-23T10:12:40.084060+0000","last_fullsized":"2024-04-23T10:12:40.084060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084168+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:12:40.084168+0000","last_peered":"2024-04-23T10:12:40.084168+0000","last_clean":"2024-04-23T10:12:40.084168+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:12:40.084168+0000","last_undegraded":"2024-04-23T10:12:40.084168+0000","last_fullsized":"2024-04-23T10:12:40.084168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736000+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:12:40.736000+0000","last_peered":"2024-04-23T10:12:40.736000+0000","last_clean":"2024-04-23T10:12:40.736000+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:12:40.736000+0000","last_undegraded":"2024-04-23T10:12:40.736000+0000","last_fullsized":"2024-04-23T10:12:40.736000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085309+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:12:40.085309+0000","last_peered":"2024-04-23T10:12:40.085309+0000","last_clean":"2024-04-23T10:12:40.085309+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:12:40.085309+0000","last_undegraded":"2024-04-23T10:12:40.085309+0000","last_fullsized":"2024-04-23T10:12:40.085309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083415+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:12:40.083415+0000","last_peered":"2024-04-23T10:12:40.083415+0000","last_clean":"2024-04-23T10:12:40.083415+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:12:40.083415+0000","last_undegraded":"2024-04-23T10:12:40.083415+0000","last_fullsized":"2024-04-23T10:12:40.083415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222560+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:12:40.222560+0000","last_peered":"2024-04-23T10:12:40.222560+0000","last_clean":"2024-04-23T10:12:40.222560+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:12:40.222560+0000","last_undegraded":"2024-04-23T10:12:40.222560+0000","last_fullsized":"2024-04-23T10:12:40.222560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736705+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:12:40.736705+0000","last_peered":"2024-04-23T10:12:40.736705+0000","last_clean":"2024-04-23T10:12:40.736705+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:12:40.736705+0000","last_undegraded":"2024-04-23T10:12:40.736705+0000","last_fullsized":"2024-04-23T10:12:40.736705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082157+0000","last_change":"2024-04-23T10:12:39.086678+0000","last_active":"2024-04-23T10:12:40.082157+0000","last_peered":"2024-04-23T10:12:40.082157+0000","last_clean":"2024-04-23T10:12:40.082157+0000","last_became_active":"2024-04-23T10:12:39.085373+0000","last_became_peered":"2024-04-23T10:12:39.085373+0000","last_unstale":"2024-04-23T10:12:40.082157+0000","last_undegraded":"2024-04-23T10:12:40.082157+0000","last_fullsized":"2024-04-23T10:12:40.082157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:40.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227424+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:12:40.227424+0000","last_peered":"2024-04-23T10:12:40.227424+0000","last_clean":"2024-04-23T10:12:40.227424+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:12:40.227424+0000","last_undegraded":"2024-04-23T10:12:40.227424+0000","last_fullsized":"2024-04-23T10:12:40.227424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424566+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:12:40.424566+0000","last_peered":"2024-04-23T10:12:40.424566+0000","last_clean":"2024-04-23T10:12:40.424566+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:12:40.424566+0000","last_undegraded":"2024-04-23T10:12:40.424566+0000","last_fullsized":"2024-04-23T10:12:40.424566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082075+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:12:40.082075+0000","last_peered":"2024-04-23T10:12:40.082075+0000","last_clean":"2024-04-23T10:12:40.082075+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:12:40.082075+0000","last_undegraded":"2024-04-23T10:12:40.082075+0000","last_fullsized":"2024-04-23T10:12:40.082075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227769+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:12:40.227769+0000","last_peered":"2024-04-23T10:12:40.227769+0000","last_clean":"2024-04-23T10:12:40.227769+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:12:40.227769+0000","last_undegraded":"2024-04-23T10:12:40.227769+0000","last_fullsized":"2024-04-23T10:12:40.227769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423933+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:12:40.423933+0000","last_peered":"2024-04-23T10:12:40.423933+0000","last_clean":"2024-04-23T10:12:40.423933+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:12:40.423933+0000","last_undegraded":"2024-04-23T10:12:40.423933+0000","last_fullsized":"2024-04-23T10:12:40.423933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425198+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:12:40.425198+0000","last_peered":"2024-04-23T10:12:40.425198+0000","last_clean":"2024-04-23T10:12:40.425198+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:12:40.425198+0000","last_undegraded":"2024-04-23T10:12:40.425198+0000","last_fullsized":"2024-04-23T10:12:40.425198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082399+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:12:40.082399+0000","last_peered":"2024-04-23T10:12:40.082399+0000","last_clean":"2024-04-23T10:12:40.082399+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:12:40.082399+0000","last_undegraded":"2024-04-23T10:12:40.082399+0000","last_fullsized":"2024-04-23T10:12:40.082399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735517+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:12:40.735517+0000","last_peered":"2024-04-23T10:12:40.735517+0000","last_clean":"2024-04-23T10:12:40.735517+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:12:40.735517+0000","last_undegraded":"2024-04-23T10:12:40.735517+0000","last_fullsized":"2024-04-23T10:12:40.735517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081599+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:12:40.081599+0000","last_peered":"2024-04-23T10:12:40.081599+0000","last_clean":"2024-04-23T10:12:40.081599+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:12:40.081599+0000","last_undegraded":"2024-04-23T10:12:40.081599+0000","last_fullsized":"2024-04-23T10:12:40.081599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695149+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:12:40.695149+0000","last_peered":"2024-04-23T10:12:40.695149+0000","last_clean":"2024-04-23T10:12:40.695149+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:12:40.695149+0000","last_undegraded":"2024-04-23T10:12:40.695149+0000","last_fullsized":"2024-04-23T10:12:40.695149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224406+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:12:40.224406+0000","last_peered":"2024-04-23T10:12:40.224406+0000","last_clean":"2024-04-23T10:12:40.224406+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:12:40.224406+0000","last_undegraded":"2024-04-23T10:12:40.224406+0000","last_fullsized":"2024-04-23T10:12:40.224406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081842+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:12:40.081842+0000","last_peered":"2024-04-23T10:12:40.081842+0000","last_clean":"2024-04-23T10:12:40.081842+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:12:40.081842+0000","last_undegraded":"2024-04-23T10:12:40.081842+0000","last_fullsized":"2024-04-23T10:12:40.081842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228252+0000","last_change":"2024-04-23T10:12:35.046012+0000","last_active":"2024-04-23T10:12:40.228252+0000","last_peered":"2024-04-23T10:12:40.228252+0000","last_clean":"2024-04-23T10:12:40.228252+0000","last_became_active":"2024-04-23T10:12:35.045699+0000","last_became_peered":"2024-04-23T10:12:35.045699+0000","last_unstale":"2024-04-23T10:12:40.228252+0000","last_undegraded":"2024-04-23T10:12:40.228252+0000","last_fullsized":"2024-04-23T10:12:40.228252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:23.156695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425569+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:12:40.425569+0000","last_peered":"2024-04-23T10:12:40.425569+0000","last_clean":"2024-04-23T10:12:40.425569+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:12:40.425569+0000","last_undegraded":"2024-04-23T10:12:40.425569+0000","last_fullsized":"2024-04-23T10:12:40.425569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227374+0000","last_change":"2024-04-23T10:12:39.140751+0000","last_active":"2024-04-23T10:12:40.227374+0000","last_peered":"2024-04-23T10:12:40.227374+0000","last_clean":"2024-04-23T10:12:40.227374+0000","last_became_active":"2024-04-23T10:12:39.140324+0000","last_became_peered":"2024-04-23T10:12:39.140324+0000","last_unstale":"2024-04-23T10:12:40.227374+0000","last_undegraded":"2024-04-23T10:12:40.227374+0000","last_fullsized":"2024-04-23T10:12:40.227374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:14:47.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425248+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:12:40.425248+0000","last_peered":"2024-04-23T10:12:40.425248+0000","last_clean":"2024-04-23T10:12:40.425248+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:12:40.425248+0000","last_undegraded":"2024-04-23T10:12:40.425248+0000","last_fullsized":"2024-04-23T10:12:40.425248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736899+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:12:40.736899+0000","last_peered":"2024-04-23T10:12:40.736899+0000","last_clean":"2024-04-23T10:12:40.736899+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:12:40.736899+0000","last_undegraded":"2024-04-23T10:12:40.736899+0000","last_fullsized":"2024-04-23T10:12:40.736899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694067+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:12:40.694067+0000","last_peered":"2024-04-23T10:12:40.694067+0000","last_clean":"2024-04-23T10:12:40.694067+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:12:40.694067+0000","last_undegraded":"2024-04-23T10:12:40.694067+0000","last_fullsized":"2024-04-23T10:12:40.694067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085565+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:12:40.085565+0000","last_peered":"2024-04-23T10:12:40.085565+0000","last_clean":"2024-04-23T10:12:40.085565+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:12:40.085565+0000","last_undegraded":"2024-04-23T10:12:40.085565+0000","last_fullsized":"2024-04-23T10:12:40.085565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425505+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:12:40.425505+0000","last_peered":"2024-04-23T10:12:40.425505+0000","last_clean":"2024-04-23T10:12:40.425505+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:12:40.425505+0000","last_undegraded":"2024-04-23T10:12:40.425505+0000","last_fullsized":"2024-04-23T10:12:40.425505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424225+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:12:40.424225+0000","last_peered":"2024-04-23T10:12:40.424225+0000","last_clean":"2024-04-23T10:12:40.424225+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:12:40.424225+0000","last_undegraded":"2024-04-23T10:12:40.424225+0000","last_fullsized":"2024-04-23T10:12:40.424225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084798+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:12:40.084798+0000","last_peered":"2024-04-23T10:12:40.084798+0000","last_clean":"2024-04-23T10:12:40.084798+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:12:40.084798+0000","last_undegraded":"2024-04-23T10:12:40.084798+0000","last_fullsized":"2024-04-23T10:12:40.084798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082819+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:12:40.082819+0000","last_peered":"2024-04-23T10:12:40.082819+0000","last_clean":"2024-04-23T10:12:40.082819+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:12:40.082819+0000","last_undegraded":"2024-04-23T10:12:40.082819+0000","last_fullsized":"2024-04-23T10:12:40.082819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425110+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:12:40.425110+0000","last_peered":"2024-04-23T10:12:40.425110+0000","last_clean":"2024-04-23T10:12:40.425110+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:12:40.425110+0000","last_undegraded":"2024-04-23T10:12:40.425110+0000","last_fullsized":"2024-04-23T10:12:40.425110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424421+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:12:40.424421+0000","last_peered":"2024-04-23T10:12:40.424421+0000","last_clean":"2024-04-23T10:12:40.424421+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:12:40.424421+0000","last_undegraded":"2024-04-23T10:12:40.424421+0000","last_fullsized":"2024-04-23T10:12:40.424421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080451+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:12:40.080451+0000","last_peered":"2024-04-23T10:12:40.080451+0000","last_clean":"2024-04-23T10:12:40.080451+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:12:40.080451+0000","last_undegraded":"2024-04-23T10:12:40.080451+0000","last_fullsized":"2024-04-23T10:12:40.080451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425432+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:12:40.425432+0000","last_peered":"2024-04-23T10:12:40.425432+0000","last_clean":"2024-04-23T10:12:40.425432+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:12:40.425432+0000","last_undegraded":"2024-04-23T10:12:40.425432+0000","last_fullsized":"2024-04-23T10:12:40.425432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.693709+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:12:40.693709+0000","last_peered":"2024-04-23T10:12:40.693709+0000","last_clean":"2024-04-23T10:12:40.693709+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:12:40.693709+0000","last_undegraded":"2024-04-23T10:12:40.693709+0000","last_fullsized":"2024-04-23T10:12:40.693709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735754+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:12:40.735754+0000","last_peered":"2024-04-23T10:12:40.735754+0000","last_clean":"2024-04-23T10:12:40.735754+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:12:40.735754+0000","last_undegraded":"2024-04-23T10:12:40.735754+0000","last_fullsized":"2024-04-23T10:12:40.735754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695103+0000","last_change":"2024-04-23T10:12:39.144005+0000","last_active":"2024-04-23T10:12:40.695103+0000","last_peered":"2024-04-23T10:12:40.695103+0000","last_clean":"2024-04-23T10:12:40.695103+0000","last_became_active":"2024-04-23T10:12:39.143429+0000","last_became_peered":"2024-04-23T10:12:39.143429+0000","last_unstale":"2024-04-23T10:12:40.695103+0000","last_undegraded":"2024-04-23T10:12:40.695103+0000","last_fullsized":"2024-04-23T10:12:40.695103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:28:05.706347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227291+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:12:40.227291+0000","last_peered":"2024-04-23T10:12:40.227291+0000","last_clean":"2024-04-23T10:12:40.227291+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:12:40.227291+0000","last_undegraded":"2024-04-23T10:12:40.227291+0000","last_fullsized":"2024-04-23T10:12:40.227291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083722+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:12:40.083722+0000","last_peered":"2024-04-23T10:12:40.083722+0000","last_clean":"2024-04-23T10:12:40.083722+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:12:40.083722+0000","last_undegraded":"2024-04-23T10:12:40.083722+0000","last_fullsized":"2024-04-23T10:12:40.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736031+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:12:40.736031+0000","last_peered":"2024-04-23T10:12:40.736031+0000","last_clean":"2024-04-23T10:12:40.736031+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:12:40.736031+0000","last_undegraded":"2024-04-23T10:12:40.736031+0000","last_fullsized":"2024-04-23T10:12:40.736031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222912+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:12:40.222912+0000","last_peered":"2024-04-23T10:12:40.222912+0000","last_clean":"2024-04-23T10:12:40.222912+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:12:40.222912+0000","last_undegraded":"2024-04-23T10:12:40.222912+0000","last_fullsized":"2024-04-23T10:12:40.222912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736371+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:12:40.736371+0000","last_peered":"2024-04-23T10:12:40.736371+0000","last_clean":"2024-04-23T10:12:40.736371+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:12:40.736371+0000","last_undegraded":"2024-04-23T10:12:40.736371+0000","last_fullsized":"2024-04-23T10:12:40.736371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080981+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:12:40.080981+0000","last_peered":"2024-04-23T10:12:40.080981+0000","last_clean":"2024-04-23T10:12:40.080981+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:12:40.080981+0000","last_undegraded":"2024-04-23T10:12:40.080981+0000","last_fullsized":"2024-04-23T10:12:40.080981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224993+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:12:40.224993+0000","last_peered":"2024-04-23T10:12:40.224993+0000","last_clean":"2024-04-23T10:12:40.224993+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:12:40.224993+0000","last_undegraded":"2024-04-23T10:12:40.224993+0000","last_fullsized":"2024-04-23T10:12:40.224993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084202+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:12:40.084202+0000","last_peered":"2024-04-23T10:12:40.084202+0000","last_clean":"2024-04-23T10:12:40.084202+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:12:40.084202+0000","last_undegraded":"2024-04-23T10:12:40.084202+0000","last_fullsized":"2024-04-23T10:12:40.084202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425618+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:12:40.425618+0000","last_peered":"2024-04-23T10:12:40.425618+0000","last_clean":"2024-04-23T10:12:40.425618+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:12:40.425618+0000","last_undegraded":"2024-04-23T10:12:40.425618+0000","last_fullsized":"2024-04-23T10:12:40.425618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694791+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:12:40.694791+0000","last_peered":"2024-04-23T10:12:40.694791+0000","last_clean":"2024-04-23T10:12:40.694791+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:12:40.694791+0000","last_undegraded":"2024-04-23T10:12:40.694791+0000","last_fullsized":"2024-04-23T10:12:40.694791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737351+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:12:40.737351+0000","last_peered":"2024-04-23T10:12:40.737351+0000","last_clean":"2024-04-23T10:12:40.737351+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:12:40.737351+0000","last_undegraded":"2024-04-23T10:12:40.737351+0000","last_fullsized":"2024-04-23T10:12:40.737351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081400+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:12:40.081400+0000","last_peered":"2024-04-23T10:12:40.081400+0000","last_clean":"2024-04-23T10:12:40.081400+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:12:40.081400+0000","last_undegraded":"2024-04-23T10:12:40.081400+0000","last_fullsized":"2024-04-23T10:12:40.081400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080961+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:12:40.080961+0000","last_peered":"2024-04-23T10:12:40.080961+0000","last_clean":"2024-04-23T10:12:40.080961+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:12:40.080961+0000","last_undegraded":"2024-04-23T10:12:40.080961+0000","last_fullsized":"2024-04-23T10:12:40.080961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736518+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:12:40.736518+0000","last_peered":"2024-04-23T10:12:40.736518+0000","last_clean":"2024-04-23T10:12:40.736518+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:12:40.736518+0000","last_undegraded":"2024-04-23T10:12:40.736518+0000","last_fullsized":"2024-04-23T10:12:40.736518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085364+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:12:40.085364+0000","last_peered":"2024-04-23T10:12:40.085364+0000","last_clean":"2024-04-23T10:12:40.085364+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:12:40.085364+0000","last_undegraded":"2024-04-23T10:12:40.085364+0000","last_fullsized":"2024-04-23T10:12:40.085364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081041+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:12:40.081041+0000","last_peered":"2024-04-23T10:12:40.081041+0000","last_clean":"2024-04-23T10:12:40.081041+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:12:40.081041+0000","last_undegraded":"2024-04-23T10:12:40.081041+0000","last_fullsized":"2024-04-23T10:12:40.081041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736041+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:12:40.736041+0000","last_peered":"2024-04-23T10:12:40.736041+0000","last_clean":"2024-04-23T10:12:40.736041+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:12:40.736041+0000","last_undegraded":"2024-04-23T10:12:40.736041+0000","last_fullsized":"2024-04-23T10:12:40.736041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080265+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:12:40.080265+0000","last_peered":"2024-04-23T10:12:40.080265+0000","last_clean":"2024-04-23T10:12:40.080265+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:12:40.080265+0000","last_undegraded":"2024-04-23T10:12:40.080265+0000","last_fullsized":"2024-04-23T10:12:40.080265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694649+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:12:40.694649+0000","last_peered":"2024-04-23T10:12:40.694649+0000","last_clean":"2024-04-23T10:12:40.694649+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:12:40.694649+0000","last_undegraded":"2024-04-23T10:12:40.694649+0000","last_fullsized":"2024-04-23T10:12:40.694649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222505+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:12:40.222505+0000","last_peered":"2024-04-23T10:12:40.222505+0000","last_clean":"2024-04-23T10:12:40.222505+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:12:40.222505+0000","last_undegraded":"2024-04-23T10:12:40.222505+0000","last_fullsized":"2024-04-23T10:12:40.222505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223019+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:12:40.223019+0000","last_peered":"2024-04-23T10:12:40.223019+0000","last_clean":"2024-04-23T10:12:40.223019+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:12:40.223019+0000","last_undegraded":"2024-04-23T10:12:40.223019+0000","last_fullsized":"2024-04-23T10:12:40.223019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228197+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:12:40.228197+0000","last_peered":"2024-04-23T10:12:40.228197+0000","last_clean":"2024-04-23T10:12:40.228197+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:12:40.228197+0000","last_undegraded":"2024-04-23T10:12:40.228197+0000","last_fullsized":"2024-04-23T10:12:40.228197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736505+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:12:40.736505+0000","last_peered":"2024-04-23T10:12:40.736505+0000","last_clean":"2024-04-23T10:12:40.736505+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:12:40.736505+0000","last_undegraded":"2024-04-23T10:12:40.736505+0000","last_fullsized":"2024-04-23T10:12:40.736505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083055+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:12:40.083055+0000","last_peered":"2024-04-23T10:12:40.083055+0000","last_clean":"2024-04-23T10:12:40.083055+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:12:40.083055+0000","last_undegraded":"2024-04-23T10:12:40.083055+0000","last_fullsized":"2024-04-23T10:12:40.083055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228406+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:12:40.228406+0000","last_peered":"2024-04-23T10:12:40.228406+0000","last_clean":"2024-04-23T10:12:40.228406+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:12:40.228406+0000","last_undegraded":"2024-04-23T10:12:40.228406+0000","last_fullsized":"2024-04-23T10:12:40.228406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694309+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:12:40.694309+0000","last_peered":"2024-04-23T10:12:40.694309+0000","last_clean":"2024-04-23T10:12:40.694309+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:12:40.694309+0000","last_undegraded":"2024-04-23T10:12:40.694309+0000","last_fullsized":"2024-04-23T10:12:40.694309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694950+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:12:40.694950+0000","last_peered":"2024-04-23T10:12:40.694950+0000","last_clean":"2024-04-23T10:12:40.694950+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:12:40.694950+0000","last_undegraded":"2024-04-23T10:12:40.694950+0000","last_fullsized":"2024-04-23T10:12:40.694950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085118+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:12:40.085118+0000","last_peered":"2024-04-23T10:12:40.085118+0000","last_clean":"2024-04-23T10:12:40.085118+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:12:40.085118+0000","last_undegraded":"2024-04-23T10:12:40.085118+0000","last_fullsized":"2024-04-23T10:12:40.085118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736101+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:12:40.736101+0000","last_peered":"2024-04-23T10:12:40.736101+0000","last_clean":"2024-04-23T10:12:40.736101+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:12:40.736101+0000","last_undegraded":"2024-04-23T10:12:40.736101+0000","last_fullsized":"2024-04-23T10:12:40.736101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:50.524048+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:12:50.524048+0000","last_peered":"2024-04-23T10:12:50.524048+0000","last_clean":"2024-04-23T10:12:50.524048+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:12:50.524048+0000","last_undegraded":"2024-04-23T10:12:50.524048+0000","last_fullsized":"2024-04-23T10:12:50.524048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424501+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:12:40.424501+0000","last_peered":"2024-04-23T10:12:40.424501+0000","last_clean":"2024-04-23T10:12:40.424501+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:12:40.424501+0000","last_undegraded":"2024-04-23T10:12:40.424501+0000","last_fullsized":"2024-04-23T10:12:40.424501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083129+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:12:40.083129+0000","last_peered":"2024-04-23T10:12:40.083129+0000","last_clean":"2024-04-23T10:12:40.083129+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:12:40.083129+0000","last_undegraded":"2024-04-23T10:12:40.083129+0000","last_fullsized":"2024-04-23T10:12:40.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425386+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:12:40.425386+0000","last_peered":"2024-04-23T10:12:40.425386+0000","last_clean":"2024-04-23T10:12:40.425386+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:12:40.425386+0000","last_undegraded":"2024-04-23T10:12:40.425386+0000","last_fullsized":"2024-04-23T10:12:40.425386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083595+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:12:40.083595+0000","last_peered":"2024-04-23T10:12:40.083595+0000","last_clean":"2024-04-23T10:12:40.083595+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:12:40.083595+0000","last_undegraded":"2024-04-23T10:12:40.083595+0000","last_fullsized":"2024-04-23T10:12:40.083595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694569+0000","last_change":"2024-04-23T10:12:35.029157+0000","last_active":"2024-04-23T10:12:40.694569+0000","last_peered":"2024-04-23T10:12:40.694569+0000","last_clean":"2024-04-23T10:12:40.694569+0000","last_became_active":"2024-04-23T10:12:35.028122+0000","last_became_peered":"2024-04-23T10:12:35.028122+0000","last_unstale":"2024-04-23T10:12:40.694569+0000","last_undegraded":"2024-04-23T10:12:40.694569+0000","last_fullsized":"2024-04-23T10:12:40.694569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:58:30.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085259+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:12:40.085259+0000","last_peered":"2024-04-23T10:12:40.085259+0000","last_clean":"2024-04-23T10:12:40.085259+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:12:40.085259+0000","last_undegraded":"2024-04-23T10:12:40.085259+0000","last_fullsized":"2024-04-23T10:12:40.085259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227674+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:12:40.227674+0000","last_peered":"2024-04-23T10:12:40.227674+0000","last_clean":"2024-04-23T10:12:40.227674+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:12:40.227674+0000","last_undegraded":"2024-04-23T10:12:40.227674+0000","last_fullsized":"2024-04-23T10:12:40.227674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085010+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:12:40.085010+0000","last_peered":"2024-04-23T10:12:40.085010+0000","last_clean":"2024-04-23T10:12:40.085010+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:12:40.085010+0000","last_undegraded":"2024-04-23T10:12:40.085010+0000","last_fullsized":"2024-04-23T10:12:40.085010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224170+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:12:40.224170+0000","last_peered":"2024-04-23T10:12:40.224170+0000","last_clean":"2024-04-23T10:12:40.224170+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:12:40.224170+0000","last_undegraded":"2024-04-23T10:12:40.224170+0000","last_fullsized":"2024-04-23T10:12:40.224170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227262+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:12:40.227262+0000","last_peered":"2024-04-23T10:12:40.227262+0000","last_clean":"2024-04-23T10:12:40.227262+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:12:40.227262+0000","last_undegraded":"2024-04-23T10:12:40.227262+0000","last_fullsized":"2024-04-23T10:12:40.227262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423747+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:12:40.423747+0000","last_peered":"2024-04-23T10:12:40.423747+0000","last_clean":"2024-04-23T10:12:40.423747+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:12:40.423747+0000","last_undegraded":"2024-04-23T10:12:40.423747+0000","last_fullsized":"2024-04-23T10:12:40.423747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081194+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:12:40.081194+0000","last_peered":"2024-04-23T10:12:40.081194+0000","last_clean":"2024-04-23T10:12:40.081194+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:12:40.081194+0000","last_undegraded":"2024-04-23T10:12:40.081194+0000","last_fullsized":"2024-04-23T10:12:40.081194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224019+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:12:40.224019+0000","last_peered":"2024-04-23T10:12:40.224019+0000","last_clean":"2024-04-23T10:12:40.224019+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:12:40.224019+0000","last_undegraded":"2024-04-23T10:12:40.224019+0000","last_fullsized":"2024-04-23T10:12:40.224019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227536+0000","last_change":"2024-04-23T10:12:35.031938+0000","last_active":"2024-04-23T10:12:40.227536+0000","last_peered":"2024-04-23T10:12:40.227536+0000","last_clean":"2024-04-23T10:12:40.227536+0000","last_became_active":"2024-04-23T10:12:35.031645+0000","last_became_peered":"2024-04-23T10:12:35.031645+0000","last_unstale":"2024-04-23T10:12:40.227536+0000","last_undegraded":"2024-04-23T10:12:40.227536+0000","last_fullsized":"2024-04-23T10:12:40.227536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:26.960607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:12:40.227565+0000","last_peered":"2024-04-23T10:12:40.227565+0000","last_clean":"2024-04-23T10:12:40.227565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:12:40.227565+0000","last_undegraded":"2024-04-23T10:12:40.227565+0000","last_fullsized":"2024-04-23T10:12:40.227565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223106+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:12:40.223106+0000","last_peered":"2024-04-23T10:12:40.223106+0000","last_clean":"2024-04-23T10:12:40.223106+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:12:40.223106+0000","last_undegraded":"2024-04-23T10:12:40.223106+0000","last_fullsized":"2024-04-23T10:12:40.223106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081034+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:12:40.081034+0000","last_peered":"2024-04-23T10:12:40.081034+0000","last_clean":"2024-04-23T10:12:40.081034+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:12:40.081034+0000","last_undegraded":"2024-04-23T10:12:40.081034+0000","last_fullsized":"2024-04-23T10:12:40.081034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227530+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:12:40.227530+0000","last_peered":"2024-04-23T10:12:40.227530+0000","last_clean":"2024-04-23T10:12:40.227530+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:12:40.227530+0000","last_undegraded":"2024-04-23T10:12:40.227530+0000","last_fullsized":"2024-04-23T10:12:40.227530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083585+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:12:40.083585+0000","last_peered":"2024-04-23T10:12:40.083585+0000","last_clean":"2024-04-23T10:12:40.083585+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:12:40.083585+0000","last_undegraded":"2024-04-23T10:12:40.083585+0000","last_fullsized":"2024-04-23T10:12:40.083585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227924+0000","last_change":"2024-04-23T10:12:39.089619+0000","last_active":"2024-04-23T10:12:40.227924+0000","last_peered":"2024-04-23T10:12:40.227924+0000","last_clean":"2024-04-23T10:12:40.227924+0000","last_became_active":"2024-04-23T10:12:39.080595+0000","last_became_peered":"2024-04-23T10:12:39.080595+0000","last_unstale":"2024-04-23T10:12:40.227924+0000","last_undegraded":"2024-04-23T10:12:40.227924+0000","last_fullsized":"2024-04-23T10:12:40.227924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:22.568699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222192+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:12:40.222192+0000","last_peered":"2024-04-23T10:12:40.222192+0000","last_clean":"2024-04-23T10:12:40.222192+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:12:40.222192+0000","last_undegraded":"2024-04-23T10:12:40.222192+0000","last_fullsized":"2024-04-23T10:12:40.222192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080449+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:12:40.080449+0000","last_peered":"2024-04-23T10:12:40.080449+0000","last_clean":"2024-04-23T10:12:40.080449+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:12:40.080449+0000","last_undegraded":"2024-04-23T10:12:40.080449+0000","last_fullsized":"2024-04-23T10:12:40.080449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082564+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:12:40.082564+0000","last_peered":"2024-04-23T10:12:40.082564+0000","last_clean":"2024-04-23T10:12:40.082564+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:12:40.082564+0000","last_undegraded":"2024-04-23T10:12:40.082564+0000","last_fullsized":"2024-04-23T10:12:40.082564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694554+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:12:40.694554+0000","last_peered":"2024-04-23T10:12:40.694554+0000","last_clean":"2024-04-23T10:12:40.694554+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:12:40.694554+0000","last_undegraded":"2024-04-23T10:12:40.694554+0000","last_fullsized":"2024-04-23T10:12:40.694554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228250+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:12:40.228250+0000","last_peered":"2024-04-23T10:12:40.228250+0000","last_clean":"2024-04-23T10:12:40.228250+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:12:40.228250+0000","last_undegraded":"2024-04-23T10:12:40.228250+0000","last_fullsized":"2024-04-23T10:12:40.228250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424882+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:12:40.424882+0000","last_peered":"2024-04-23T10:12:40.424882+0000","last_clean":"2024-04-23T10:12:40.424882+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:12:40.424882+0000","last_undegraded":"2024-04-23T10:12:40.424882+0000","last_fullsized":"2024-04-23T10:12:40.424882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223845+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:12:40.223845+0000","last_peered":"2024-04-23T10:12:40.223845+0000","last_clean":"2024-04-23T10:12:40.223845+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:12:40.223845+0000","last_undegraded":"2024-04-23T10:12:40.223845+0000","last_fullsized":"2024-04-23T10:12:40.223845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228257+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:12:40.228257+0000","last_peered":"2024-04-23T10:12:40.228257+0000","last_clean":"2024-04-23T10:12:40.228257+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:12:40.228257+0000","last_undegraded":"2024-04-23T10:12:40.228257+0000","last_fullsized":"2024-04-23T10:12:40.228257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081108+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:12:40.081108+0000","last_peered":"2024-04-23T10:12:40.081108+0000","last_clean":"2024-04-23T10:12:40.081108+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:12:40.081108+0000","last_undegraded":"2024-04-23T10:12:40.081108+0000","last_fullsized":"2024-04-23T10:12:40.081108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227349+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:12:40.227349+0000","last_peered":"2024-04-23T10:12:40.227349+0000","last_clean":"2024-04-23T10:12:40.227349+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:12:40.227349+0000","last_undegraded":"2024-04-23T10:12:40.227349+0000","last_fullsized":"2024-04-23T10:12:40.227349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082447+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:12:40.082447+0000","last_peered":"2024-04-23T10:12:40.082447+0000","last_clean":"2024-04-23T10:12:40.082447+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:12:40.082447+0000","last_undegraded":"2024-04-23T10:12:40.082447+0000","last_fullsized":"2024-04-23T10:12:40.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223339+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:12:40.223339+0000","last_peered":"2024-04-23T10:12:40.223339+0000","last_clean":"2024-04-23T10:12:40.223339+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:12:40.223339+0000","last_undegraded":"2024-04-23T10:12:40.223339+0000","last_fullsized":"2024-04-23T10:12:40.223339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736824+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:12:40.736824+0000","last_peered":"2024-04-23T10:12:40.736824+0000","last_clean":"2024-04-23T10:12:40.736824+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:12:40.736824+0000","last_undegraded":"2024-04-23T10:12:40.736824+0000","last_fullsized":"2024-04-23T10:12:40.736824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081276+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:12:40.081276+0000","last_peered":"2024-04-23T10:12:40.081276+0000","last_clean":"2024-04-23T10:12:40.081276+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:12:40.081276+0000","last_undegraded":"2024-04-23T10:12:40.081276+0000","last_fullsized":"2024-04-23T10:12:40.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.086183+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:12:40.086183+0000","last_peered":"2024-04-23T10:12:40.086183+0000","last_clean":"2024-04-23T10:12:40.086183+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:12:40.086183+0000","last_undegraded":"2024-04-23T10:12:40.086183+0000","last_fullsized":"2024-04-23T10:12:40.086183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080933+0000","last_change":"2024-04-23T10:12:35.032838+0000","last_active":"2024-04-23T10:12:40.080933+0000","last_peered":"2024-04-23T10:12:40.080933+0000","last_clean":"2024-04-23T10:12:40.080933+0000","last_became_active":"2024-04-23T10:12:35.032273+0000","last_became_peered":"2024-04-23T10:12:35.032273+0000","last_unstale":"2024-04-23T10:12:40.080933+0000","last_undegraded":"2024-04-23T10:12:40.080933+0000","last_fullsized":"2024-04-23T10:12:40.080933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:24:44.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423818+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:12:40.423818+0000","last_peered":"2024-04-23T10:12:40.423818+0000","last_clean":"2024-04-23T10:12:40.423818+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:12:40.423818+0000","last_undegraded":"2024-04-23T10:12:40.423818+0000","last_fullsized":"2024-04-23T10:12:40.423818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694211+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:12:40.694211+0000","last_peered":"2024-04-23T10:12:40.694211+0000","last_clean":"2024-04-23T10:12:40.694211+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:12:40.694211+0000","last_undegraded":"2024-04-23T10:12:40.694211+0000","last_fullsized":"2024-04-23T10:12:40.694211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227425+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:12:40.227425+0000","last_peered":"2024-04-23T10:12:40.227425+0000","last_clean":"2024-04-23T10:12:40.227425+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:12:40.227425+0000","last_undegraded":"2024-04-23T10:12:40.227425+0000","last_fullsized":"2024-04-23T10:12:40.227425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082582+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:12:40.082582+0000","last_peered":"2024-04-23T10:12:40.082582+0000","last_clean":"2024-04-23T10:12:40.082582+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:12:40.082582+0000","last_undegraded":"2024-04-23T10:12:40.082582+0000","last_fullsized":"2024-04-23T10:12:40.082582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223336+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:12:40.223336+0000","last_peered":"2024-04-23T10:12:40.223336+0000","last_clean":"2024-04-23T10:12:40.223336+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:12:40.223336+0000","last_undegraded":"2024-04-23T10:12:40.223336+0000","last_fullsized":"2024-04-23T10:12:40.223336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223648+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:12:40.223648+0000","last_peered":"2024-04-23T10:12:40.223648+0000","last_clean":"2024-04-23T10:12:40.223648+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:12:40.223648+0000","last_undegraded":"2024-04-23T10:12:40.223648+0000","last_fullsized":"2024-04-23T10:12:40.223648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737307+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:12:40.737307+0000","last_peered":"2024-04-23T10:12:40.737307+0000","last_clean":"2024-04-23T10:12:40.737307+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:12:40.737307+0000","last_undegraded":"2024-04-23T10:12:40.737307+0000","last_fullsized":"2024-04-23T10:12:40.737307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227175+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:12:40.227175+0000","last_peered":"2024-04-23T10:12:40.227175+0000","last_clean":"2024-04-23T10:12:40.227175+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:12:40.227175+0000","last_undegraded":"2024-04-23T10:12:40.227175+0000","last_fullsized":"2024-04-23T10:12:40.227175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735764+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:12:40.735764+0000","last_peered":"2024-04-23T10:12:40.735764+0000","last_clean":"2024-04-23T10:12:40.735764+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:12:40.735764+0000","last_undegraded":"2024-04-23T10:12:40.735764+0000","last_fullsized":"2024-04-23T10:12:40.735764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082310+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:12:40.082310+0000","last_peered":"2024-04-23T10:12:40.082310+0000","last_clean":"2024-04-23T10:12:40.082310+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:12:40.082310+0000","last_undegraded":"2024-04-23T10:12:40.082310+0000","last_fullsized":"2024-04-23T10:12:40.082310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735994+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:12:40.735994+0000","last_peered":"2024-04-23T10:12:40.735994+0000","last_clean":"2024-04-23T10:12:40.735994+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:12:40.735994+0000","last_undegraded":"2024-04-23T10:12:40.735994+0000","last_fullsized":"2024-04-23T10:12:40.735994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083953+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:12:40.083953+0000","last_peered":"2024-04-23T10:12:40.083953+0000","last_clean":"2024-04-23T10:12:40.083953+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:12:40.083953+0000","last_undegraded":"2024-04-23T10:12:40.083953+0000","last_fullsized":"2024-04-23T10:12:40.083953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425202+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:12:40.425202+0000","last_peered":"2024-04-23T10:12:40.425202+0000","last_clean":"2024-04-23T10:12:40.425202+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:12:40.425202+0000","last_undegraded":"2024-04-23T10:12:40.425202+0000","last_fullsized":"2024-04-23T10:12:40.425202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737045+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:12:40.737045+0000","last_peered":"2024-04-23T10:12:40.737045+0000","last_clean":"2024-04-23T10:12:40.737045+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:12:40.737045+0000","last_undegraded":"2024-04-23T10:12:40.737045+0000","last_fullsized":"2024-04-23T10:12:40.737045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574856,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574858,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574857,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:00.595 INFO:tasks.cephfs.filesystem.ceph_manager:clean! 2024-04-23T10:13:00.595 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-23T10:13:00.596 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-23T10:13:00.596 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-23T10:13:00.596 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-23T10:13:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.754+0000 7f65ea84e640 1 Processor -- start 2024-04-23T10:13:00.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.754+0000 7f65ea84e640 1 -- start start 2024-04-23T10:13:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65ea84e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f65e4074100 0x7f65e406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65ea84e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40c5d70 con 0x7f65e414fbc0 2024-04-23T10:13:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65ea84e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f65e40c6050 con 0x7f65e414ffa0 2024-04-23T10:13:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65ea84e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f65e40c6330 con 0x7f65e4074100 2024-04-23T10:13:00.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f65e414fbc0 0x7f65e40c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:60720/0 (socket says 172.21.15.26:60720) 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 -- 172.21.15.26:0/3921493465 learned_addr learned my addr 172.21.15.26:0/3921493465 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e8deb640 1 --2- 172.21.15.26:0/3921493465 >> v2:172.21.15.190:3300/0 conn(0x7f65e4074100 0x7f65e406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2327104292 0 0) 0x7f65e40c5d70 con 0x7f65e414fbc0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f65cc003530 con 0x7f65e414fbc0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2617563404 0 0) 0x7f65cc003530 con 0x7f65e414fbc0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 >> v2:172.21.15.190:3300/0 conn(0x7f65e4074100 msgr2=0x7f65e406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 --2- 172.21.15.26:0/3921493465 >> v2:172.21.15.190:3300/0 conn(0x7f65e4074100 0x7f65e406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 >> v1:172.21.15.190:6789/0 conn(0x7f65e414ffa0 legacy=0x7f65e40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40c6610 con 0x7f65e414fbc0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f65d4001680 con 0x7f65e414fbc0 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 >> v1:172.21.15.26:6789/0 conn(0x7f65e414fbc0 legacy=0x7f65e40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 0x7f65cc003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40c6330 con 0x7f65cc0039f0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65cc00c0a0 con 0x7f65cc0051d0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f65cc00c2a0 con 0x7f65cc004810 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 0x7f65cc003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e37fe640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e8deb640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 -- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc004810 msgr2=0x7f65cc004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc004810 0x7f65cc004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 -- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65cc0051d0 msgr2=0x7f65cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 -- 172.21.15.26:0/3921493465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65cc003530 con 0x7f65cc0039f0 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e8deb640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65cc0051d0 0x7f65cc00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:00.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e8deb640 1 -- 172.21.15.26:0/3921493465 reap_dead start 2024-04-23T10:13:00.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.758+0000 7f65e3fff640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 0x7f65cc003e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c1c0 tx=0x7f65d401cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd48ab4206a7aa23 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4007d00 con 0x7f65cc0039f0 2024-04-23T10:13:00.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d40a9020 con 0x7f65cc0039f0 2024-04-23T10:13:00.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e2ffd640 1 -- 172.21.15.26:0/3921493465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d4005b00 con 0x7f65cc0039f0 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 msgr2=0x7f65cc003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 0x7f65cc003e10 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f65d400c1c0 tx=0x7f65d401cc20 comp rx=0 tx=0).stop 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/3921493465 shutdown_connections 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 --2- 172.21.15.26:0/3921493465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65cc0039f0 0x7f65cc003e10 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/3921493465 >> 172.21.15.26:0/3921493465 conn(0x7f65e406b9d0 msgr2=0x7f65e406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/3921493465 shutdown_connections 2024-04-23T10:13:00.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/3921493465 wait complete. 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 Processor -- start 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- start start 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc0039f0 0x7f65e415af50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 0x7f65e40c3e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40c75c0 con 0x7f65e415a0b0 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f65e40c7440 con 0x7f65e40c39e0 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f65e40c7740 con 0x7f65cc0039f0 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37918/0 (socket says 172.21.15.26:37918) 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 -- 172.21.15.26:0/1463127180 learned_addr learned my addr 172.21.15.26:0/1463127180 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e3fff640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc0039f0 0x7f65e415af50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e8deb640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 0x7f65e40c3e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 -- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc0039f0 msgr2=0x7f65e415af50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc0039f0 0x7f65e415af50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 -- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 msgr2=0x7f65e40c3e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 0x7f65e40c3e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 -- 172.21.15.26:0/1463127180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f65e40c43a0 con 0x7f65e415a0b0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e8deb640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 0x7f65e40c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e37fe640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e4e0 tx=0x7f65d800e9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d80052e0 con 0x7f65e415a0b0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f65d8018070 con 0x7f65e415a0b0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f65d8005480 con 0x7f65e415a0b0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f65e40c32f0 con 0x7f65e415a0b0 2024-04-23T10:13:00.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.762+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f65e41593f0 con 0x7f65e415a0b0 2024-04-23T10:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f65e4075df0 con 0x7f65e415a0b0 2024-04-23T10:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f65d8003840 con 0x7f65e415a0b0 2024-04-23T10:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65e0ff9640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 0x7f65d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f65d80868e0 con 0x7f65e415a0b0 2024-04-23T10:13:00.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65e3fff640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 0x7f65d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:00.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.766+0000 7f65e3fff640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 0x7f65d006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65d40aa000 tx=0x7f65e40c68f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:00.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.770+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f65e40c43a0 con 0x7f65e415a0b0 2024-04-23T10:13:00.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.970+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f65e4072ac0 con 0x7f65e415a0b0 2024-04-23T10:13:00.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.974+0000 7f65e0ff9640 1 -- 172.21.15.26:0/1463127180 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+168092 (secure 0 0 0) 0x7f65d8056bf0 con 0x7f65e415a0b0 2024-04-23T10:13:00.977 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 msgr2=0x7f65d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 0x7f65d006a840 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f65d40aa000 tx=0x7f65e40c68f0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 msgr2=0x7f65e40cb590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f65d800e4e0 tx=0x7f65d800e9a0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 shutdown_connections 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f65d0068380 0x7f65d006a840 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f65e40c39e0 0x7f65e40c3e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f65e415a0b0 0x7f65e40cb590 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 --2- 172.21.15.26:0/1463127180 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f65cc0039f0 0x7f65e415af50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:00.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 >> 172.21.15.26:0/1463127180 conn(0x7f65e406b9d0 msgr2=0x7f65e414df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:00.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 shutdown_connections 2024-04-23T10:13:00.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:00.978+0000 7f65ea84e640 1 -- 172.21.15.26:0/1463127180 wait complete. 2024-04-23T10:13:00.994 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":5,"flags":0,"active_gid":4105,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6832","nonce":2066447761},{"type":"v1","addr":"172.21.15.190:6833","nonce":2066447761}]},"active_addr":"172.21.15.190:6833/2066447761","active_change":"2024-04-23T10:12:14.897840+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4113,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1984975813}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1933048264}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":2249993587}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.190:0","nonce":1383817671}]}]} 2024-04-23T10:13:00.997 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-23T10:13:00.998 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-23T10:13:00.998 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 Processor -- start 2024-04-23T10:13:01.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 -- start start 2024-04-23T10:13:01.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c151f40 0x7f749c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f749c06cfd0 0x7f749c06d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f749c157da0 con 0x7f749c072ae0 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f749c0c89e0 con 0x7f749c06cfd0 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f74a1bb8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f749c0c8c80 con 0x7f749c151f40 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f749c06cfd0 0x7f749c06d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f749c06cfd0 0x7f749c06d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37928/0 (socket says 172.21.15.26:37928) 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 -- 172.21.15.26:0/960597905 learned_addr learned my addr 172.21.15.26:0/960597905 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749b7fe640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c151f40 0x7f749c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 -- 172.21.15.26:0/960597905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c151f40 msgr2=0x7f749c0c9630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c151f40 0x7f749c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 -- 172.21.15.26:0/960597905 >> v1:172.21.15.190:6789/0 conn(0x7f749c072ae0 legacy=0x7f749c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.114+0000 7f749bfff640 1 -- 172.21.15.26:0/960597905 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c158020 con 0x7f749c06cfd0 2024-04-23T10:13:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f749bfff640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c06cfd0 0x7f749c06d420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7494009e50 tx=0x7f749401f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff36bb2247989765 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f749a7fc640 1 -- 172.21.15.26:0/960597905 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940a8bd0 con 0x7f749c06cfd0 2024-04-23T10:13:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f749a7fc640 1 -- 172.21.15.26:0/960597905 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74940a8d70 con 0x7f749c06cfd0 2024-04-23T10:13:01.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f749a7fc640 1 -- 172.21.15.26:0/960597905 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74940b0610 con 0x7f749c06cfd0 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- 172.21.15.26:0/960597905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c06cfd0 msgr2=0x7f749c06d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c06cfd0 0x7f749c06d420 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f7494009e50 tx=0x7f749401f000 comp rx=0 tx=0).stop 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- 172.21.15.26:0/960597905 shutdown_connections 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c06cfd0 0x7f749c06d420 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/960597905 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c151f40 0x7f749c0c9630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- 172.21.15.26:0/960597905 >> 172.21.15.26:0/960597905 conn(0x7f749c0ca540 msgr2=0x7f749c0ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- 172.21.15.26:0/960597905 shutdown_connections 2024-04-23T10:13:01.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- 172.21.15.26:0/960597905 wait complete. 2024-04-23T10:13:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 Processor -- start 2024-04-23T10:13:01.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.118+0000 7f74a1bb8640 1 -- start start 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c06cfd0 0x7f749c1eda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f749c151f40 0x7f749c150f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f749c0c9b70 con 0x7f749c072ae0 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f749c1585e0 con 0x7f749c151f40 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f749c0c9170 con 0x7f749c06cfd0 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37942/0 (socket says 172.21.15.26:37942) 2024-04-23T10:13:01.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 -- 172.21.15.26:0/2567832910 learned_addr learned my addr 172.21.15.26:0/2567832910 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749bfff640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f749c151f40 0x7f749c150f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749b7fe640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c06cfd0 0x7f749c1eda30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 -- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c06cfd0 msgr2=0x7f749c1eda30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c06cfd0 0x7f749c1eda30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 -- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f749c151f40 msgr2=0x7f749c150f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f749c151f40 0x7f749c150f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 -- 172.21.15.26:0/2567832910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f749c159000 con 0x7f749c072ae0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f749affd640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c480 tx=0x7f748c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c012830 con 0x7f749c072ae0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f748c017070 con 0x7f749c072ae0 2024-04-23T10:13:01.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f748c012c30 con 0x7f749c072ae0 2024-04-23T10:13:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f749c1ee070 con 0x7f749c072ae0 2024-04-23T10:13:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f749c1ee630 con 0x7f749c072ae0 2024-04-23T10:13:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.122+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f749c075df0 con 0x7f749c072ae0 2024-04-23T10:13:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.126+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f748c01c460 con 0x7f749c072ae0 2024-04-23T10:13:01.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.126+0000 7f7483fff640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 0x7f748806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.126+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f748c086ad0 con 0x7f749c072ae0 2024-04-23T10:13:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.126+0000 7f749b7fe640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 0x7f748806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.125 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.126+0000 7f749b7fe640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 0x7f748806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f749000a8d0 tx=0x7f7490008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.130+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f748c056d50 con 0x7f749c072ae0 2024-04-23T10:13:01.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.286+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f749c156190 con 0x7f749c072ae0 2024-04-23T10:13:01.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f7483fff640 1 -- 172.21.15.26:0/2567832910 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7f748c056650 con 0x7f749c072ae0 2024-04-23T10:13:01.290 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:01.290 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 msgr2=0x7f748806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 0x7f748806a840 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f749000a8d0 tx=0x7f7490008040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 msgr2=0x7f749c15be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7f748c00c480 tx=0x7f748c00c940 comp rx=0 tx=0).stop 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 shutdown_connections 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7488068380 0x7f748806a840 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f749c151f40 0x7f749c150f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f749c072ae0 0x7f749c15be10 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 --2- 172.21.15.26:0/2567832910 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f749c06cfd0 0x7f749c1eda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 >> 172.21.15.26:0/2567832910 conn(0x7f749c0ca540 msgr2=0x7f749c06d3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 shutdown_connections 2024-04-23T10:13:01.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.290+0000 7f74a1bb8640 1 -- 172.21.15.26:0/2567832910 wait complete. 2024-04-23T10:13:01.308 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-23T10:13:01.308 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:01.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 Processor -- start 2024-04-23T10:13:01.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 -- start start 2024-04-23T10:13:01.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6c00c6210 0x7fa6c00c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa6c00c8080 con 0x7fa6c00c9370 2024-04-23T10:13:01.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa6c00c5d80 con 0x7fa6c00c6210 2024-04-23T10:13:01.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6c52ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c00c8360 con 0x7fa6c0159cf0 2024-04-23T10:13:01.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6be7fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa6c00c6210 0x7fa6c00c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6beffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:59756/0 (socket says 172.21.15.26:59756) 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6beffd640 1 -- 172.21.15.26:0/1049106569 learned_addr learned my addr 172.21.15.26:0/1049106569 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6bf7fe640 1 --1- 172.21.15.26:0/1049106569 >> v1:172.21.15.190:6789/0 conn(0x7fa6c00c9370 0x7fa6c00cb1e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:60434/0 (socket says 172.21.15.26:60434) 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6bdffb640 1 -- 172.21.15.26:0/1049106569 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1341368320 0 0) 0x7fa6c00c8080 con 0x7fa6c00c9370 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6bdffb640 1 -- 172.21.15.26:0/1049106569 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa6a8003530 con 0x7fa6c00c9370 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6be7fc640 1 -- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 msgr2=0x7fa6c0071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6be7fc640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6be7fc640 1 -- 172.21.15.26:0/1049106569 >> v1:172.21.15.190:6789/0 conn(0x7fa6c00c9370 legacy=0x7fa6c00cb1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.418+0000 7fa6be7fc640 1 -- 172.21.15.26:0/1049106569 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c00c8640 con 0x7fa6c00c6210 2024-04-23T10:13:01.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.422+0000 7fa6beffd640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.422+0000 7fa6be7fc640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c00c6210 0x7fa6c00c6630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097c0 tx=0x7fa6b401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=b688d7d64a03efee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6bdffb640 1 -- 172.21.15.26:0/1049106569 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40b5070 con 0x7fa6c00c6210 2024-04-23T10:13:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6bdffb640 1 -- 172.21.15.26:0/1049106569 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b40a8990 con 0x7fa6c00c6210 2024-04-23T10:13:01.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6bdffb640 1 -- 172.21.15.26:0/1049106569 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b40a8d60 con 0x7fa6c00c6210 2024-04-23T10:13:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c00c6210 msgr2=0x7fa6c00c6630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c00c6210 0x7fa6c00c6630 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40097c0 tx=0x7fa6b401ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1049106569 shutdown_connections 2024-04-23T10:13:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c00c6210 0x7fa6c00c6630 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1049106569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c0159cf0 0x7fa6c0071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1049106569 >> 172.21.15.26:0/1049106569 conn(0x7fa6c00676a0 msgr2=0x7fa6c0067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1049106569 shutdown_connections 2024-04-23T10:13:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1049106569 wait complete. 2024-04-23T10:13:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 Processor -- start 2024-04-23T10:13:01.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- start start 2024-04-23T10:13:01.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c00c9370 0x7fa6c01eece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 0x7fa6c01e2ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c0158f80 con 0x7fa6c00c6210 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6c00c8c00 con 0x7fa6c0159cf0 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa6c00cb8f0 con 0x7fa6c00c9370 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37950/0 (socket says 172.21.15.26:37950) 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 -- 172.21.15.26:0/1550878661 learned_addr learned my addr 172.21.15.26:0/1550878661 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6bf7fe640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 0x7fa6c01e2ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6be7fc640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c00c9370 0x7fa6c01eece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 -- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c00c9370 msgr2=0x7fa6c01eece0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c00c9370 0x7fa6c01eece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 -- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 msgr2=0x7fa6c01e2ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 0x7fa6c01e2ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 -- 172.21.15.26:0/1550878661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6c01e4580 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6bf7fe640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 0x7fa6c01e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6beffd640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000e960 tx=0x7fa6b000ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b0017070 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa6b000c9a0 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6c01e4f70 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6b000cd50 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.426+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6c015a1a0 con 0x7fa6c00c6210 2024-04-23T10:13:01.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa6c0075df0 con 0x7fa6c00c6210 2024-04-23T10:13:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa6b001a070 con 0x7fa6c00c6210 2024-04-23T10:13:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6a77fe640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 0x7fa6ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa6b0086b60 con 0x7fa6c00c6210 2024-04-23T10:13:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6be7fc640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 0x7fa6ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.430+0000 7fa6be7fc640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 0x7fa6ac06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40b2000 tx=0x7fa6b40aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.434+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa6b0056de0 con 0x7fa6c00c6210 2024-04-23T10:13:01.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.590+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa6c00c9150 con 0x7fa6c00c6210 2024-04-23T10:13:01.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6a77fe640 1 -- 172.21.15.26:0/1550878661 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v24) ==== 74+0+18502 (secure 0 0 0) 0x7fa6b00566e0 con 0x7fa6c00c6210 2024-04-23T10:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:01.593 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":24,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:12:39.438303+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 msgr2=0x7fa6ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 0x7fa6ac06a840 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fa6b40b2000 tx=0x7fa6b40aa070 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 msgr2=0x7fa6c015b420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7fa6b000e960 tx=0x7fa6b000ee20 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 shutdown_connections 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa6ac068380 0x7fa6ac06a840 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6c0159cf0 0x7fa6c01e2ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6c00c9370 0x7fa6c01eece0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 --2- 172.21.15.26:0/1550878661 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6c00c6210 0x7fa6c015b420 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 >> 172.21.15.26:0/1550878661 conn(0x7fa6c00676a0 msgr2=0x7fa6c00ce750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 shutdown_connections 2024-04-23T10:13:01.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.594+0000 7fa6c52ed640 1 -- 172.21.15.26:0/1550878661 wait complete. 2024-04-23T10:13:01.611 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-23T10:13:01.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-23T10:13:01.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-23T10:13:01.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-23T10:13:01.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-23T10:13:01.613 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-23T10:13:01.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-23T10:13:01.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-23T10:13:01.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 Processor -- start 2024-04-23T10:13:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 -- start start 2024-04-23T10:13:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 0x7f9e840c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e84072c20 con 0x7f9e84070f60 2024-04-23T10:13:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e84071a50 con 0x7f9e84157100 2024-04-23T10:13:01.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.782+0000 7f9e895e2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9e840c77e0 con 0x7f9e841512d0 2024-04-23T10:13:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e837fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e84070f60 0x7f9e84161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57474/0 (socket says 172.21.15.26:57474) 2024-04-23T10:13:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e837fe640 1 -- 172.21.15.26:0/2290174815 learned_addr learned my addr 172.21.15.26:0/2290174815 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/2290174815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 0x7f9e840c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e81ffb640 1 -- 172.21.15.26:0/2290174815 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3143603326 0 0) 0x7f9e84072c20 con 0x7f9e84070f60 2024-04-23T10:13:01.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e81ffb640 1 -- 172.21.15.26:0/2290174815 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e6c003530 con 0x7f9e84070f60 2024-04-23T10:13:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e81ffb640 1 -- 172.21.15.26:0/2290174815 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1515800876 0 0) 0x7f9e84071a50 con 0x7f9e84157100 2024-04-23T10:13:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2290174815 >> v1:172.21.15.190:6789/0 conn(0x7f9e84157100 legacy=0x7f9e84072510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2290174815 >> v1:172.21.15.26:6789/0 conn(0x7f9e84070f60 legacy=0x7f9e84161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.786+0000 7f9e82ffd640 1 -- 172.21.15.26:0/2290174815 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e840c7ac0 con 0x7f9e841512d0 2024-04-23T10:13:01.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/2290174815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 0x7f9e840c6f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e740090e0 tx=0x7f9e7401d6e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=38ac3f6c863f984b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e81ffb640 1 -- 172.21.15.26:0/2290174815 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e740b3070 con 0x7f9e841512d0 2024-04-23T10:13:01.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e81ffb640 1 -- 172.21.15.26:0/2290174815 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e740a6790 con 0x7f9e841512d0 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- 172.21.15.26:0/2290174815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 msgr2=0x7f9e840c6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 --2- 172.21.15.26:0/2290174815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 0x7f9e840c6f50 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f9e740090e0 tx=0x7f9e7401d6e0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- 172.21.15.26:0/2290174815 shutdown_connections 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 --2- 172.21.15.26:0/2290174815 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e841512d0 0x7f9e840c6f50 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- 172.21.15.26:0/2290174815 >> 172.21.15.26:0/2290174815 conn(0x7f9e840c9050 msgr2=0x7f9e840c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- 172.21.15.26:0/2290174815 shutdown_connections 2024-04-23T10:13:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- 172.21.15.26:0/2290174815 wait complete. 2024-04-23T10:13:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 Processor -- start 2024-04-23T10:13:01.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.790+0000 7f9e895e2640 1 -- start start 2024-04-23T10:13:01.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e84070f60 0x7f9e84204870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e841512d0 0x7f9e8406bc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 0x7f9e8415a630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e840c7490 con 0x7f9e84157100 2024-04-23T10:13:01.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e84071780 con 0x7f9e841512d0 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9e8406e590 con 0x7f9e84070f60 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 0x7f9e8415a630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 0x7f9e8415a630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50164/0 (socket says 172.21.15.26:50164) 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 -- 172.21.15.26:0/842997082 learned_addr learned my addr 172.21.15.26:0/842997082 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e84070f60 0x7f9e84204870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e827fc640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e841512d0 0x7f9e8406bc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 -- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e84070f60 msgr2=0x7f9e84204870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e84070f60 0x7f9e84204870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 -- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e841512d0 msgr2=0x7f9e8406bc30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e841512d0 0x7f9e8406bc30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e84204db0 con 0x7f9e84157100 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e837fe640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 0x7f9e8415a630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c430 tx=0x7f9e7800c8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e780074e0 con 0x7f9e84157100 2024-04-23T10:13:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e780047f0 con 0x7f9e84157100 2024-04-23T10:13:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e78007680 con 0x7f9e84157100 2024-04-23T10:13:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e840c4520 con 0x7f9e84157100 2024-04-23T10:13:01.796 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.794+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e840c5b60 con 0x7f9e84157100 2024-04-23T10:13:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e78011070 con 0x7f9e84157100 2024-04-23T10:13:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e84204450 con 0x7f9e84157100 2024-04-23T10:13:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 Processor -- start 2024-04-23T10:13:01.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e70068380 0x7f9e7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 -- start start 2024-04-23T10:13:01.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e78015e10 con 0x7f9e84157100 2024-04-23T10:13:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 Processor -- start 2024-04-23T10:13:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7f9e700726c0 0x7f9e70074b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e70075230 con 0x7f9e700726c0 2024-04-23T10:13:01.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 Processor -- start 2024-04-23T10:13:01.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e70068380 0x7f9e7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e827fc640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7f9e700726c0 0x7f9e70074b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e78052dc0 con 0x7f9e84157100 2024-04-23T10:13:01.800 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e827fc640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7f9e700726c0 0x7f9e70074b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e82ffd640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e70068380 0x7f9e7006a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e740b0000 tx=0x7f9e740a8070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fd306955640 1 Processor -- start 2024-04-23T10:13:01.801 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fd306955640 1 -- start start 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== osd.2 v2:172.21.15.26:6808/3344984401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e70075230 con 0x7f9e700726c0 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 -- start start 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e28157100 0x7f9e280c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e28071a50 con 0x7f9e28070f60 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e280c77e0 con 0x7f9e280c9b70 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2f0e2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9e280c7ac0 con 0x7f9e28157100 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2d67f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9e28070f60 0x7f9e28161930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57496/0 (socket says 172.21.15.26:57496) 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e2d67f640 1 -- 172.21.15.26:0/92617780 learned_addr learned my addr 172.21.15.26:0/92617780 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f9e27fff640 1 --2- 172.21.15.26:0/92617780 >> v2:172.21.15.26:3300/0 conn(0x7f9e28157100 0x7f9e280c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2010278895 0 0) 0x7f9e280c77e0 con 0x7f9e280c9b70 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e10003530 con 0x7f9e280c9b70 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 -- start start 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8b20067900 0x7f8b2015f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b200ccc20 0x7f8b2015f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b200b5060 con 0x7f8b20067ce0 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8b200b30e0 con 0x7f8b200ccc20 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b286b4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8b200b3380 con 0x7f8b20067900 2024-04-23T10:13:01.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b26c51640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b20067ce0 0x7f8b20159170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57498/0 (socket says 172.21.15.26:57498) 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b26c51640 1 -- 172.21.15.26:0/2080671469 learned_addr learned my addr 172.21.15.26:0/2080671469 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7f8b26450640 1 --2- 172.21.15.26:0/2080671469 >> v2:172.21.15.190:3300/0 conn(0x7f8b20067900 0x7f8b2015f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f8b26450640 1 -- 172.21.15.26:0/2080671469 >> v2:172.21.15.26:3300/0 conn(0x7f8b200ccc20 msgr2=0x7f8b2015f8d0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f8b26450640 1 --2- 172.21.15.26:0/2080671469 >> v2:172.21.15.26:3300/0 conn(0x7f8b200ccc20 0x7f8b2015f8d0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f8b26450640 1 -- 172.21.15.26:0/2080671469 >> v1:172.21.15.26:6789/0 conn(0x7f8b20067ce0 legacy=0x7f8b20159170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdbe0157430 0x7fdbe0157850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdbe015a7e0 con 0x7fdbe00c88e0 2024-04-23T10:13:01.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe0156f50 con 0x7fdbe0151110 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdffff640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdbe01514f0 con 0x7fdbe0157430 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdeffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50180/0 (socket says 172.21.15.26:50180) 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdeffd640 1 -- 172.21.15.26:0/3692620218 learned_addr learned my addr 172.21.15.26:0/3692620218 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/3692620218 >> v2:172.21.15.190:3300/0 conn(0x7fdbe0157430 0x7fdbe0157850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbddffb640 1 -- 172.21.15.26:0/3692620218 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1300298910 0 0) 0x7fdbe015a7e0 con 0x7fdbe00c88e0 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.798+0000 7fdbddffb640 1 -- 172.21.15.26:0/3692620218 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fdbcc003530 con 0x7fdbe00c88e0 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 232871278 0 0) 0x7f9e28071a50 con 0x7f9e28070f60 2024-04-23T10:13:01.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9e280c77e0 con 0x7f9e28070f60 2024-04-23T10:13:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd306955640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 0x7fd2f80d54e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd306955640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd2f80475e0 0x7fd2f80dbc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd306955640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2f8046260 con 0x7fd2f804b960 2024-04-23T10:13:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd306955640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f8047150 con 0x7fd2f80475e0 2024-04-23T10:13:01.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd306955640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd2f8046540 con 0x7fd2f8045d10 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd304ef2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2f804b960 0x7fd2f8006280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57508/0 (socket says 172.21.15.26:57508) 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4194663896 0 0) 0x7f9e10003530 con 0x7f9e280c9b70 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 >> v2:172.21.15.26:3300/0 conn(0x7f9e28157100 msgr2=0x7f9e280c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 --2- 172.21.15.26:0/92617780 >> v2:172.21.15.26:3300/0 conn(0x7f9e28157100 0x7f9e280c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 >> v1:172.21.15.26:6789/0 conn(0x7f9e28070f60 legacy=0x7f9e28161930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e280c7da0 con 0x7f9e280c9b70 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f9e20001a00 con 0x7f9e280c9b70 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 >> v1:172.21.15.190:6789/0 conn(0x7f9e280c9b70 legacy=0x7f9e281512d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 0x7f9e10003f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10004810 0x7f9e10004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e100051d0 0x7f9e1000dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e280c7ac0 con 0x7f9e100051d0 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e1000e310 con 0x7f9e10003b50 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9e1000e510 con 0x7f9e10004810 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd304ef2640 1 -- 172.21.15.26:0/188745414 learned_addr learned my addr 172.21.15.26:0/188745414 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 Processor -- start 2024-04-23T10:13:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 0x7f9e10003f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/188745414 >> v2:172.21.15.26:3300/0 conn(0x7fd2f80475e0 0x7fd2f80dbc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2fffff640 1 --2- 172.21.15.26:0/188745414 >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 0x7fd2f80d54e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 -- start start 2024-04-23T10:13:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdf7fe640 1 -- 172.21.15.26:0/3692620218 >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 msgr2=0x7fdbe00c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/3692620218 >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdf7fe640 1 -- 172.21.15.26:0/3692620218 >> v1:172.21.15.26:6789/0 conn(0x7fdbe00c88e0 legacy=0x7fdbe00c95d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdf7fe640 1 -- 172.21.15.26:0/3692620218 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe015aa80 con 0x7fdbe0157430 2024-04-23T10:13:01.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f8b26450640 1 -- 172.21.15.26:0/2080671469 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b200b52d0 con 0x7f8b20067900 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdeffd640 1 --2- 172.21.15.26:0/3692620218 >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2ff7fe640 1 -- 172.21.15.26:0/188745414 >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 msgr2=0x7fd2f80d54e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/188745414 >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 0x7fd2f80d54e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2ff7fe640 1 -- 172.21.15.26:0/188745414 >> v1:172.21.15.26:6789/0 conn(0x7fd2f804b960 legacy=0x7fd2f8006280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2ff7fe640 1 -- 172.21.15.26:0/188745414 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f8046820 con 0x7fd2f80475e0 2024-04-23T10:13:01.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fd2fffff640 1 --2- 172.21.15.26:0/188745414 >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 0x7fd2f80d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6994155250 0x7f69940cc6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f699415ba00 con 0x7f699415e8b0 2024-04-23T10:13:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69940cb480 con 0x7f69940cbfc0 2024-04-23T10:13:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69996a3640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6994155630 con 0x7f6994155250 2024-04-23T10:13:01.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 -- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10004810 msgr2=0x7f9e10004c90 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10004810 0x7f9e10004c90 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 -- 172.21.15.26:0/92617780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e100051d0 msgr2=0x7f9e1000dbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e100051d0 0x7f9e1000dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2ce7e640 1 -- 172.21.15.26:0/92617780 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e280c7da0 con 0x7f9e10003b50 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f9e2d67f640 1 -- 172.21.15.26:0/92617780 reap_dead start 2024-04-23T10:13:01.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/3692620218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0157430 0x7fdbe0157850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00745d0 tx=0x7fdbd801f100 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ae2c3159f60a11dd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69927fc640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f69940cbfc0 0x7f69940d0c70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:47704/0 (socket says 172.21.15.26:47704) 2024-04-23T10:13:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69937fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f699415e8b0 0x7f699415ed00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57510/0 (socket says 172.21.15.26:57510) 2024-04-23T10:13:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f69937fe640 1 -- 172.21.15.26:0/1110548751 learned_addr learned my addr 172.21.15.26:0/1110548751 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f6992ffd640 1 --2- 172.21.15.26:0/1110548751 >> v2:172.21.15.26:3300/0 conn(0x7f6994155250 0x7f69940cc6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f6992ffd640 1 -- 172.21.15.26:0/1110548751 >> v1:172.21.15.190:6789/0 conn(0x7f69940cbfc0 legacy=0x7f69940d0c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f6992ffd640 1 -- 172.21.15.26:0/1110548751 >> v1:172.21.15.26:6789/0 conn(0x7f699415e8b0 legacy=0x7f699415ed00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f6992ffd640 1 -- 172.21.15.26:0/1110548751 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6994068590 con 0x7f6994155250 2024-04-23T10:13:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.802+0000 7f8b26450640 1 --2- 172.21.15.26:0/2080671469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067900 0x7f8b2015f390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b140097c0 tx=0x7f8b1401c280 comp rx=0 tx=0).ready entity=mon.1 client_cookie=61d446b9e78f0ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b2544e640 1 -- 172.21.15.26:0/2080671469 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b140b0070 con 0x7f8b20067900 2024-04-23T10:13:01.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b2544e640 1 -- 172.21.15.26:0/2080671469 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b140ab600 con 0x7f8b20067900 2024-04-23T10:13:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/188745414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f80475e0 0x7fd2f80dbc30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd30006ac00 tx=0x7fd300098d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c5d862beeb2a1a6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbddffb640 1 -- 172.21.15.26:0/3692620218 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80b5070 con 0x7fdbe0157430 2024-04-23T10:13:01.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 Processor -- start 2024-04-23T10:13:01.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbddffb640 1 -- 172.21.15.26:0/3692620218 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd80b0440 con 0x7fdbe0157430 2024-04-23T10:13:01.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbddffb640 1 -- 172.21.15.26:0/3692620218 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd80b0810 con 0x7fdbe0157430 2024-04-23T10:13:01.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd2feffd640 1 -- 172.21.15.26:0/188745414 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd30012e070 con 0x7fd2f80475e0 2024-04-23T10:13:01.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 -- start start 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- 172.21.15.26:0/2080671469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067900 msgr2=0x7f8b2015f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 --2- 172.21.15.26:0/2080671469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067900 0x7f8b2015f390 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b140097c0 tx=0x7f8b1401c280 comp rx=0 tx=0).stop 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- 172.21.15.26:0/2080671469 shutdown_connections 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 --2- 172.21.15.26:0/2080671469 >> v2:172.21.15.26:3300/0 conn(0x7f8b200ccc20 0x7f8b2015f8d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 --2- 172.21.15.26:0/2080671469 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067900 0x7f8b2015f390 secure :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0x7f8b140097c0 tx=0x7f8b1401c280 comp rx=0 tx=0).stop 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- 172.21.15.26:0/2080671469 >> 172.21.15.26:0/2080671469 conn(0x7f8b2006d9c0 msgr2=0x7f8b200d07a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- 172.21.15.26:0/2080671469 shutdown_connections 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 -- 172.21.15.26:0/3692620218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0157430 msgr2=0x7fdbe0157850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 --2- 172.21.15.26:0/3692620218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0157430 0x7fdbe0157850 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7fdbe00745d0 tx=0x7fdbd801f100 comp rx=0 tx=0).stop 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 -- 172.21.15.26:0/3692620218 shutdown_connections 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 --2- 172.21.15.26:0/3692620218 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0157430 0x7fdbe0157850 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 --2- 172.21.15.26:0/3692620218 >> v2:172.21.15.26:3300/0 conn(0x7fdbe0151110 0x7fdbe00c3ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 -- 172.21.15.26:0/3692620218 >> 172.21.15.26:0/3692620218 conn(0x7fdbe006eb20 msgr2=0x7fdbe006ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 -- 172.21.15.26:0/3692620218 shutdown_connections 2024-04-23T10:13:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd2feffd640 1 -- 172.21.15.26:0/188745414 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd300121b00 con 0x7fd2f80475e0 2024-04-23T10:13:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd2feffd640 1 -- 172.21.15.26:0/188745414 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd300129440 con 0x7fd2f80475e0 2024-04-23T10:13:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd306955640 1 -- 172.21.15.26:0/188745414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f80475e0 msgr2=0x7fd2f80dbc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fd306955640 1 --2- 172.21.15.26:0/188745414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f80475e0 0x7fd2f80dbc30 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7fd30006ac00 tx=0x7fd300098d50 comp rx=0 tx=0).stop 2024-04-23T10:13:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 0x7f45980d4b50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a5f48640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f459804b300 0x7f4598005ea0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57524/0 (socket says 172.21.15.26:57524) 2024-04-23T10:13:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a5f48640 1 -- 172.21.15.26:0/1206238735 learned_addr learned my addr 172.21.15.26:0/1206238735 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45980dbab0 con 0x7f459804b300 2024-04-23T10:13:01.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f6992ffd640 1 --2- 172.21.15.26:0/1110548751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6994155250 0x7f69940cc6b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69880097c0 tx=0x7f698801c2f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d39efc2286fdf308 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4598045fc0 con 0x7f4598046d80 2024-04-23T10:13:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f45980dbd50 con 0x7f459804b6e0 2024-04-23T10:13:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- 172.21.15.26:0/2080671469 wait complete. 2024-04-23T10:13:01.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 Processor -- start 2024-04-23T10:13:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 256306352 0 0) 0x7f45980dbab0 con 0x7f459804b300 2024-04-23T10:13:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f458c003530 con 0x7f459804b300 2024-04-23T10:13:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f6991ffb640 1 -- 172.21.15.26:0/1110548751 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69880b0070 con 0x7f6994155250 2024-04-23T10:13:01.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a5747640 1 --2- 172.21.15.26:0/1206238735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 0x7f45980d4b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f6991ffb640 1 -- 172.21.15.26:0/1110548751 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69880ab600 con 0x7f6994155250 2024-04-23T10:13:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 827640927 0 0) 0x7f4598045fc0 con 0x7f4598046d80 2024-04-23T10:13:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f45980dbab0 con 0x7f4598046d80 2024-04-23T10:13:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7fdbdffff640 1 -- 172.21.15.26:0/3692620218 wait complete. 2024-04-23T10:13:01.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 Processor -- start 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 -- 172.21.15.26:0/188745414 shutdown_connections 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 --2- 172.21.15.26:0/188745414 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f80475e0 0x7fd2f80dbc30 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 --2- 172.21.15.26:0/188745414 >> v2:172.21.15.190:3300/0 conn(0x7fd2f8045d10 0x7fd2f80d54e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 -- 172.21.15.26:0/188745414 >> 172.21.15.26:0/188745414 conn(0x7fd2f8050a50 msgr2=0x7fd2f8050e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- 172.21.15.26:0/1110548751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6994155250 msgr2=0x7f69940cc6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 --2- 172.21.15.26:0/1110548751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6994155250 0x7f69940cc6b0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f69880097c0 tx=0x7f698801c2f0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- 172.21.15.26:0/1110548751 shutdown_connections 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 --2- 172.21.15.26:0/1110548751 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6994155250 0x7f69940cc6b0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- 172.21.15.26:0/1110548751 >> 172.21.15.26:0/1110548751 conn(0x7f699406d7c0 msgr2=0x7f699406dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 0x7f9e10003f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e20007fd0 tx=0x7f9e20021330 comp rx=0 tx=0).ready entity=mon.1 client_cookie=973f2fde0dc4d6db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a5747640 1 -- 172.21.15.26:0/1206238735 >> v1:172.21.15.190:6789/0 conn(0x7f4598046d80 legacy=0x7f45980dad40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a5747640 1 -- 172.21.15.26:0/1206238735 >> v1:172.21.15.26:6789/0 conn(0x7f459804b300 legacy=0x7f4598005ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a5747640 1 -- 172.21.15.26:0/1206238735 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45980462a0 con 0x7f459804b6e0 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- 172.21.15.26:0/1110548751 shutdown_connections 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.806+0000 7f8b286b4640 1 -- start start 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067ce0 0x7f8b20169fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 0x7f8b20143b00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b20144040 0x7f8b201414b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200cc760 con 0x7f8b200ccc20 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8b200b5890 con 0x7f8b20067ce0 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b286b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8b20159880 con 0x7f8b20144040 2024-04-23T10:13:01.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 0x7f8b20143b00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 0x7f8b20143b00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50234/0 (socket says 172.21.15.26:50234) 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 -- 172.21.15.26:0/915946518 learned_addr learned my addr 172.21.15.26:0/915946518 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 -- 172.21.15.26:0/188745414 shutdown_connections 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 -- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b20144040 msgr2=0x7f8b201414b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b20144040 0x7f8b201414b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 -- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067ce0 msgr2=0x7f8b20169fe0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b20067ce0 0x7f8b20169fe0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2015a870 con 0x7f8b200ccc20 2024-04-23T10:13:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 -- start start 2024-04-23T10:13:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 -- 172.21.15.26:0/188745414 wait complete. 2024-04-23T10:13:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 Processor -- start 2024-04-23T10:13:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- 172.21.15.26:0/1110548751 wait complete. 2024-04-23T10:13:01.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 Processor -- start 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e200b5070 con 0x7f9e10003b50 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e200b0620 con 0x7f9e10003b50 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e277fe640 1 -- 172.21.15.26:0/92617780 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e2000c0e0 con 0x7f9e10003b50 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 msgr2=0x7f9e10003f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 0x7f9e10003f50 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x7f9e20007fd0 tx=0x7f9e20021330 comp rx=0 tx=0).stop 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/92617780 shutdown_connections 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 --2- 172.21.15.26:0/92617780 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e10003b50 0x7f9e10003f50 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/92617780 >> 172.21.15.26:0/92617780 conn(0x7f9e280c9050 msgr2=0x7f9e280c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/92617780 shutdown_connections 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2634294518 0 0) 0x7f45980dbab0 con 0x7f4598046d80 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbe00c88e0 0x7fdbe0072c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbe00c88e0 0x7fdbe0072c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdeffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbe00c88e0 0x7fdbe0072c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50238/0 (socket says 172.21.15.26:50238) 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0151110 0x7fdbe014caf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdeffd640 1 -- 172.21.15.26:0/1064598822 learned_addr learned my addr 172.21.15.26:0/1064598822 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbe0157430 0x7fdbe01599f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe015b320 con 0x7fdbe00c88e0 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdbe015b040 con 0x7fdbe0151110 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdbe0157d90 con 0x7fdbe0157430 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0151110 0x7fdbe014caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbe0157430 0x7fdbe01599f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a5747640 1 --2- 172.21.15.26:0/1206238735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 0x7f45980d4b50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f459c009770 tx=0x7f459c01c310 comp rx=0 tx=0).ready entity=mon.2 client_cookie=6bf7c23cfe0513a0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b25c4f640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 0x7f8b20143b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000ba10 tx=0x7f8b1000bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10019070 con 0x7f8b200ccc20 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1000cbd0 con 0x7f8b200ccc20 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fd306955640 1 -- start start 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 -- start start 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 0x7f699414b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6994155250 0x7f69941557b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f69996a3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 0x7f6994155cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 0x7f6994155cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 0x7f6994155cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50248/0 (socket says 172.21.15.26:50248) 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 0x7f699414b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69927fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6994155250 0x7f69941557b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f6992ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 0x7f699414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55664/0 (socket says 172.21.15.26:55664) 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69996a3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69940cb120 con 0x7f699415e8b0 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69996a3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6994068870 con 0x7f6994155250 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69996a3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69940d1380 con 0x7f69940cbfc0 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/92617780 wait complete. 2024-04-23T10:13:01.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 Processor -- start 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0b0070 con 0x7f459804b6e0 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7f45a4f46640 1 -- 172.21.15.26:0/1206238735 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459804c940 con 0x7f459804b6e0 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 msgr2=0x7f45980d4b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 --2- 172.21.15.26:0/1206238735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 0x7f45980d4b50 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f459c009770 tx=0x7f459c01c310 comp rx=0 tx=0).stop 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 -- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbe0157430 msgr2=0x7fdbe01599f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbe0157430 0x7fdbe01599f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 -- 172.21.15.26:0/1064598822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbe00c88e0 msgr2=0x7fdbe0072c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdbe00c88e0 0x7fdbe0072c80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbde7fc640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdbe0071900 con 0x7fdbe0151110 2024-04-23T10:13:01.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.810+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdbe0157430 0x7fdbe01599f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f8045d10 0x7fd2f80da7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80475e0 0x7fd2f80dc370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 0x7fd2f8185230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f804d050 con 0x7fd2f8045d10 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd2f804ced0 con 0x7fd2f804b960 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd2f80dfb00 con 0x7fd2f80475e0 2024-04-23T10:13:01.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 shutdown_connections 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 --2- 172.21.15.26:0/1206238735 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f459804b6e0 0x7f45980d4b50 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 >> 172.21.15.26:0/1206238735 conn(0x7f4598050190 msgr2=0x7f45980505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2015ab10 con 0x7f8b200ccc20 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2015b0d0 con 0x7f8b200ccc20 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbde7fc640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0151110 0x7fdbe014caf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0007fd0 tx=0x7fdbd000c8e0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0017070 con 0x7fdbe0151110 2024-04-23T10:13:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdbd0003600 con 0x7fdbe0151110 2024-04-23T10:13:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdbe0071be0 con 0x7fdbe0151110 2024-04-23T10:13:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdbd0003a30 con 0x7fdbe0151110 2024-04-23T10:13:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdbe00721a0 con 0x7fdbe0151110 2024-04-23T10:13:01.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8b20076440 con 0x7f8b200ccc20 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 0x7fd2f8185230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 0x7fd2f8185230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:40546/0 (socket says 172.21.15.26:40546) 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 -- 172.21.15.26:0/3918455449 learned_addr learned my addr 172.21.15.26:0/3918455449 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80475e0 0x7fd2f80dc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69927fc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6994155250 0x7f69941557b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:40536/0 (socket says 172.21.15.26:40536) 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69927fc640 1 -- 172.21.15.26:0/2698514009 learned_addr learned my addr 172.21.15.26:0/2698514009 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 -- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 msgr2=0x7f699414b320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 0x7f699414b320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 -- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6994155250 msgr2=0x7f69941557b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6994155250 0x7f69941557b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69941f52f0 con 0x7f699415e8b0 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f6992ffd640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69940cbfc0 0x7f699414b320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello state changed while learned_addr, mark_down or replacing must be happened just now 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fdbe00716a0 con 0x7fdbe0151110 2024-04-23T10:13:01.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2fffff640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f8045d10 0x7fd2f80da7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 -- start start 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10003b50 0x7f9e280c2880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 0x7f9e280ca500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 -- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80475e0 msgr2=0x7fd2f80dc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2f80475e0 0x7fd2f80dc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 -- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f8045d10 msgr2=0x7fd2f80da7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f8045d10 0x7fd2f80da7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2f81884a0 con 0x7fd2f804b960 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2fffff640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2f8045d10 0x7fd2f80da7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69937fe640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 0x7f6994155cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e480 tx=0x7f698c00e880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2ce7e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10003b50 0x7f9e280c2880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2ce7e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10003b50 0x7f9e280c2880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55678/0 (socket says 172.21.15.26:55678) 2024-04-23T10:13:01.842 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 0x7f9e280ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 0x7f9e280ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50258/0 (socket says 172.21.15.26:50258) 2024-04-23T10:13:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 shutdown_connections 2024-04-23T10:13:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd304ef2640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 0x7fd2f8185230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c390 tx=0x7fd2ec00c850 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8b10014440 con 0x7f8b200ccc20 2024-04-23T10:13:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c019070 con 0x7f699415e8b0 2024-04-23T10:13:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f698c009480 con 0x7f699415e8b0 2024-04-23T10:13:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69941f55d0 con 0x7f699415e8b0 2024-04-23T10:13:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941f5b90 con 0x7f699415e8b0 2024-04-23T10:13:01.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e280caa40 0x7f9e280cb990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f698c009830 con 0x7f699415e8b0 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec017070 con 0x7fd2f804b960 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2f8188780 con 0x7fd2f804b960 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd306955640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2f8188d40 con 0x7fd2f804b960 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2ec005cf0 con 0x7fd2f804b960 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2ec007310 con 0x7fd2f804b960 2024-04-23T10:13:01.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd306955640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd2f8188250 con 0x7fd2f804b960 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e2806e590 con 0x7f9e280c5900 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e28071ff0 con 0x7f9e280caa40 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2f0e2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9e2806e710 con 0x7f9e10003b50 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 -- 172.21.15.26:0/1497742736 learned_addr learned my addr 172.21.15.26:0/1497742736 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e2d67f640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e280caa40 0x7f9e280cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 -- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10003b50 msgr2=0x7f9e280c2880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e10003b50 0x7f9e280c2880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 -- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e280caa40 msgr2=0x7f9e280cb990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e280caa40 0x7f9e280cb990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f9e27fff640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e280caec0 con 0x7f9e280c5900 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e27fff640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 0x7f9e280ca500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800e7d0 tx=0x7f9e1800ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8b1001c070 con 0x7f8b200ccc20 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b1effd640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8b0c068450 0x7f8b0c06a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f8b10087630 con 0x7f8b200ccc20 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b26450640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8b0c068450 0x7f8b0c06a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b1effd640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7f8b0c071bc0 0x7f8b0c074000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8b1000ee50 con 0x7f8b0c071bc0 2024-04-23T10:13:01.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f8b10087a20 con 0x7f8b200ccc20 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdbd001a070 con 0x7fdbe0151110 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7fdbd77fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdbc00683d0 0x7fdbc006a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fdbd0086630 con 0x7fdbe0151110 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbd77fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fdbc0071b50 0x7fdbc0073f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fdbd0010e50 con 0x7fdbc0071b50 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fdbd0086a90 con 0x7fdbe0151110 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbdeffd640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdbc00683d0 0x7fdbc006a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fdbc0071b50 0x7fdbc0073f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b26c51640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7f8b0c071bc0 0x7f8b0c074000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e18028070 con 0x7f9e280c5900 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e1800c8c0 con 0x7f9e280c5900 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e1800ccb0 con 0x7f9e280c5900 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.814+0000 7f45a6f4a640 1 -- 172.21.15.26:0/1206238735 wait complete. 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 Processor -- start 2024-04-23T10:13:01.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f6974001040 con 0x7f699415e8b0 2024-04-23T10:13:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b26450640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8b0c068450 0x7f8b0c06a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad000 tx=0x7f8b140a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbdeffd640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdbc00683d0 0x7fdbc006a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8004430 tx=0x7fdbc800d040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbdf7fe640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fdbc0071b50 0x7fdbc0073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 -- start start 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4598046d80 0x7f459817d040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459804b300 0x7f45980da030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459804b6e0 0x7f45980d71a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45980db820 con 0x7f459804b6e0 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45980db6a0 con 0x7f459804b300 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6f4a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f459817d580 con 0x7f4598046d80 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5f48640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4598046d80 0x7f459817d040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5f48640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4598046d80 0x7f459817d040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55690/0 (socket says 172.21.15.26:55690) 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5f48640 1 -- 172.21.15.26:0/913388779 learned_addr learned my addr 172.21.15.26:0/913388779 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459804b300 0x7f45980da030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2ec01a070 con 0x7fd2f804b960 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2e4068380 0x7fd2e406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fd2ec0861e0 con 0x7fd2f804b960 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fd2e4071a70 0x7fd2e4073eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd2ec016ec0 con 0x7fd2e4071a70 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7fd2ec086670 con 0x7fd2f804b960 2024-04-23T10:13:01.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a6749640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459804b6e0 0x7f45980d71a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fd2e4071a70 0x7fd2e4073eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e281f87a0 con 0x7f9e280c5900 2024-04-23T10:13:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f8b26c51640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7f8b0c071bc0 0x7f8b0c074000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fd2ff7fe640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fd2e4071a70 0x7fd2e4073eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 -- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4598046d80 msgr2=0x7f459817d040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4598046d80 0x7f459817d040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 -- 172.21.15.26:0/913388779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459804b6e0 msgr2=0x7f45980d71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f459804b6e0 0x7f45980d71a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f45a5747640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45980e6000 con 0x7f459804b300 2024-04-23T10:13:01.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== osd.6 v2:172.21.15.190:6808/2710988300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fdbd0010e50 con 0x7fdbc0071b50 2024-04-23T10:13:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7fd2fffff640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2e4068380 0x7fd2e406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f698c01c070 con 0x7f699415e8b0 2024-04-23T10:13:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.818+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e281f8d60 con 0x7f9e280c5900 2024-04-23T10:13:01.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45a5747640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459804b300 0x7f45980da030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ab000 tx=0x7f459c01ab50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6980068380 0x7f698006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f698c089b30 con 0x7f699415e8b0 2024-04-23T10:13:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0b0050 con 0x7f459804b300 2024-04-23T10:13:01.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c0b1040 con 0x7f459804b300 2024-04-23T10:13:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7f6980071af0 0x7f6980073f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f6980074600 con 0x7f6980071af0 2024-04-23T10:13:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f698c089f20 con 0x7f699415e8b0 2024-04-23T10:13:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f6992ffd640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6980068380 0x7f698006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== osd.0 v2:172.21.15.26:6817/1116322657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd2ec016ec0 con 0x7fd2e4071a70 2024-04-23T10:13:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7fd2fffff640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2e4068380 0x7fd2e406a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400dc90 tx=0x7fd2f4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f9e281f8550 con 0x7f9e280c5900 2024-04-23T10:13:01.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f69927fc640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7f6980071af0 0x7f6980073f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c0b7650 con 0x7f459804b300 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45980e62e0 con 0x7f459804b300 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45980e4ee0 con 0x7f459804b300 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f459804c940 con 0x7f459804b300 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== osd.5 v2:172.21.15.190:6800/228505156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8b1000ee50 con 0x7f8b0c071bc0 2024-04-23T10:13:01.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f69927fc640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7f6980071af0 0x7f6980073f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e1802b070 con 0x7f9e280c5900 2024-04-23T10:13:01.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e140683b0 0x7f9e1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9e18097f00 con 0x7f9e280c5900 2024-04-23T10:13:01.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== osd.1 v2:172.21.15.26:6816/1500743666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f6980074600 con 0x7f6980071af0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e140683b0 0x7f9e1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f9e14071aa0 0x7f9e14073ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f9e140745b0 con 0x7f9e14071aa0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f9e1809a520 con 0x7f9e280c5900 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.822+0000 7f9e2d67f640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f9e14071aa0 0x7f9e14073ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f9e2ce7e640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e140683b0 0x7f9e1406a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e200b2000 tx=0x7f9e20009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f9e2d67f640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f9e14071aa0 0x7f9e14073ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f459c0be030 con 0x7f459804b300 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== osd.3 v2:172.21.15.26:6800/451500618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f9e140745b0 con 0x7f9e14071aa0 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c068970 0x7f458c06ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f459c1218a0 con 0x7f459804b300 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f458c072060 0x7f458c0744a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45a5f48640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c068970 0x7f458c06ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f459c0a8ec0 con 0x7f458c072060 2024-04-23T10:13:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f459c121c50 con 0x7f459804b300 2024-04-23T10:13:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f45a5f48640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c068970 0x7f458c06ae30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45900011f0 tx=0x7f4590009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.826+0000 7f6992ffd640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6980068380 0x7f698006a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69880ad000 tx=0x7f69880a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f45a6749640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f458c072060 0x7f458c0744a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 --> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e84076440 con 0x7f9e700726c0 2024-04-23T10:13:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e6b7fe640 1 -- 172.21.15.26:0/842997082 <== osd.2 v2:172.21.15.26:6808/3344984401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e84076440 con 0x7f9e700726c0 2024-04-23T10:13:01.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f45a6749640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f458c072060 0x7f458c0744a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7f9e700726c0 msgr2=0x7f9e70074b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7f9e700726c0 0x7f9e70074b60 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e70068380 msgr2=0x7f9e7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e70068380 0x7f9e7006a840 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f9e740b0000 tx=0x7f9e740a8070 comp rx=0 tx=0).stop 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 msgr2=0x7f9e8415a630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 --2- 172.21.15.26:0/842997082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e84157100 0x7f9e8415a630 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f9e7800c430 tx=0x7f9e7800c8f0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e837fe640 1 -- 172.21.15.26:0/842997082 reap_dead start 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 shutdown_connections 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 >> 172.21.15.26:0/842997082 conn(0x7f9e840c9050 msgr2=0x7f9e840c6c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 shutdown_connections 2024-04-23T10:13:01.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.830+0000 7f9e895e2640 1 -- 172.21.15.26:0/842997082 wait complete. 2024-04-23T10:13:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.834+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== osd.4 v2:172.21.15.190:6817/3258213114 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f459c0a8ec0 con 0x7f458c072060 2024-04-23T10:13:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 --> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fdbe0076360 con 0x7fdbc0071b50 2024-04-23T10:13:01.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbd77fe640 1 -- 172.21.15.26:0/1064598822 <== osd.6 v2:172.21.15.190:6808/2710988300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fdbe0076360 con 0x7fdbc0071b50 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fdbc0071b50 msgr2=0x7fdbc0073f90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fdbc0071b50 0x7fdbc0073f90 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdbc00683d0 msgr2=0x7fdbc006a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdbc00683d0 0x7fdbc006a890 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7fdbc8004430 tx=0x7fdbc800d040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0151110 msgr2=0x7fdbe014caf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 --2- 172.21.15.26:0/1064598822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdbe0151110 0x7fdbe014caf0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x7fdbd0007fd0 tx=0x7fdbd000c8e0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdf7fe640 1 -- 172.21.15.26:0/1064598822 reap_dead start 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 shutdown_connections 2024-04-23T10:13:01.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 >> 172.21.15.26:0/1064598822 conn(0x7fdbe006eb20 msgr2=0x7fdbe01566e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 shutdown_connections 2024-04-23T10:13:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.838+0000 7fdbdffff640 1 -- 172.21.15.26:0/1064598822 wait complete. 2024-04-23T10:13:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 Processor -- start 2024-04-23T10:13:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 -- start start 2024-04-23T10:13:01.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f35b815f3d0 0x7f35b80c9050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b80ca830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35b806cbf0 con 0x7f35b8073710 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f35b80caec0 con 0x7f35b815f3d0 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35be594640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35b806ceb0 con 0x7f35b8073af0 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bd592640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f35b8073710 0x7f35b80ca030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57534/0 (socket says 172.21.15.26:57534) 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bd592640 1 -- 172.21.15.26:0/3104436450 learned_addr learned my addr 172.21.15.26:0/3104436450 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bdd93640 1 --2- 172.21.15.26:0/3104436450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b80ca830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bcd91640 1 --2- 172.21.15.26:0/3104436450 >> v2:172.21.15.190:3300/0 conn(0x7f35b815f3d0 0x7f35b80c9050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd306955640 1 -- 172.21.15.26:0/3918455449 --> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fd2f8033570 con 0x7fd2e4071a70 2024-04-23T10:13:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2fcff9640 1 -- 172.21.15.26:0/3918455449 <== osd.0 v2:172.21.15.26:6817/1116322657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fd2f8033570 con 0x7fd2e4071a70 2024-04-23T10:13:01.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fd2e4071a70 msgr2=0x7fd2e4073eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fd2e4071a70 0x7fd2e4073eb0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2e4068380 msgr2=0x7fd2e406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2e4068380 0x7fd2e406a840 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7fd2f400dc90 tx=0x7fd2f4008040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 msgr2=0x7fd2f8185230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 --2- 172.21.15.26:0/3918455449 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2f804b960 0x7fd2f8185230 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7fd2ec00c390 tx=0x7fd2ec00c850 comp rx=0 tx=0).stop 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd304ef2640 1 -- 172.21.15.26:0/3918455449 reap_dead start 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 shutdown_connections 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 >> 172.21.15.26:0/3918455449 conn(0x7fd2f8050a50 msgr2=0x7fd2f80e63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 shutdown_connections 2024-04-23T10:13:01.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7fd2ea7fc640 1 -- 172.21.15.26:0/3918455449 wait complete. 2024-04-23T10:13:01.872 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:01.872 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bdd93640 1 -- 172.21.15.26:0/3104436450 >> v2:172.21.15.190:3300/0 conn(0x7f35b815f3d0 msgr2=0x7f35b80c9050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bdd93640 1 --2- 172.21.15.26:0/3104436450 >> v2:172.21.15.190:3300/0 conn(0x7f35b815f3d0 0x7f35b80c9050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bdd93640 1 -- 172.21.15.26:0/3104436450 >> v1:172.21.15.26:6789/0 conn(0x7f35b8073710 legacy=0x7f35b80ca030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.850+0000 7f35bdd93640 1 -- 172.21.15.26:0/3104436450 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b806d190 con 0x7f35b8073af0 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7f35bdd93640 1 --2- 172.21.15.26:0/3104436450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b80ca830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009d90 tx=0x7f35b001c820 comp rx=0 tx=0).ready entity=mon.2 client_cookie=f22ec84972074c4d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 --> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8b20076440 con 0x7f8b0c071bc0 2024-04-23T10:13:01.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7f8b1effd640 1 -- 172.21.15.26:0/915946518 <== osd.5 v2:172.21.15.190:6800/228505156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8b20076440 con 0x7f8b0c071bc0 2024-04-23T10:13:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7f8b0c071bc0 msgr2=0x7f8b0c074000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.854+0000 7f8b286b4640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7f8b0c071bc0 0x7f8b0c074000 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35affff640 1 -- 172.21.15.26:0/3104436450 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00b2070 con 0x7f35b8073af0 2024-04-23T10:13:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35affff640 1 -- 172.21.15.26:0/3104436450 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35b00a5820 con 0x7f35b8073af0 2024-04-23T10:13:01.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35affff640 1 -- 172.21.15.26:0/3104436450 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35b00a5bf0 con 0x7f35b8073af0 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8b0c068450 msgr2=0x7f8b0c06a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8b0c068450 0x7f8b0c06a910 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7f8b140ad000 tx=0x7f8b140a6000 comp rx=0 tx=0).stop 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 msgr2=0x7f8b20143b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 --2- 172.21.15.26:0/915946518 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b200ccc20 0x7f8b20143b00 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f8b1000ba10 tx=0x7f8b1000bed0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b26c51640 1 -- 172.21.15.26:0/915946518 reap_dead start 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 shutdown_connections 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 >> 172.21.15.26:0/915946518 conn(0x7f8b2006d9c0 msgr2=0x7f8b201562a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- 172.21.15.26:0/3104436450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 msgr2=0x7f35b80ca830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 --2- 172.21.15.26:0/3104436450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b80ca830 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f35b0009d90 tx=0x7f35b001c820 comp rx=0 tx=0).stop 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- 172.21.15.26:0/3104436450 shutdown_connections 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 --2- 172.21.15.26:0/3104436450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b80ca830 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 --2- 172.21.15.26:0/3104436450 >> v2:172.21.15.190:3300/0 conn(0x7f35b815f3d0 0x7f35b80c9050 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- 172.21.15.26:0/3104436450 >> 172.21.15.26:0/3104436450 conn(0x7f35b806f4a0 msgr2=0x7f35b8070df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 --> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f6974002de0 con 0x7f6980071af0 2024-04-23T10:13:01.877 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:01.877 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T10:13:01.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- 172.21.15.26:0/3104436450 shutdown_connections 2024-04-23T10:13:01.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- 172.21.15.26:0/3104436450 wait complete. 2024-04-23T10:13:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f697b7fe640 1 -- 172.21.15.26:0/2698514009 <== osd.1 v2:172.21.15.26:6816/1500743666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f6974002de0 con 0x7f6980071af0 2024-04-23T10:13:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7f6980071af0 msgr2=0x7f6980073f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7f6980071af0 0x7f6980073f30 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6980068380 msgr2=0x7f698006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6980068380 0x7f698006a840 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f69880ad000 tx=0x7f69880a6000 comp rx=0 tx=0).stop 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 msgr2=0x7f6994155cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 --2- 172.21.15.26:0/2698514009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f699415e8b0 0x7f6994155cf0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f698c00e480 tx=0x7f698c00e880 comp rx=0 tx=0).stop 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69937fe640 1 -- 172.21.15.26:0/2698514009 reap_dead start 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 shutdown_connections 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 >> 172.21.15.26:0/2698514009 conn(0x7f699406d7c0 msgr2=0x7f699415ed00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 shutdown_connections 2024-04-23T10:13:01.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 shutdown_connections 2024-04-23T10:13:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f69996a3640 1 -- 172.21.15.26:0/2698514009 wait complete. 2024-04-23T10:13:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f8b286b4640 1 -- 172.21.15.26:0/915946518 wait complete. 2024-04-23T10:13:01.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 Processor -- start 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.858+0000 7f35be594640 1 -- start start 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 0x7f35b8143f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b8160530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b815f3d0 0x7f35b8145040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35b80c55c0 con 0x7f35b8073710 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35b806d470 con 0x7f35b815f3d0 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35b80c5740 con 0x7f35b8073af0 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 --> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f9e281f91f0 con 0x7f9e14071aa0 2024-04-23T10:13:01.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 0x7f35b8143f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 0x7f35b8143f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50282/0 (socket says 172.21.15.26:50282) 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 -- 172.21.15.26:0/29708021 learned_addr learned my addr 172.21.15.26:0/29708021 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e257fa640 1 -- 172.21.15.26:0/1497742736 <== osd.3 v2:172.21.15.26:6800/451500618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f9e1c008d60 con 0x7f9e14071aa0 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bcd91640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b8160530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bdd93640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b815f3d0 0x7f35b8145040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 -- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 msgr2=0x7f35b8160530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35b8073af0 0x7f35b8160530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 -- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b815f3d0 msgr2=0x7f35b8145040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35b815f3d0 0x7f35b8145040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35b80c86c0 con 0x7f35b8073710 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35bd592640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 0x7f35b8143f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009ec0 tx=0x7f35a800c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a8019070 con 0x7f35b8073710 2024-04-23T10:13:01.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35a8007af0 con 0x7f35b8073710 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35b8143540 con 0x7f35b8073710 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35a800ce10 con 0x7f35b8073710 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35b80c8100 con 0x7f35b8073710 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f9e14071aa0 msgr2=0x7f9e14073ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f9e14071aa0 0x7f9e14073ee0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e140683b0 msgr2=0x7f9e1406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e140683b0 0x7f9e1406a870 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f9e200b2000 tx=0x7f9e20009040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 msgr2=0x7f9e280ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 --2- 172.21.15.26:0/1497742736 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e280c5900 0x7f9e280ca500 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f9e1800e7d0 tx=0x7f9e1800ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2d67f640 1 -- 172.21.15.26:0/1497742736 reap_dead start 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 shutdown_connections 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 >> 172.21.15.26:0/1497742736 conn(0x7f9e280c9050 msgr2=0x7f9e2814f5f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 shutdown_connections 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f9e2f0e2640 1 -- 172.21.15.26:0/1497742736 wait complete. 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 --> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f4598048310 con 0x7f458c072060 2024-04-23T10:13:01.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f35b80c7bd0 con 0x7f35b8073710 2024-04-23T10:13:01.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.862+0000 7f45967fc640 1 -- 172.21.15.26:0/913388779 <== osd.4 v2:172.21.15.190:6817/3258213114 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f45a0076440 con 0x7f458c072060 2024-04-23T10:13:01.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35a801c070 con 0x7f35b8073710 2024-04-23T10:13:01.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f359c068380 0x7f359c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f458c072060 msgr2=0x7f458c0744a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f458c072060 0x7f458c0744a0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c068970 msgr2=0x7f458c06ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c068970 0x7f458c06ae30 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f45900011f0 tx=0x7f4590009040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459804b300 msgr2=0x7f45980da030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 --2- 172.21.15.26:0/913388779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f459804b300 0x7f45980da030 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f459c0ab000 tx=0x7f459c01ab50 comp rx=0 tx=0).stop 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6749640 1 -- 172.21.15.26:0/913388779 reap_dead start 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 shutdown_connections 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 >> 172.21.15.26:0/913388779 conn(0x7f4598050190 msgr2=0x7f45980cf040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 shutdown_connections 2024-04-23T10:13:01.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f45a6f4a640 1 -- 172.21.15.26:0/913388779 wait complete. 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f35a8056de0 con 0x7f35b8073710 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35bcd91640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f359c068380 0x7f359c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f359c071a00 0x7f359c073e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f35a8012e50 con 0x7f359c071a00 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=24) ==== 24+0+0 (secure 0 0 0) 0x7f35a8054fe0 con 0x7f35b8073710 2024-04-23T10:13:01.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35bdd93640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f359c071a00 0x7f359c073e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:01.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35bcd91640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f359c068380 0x7f359c06a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35b806dc10 tx=0x7f35b4008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.866+0000 7f35bdd93640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f359c071a00 0x7f359c073e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:01.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.870+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== osd.7 v2:172.21.15.190:6816/2532942072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f35a8012e50 con 0x7f359c071a00 2024-04-23T10:13:01.889 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:01.890 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T10:13:01.890 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:01.891 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T10:13:01.892 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:01.892 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T10:13:01.894 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:01.895 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T10:13:01.895 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:01.896 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T10:13:01.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.894+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 --> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f35b80c7bd0 con 0x7f359c071a00 2024-04-23T10:13:01.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.894+0000 7f35adffb640 1 -- 172.21.15.26:0/29708021 <== osd.7 v2:172.21.15.190:6816/2532942072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f35b80c7bd0 con 0x7f359c071a00 2024-04-23T10:13:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f359c071a00 msgr2=0x7f359c073e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f359c071a00 0x7f359c073e40 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f359c068380 msgr2=0x7f359c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f359c068380 0x7f359c06a840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f35b806dc10 tx=0x7f35b4008040 comp rx=0 tx=0).stop 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 msgr2=0x7f35b8143f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 --2- 172.21.15.26:0/29708021 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35b8073710 0x7f35b8143f00 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f35a8009ec0 tx=0x7f35a800c430 comp rx=0 tx=0).stop 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35bdd93640 1 -- 172.21.15.26:0/29708021 reap_dead start 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 shutdown_connections 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 >> 172.21.15.26:0/29708021 conn(0x7f35b806f4a0 msgr2=0x7f35b815c890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 shutdown_connections 2024-04-23T10:13:01.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:01.898+0000 7f35be594640 1 -- 172.21.15.26:0/29708021 wait complete. 2024-04-23T10:13:01.918 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:01.918 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T10:13:02.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 Processor -- start 2024-04-23T10:13:02.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 -- start start 2024-04-23T10:13:02.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 0x7efd8c0c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efd8c157100 0x7efd8c072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efd8c071a50 con 0x7efd8c072a50 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c0c77e0 con 0x7efd8c1512d0 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd91958640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efd8c0c7ac0 con 0x7efd8c157100 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efd8c072a50 0x7efd8c070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57548/0 (socket says 172.21.15.26:57548) 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8b7fe640 1 -- 172.21.15.26:0/4360276 learned_addr learned my addr 172.21.15.26:0/4360276 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/4360276 >> v2:172.21.15.190:3300/0 conn(0x7efd8c157100 0x7efd8c072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8affd640 1 --2- 172.21.15.26:0/4360276 >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 0x7efd8c0c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd89ffb640 1 -- 172.21.15.26:0/4360276 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2839020621 0 0) 0x7efd8c071a50 con 0x7efd8c072a50 2024-04-23T10:13:02.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd89ffb640 1 -- 172.21.15.26:0/4360276 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7efd74005740 con 0x7efd8c072a50 2024-04-23T10:13:02.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8a7fc640 1 -- 172.21.15.26:0/4360276 >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 msgr2=0x7efd8c0c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/4360276 >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 0x7efd8c0c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8a7fc640 1 -- 172.21.15.26:0/4360276 >> v1:172.21.15.26:6789/0 conn(0x7efd8c072a50 legacy=0x7efd8c070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.050+0000 7efd8a7fc640 1 -- 172.21.15.26:0/4360276 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c0c7da0 con 0x7efd8c157100 2024-04-23T10:13:02.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd8affd640 1 --2- 172.21.15.26:0/4360276 >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 0x7efd8c0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/4360276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c157100 0x7efd8c072510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c6c10 tx=0x7efd8401c970 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1baf76a2ca70611 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd89ffb640 1 -- 172.21.15.26:0/4360276 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840b2070 con 0x7efd8c157100 2024-04-23T10:13:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd89ffb640 1 -- 172.21.15.26:0/4360276 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd840a5a30 con 0x7efd8c157100 2024-04-23T10:13:02.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd89ffb640 1 -- 172.21.15.26:0/4360276 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd840a5de0 con 0x7efd8c157100 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd91958640 1 -- 172.21.15.26:0/4360276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c157100 msgr2=0x7efd8c072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.054+0000 7efd91958640 1 --2- 172.21.15.26:0/4360276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c157100 0x7efd8c072510 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7efd8c0c6c10 tx=0x7efd8401c970 comp rx=0 tx=0).stop 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- 172.21.15.26:0/4360276 shutdown_connections 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 --2- 172.21.15.26:0/4360276 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c157100 0x7efd8c072510 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 --2- 172.21.15.26:0/4360276 >> v2:172.21.15.26:3300/0 conn(0x7efd8c1512d0 0x7efd8c0c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- 172.21.15.26:0/4360276 >> 172.21.15.26:0/4360276 conn(0x7efd8c0c9050 msgr2=0x7efd8c0c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- 172.21.15.26:0/4360276 shutdown_connections 2024-04-23T10:13:02.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- 172.21.15.26:0/4360276 wait complete. 2024-04-23T10:13:02.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 Processor -- start 2024-04-23T10:13:02.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- start start 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c1512d0 0x7efd8c1e90c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd8c157100 0x7efd8c14dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c06e710 con 0x7efd8c072a50 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efd8c06e590 con 0x7efd8c1512d0 2024-04-23T10:13:02.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd91958640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efd8c0c8c30 con 0x7efd8c157100 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.058+0000 7efd8affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50300/0 (socket says 172.21.15.26:50300) 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c1512d0 0x7efd8c1e90c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 -- 172.21.15.26:0/2091246768 learned_addr learned my addr 172.21.15.26:0/2091246768 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8b7fe640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd8c157100 0x7efd8c14dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 -- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd8c157100 msgr2=0x7efd8c14dd10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd8c157100 0x7efd8c14dd10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 -- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c1512d0 msgr2=0x7efd8c1e90c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c1512d0 0x7efd8c1e90c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 -- 172.21.15.26:0/2091246768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efd8c1f3b30 con 0x7efd8c072a50 2024-04-23T10:13:02.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.062+0000 7efd8affd640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c7f0 tx=0x7efd7c00ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c015070 con 0x7efd8c072a50 2024-04-23T10:13:02.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efd7c007820 con 0x7efd8c072a50 2024-04-23T10:13:02.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd91958640 1 -- 172.21.15.26:0/2091246768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efd8c204130 con 0x7efd8c072a50 2024-04-23T10:13:02.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd91958640 1 -- 172.21.15.26:0/2091246768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efd8c2046d0 con 0x7efd8c072a50 2024-04-23T10:13:02.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efd7c007c10 con 0x7efd8c072a50 2024-04-23T10:13:02.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd91958640 1 -- 172.21.15.26:0/2091246768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efd6c0052a0 con 0x7efd8c072a50 2024-04-23T10:13:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efd7c018070 con 0x7efd8c072a50 2024-04-23T10:13:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7f1bb75b8640 1 Processor -- start 2024-04-23T10:13:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 0x7efd7806a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efd7c086aa0 con 0x7efd8c072a50 2024-04-23T10:13:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 0x7efd7806a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.066+0000 7f1bb75b8640 1 -- start start 2024-04-23T10:13:02.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 Processor -- start 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 -- start start 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb75b8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1bb00c9b70 0x7f1bb0151240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb75b8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb0071a50 con 0x7f1bb0072510 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb75b8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1bb00c77e0 con 0x7f1bb0157100 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb75b8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1bb00c7ac0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5b55640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1bb0072510 0x7f1bb0070f60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57552/0 (socket says 172.21.15.26:57552) 2024-04-23T10:13:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5b55640 1 -- 172.21.15.26:0/622756403 learned_addr learned my addr 172.21.15.26:0/622756403 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5354640 1 --2- 172.21.15.26:0/622756403 >> v2:172.21.15.26:3300/0 conn(0x7f1bb00c9b70 0x7f1bb0151240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7efd8a7fc640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 0x7efd7806a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd840a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5354640 1 -- 172.21.15.26:0/622756403 >> v1:172.21.15.190:6789/0 conn(0x7f1bb0157100 legacy=0x7f1bb00c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5354640 1 -- 172.21.15.26:0/622756403 >> v1:172.21.15.26:6789/0 conn(0x7f1bb0072510 legacy=0x7f1bb0070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1ba7fff640 1 -- 172.21.15.26:0/622756403 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 361591843 0 0) 0x7f1bb00c77e0 con 0x7f1bb0157100 2024-04-23T10:13:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f1bb5354640 1 -- 172.21.15.26:0/622756403 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb00c7da0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711c152ec0 0x7f711c073b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7fe84359e640 1 Processor -- start 2024-04-23T10:13:02.071 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7fe84359e640 1 -- start start 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f711c159730 0x7f711c0c5a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711c152ec0 0x7f711c073b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f711c074190 con 0x7f711c0c5fb0 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f711c0c7690 con 0x7f711c152ec0 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f71224c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f711c15c2a0 con 0x7f711c159730 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f711c152ec0 0x7f711c073b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50316/0 (socket says 172.21.15.26:50316) 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 -- 172.21.15.26:0/2810183101 learned_addr learned my addr 172.21.15.26:0/2810183101 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 -- 172.21.15.26:0/2810183101 >> v2:172.21.15.190:3300/0 conn(0x7f711c159730 msgr2=0x7f711c0c5a70 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 --2- 172.21.15.26:0/2810183101 >> v2:172.21.15.190:3300/0 conn(0x7f711c159730 0x7f711c0c5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 -- 172.21.15.26:0/2810183101 >> v1:172.21.15.26:6789/0 conn(0x7f711c0c5fb0 legacy=0x7f711c0c7ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7f711bfff640 1 -- 172.21.15.26:0/2810183101 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c15c580 con 0x7f711c152ec0 2024-04-23T10:13:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7fe84359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 0x7fe8440c95d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7fe84259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe844151110 0x7fe8440c3ac0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57570/0 (socket says 172.21.15.26:57570) 2024-04-23T10:13:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.070+0000 7fe84259c640 1 -- 172.21.15.26:0/768661538 learned_addr learned my addr 172.21.15.26:0/768661538 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:02.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe84359e640 1 --2- 172.21.15.26:0/768661538 >> v2:172.21.15.190:3300/0 conn(0x7fe84406f640 0x7fe8440c9b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 Processor -- start 2024-04-23T10:13:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 -- start start 2024-04-23T10:13:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe841d9b640 1 --2- 172.21.15.26:0/768661538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 0x7fe8440c95d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8440c41d0 con 0x7fe844151110 2024-04-23T10:13:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe842d9d640 1 --2- 172.21.15.26:0/768661538 >> v2:172.21.15.190:3300/0 conn(0x7fe84406f640 0x7fe8440c9b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe84415a7e0 con 0x7fe84406f640 2024-04-23T10:13:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe844156f50 con 0x7fe8440c88e0 2024-04-23T10:13:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7f1bb5354640 1 --2- 172.21.15.26:0/622756403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb00c9b70 0x7f1bb0151240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097c0 tx=0x7f1bac01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ff6e4c75c7065441 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 Processor -- start 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe3440c7c40 0x7fe3440c8070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34406f6b0 con 0x7fe344150ed0 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34406bbe0 con 0x7fe34406f040 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34359e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe3440c3e00 con 0x7fe3440c7c40 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe344150ed0 0x7fe3441577c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57580/0 (socket says 172.21.15.26:57580) 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe34259c640 1 -- 172.21.15.26:0/1181988236 learned_addr learned my addr 172.21.15.26:0/1181988236 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe342d9d640 1 --2- 172.21.15.26:0/1181988236 >> v2:172.21.15.26:3300/0 conn(0x7fe3440c7c40 0x7fe3440c8070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 -- start start 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fead4155410 0x7fead40c9b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fead406e590 0x7fead40c7ad0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fead4071000 con 0x7fead415ef00 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fead40c8010 con 0x7fead4155410 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fead9a44640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fead40712e0 con 0x7fead406e590 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe342d9d640 1 -- 172.21.15.26:0/1181988236 >> v1:172.21.15.190:6789/0 conn(0x7fe34406f040 legacy=0x7fe3440c36f0 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe342d9d640 1 -- 172.21.15.26:0/1181988236 >> v1:172.21.15.26:6789/0 conn(0x7fe344150ed0 legacy=0x7fe3441577c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe342d9d640 1 -- 172.21.15.26:0/1181988236 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34406bec0 con 0x7fe3440c7c40 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe841d9b640 1 -- 172.21.15.26:0/768661538 >> v2:172.21.15.190:3300/0 conn(0x7fe84406f640 msgr2=0x7fe8440c9b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe841d9b640 1 --2- 172.21.15.26:0/768661538 >> v2:172.21.15.190:3300/0 conn(0x7fe84406f640 0x7fe8440c9b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe841d9b640 1 -- 172.21.15.26:0/768661538 >> v1:172.21.15.26:6789/0 conn(0x7fe844151110 legacy=0x7fe8440c3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.074+0000 7fe841d9b640 1 -- 172.21.15.26:0/768661538 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441514f0 con 0x7fe8440c88e0 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fead4155410 0x7fead40c9b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f711bfff640 1 --2- 172.21.15.26:0/2810183101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c152ec0 0x7f711c073b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f711c074740 tx=0x7f710401ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=349e6b0bc692cebe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fead4155410 0x7fead40c9b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50336/0 (socket says 172.21.15.26:50336) 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 -- 172.21.15.26:0/70842828 learned_addr learned my addr 172.21.15.26:0/70842828 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead27fc640 1 --2- 172.21.15.26:0/70842828 >> v2:172.21.15.190:3300/0 conn(0x7fead406e590 0x7fead40c7ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 -- 172.21.15.26:0/70842828 >> v2:172.21.15.190:3300/0 conn(0x7fead406e590 msgr2=0x7fead40c7ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 --2- 172.21.15.26:0/70842828 >> v2:172.21.15.190:3300/0 conn(0x7fead406e590 0x7fead40c7ad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 -- 172.21.15.26:0/70842828 >> v1:172.21.15.26:6789/0 conn(0x7fead415ef00 legacy=0x7fead4071970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fead2ffd640 1 -- 172.21.15.26:0/70842828 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead40715c0 con 0x7fead4155410 2024-04-23T10:13:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe841d9b640 1 --2- 172.21.15.26:0/768661538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 0x7fe8440c95d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe83400a960 tx=0x7fe834021180 comp rx=0 tx=0).ready entity=mon.2 client_cookie=fc54e41fe14a2637 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1ba7fff640 1 -- 172.21.15.26:0/622756403 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0b5070 con 0x7f1bb00c9b70 2024-04-23T10:13:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efd7c0567f0 con 0x7efd8c072a50 2024-04-23T10:13:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1ba7fff640 1 -- 172.21.15.26:0/622756403 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bac0a8990 con 0x7f1bb00c9b70 2024-04-23T10:13:02.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1ba7fff640 1 -- 172.21.15.26:0/622756403 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1bac0a8d60 con 0x7f1bb00c9b70 2024-04-23T10:13:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe342d9d640 1 --2- 172.21.15.26:0/1181988236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe3440c8070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00be90 tx=0x7fe33c021220 comp rx=0 tx=0).ready entity=mon.0 client_cookie=786e476bbe6eacff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f711b7fe640 1 -- 172.21.15.26:0/2810183101 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f71040b5070 con 0x7f711c152ec0 2024-04-23T10:13:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 -- 172.21.15.26:0/622756403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb00c9b70 msgr2=0x7f1bb0151240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 --2- 172.21.15.26:0/622756403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb00c9b70 0x7f1bb0151240 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0097c0 tx=0x7f1bac01ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:02.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 -- 172.21.15.26:0/622756403 shutdown_connections 2024-04-23T10:13:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 --2- 172.21.15.26:0/622756403 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb00c9b70 0x7f1bb0151240 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 -- 172.21.15.26:0/622756403 >> 172.21.15.26:0/622756403 conn(0x7f1bb00c9050 msgr2=0x7f1bb00c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84159a640 1 -- 172.21.15.26:0/768661538 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8340b6070 con 0x7fe8440c88e0 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f711b7fe640 1 -- 172.21.15.26:0/2810183101 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f71040a8a30 con 0x7f711c152ec0 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 -- 172.21.15.26:0/2810183101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c152ec0 msgr2=0x7f711c073b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 --2- 172.21.15.26:0/2810183101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c152ec0 0x7f711c073b30 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f711c074740 tx=0x7f710401ed30 comp rx=0 tx=0).stop 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 -- 172.21.15.26:0/2810183101 shutdown_connections 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 --2- 172.21.15.26:0/2810183101 >> v2:172.21.15.190:3300/0 conn(0x7f711c159730 0x7f711c0c5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 --2- 172.21.15.26:0/2810183101 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c152ec0 0x7f711c073b30 secure :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f711c074740 tx=0x7f710401ed30 comp rx=0 tx=0).stop 2024-04-23T10:13:02.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 -- 172.21.15.26:0/2810183101 >> 172.21.15.26:0/2810183101 conn(0x7f711c0676a0 msgr2=0x7f711c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84159a640 1 -- 172.21.15.26:0/768661538 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8340b1600 con 0x7fe8440c88e0 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84159a640 1 -- 172.21.15.26:0/768661538 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83400b040 con 0x7fe8440c88e0 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 msgr2=0x7fe8440c95d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 --2- 172.21.15.26:0/768661538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 0x7fe8440c95d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe83400a960 tx=0x7fe834021180 comp rx=0 tx=0).stop 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 shutdown_connections 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 --2- 172.21.15.26:0/768661538 >> v2:172.21.15.190:3300/0 conn(0x7fe84406f640 0x7fe8440c9b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 --2- 172.21.15.26:0/768661538 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8440c88e0 0x7fe8440c95d0 secure :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7fe83400a960 tx=0x7fe834021180 comp rx=0 tx=0).stop 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 >> 172.21.15.26:0/768661538 conn(0x7fe84406eb20 msgr2=0x7fe84406ef30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 -- 172.21.15.26:0/622756403 shutdown_connections 2024-04-23T10:13:02.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 -- 172.21.15.26:0/2810183101 shutdown_connections 2024-04-23T10:13:02.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 shutdown_connections 2024-04-23T10:13:02.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f71224c4640 1 -- 172.21.15.26:0/2810183101 wait complete. 2024-04-23T10:13:02.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7f1bb75b8640 1 -- 172.21.15.26:0/622756403 wait complete. 2024-04-23T10:13:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 Processor -- start 2024-04-23T10:13:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.078+0000 7fe84359e640 1 -- 172.21.15.26:0/768661538 wait complete. 2024-04-23T10:13:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 Processor -- start 2024-04-23T10:13:02.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 Processor -- start 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 -- start start 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 -- start start 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb0072510 0x7f1bb0201c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 0x7fe844159c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe844151110 0x7fe8440c2990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe84415b040 con 0x7fe844151110 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe84415ad60 con 0x7fe84406f640 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84359e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe84415b320 con 0x7fe8441f5840 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bb0157100 0x7f1bb01f0230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0151780 con 0x7f1bb0072510 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1bb0071ff0 con 0x7f1bb0157100 2024-04-23T10:13:02.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb75b8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1bb006e590 con 0x7f1bb00c9b70 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 -- start start 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 0x7f711c1ed760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 0x7f711c14e8a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 0x7f711c149330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f711c15ce20 con 0x7f711c148e80 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f711c15cb40 con 0x7f711c159730 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f71224c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f711c159b50 con 0x7f711c0c5fb0 2024-04-23T10:13:02.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fead2ffd640 1 --2- 172.21.15.26:0/70842828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4155410 0x7fead40c9b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fead40681c0 tx=0x7feac401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb92dd68dfc48f8a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe34159a640 1 -- 172.21.15.26:0/1181988236 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0b8070 con 0x7fe3440c7c40 2024-04-23T10:13:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe34159a640 1 -- 172.21.15.26:0/1181988236 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c0b3410 con 0x7fe3440c7c40 2024-04-23T10:13:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe34159a640 1 -- 172.21.15.26:0/1181988236 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0b37e0 con 0x7fe3440c7c40 2024-04-23T10:13:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe842d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe842d9d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55736/0 (socket says 172.21.15.26:55736) 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe842d9d640 1 -- 172.21.15.26:0/1172070478 learned_addr learned my addr 172.21.15.26:0/1172070478 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 0x7fe844159c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55724/0 (socket says 172.21.15.26:55724) 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 -- 172.21.15.26:0/485710154 learned_addr learned my addr 172.21.15.26:0/485710154 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb5b55640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bb0157100 0x7f1bb01f0230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fead1ffb640 1 -- 172.21.15.26:0/70842828 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac40b0070 con 0x7fead4155410 2024-04-23T10:13:02.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f7113fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 0x7f711c14e8a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f7113fff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 0x7f711c14e8a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:40648/0 (socket says 172.21.15.26:40648) 2024-04-23T10:13:02.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fead1ffb640 1 -- 172.21.15.26:0/70842828 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac40ab600 con 0x7fead4155410 2024-04-23T10:13:02.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fead1ffb640 1 -- 172.21.15.26:0/70842828 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac40ab9d0 con 0x7fead4155410 2024-04-23T10:13:02.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f7113fff640 1 -- 172.21.15.26:0/1937222204 learned_addr learned my addr 172.21.15.26:0/1937222204 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb5354640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb0072510 0x7f1bb0201c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe841d9b640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe844151110 0x7fe8440c2990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f7120a61640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 0x7f711c149330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 -- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 msgr2=0x7fe8441f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 -- 172.21.15.26:0/1172070478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe844151110 msgr2=0x7fe8440c2990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe844151110 0x7fe8440c2990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7fe84259c640 1 -- 172.21.15.26:0/1172070478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8441f8ab0 con 0x7fe84406f640 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 -- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bb0157100 msgr2=0x7f1bb01f0230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bb0157100 0x7f1bb01f0230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 -- 172.21.15.26:0/485710154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb0072510 msgr2=0x7f1bb0201c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb0072510 0x7f1bb0201c10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.082+0000 7f1bb4b53640 1 -- 172.21.15.26:0/485710154 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1bb01ef880 con 0x7f1bb00c9b70 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- 172.21.15.26:0/1181988236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 msgr2=0x7fe3440c8070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 --2- 172.21.15.26:0/1181988236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe3440c8070 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7fe33c00be90 tx=0x7fe33c021220 comp rx=0 tx=0).stop 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- 172.21.15.26:0/1181988236 shutdown_connections 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 --2- 172.21.15.26:0/1181988236 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe3440c8070 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- 172.21.15.26:0/1181988236 >> 172.21.15.26:0/1181988236 conn(0x7fe34406e0d0 msgr2=0x7fe34406e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- 172.21.15.26:0/1181988236 shutdown_connections 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- 172.21.15.26:0/1181988236 wait complete. 2024-04-23T10:13:02.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe84259c640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 0x7fe844159c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe83c001a30 tx=0x7fe83c001ef0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- 172.21.15.26:0/70842828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4155410 msgr2=0x7fead40c9b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 --2- 172.21.15.26:0/70842828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4155410 0x7fead40c9b70 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7fead40681c0 tx=0x7feac401c4e0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe842d9d640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- 172.21.15.26:0/70842828 shutdown_connections 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 --2- 172.21.15.26:0/70842828 >> v2:172.21.15.190:3300/0 conn(0x7fead406e590 0x7fead40c7ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 --2- 172.21.15.26:0/70842828 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead4155410 0x7fead40c9b70 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- 172.21.15.26:0/70842828 >> 172.21.15.26:0/70842828 conn(0x7fead40c9050 msgr2=0x7fead40c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1bb4b53640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000c440 tx=0x7f1ba000c900 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f711bfff640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 0x7f711c1ed760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 -- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 msgr2=0x7f711c1ed760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 0x7f711c1ed760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 -- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 msgr2=0x7f711c14e8a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 0x7f711c14e8a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 -- 172.21.15.26:0/1937222204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f711c149870 con 0x7f711c148e80 2024-04-23T10:13:02.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- 172.21.15.26:0/70842828 shutdown_connections 2024-04-23T10:13:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f711bfff640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 0x7f711c1ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c018070 con 0x7fe84406f640 2024-04-23T10:13:02.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0017070 con 0x7f1bb00c9b70 2024-04-23T10:13:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe83c0082d0 con 0x7fe84406f640 2024-04-23T10:13:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe83c00d8c0 con 0x7fe84406f640 2024-04-23T10:13:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f7120a61640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 0x7f711c149330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f711c074360 tx=0x7f711400cb90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1bb75b8640 1 -- 172.21.15.26:0/485710154 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1bb01efb40 con 0x7f1bb00c9b70 2024-04-23T10:13:02.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1bb75b8640 1 -- 172.21.15.26:0/485710154 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7f1bb01fdfe0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe84359e640 1 -- 172.21.15.26:0/1172070478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe8441f8d90 con 0x7fe84406f640 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ba00054e0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1ba0003890 con 0x7f1bb00c9b70 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 Processor -- start 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 -- start start 2024-04-23T10:13:02.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe84359e640 1 -- 172.21.15.26:0/1172070478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8441f9350 con 0x7fe84406f640 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114003ba0 con 0x7f711c148e80 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7114003d60 con 0x7f711c148e80 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7114005310 con 0x7f711c148e80 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- 172.21.15.26:0/70842828 wait complete. 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 Processor -- start 2024-04-23T10:13:02.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f711c14d110 con 0x7f711c148e80 2024-04-23T10:13:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 0x7fe344072c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe84359e640 1 -- 172.21.15.26:0/1172070478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe844076360 con 0x7fe84406f640 2024-04-23T10:13:02.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe34359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe34414c430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 -- start start 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead9a44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fead2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50372/0 (socket says 172.21.15.26:50372) 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 -- 172.21.15.26:0/2931179200 learned_addr learned my addr 172.21.15.26:0/2931179200 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7fe341d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe34414c430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe341d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe34414c430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50370/0 (socket says 172.21.15.26:50370) 2024-04-23T10:13:02.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead4155410 0x7fead42013f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 0x7fe344072c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe341d9b640 1 -- 172.21.15.26:0/2356572362 learned_addr learned my addr 172.21.15.26:0/2356572362 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead415ef00 0x7fead40cb800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe344150ed0 0x7fe344070f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fead4072080 con 0x7fead406e590 2024-04-23T10:13:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe34406c480 con 0x7fe3440c7c40 2024-04-23T10:13:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fead415f330 con 0x7fead4155410 2024-04-23T10:13:02.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fead4072200 con 0x7fead415ef00 2024-04-23T10:13:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe34406c9a0 con 0x7fe344150ed0 2024-04-23T10:13:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe3441e9770 con 0x7fe34406f040 2024-04-23T10:13:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 Processor -- start 2024-04-23T10:13:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 -- start start 2024-04-23T10:13:02.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f011c0f6c70 0x7f011c04c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c1002f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01237fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f011c007670 0x7f011c045300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57594/0 (socket says 172.21.15.26:57594) 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1ba001a070 con 0x7f1bb00c9b70 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1ba5ffb640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 0x7f1b9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f1ba0086030 con 0x7f1bb00c9b70 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01237fe640 1 -- 172.21.15.26:0/2315430556 learned_addr learned my addr 172.21.15.26:0/2315430556 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f0123fff640 1 --2- 172.21.15.26:0/2315430556 >> v2:172.21.15.190:3300/0 conn(0x7f011c0f6c70 0x7f011c04c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f012aa2b640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c1002f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011c04b690 con 0x7f011c007670 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f011c04c6f0 con 0x7f011c0f6c70 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.086+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f011c0071e0 con 0x7f011c0ffe60 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe342d9d640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe344150ed0 0x7fe344070f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 -- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead415ef00 msgr2=0x7fead40cb800 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead415ef00 0x7fead40cb800 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 -- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead4155410 msgr2=0x7fead42013f0 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:13:02.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead4155410 0x7fead42013f0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fead4201930 con 0x7fead406e590 2024-04-23T10:13:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1bb5354640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 0x7f1b9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1bb75b8640 1 -- 172.21.15.26:0/485710154 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b900052a0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead2ffd640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feac40190f0 tx=0x7feac4019280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f0123fff640 1 -- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 msgr2=0x7f011c1002f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f0123fff640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c1002f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f0123fff640 1 -- 172.21.15.26:0/2315430556 >> v1:172.21.15.26:6789/0 conn(0x7f011c007670 legacy=0x7f011c045300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f0123fff640 1 -- 172.21.15.26:0/2315430556 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c0f7050 con 0x7f011c0f6c70 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f71140054b0 con 0x7f711c148e80 2024-04-23T10:13:02.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 -- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe344150ed0 msgr2=0x7fe344070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe344150ed0 0x7fe344070f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 -- 172.21.15.26:0/2356572362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 msgr2=0x7fe34414c430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe34414c430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe83c01b070 con 0x7fe84406f640 2024-04-23T10:13:02.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe3440ca680 con 0x7fe34406f040 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f711c14cc40 con 0x7f711c148e80 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe832ffd640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 0x7fe82406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe83c086bc0 con 0x7fe84406f640 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac40b0050 con 0x7fead406e590 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feac40bb070 con 0x7fead406e590 2024-04-23T10:13:02.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feac40abe60 con 0x7fead406e590 2024-04-23T10:13:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe841d9b640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 0x7fe82406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f71197fa640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 0x7f70fc06a890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f1bb5354640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 0x7f1b9406a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0b2000 tx=0x7f1bac0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f711bfff640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 0x7f70fc06a890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe34259c640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 0x7fe344072c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c5b0 tx=0x7fe33400ca70 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7114053e80 con 0x7f711c148e80 2024-04-23T10:13:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fead415b5b0 con 0x7fead406e590 2024-04-23T10:13:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fead415bb70 con 0x7fead406e590 2024-04-23T10:13:02.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fe841d9b640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 0x7fe82406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8340b3000 tx=0x7fe8340ac000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f71127fc640 1 -- 172.21.15.26:0/1937222204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f70f40052a0 con 0x7f711c148e80 2024-04-23T10:13:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7f711bfff640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 0x7f70fc06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71040b2000 tx=0x7f71040aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.090+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feab40052a0 con 0x7fead406e590 2024-04-23T10:13:02.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7f0123fff640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c04c1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01180077b0 tx=0x7f0118020f40 comp rx=0 tx=0).ready entity=mon.1 client_cookie=e21d28bf484b3e48 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feac40b5810 con 0x7fead406e590 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7feabbfff640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 0x7feac006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feac4120bf0 con 0x7fead406e590 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7fead27fc640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 0x7feac006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.094+0000 7fead27fc640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 0x7feac006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feac8006fd0 tx=0x7feac8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f71140564e0 con 0x7f711c148e80 2024-04-23T10:13:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f0122ffd640 1 -- 172.21.15.26:0/2315430556 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180aac50 con 0x7f011c0f6c70 2024-04-23T10:13:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f0122ffd640 1 -- 172.21.15.26:0/2315430556 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f011800ae50 con 0x7f011c0f6c70 2024-04-23T10:13:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f0122ffd640 1 -- 172.21.15.26:0/2315430556 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180b23f0 con 0x7f011c0f6c70 2024-04-23T10:13:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe83c056890 con 0x7fe84406f640 2024-04-23T10:13:02.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 msgr2=0x7f011c04c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.102+0000 7f01297c9640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c04c1b0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f01180077b0 tx=0x7f0118020f40 comp rx=0 tx=0).stop 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33400e840 con 0x7fe34406f040 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe334008040 con 0x7fe34406f040 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33400ec20 con 0x7fe34406f040 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe3440ca960 con 0x7fe34406f040 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fe3441e9ca0 con 0x7fe34406f040 2024-04-23T10:13:02.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1ba0055bc0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 shutdown_connections 2024-04-23T10:13:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c1002f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 --2- 172.21.15.26:0/2315430556 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c04c1b0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 >> 172.21.15.26:0/2315430556 conn(0x7f011c050360 msgr2=0x7f011c050770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 shutdown_connections 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7f01297c9640 1 -- 172.21.15.26:0/2315430556 wait complete. 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe344076440 con 0x7fe34406f040 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe334038830 con 0x7fe34406f040 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 0x7fe32406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.106+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fe334086f30 con 0x7fe34406f040 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7fe341d9b640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 0x7fe32406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7fe341d9b640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 0x7fe32406a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3440c55d0 tx=0x7fe338008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 Processor -- start 2024-04-23T10:13:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 -- start start 2024-04-23T10:13:02.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feac40160d0 con 0x7fead406e590 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c0fda30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c0eb470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f011c006b90 con 0x7f011c007670 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f011c04b110 con 0x7f011c0f6c70 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f01297c9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f011c006e70 con 0x7f011c0ffe60 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50384/0 (socket says 172.21.15.26:50384) 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 -- 172.21.15.26:0/4289314420 learned_addr learned my addr 172.21.15.26:0/4289314420 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 -- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 msgr2=0x7f011c0eb470 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c0eb470 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 -- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 msgr2=0x7f011c0fda30 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c0fda30 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 -- 172.21.15.26:0/4289314420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f011c0e36e0 con 0x7f011c007670 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.110+0000 7f0123fff640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f011801eb70 tx=0x7f011801dce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180c3020 con 0x7f011c007670 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0118005ba0 con 0x7f011c007670 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f011c035ed0 con 0x7f011c007670 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f011c0361b0 con 0x7f011c007670 2024-04-23T10:13:02.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe334014030 con 0x7fe34406f040 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01180bb850 con 0x7f011c007670 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.118+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f01180bba30 con 0x7f011c007670 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.122+0000 7f0120ff9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 0x7f010806a970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.122+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f0118127f00 con 0x7f011c007670 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.122+0000 7f01237fe640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 0x7f010806a970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.122+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01040052a0 con 0x7f011c007670 2024-04-23T10:13:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.130+0000 7f01237fe640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 0x7f010806a970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ddcc0 tx=0x7f0110007a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.130+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f01180cd060 con 0x7f011c007670 2024-04-23T10:13:02.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 Processor -- start 2024-04-23T10:13:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 -- start start 2024-04-23T10:13:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c20151490 0x7f7c200c5aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c200c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7c2006c940 con 0x7f7c2015a760 2024-04-23T10:13:02.162 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7c2006c710 con 0x7f7c20151490 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c285ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c200c5610 con 0x7f7c200c39e0 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c20151490 0x7f7c200c5aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7c20151490 0x7f7c200c5aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50400/0 (socket says 172.21.15.26:50400) 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 -- 172.21.15.26:0/2878586878 learned_addr learned my addr 172.21.15.26:0/2878586878 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c25b48640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c200c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 -- 172.21.15.26:0/2878586878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 msgr2=0x7f7c200c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c200c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 -- 172.21.15.26:0/2878586878 >> v1:172.21.15.190:6789/0 conn(0x7f7c2015a760 legacy=0x7f7c2015abc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.162+0000 7f7c26349640 1 -- 172.21.15.26:0/2878586878 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c200c4ce0 con 0x7f7c20151490 2024-04-23T10:13:02.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c26349640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c20151490 0x7f7c200c5aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca23fcddd8d01202 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c25347640 1 -- 172.21.15.26:0/2878586878 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0b2070 con 0x7f7c20151490 2024-04-23T10:13:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c25347640 1 -- 172.21.15.26:0/2878586878 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c1c0a9070 con 0x7f7c20151490 2024-04-23T10:13:02.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c25347640 1 -- 172.21.15.26:0/2878586878 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c1c0ad880 con 0x7f7c20151490 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c285ad640 1 -- 172.21.15.26:0/2878586878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c20151490 msgr2=0x7f7c200c5aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.174+0000 7f7c285ad640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c20151490 0x7f7c200c5aa0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c009870 tx=0x7f7c1c01c560 comp rx=0 tx=0).stop 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- 172.21.15.26:0/2878586878 shutdown_connections 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c200c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 --2- 172.21.15.26:0/2878586878 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c20151490 0x7f7c200c5aa0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- 172.21.15.26:0/2878586878 >> 172.21.15.26:0/2878586878 conn(0x7f7c2006b9d0 msgr2=0x7f7c2006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- 172.21.15.26:0/2878586878 shutdown_connections 2024-04-23T10:13:02.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- 172.21.15.26:0/2878586878 wait complete. 2024-04-23T10:13:02.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 Processor -- start 2024-04-23T10:13:02.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- start start 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c20156f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20151490 0x7f7c20157450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7c20151870 con 0x7f7c2015a760 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7c200c7420 con 0x7f7c20151490 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c285ad640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7c200681d0 con 0x7f7c200c39e0 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c26b4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c26b4a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50404/0 (socket says 172.21.15.26:50404) 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c26b4a640 1 -- 172.21.15.26:0/1399026415 learned_addr learned my addr 172.21.15.26:0/1399026415 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:02.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.178+0000 7f7c26349640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c20156f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 -- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 msgr2=0x7f7c20156f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c20156f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 -- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20151490 msgr2=0x7f7c20157450 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20151490 0x7f7c20157450 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 -- 172.21.15.26:0/1399026415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7c20156a60 con 0x7f7c2015a760 2024-04-23T10:13:02.181 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.182+0000 7f7c26b4a640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c390 tx=0x7f7c1000c850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.190+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c100052d0 con 0x7f7c2015a760 2024-04-23T10:13:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.190+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7c20072dc0 con 0x7f7c2015a760 2024-04-23T10:13:02.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.190+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7c201f4600 con 0x7f7c2015a760 2024-04-23T10:13:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c10005470 con 0x7f7c2015a760 2024-04-23T10:13:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7c10007240 con 0x7f7c2015a760 2024-04-23T10:13:02.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7c100073e0 con 0x7f7c2015a760 2024-04-23T10:13:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c16ffd640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 0x7f7c0406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:02.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f7c100861d0 con 0x7f7c2015a760 2024-04-23T10:13:02.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c26349640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 0x7f7c0406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:02.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.194+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7c080052a0 con 0x7f7c2015a760 2024-04-23T10:13:02.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.198+0000 7f7c26349640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 0x7f7c0406a940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0af000 tx=0x7f7c1c0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:02.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.206+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7c10055de0 con 0x7f7c2015a760 2024-04-23T10:13:02.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.418+0000 7f1bb75b8640 1 -- 172.21.15.26:0/485710154 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f1b90005590 con 0x7f1bb00c9b70 2024-04-23T10:13:02.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.418+0000 7f1ba5ffb640 1 -- 172.21.15.26:0/485710154 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f1ba0059ec0 con 0x7f1bb00c9b70 2024-04-23T10:13:02.421 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2024-04-23T10:13:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 msgr2=0x7f1b9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 0x7f1b9406a840 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7f1bac0b2000 tx=0x7f1bac0aa070 comp rx=0 tx=0).stop 2024-04-23T10:13:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 msgr2=0x7f1bb01f4a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7f1ba000c440 tx=0x7f1ba000c900 comp rx=0 tx=0).stop 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 shutdown_connections 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1b94068380 0x7f1b9406a840 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1bb0157100 0x7f1bb01f0230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1bb00c9b70 0x7f1bb01f4a30 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 --2- 172.21.15.26:0/485710154 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1bb0072510 0x7f1bb0201c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 >> 172.21.15.26:0/485710154 conn(0x7f1bb00c9050 msgr2=0x7f1bb0150050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 shutdown_connections 2024-04-23T10:13:02.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.422+0000 7f1b9b7fe640 1 -- 172.21.15.26:0/485710154 wait complete. 2024-04-23T10:13:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.426+0000 7efd91958640 1 -- 172.21.15.26:0/2091246768 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efd6c005860 con 0x7efd8c072a50 2024-04-23T10:13:02.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.426+0000 7efd73fff640 1 -- 172.21.15.26:0/2091246768 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efd7c05aaf0 con 0x7efd8c072a50 2024-04-23T10:13:02.428 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 msgr2=0x7efd7806a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.429 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 0x7efd7806a890 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7efd840af000 tx=0x7efd840a7070 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 msgr2=0x7efd8c200f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7efd7c00c7f0 tx=0x7efd7c00ccb0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 shutdown_connections 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efd780683d0 0x7efd7806a890 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efd8c157100 0x7efd8c14dd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efd8c1512d0 0x7efd8c1e90c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 --2- 172.21.15.26:0/2091246768 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efd8c072a50 0x7efd8c200f20 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 >> 172.21.15.26:0/2091246768 conn(0x7efd8c0c9050 msgr2=0x7efd8c14f6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 shutdown_connections 2024-04-23T10:13:02.430 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.430+0000 7efd71ffb640 1 -- 172.21.15.26:0/2091246768 wait complete. 2024-04-23T10:13:02.443 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2024-04-23T10:13:02.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.434+0000 7f71127fc640 1 -- 172.21.15.26:0/1937222204 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f70f4005860 con 0x7f711c148e80 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.434+0000 7f71197fa640 1 -- 172.21.15.26:0/1937222204 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7114055de0 con 0x7f711c148e80 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 msgr2=0x7f70fc06a890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 0x7f70fc06a890 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7f71040b2000 tx=0x7f71040aa070 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 msgr2=0x7f711c149330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 0x7f711c149330 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f711c074360 tx=0x7f711400cb90 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 shutdown_connections 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f70fc0683d0 0x7f70fc06a890 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f711c148e80 0x7f711c149330 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f711c159730 0x7f711c14e8a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 --2- 172.21.15.26:0/1937222204 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f711c0c5fb0 0x7f711c1ed760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 >> 172.21.15.26:0/1937222204 conn(0x7f711c0676a0 msgr2=0x7f711c06cae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 shutdown_connections 2024-04-23T10:13:02.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.438+0000 7f71224c4640 1 -- 172.21.15.26:0/1937222204 wait complete. 2024-04-23T10:13:02.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.442+0000 7fe84359e640 1 -- 172.21.15.26:0/1172070478 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7fe84414a5c0 con 0x7fe84406f640 2024-04-23T10:13:02.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.446+0000 7fe832ffd640 1 -- 172.21.15.26:0/1172070478 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe83c05ab90 con 0x7fe84406f640 2024-04-23T10:13:02.448 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2024-04-23T10:13:02.449 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.6 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 msgr2=0x7fe82406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 0x7fe82406a840 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fe8340b3000 tx=0x7fe8340ac000 comp rx=0 tx=0).stop 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 msgr2=0x7fe844159c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 0x7fe844159c50 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7fe83c001a30 tx=0x7fe83c001ef0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 shutdown_connections 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe824068380 0x7fe82406a840 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8441f5840 0x7fe8441f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe844151110 0x7fe8440c2990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 --2- 172.21.15.26:0/1172070478 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe84406f640 0x7fe844159c50 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 >> 172.21.15.26:0/1172070478 conn(0x7fe84406eb20 msgr2=0x7fe844157330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 shutdown_connections 2024-04-23T10:13:02.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fe830ff9640 1 -- 172.21.15.26:0/1172070478 wait complete. 2024-04-23T10:13:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.450+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7feab4005590 con 0x7fead406e590 2024-04-23T10:13:02.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.454+0000 7feabbfff640 1 -- 172.21.15.26:0/2931179200 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feac40f0780 con 0x7fead406e590 2024-04-23T10:13:02.453 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:02.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.454+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 msgr2=0x7feac006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 0x7feac006a840 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7feac8006fd0 tx=0x7feac8008040 comp rx=0 tx=0).stop 2024-04-23T10:13:02.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 msgr2=0x7fead4204980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7feac40190f0 tx=0x7feac4019280 comp rx=0 tx=0).stop 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 shutdown_connections 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feac0068380 0x7feac006a840 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fead415ef00 0x7fead40cb800 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fead4155410 0x7fead42013f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 --2- 172.21.15.26:0/2931179200 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fead406e590 0x7fead4204980 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 >> 172.21.15.26:0/2931179200 conn(0x7fead40c9050 msgr2=0x7fead4153730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 shutdown_connections 2024-04-23T10:13:02.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.458+0000 7fead9a44640 1 -- 172.21.15.26:0/2931179200 wait complete. 2024-04-23T10:13:02.458 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.2 2024-04-23T10:13:02.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.462+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fe344157bc0 con 0x7fe34406f040 2024-04-23T10:13:02.462 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.0 2024-04-23T10:13:02.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.462+0000 7fe332ffd640 1 -- 172.21.15.26:0/2356572362 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fe334057290 con 0x7fe34406f040 2024-04-23T10:13:02.463 INFO:teuthology.orchestra.run.smithi026.stdout:55834574856 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 msgr2=0x7fe32406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 0x7fe32406a870 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7fe3440c55d0 tx=0x7fe338008040 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 msgr2=0x7fe344072c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 0x7fe344072c00 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7fe33400c5b0 tx=0x7fe33400ca70 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 shutdown_connections 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe3240683b0 0x7fe32406a870 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe344150ed0 0x7fe344070f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe3440c7c40 0x7fe34414c430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 --2- 172.21.15.26:0/2356572362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34406f040 0x7fe344072c00 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 >> 172.21.15.26:0/2356572362 conn(0x7fe34406e0d0 msgr2=0x7fe34406e4b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 shutdown_connections 2024-04-23T10:13:02.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7fe34359e640 1 -- 172.21.15.26:0/2356572362 wait complete. 2024-04-23T10:13:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f0104005590 con 0x7f011c007670 2024-04-23T10:13:02.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.466+0000 7f0120ff9640 1 -- 172.21.15.26:0/4289314420 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f011801aaa0 con 0x7f011c007670 2024-04-23T10:13:02.467 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:02.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 msgr2=0x7f010806a970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 0x7f010806a970 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f011c0ddcc0 tx=0x7f0110007a50 comp rx=0 tx=0).stop 2024-04-23T10:13:02.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 msgr2=0x7f011c0e3ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f011801eb70 tx=0x7f011801dce0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 shutdown_connections 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f01080684b0 0x7f010806a970 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f011c0ffe60 0x7f011c0eb470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f011c0f6c70 0x7f011c0fda30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 --2- 172.21.15.26:0/4289314420 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f011c007670 0x7f011c0e3ea0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 >> 172.21.15.26:0/4289314420 conn(0x7f011c050360 msgr2=0x7f011c0e5f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 shutdown_connections 2024-04-23T10:13:02.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.470+0000 7f01297c9640 1 -- 172.21.15.26:0/4289314420 wait complete. 2024-04-23T10:13:02.471 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.1 2024-04-23T10:13:02.486 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574856 for osd.5 2024-04-23T10:13:02.488 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.4 2024-04-23T10:13:02.490 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574858 for osd.3 2024-04-23T10:13:02.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.510+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7f7c08005590 con 0x7f7c2015a760 2024-04-23T10:13:02.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.510+0000 7f7c16ffd640 1 -- 172.21.15.26:0/1399026415 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7c1005a0e0 con 0x7f7c2015a760 2024-04-23T10:13:02.511 INFO:teuthology.orchestra.run.smithi026.stdout:55834574857 2024-04-23T10:13:02.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 msgr2=0x7f7c0406a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 0x7f7c0406a940 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f7c1c0af000 tx=0x7f7c1c0a7000 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 msgr2=0x7f7c20142ae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f7c1000c390 tx=0x7f7c1000c850 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 shutdown_connections 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7c04068480 0x7f7c0406a940 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7c2015a760 0x7f7c20142ae0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7c20151490 0x7f7c20157450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 --2- 172.21.15.26:0/1399026415 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7c200c39e0 0x7f7c20156f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 >> 172.21.15.26:0/1399026415 conn(0x7f7c2006b9d0 msgr2=0x7f7c200cb580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 shutdown_connections 2024-04-23T10:13:02.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:02.514+0000 7f7c285ad640 1 -- 172.21.15.26:0/1399026415 wait complete. 2024-04-23T10:13:02.528 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574857 for osd.7 2024-04-23T10:13:03.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-23T10:13:03.459 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-23T10:13:03.463 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-23T10:13:03.473 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-23T10:13:03.488 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-23T10:13:03.489 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-23T10:13:03.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-23T10:13:03.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-23T10:13:03.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 Processor -- start 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 -- start start 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af81512d0 0x7f6af80c6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6af8157100 0x7f6af8072510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6af8071a50 con 0x7f6af8072a50 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6af80c77e0 con 0x7f6af8157100 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6b004c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6af80c7ac0 con 0x7f6af81512d0 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6af8157100 0x7f6af8072510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6af8157100 0x7f6af8072510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50406/0 (socket says 172.21.15.26:50406) 2024-04-23T10:13:03.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 -- 172.21.15.26:0/3207990088 learned_addr learned my addr 172.21.15.26:0/3207990088 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afe25d640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af81512d0 0x7f6af80c6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 -- 172.21.15.26:0/3207990088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af81512d0 msgr2=0x7f6af80c6f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af81512d0 0x7f6af80c6f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 -- 172.21.15.26:0/3207990088 >> v1:172.21.15.26:6789/0 conn(0x7f6af8072a50 legacy=0x7f6af8070f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.634+0000 7f6afda5c640 1 -- 172.21.15.26:0/3207990088 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af80c7da0 con 0x7f6af8157100 2024-04-23T10:13:03.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.638+0000 7f6afda5c640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8157100 0x7f6af8072510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d3c0 tx=0x7f6af001eda0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26198b1b1591b12f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6afd25b640 1 -- 172.21.15.26:0/3207990088 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af00ad070 con 0x7f6af8157100 2024-04-23T10:13:03.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6afd25b640 1 -- 172.21.15.26:0/3207990088 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af00a7e50 con 0x7f6af8157100 2024-04-23T10:13:03.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6afd25b640 1 -- 172.21.15.26:0/3207990088 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af000be60 con 0x7f6af8157100 2024-04-23T10:13:03.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 -- 172.21.15.26:0/3207990088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8157100 msgr2=0x7f6af8072510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8157100 0x7f6af8072510 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7f6af000d3c0 tx=0x7f6af001eda0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 -- 172.21.15.26:0/3207990088 shutdown_connections 2024-04-23T10:13:03.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8157100 0x7f6af8072510 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 --2- 172.21.15.26:0/3207990088 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af81512d0 0x7f6af80c6f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 -- 172.21.15.26:0/3207990088 >> 172.21.15.26:0/3207990088 conn(0x7f6af80c9050 msgr2=0x7f6af80c9460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 -- 172.21.15.26:0/3207990088 shutdown_connections 2024-04-23T10:13:03.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.646+0000 7f6b004c1640 1 -- 172.21.15.26:0/3207990088 wait complete. 2024-04-23T10:13:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 Processor -- start 2024-04-23T10:13:03.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 -- start start 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6af81512d0 0x7f6af81428a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af8157100 0x7f6af80cb4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6af806e710 con 0x7f6af8072a50 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6af806e590 con 0x7f6af81512d0 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6b004c1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6af80c8c30 con 0x7f6af8157100 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50416/0 (socket says 172.21.15.26:50416) 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 -- 172.21.15.26:0/3142280722 learned_addr learned my addr 172.21.15.26:0/3142280722 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afda5c640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6af81512d0 0x7f6af81428a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afea5e640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af8157100 0x7f6af80cb4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 -- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af8157100 msgr2=0x7f6af80cb4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af8157100 0x7f6af80cb4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 -- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6af81512d0 msgr2=0x7f6af81428a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6af81512d0 0x7f6af81428a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.650+0000 7f6afe25d640 1 -- 172.21.15.26:0/3142280722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6af815aee0 con 0x7f6af8072a50 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6afe25d640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6af400e930 tx=0x7f6af400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af4017070 con 0x7f6af8072a50 2024-04-23T10:13:03.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6b004c1640 1 -- 172.21.15.26:0/3142280722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6af81581f0 con 0x7f6af8072a50 2024-04-23T10:13:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6b004c1640 1 -- 172.21.15.26:0/3142280722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6af81584b0 con 0x7f6af8072a50 2024-04-23T10:13:03.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6af400c980 con 0x7f6af8072a50 2024-04-23T10:13:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6af400cd30 con 0x7f6af8072a50 2024-04-23T10:13:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6af401a070 con 0x7f6af8072a50 2024-04-23T10:13:03.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 0x7f6adc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.654+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6af4086ef0 con 0x7f6af8072a50 2024-04-23T10:13:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.658+0000 7f6b004c1640 1 -- 172.21.15.26:0/3142280722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ae00052a0 con 0x7f6af8072a50 2024-04-23T10:13:03.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.658+0000 7f6afda5c640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 0x7f6adc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.662+0000 7f6afda5c640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 0x7f6adc06a940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6af00b2000 tx=0x7f6af000a040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.666+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6af4056da0 con 0x7f6af8072a50 2024-04-23T10:13:03.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.674+0000 7fb359a60640 1 Processor -- start 2024-04-23T10:13:03.675 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.674+0000 7fb359a60640 1 -- start start 2024-04-23T10:13:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb359a60640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb34c0dd2c0 0x7fb34c0e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb358a5e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb34c0dd2c0 0x7fb34c0e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb359a60640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c04c690 con 0x7fb34c0e6c30 2024-04-23T10:13:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb359a60640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb34c0454e0 con 0x7fb34c0e71f0 2024-04-23T10:13:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb359a60640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb34c0457c0 con 0x7fb34c0dd2c0 2024-04-23T10:13:03.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb35925f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb34c0e6c30 0x7fb34c04ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57616/0 (socket says 172.21.15.26:57616) 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb35925f640 1 -- 172.21.15.26:0/401397591 learned_addr learned my addr 172.21.15.26:0/401397591 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2587752757 0 0) 0x7fb34c04c690 con 0x7fb34c0e6c30 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb344003530 con 0x7fb34c0e6c30 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 347487046 0 0) 0x7fb34c0454e0 con 0x7fb34c0e71f0 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c04c690 con 0x7fb34c0e71f0 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 436086301 0 0) 0x7fb344003530 con 0x7fb34c0e6c30 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 >> v2:172.21.15.26:3300/0 conn(0x7fb34c0dd2c0 msgr2=0x7fb34c0e66f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 --2- 172.21.15.26:0/401397591 >> v2:172.21.15.26:3300/0 conn(0x7fb34c0dd2c0 0x7fb34c0e66f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 >> v1:172.21.15.190:6789/0 conn(0x7fb34c0e71f0 legacy=0x7fb34c0462a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c045aa0 con 0x7fb34c0e6c30 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fb354050540 con 0x7fb34c0e6c30 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 >> v1:172.21.15.26:6789/0 conn(0x7fb34c0e6c30 legacy=0x7fb34c04ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344003bd0 0x7fb344003fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 0x7fb344004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3440051d0 0x7fb34400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0457c0 con 0x7fb344003bd0 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb34400bf70 con 0x7fb344004810 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb34400c170 con 0x7fb3440051d0 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb35925f640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3440051d0 0x7fb34400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 0x7fb344004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb358a5e640 1 --2- 172.21.15.26:0/401397591 >> v2:172.21.15.26:3300/0 conn(0x7fb34c0dd2c0 0x7fb34c0e66f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb358a5e640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344003bd0 0x7fb344003fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 Processor -- start 2024-04-23T10:13:03.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 -- start start 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3e7406ce30 0x7f3e740c8430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e7406ebf0 0x7f3e7406f060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e74074000 con 0x7f3e740c36f0 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7416b2a0 con 0x7f3e7406ebf0 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79f67640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3e7406d420 con 0x7f3e7406ce30 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e7406ebf0 0x7f3e7406f060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3e7406ebf0 0x7f3e7406f060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50440/0 (socket says 172.21.15.26:50440) 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 -- 172.21.15.26:0/3416713000 learned_addr learned my addr 172.21.15.26:0/3416713000 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e78f65640 1 --2- 172.21.15.26:0/3416713000 >> v2:172.21.15.190:3300/0 conn(0x7f3e7406ce30 0x7f3e740c8430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 -- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3440051d0 msgr2=0x7fb34400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3440051d0 0x7fb34400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 -- 172.21.15.26:0/401397591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344003bd0 msgr2=0x7fb344003fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344003bd0 0x7fb344003fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb353fff640 1 -- 172.21.15.26:0/401397591 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb344003530 con 0x7fb344004810 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb358a5e640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344003bd0 0x7fb344003fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb35925f640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3440051d0 0x7fb34400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.678+0000 7fb35925f640 1 -- 172.21.15.26:0/401397591 reap_dead start 2024-04-23T10:13:03.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7fb353fff640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 0x7fb344004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb340001820 tx=0x7fb34001eb50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9cee318a40369e0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 -- 172.21.15.26:0/3416713000 >> v2:172.21.15.190:3300/0 conn(0x7f3e7406ce30 msgr2=0x7f3e740c8430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 --2- 172.21.15.26:0/3416713000 >> v2:172.21.15.190:3300/0 conn(0x7f3e7406ce30 0x7f3e740c8430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 -- 172.21.15.26:0/3416713000 >> v1:172.21.15.190:6789/0 conn(0x7f3e740c36f0 legacy=0x7f3e7416b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7f3e79766640 1 -- 172.21.15.26:0/3416713000 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7406d700 con 0x7f3e7406ebf0 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340001440 con 0x7fb344004810 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3400052d0 con 0x7fb344004810 2024-04-23T10:13:03.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.682+0000 7fb3537fe640 1 -- 172.21.15.26:0/401397591 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb340007260 con 0x7fb344004810 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 Processor -- start 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 -- start start 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 msgr2=0x7fb344004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 0x7fb344004c90 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7fb340001820 tx=0x7fb34001eb50 comp rx=0 tx=0).stop 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- 172.21.15.26:0/401397591 shutdown_connections 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 --2- 172.21.15.26:0/401397591 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb344004810 0x7fb344004c90 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- 172.21.15.26:0/401397591 >> 172.21.15.26:0/401397591 conn(0x7fb34c050190 msgr2=0x7fb34c0505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf00723a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efcf00c8a10 0x7efcf00c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7efcf006d0b0 0x7efcf0151cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efcf006bd30 con 0x7efcf00c8a10 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7efcf006c010 con 0x7efcf006d0b0 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcf4b51640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efcf006c2f0 con 0x7efcf00c8630 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efcf00c8a10 0x7efcf00c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efcf00c8a10 0x7efcf00c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50446/0 (socket says 172.21.15.26:50446) 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 -- 172.21.15.26:0/1441422612 learned_addr learned my addr 172.21.15.26:0/1441422612 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcee59c640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf00723a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- 172.21.15.26:0/401397591 shutdown_connections 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79766640 1 --2- 172.21.15.26:0/3416713000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e7406f060 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e74070590 tx=0x7f3e6c01ed90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=278775c0be6a36fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efceed9d640 1 --2- 172.21.15.26:0/1441422612 >> v2:172.21.15.190:3300/0 conn(0x7efcf006d0b0 0x7efcf0151cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 -- 172.21.15.26:0/1441422612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 msgr2=0x7efcf00723a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf00723a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 -- 172.21.15.26:0/1441422612 >> v2:172.21.15.190:3300/0 conn(0x7efcf006d0b0 msgr2=0x7efcf0151cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 --2- 172.21.15.26:0/1441422612 >> v2:172.21.15.190:3300/0 conn(0x7efcf006d0b0 0x7efcf0151cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7efcedd9b640 1 -- 172.21.15.26:0/1441422612 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf006c5d0 con 0x7efcf00c8a10 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e737fe640 1 -- 172.21.15.26:0/3416713000 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0ad070 con 0x7f3e7406ebf0 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e737fe640 1 -- 172.21.15.26:0/3416713000 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c0a7c60 con 0x7f3e7406ebf0 2024-04-23T10:13:03.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e737fe640 1 -- 172.21.15.26:0/3416713000 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c00be60 con 0x7f3e7406ebf0 2024-04-23T10:13:03.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fa87d471640 1 Processor -- start 2024-04-23T10:13:03.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fa87d471640 1 -- start start 2024-04-23T10:13:03.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- 172.21.15.26:0/401397591 wait complete. 2024-04-23T10:13:03.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f37271fa640 1 Processor -- start 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 Processor -- start 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 -- 172.21.15.26:0/3416713000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 msgr2=0x7f3e7406f060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 --2- 172.21.15.26:0/3416713000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e7406f060 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3e74070590 tx=0x7f3e6c01ed90 comp rx=0 tx=0).stop 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 -- 172.21.15.26:0/3416713000 shutdown_connections 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 --2- 172.21.15.26:0/3416713000 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e7406f060 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 --2- 172.21.15.26:0/3416713000 >> v2:172.21.15.190:3300/0 conn(0x7f3e7406ce30 0x7f3e740c8430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f3e79f67640 1 -- 172.21.15.26:0/3416713000 >> 172.21.15.26:0/3416713000 conn(0x7f3e7406e0d0 msgr2=0x7f3e7406e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fa87d471640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fa87d471640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa87806ce30 0x7fa87816b730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7f37271fa640 1 -- start start 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37271fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 0x7f37180e66f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37271fa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f37180e71f0 0x7f37180e6c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37271fa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f371804c690 con 0x7f37180462a0 2024-04-23T10:13:03.692 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37271fa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f37180454e0 con 0x7f37180e71f0 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37271fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f37180457c0 con 0x7f37180dd2c0 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37269f9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f37180462a0 0x7f371804ba70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57620/0 (socket says 172.21.15.26:57620) 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37269f9640 1 -- 172.21.15.26:0/2288388885 learned_addr learned my addr 172.21.15.26:0/2288388885 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37261f8640 1 --2- 172.21.15.26:0/2288388885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 0x7f37180e66f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa87d471640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa878073810 0x7fa8780c4100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.686+0000 7fb359a60640 1 -- start start 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb34c0d5e00 0x7fb34c04bcd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.693 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 0x7fb34c047c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37259f7640 1 --2- 172.21.15.26:0/2288388885 >> v2:172.21.15.190:3300/0 conn(0x7f37180e71f0 0x7f37180e6c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c0e66f0 con 0x7fb344004810 2024-04-23T10:13:03.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb34c04c970 con 0x7fb34c0d5e00 2024-04-23T10:13:03.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb34c0e6870 con 0x7fb34c0477f0 2024-04-23T10:13:03.694 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f3e79f67640 1 -- 172.21.15.26:0/3416713000 shutdown_connections 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa87d471640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa87816b2a0 con 0x7fa878073810 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa87d471640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa878073d60 con 0x7fa87806ce30 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa87d471640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa878074000 con 0x7fa87806ebf0 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50454/0 (socket says 172.21.15.26:50454) 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 -- 172.21.15.26:0/3360070018 learned_addr learned my addr 172.21.15.26:0/3360070018 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb353fff640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb34c0d5e00 0x7fb34c04bcd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f3e79f67640 1 -- 172.21.15.26:0/3416713000 wait complete. 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7efcedd9b640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00c9820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efce8009870 tx=0x7efce8027520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e662c082a1122bad server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55864/0 (socket says 172.21.15.26:55864) 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 -- 172.21.15.26:0/1626901823 learned_addr learned my addr 172.21.15.26:0/1626901823 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa8777fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa87806ce30 0x7fa87816b730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37261f8640 1 -- 172.21.15.26:0/2288388885 >> v2:172.21.15.190:3300/0 conn(0x7f37180e71f0 msgr2=0x7f37180e6c30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37261f8640 1 --2- 172.21.15.26:0/2288388885 >> v2:172.21.15.190:3300/0 conn(0x7f37180e71f0 0x7f37180e6c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37261f8640 1 -- 172.21.15.26:0/2288388885 >> v1:172.21.15.26:6789/0 conn(0x7f37180462a0 legacy=0x7f371804ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f37261f8640 1 -- 172.21.15.26:0/2288388885 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3718045aa0 con 0x7f37180dd2c0 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb35925f640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 0x7fb34c047c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 -- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 msgr2=0x7fb34c047c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 0x7fb34c047c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 -- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb34c0d5e00 msgr2=0x7fb34c04bcd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb34c0d5e00 0x7fb34c04bcd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 -- 172.21.15.26:0/3360070018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb34c0481b0 con 0x7fb344004810 2024-04-23T10:13:03.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb35925f640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 0x7fb34c047c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 -- 172.21.15.26:0/1626901823 >> v2:172.21.15.190:3300/0 conn(0x7fa87806ce30 msgr2=0x7fa87816b730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 --2- 172.21.15.26:0/1626901823 >> v2:172.21.15.190:3300/0 conn(0x7fa87806ce30 0x7fa87816b730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 -- 172.21.15.26:0/1626901823 >> v2:172.21.15.26:3300/0 conn(0x7fa878073810 msgr2=0x7fa8780c4100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 --2- 172.21.15.26:0/1626901823 >> v2:172.21.15.26:3300/0 conn(0x7fa878073810 0x7fa8780c4100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fa877fff640 1 -- 172.21.15.26:0/1626901823 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87806d420 con 0x7fa87806ebf0 2024-04-23T10:13:03.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb358a5e640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb348011c10 tx=0x7fb34800f610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348019070 con 0x7fb344004810 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb348004030 con 0x7fb344004810 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb34c048ec0 con 0x7fb344004810 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb34c049480 con 0x7fb344004810 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb348009860 con 0x7fb344004810 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f3e79f67640 1 Processor -- start 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7f3e79f67640 1 -- start start 2024-04-23T10:13:03.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.690+0000 7efced59a640 1 -- 172.21.15.26:0/1441422612 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80bc070 con 0x7efcf00c8a10 2024-04-23T10:13:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 Processor -- start 2024-04-23T10:13:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efced59a640 1 -- 172.21.15.26:0/1441422612 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce80b7600 con 0x7efcf00c8a10 2024-04-23T10:13:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efced59a640 1 -- 172.21.15.26:0/1441422612 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce80b79d0 con 0x7efcf00c8a10 2024-04-23T10:13:03.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 -- start start 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 0x7f3e7420cb40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e74165970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 0x7f3e74165040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e741791e0 con 0x7f3e7406ebf0 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740c8b80 con 0x7f3e740c36f0 2024-04-23T10:13:03.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3e74179360 con 0x7f3e7406ce30 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e78f65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 0x7f3e7420cb40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 0x7f3e74165040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e78f65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 0x7f3e7420cb40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55900/0 (socket says 172.21.15.26:55900) 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e78f65640 1 -- 172.21.15.26:0/2815081073 learned_addr learned my addr 172.21.15.26:0/2815081073 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- 172.21.15.26:0/1441422612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 msgr2=0x7efcf00c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00c9820 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7efce8009870 tx=0x7efce8027520 comp rx=0 tx=0).stop 2024-04-23T10:13:03.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e73fff640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e74165970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- 172.21.15.26:0/1441422612 shutdown_connections 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 --2- 172.21.15.26:0/1441422612 >> v2:172.21.15.190:3300/0 conn(0x7efcf006d0b0 0x7efcf0151cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00c9820 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 --2- 172.21.15.26:0/1441422612 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf00723a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- 172.21.15.26:0/1441422612 >> 172.21.15.26:0/1441422612 conn(0x7efcf00ca0d0 msgr2=0x7efcf00ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- 172.21.15.26:0/1441422612 shutdown_connections 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 -- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 msgr2=0x7f3e7420cb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 0x7f3e7420cb40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 -- 172.21.15.26:0/2815081073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 msgr2=0x7f3e74165970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e74165970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 -- 172.21.15.26:0/2815081073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e7420d080 con 0x7f3e740c36f0 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e73fff640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e74165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79766640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 0x7f3e74165040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0af000 tx=0x7f3e6c01bb30 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64900458a0 0x7f64900db7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900470a0 0x7f64900062f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6490046000 con 0x7f64900d5000 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f64900512c0 con 0x7f64900458a0 2024-04-23T10:13:03.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d818640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6490046c10 con 0x7f64900470a0 2024-04-23T10:13:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0c0070 con 0x7f3e740c36f0 2024-04-23T10:13:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649c816640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f64900d5000 0x7f649004b4f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:47754/0 (socket says 172.21.15.26:47754) 2024-04-23T10:13:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649c816640 1 -- 172.21.15.26:0/135330978 learned_addr learned my addr 172.21.15.26:0/135330978 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:03.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f6497fff640 1 --2- 172.21.15.26:0/135330978 >> v2:172.21.15.190:3300/0 conn(0x7f64900458a0 0x7f64900db7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c007cb0 con 0x7f3e740c36f0 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c0ad040 con 0x7f3e740c36f0 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e74162ab0 con 0x7f3e740c36f0 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- 172.21.15.26:0/1441422612 wait complete. 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 Processor -- start 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fa877fff640 1 --2- 172.21.15.26:0/1626901823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa87806a140 tx=0x7fa87001c520 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d82d9113ce6c9a04 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fa876ffd640 1 -- 172.21.15.26:0/1626901823 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700b0070 con 0x7fa87806ebf0 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f37261f8640 1 --2- 172.21.15.26:0/2288388885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 0x7f37180e66f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f372006ac00 tx=0x7f37200989e0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d5a41edc3d3f2cdf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb34801c070 con 0x7fb344004810 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb3517fa640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 0x7fb33806a910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fb3480871b0 con 0x7fb344004810 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb34c0053a0 con 0x7fb344004810 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb353fff640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 0x7fb33806a910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f649d017640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900470a0 0x7f64900062f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f64977fe640 1 -- 172.21.15.26:0/135330978 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3705654092 0 0) 0x7f6490046000 con 0x7f64900d5000 2024-04-23T10:13:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f64977fe640 1 -- 172.21.15.26:0/135330978 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6488003530 con 0x7f64900d5000 2024-04-23T10:13:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e74163070 con 0x7f3e740c36f0 2024-04-23T10:13:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7fb353fff640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 0x7fb33806a910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3400017f0 tx=0x7fb340001280 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7efcf4b51640 1 -- start start 2024-04-23T10:13:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f6497fff640 1 -- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900470a0 msgr2=0x7f64900062f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f6497fff640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900470a0 0x7f64900062f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f6497fff640 1 -- 172.21.15.26:0/135330978 >> v1:172.21.15.190:6789/0 conn(0x7f64900d5000 legacy=0x7f649004b4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.694+0000 7f6497fff640 1 -- 172.21.15.26:0/135330978 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900462e0 con 0x7f64900458a0 2024-04-23T10:13:03.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37251f6640 1 -- 172.21.15.26:0/2288388885 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720121820 con 0x7f37180dd2c0 2024-04-23T10:13:03.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf014e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37251f6640 1 -- 172.21.15.26:0/2288388885 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3720121a00 con 0x7f37180dd2c0 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00ccff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:40758/0 (socket says 172.21.15.26:40758) 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcedd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf014e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcedd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf014e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55920/0 (socket says 172.21.15.26:55920) 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 -- 172.21.15.26:0/3395154174 learned_addr learned my addr 172.21.15.26:0/3395154174 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efcf006b9d0 con 0x7efcf00c8a10 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efcf006cb90 con 0x7efcf006d0b0 2024-04-23T10:13:03.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efcf00c9d60 con 0x7efcf00c8630 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37251f6640 1 -- 172.21.15.26:0/2288388885 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3720129440 con 0x7f37180dd2c0 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 -- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 msgr2=0x7efcf014e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf014e9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efceed9d640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00ccff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 -- 172.21.15.26:0/3395154174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 msgr2=0x7efcf00ccff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00ccff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efcf00cc6f0 con 0x7efcf006d0b0 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- 172.21.15.26:0/2288388885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 msgr2=0x7f37180e66f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 --2- 172.21.15.26:0/2288388885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 0x7f37180e66f0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f372006ac00 tx=0x7f37200989e0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efceed9d640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- 172.21.15.26:0/2288388885 shutdown_connections 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 --2- 172.21.15.26:0/2288388885 >> v2:172.21.15.190:3300/0 conn(0x7f37180e71f0 0x7f37180e6c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 --2- 172.21.15.26:0/2288388885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180dd2c0 0x7f37180e66f0 secure :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f372006ac00 tx=0x7f37200989e0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- 172.21.15.26:0/2288388885 >> 172.21.15.26:0/2288388885 conn(0x7f3718050190 msgr2=0x7f37180505a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcee59c640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efce0009dd0 tx=0x7efce000c490 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- 172.21.15.26:0/2288388885 shutdown_connections 2024-04-23T10:13:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- 172.21.15.26:0/2288388885 wait complete. 2024-04-23T10:13:03.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa876ffd640 1 -- 172.21.15.26:0/1626901823 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700ab600 con 0x7fa87806ebf0 2024-04-23T10:13:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0018020 con 0x7efcf006d0b0 2024-04-23T10:13:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efce0014480 con 0x7efcf006d0b0 2024-04-23T10:13:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efce0014870 con 0x7efcf006d0b0 2024-04-23T10:13:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e74076440 con 0x7f3e740c36f0 2024-04-23T10:13:03.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efcf00cc990 con 0x7efcf006d0b0 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7efcf4b51640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efcf00cb710 con 0x7efcf006d0b0 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 -- 172.21.15.26:0/1626901823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 msgr2=0x7fa87806efd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa876ffd640 1 -- 172.21.15.26:0/1626901823 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700ab9d0 con 0x7fa87806ebf0 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 --2- 172.21.15.26:0/1626901823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7fa87806a140 tx=0x7fa87001c520 comp rx=0 tx=0).stop 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 -- 172.21.15.26:0/1626901823 shutdown_connections 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 --2- 172.21.15.26:0/1626901823 >> v2:172.21.15.26:3300/0 conn(0x7fa878073810 0x7fa8780c4100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 --2- 172.21.15.26:0/1626901823 >> v2:172.21.15.190:3300/0 conn(0x7fa87806ce30 0x7fa87816b730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 --2- 172.21.15.26:0/1626901823 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ebf0 0x7fa87806efd0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 -- 172.21.15.26:0/1626901823 >> 172.21.15.26:0/1626901823 conn(0x7fa87806e0d0 msgr2=0x7fa87806e4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 -- 172.21.15.26:0/1626901823 shutdown_connections 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e6c008280 con 0x7f3e740c36f0 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f3e717fa640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 0x7f3e5806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f6497fff640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900458a0 0x7f64900db7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c00a960 tx=0x7f648c0211a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=c8934780582c893a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f64977fe640 1 -- 172.21.15.26:0/135330978 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c0b7070 con 0x7f64900458a0 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f64977fe640 1 -- 172.21.15.26:0/135330978 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f648c0b2440 con 0x7f64900458a0 2024-04-23T10:13:03.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f64977fe640 1 -- 172.21.15.26:0/135330978 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f648c00b040 con 0x7f64900458a0 2024-04-23T10:13:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7fa87d471640 1 -- 172.21.15.26:0/1626901823 wait complete. 2024-04-23T10:13:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f3e6c1207f0 con 0x7f3e740c36f0 2024-04-23T10:13:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 Processor -- start 2024-04-23T10:13:03.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 -- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900458a0 msgr2=0x7f64900db7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900458a0 0x7f64900db7c0 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f648c00a960 tx=0x7f648c0211a0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 Processor -- start 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.698+0000 7f37271fa640 1 -- start start 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f3e78f65640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 0x7f3e5806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 -- 172.21.15.26:0/135330978 shutdown_connections 2024-04-23T10:13:03.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900470a0 0x7f64900062f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 --2- 172.21.15.26:0/135330978 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900458a0 0x7f64900db7c0 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 -- 172.21.15.26:0/135330978 >> 172.21.15.26:0/135330978 conn(0x7f64900505e0 msgr2=0x7f64900509f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180462a0 0x7f37180e5a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37180e71f0 0x7f37180c6f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f371804c180 con 0x7f37180e71f0 2024-04-23T10:13:03.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f371804c970 con 0x7f3718049ca0 2024-04-23T10:13:03.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37271fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f371804c300 con 0x7f37180462a0 2024-04-23T10:13:03.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f3e78f65640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 0x7f3e5806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009c60 tx=0x7f3e68009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:40768/0 (socket says 172.21.15.26:40768) 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 -- 172.21.15.26:0/1006569796 learned_addr learned my addr 172.21.15.26:0/1006569796 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 -- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180462a0 msgr2=0x7f37180e5a70 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180462a0 0x7f37180e5a70 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 -- 172.21.15.26:0/1006569796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37180e71f0 msgr2=0x7f37180c6f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37180e71f0 0x7f37180c6f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 -- 172.21.15.26:0/1006569796 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37180e63d0 con 0x7f3718049ca0 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f37269f9640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f371c00faf0 tx=0x7f371c005740 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efce001b020 con 0x7efcf006d0b0 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcdeffd640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 0x7efcd006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7efce00878f0 con 0x7efcf006d0b0 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 -- start start 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa878073810 0x7fa878172e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa878072940 0x7fa8780cb480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780c3870 con 0x7fa878073810 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa8780c36f0 con 0x7fa878072940 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa8780c39f0 con 0x7fa87806ce30 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55936/0 (socket says 172.21.15.26:55936) 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 -- 172.21.15.26:0/2844841881 learned_addr learned my addr 172.21.15.26:0/2844841881 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87cc70640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa878072940 0x7fa8780cb480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa8777fe640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa878073810 0x7fa878172e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcedd9b640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 0x7efcd006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 -- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa878072940 msgr2=0x7fa8780cb480 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa878072940 0x7fa8780cb480 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 -- 172.21.15.26:0/2844841881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa878073810 msgr2=0x7fa878172e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa878073810 0x7fa878172e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 -- 172.21.15.26:0/2844841881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa878207690 con 0x7fa87806ce30 2024-04-23T10:13:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa877fff640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ae040 tx=0x7fa87001ad60 comp rx=0 tx=0).ready entity=mon.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700b0040 con 0x7fa87806ce30 2024-04-23T10:13:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcedd9b640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 0x7efcd006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efce80b9000 tx=0x7efce8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa87815aa70 con 0x7fa87806ce30 2024-04-23T10:13:03.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa8700bc070 con 0x7fa87806ce30 2024-04-23T10:13:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efcd40052a0 con 0x7efcf006d0b0 2024-04-23T10:13:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 -- 172.21.15.26:0/135330978 shutdown_connections 2024-04-23T10:13:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.702+0000 7f649d818640 1 -- 172.21.15.26:0/135330978 wait complete. 2024-04-23T10:13:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({osdmap=0}) -- 0x7fa87815b030 con 0x7fa87806ce30 2024-04-23T10:13:03.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa8700b6660 con 0x7fa87806ce30 2024-04-23T10:13:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 Processor -- start 2024-04-23T10:13:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb34c0481b0 con 0x7fb344004810 2024-04-23T10:13:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa878076440 con 0x7fa87806ce30 2024-04-23T10:13:03.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa8700b6800 con 0x7fa87806ce30 2024-04-23T10:13:03.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa874ff9640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 0x7fa86406a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7fa870120f00 con 0x7fa87806ce30 2024-04-23T10:13:03.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa8777fe640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 0x7fa86406a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- start start 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900458a0 0x7f64900cce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 0x7f64900db2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f64900d53e0 con 0x7f64900d5000 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64900468a0 con 0x7f64900470a0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f649004bc00 con 0x7f64900458a0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50506/0 (socket says 172.21.15.26:50506) 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 -- 172.21.15.26:0/3556629009 learned_addr learned my addr 172.21.15.26:0/3556629009 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649c816640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900458a0 0x7f64900cce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f6497fff640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 0x7f64900db2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 -- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900458a0 msgr2=0x7f64900cce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900458a0 0x7f64900cce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 -- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 msgr2=0x7f64900db2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 0x7f64900db2f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 -- 172.21.15.26:0/3556629009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64900cbf90 con 0x7f64900d5000 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f6497fff640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 0x7f64900db2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d017640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6498069360 tx=0x7f649806db60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7fa8777fe640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 0x7fa86406a980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa878069080 tx=0x7fa860008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f64980693c0 con 0x7f64900d5000 2024-04-23T10:13:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- 172.21.15.26:0/3556629009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f64900ceb10 con 0x7f64900d5000 2024-04-23T10:13:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.706+0000 7f649d818640 1 -- 172.21.15.26:0/3556629009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f64900d99f0 con 0x7f64900d5000 2024-04-23T10:13:03.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6498069560 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6498069b50 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f649d818640 1 -- 172.21.15.26:0/3556629009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f64780052a0 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6498069d70 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f64957fa640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 0x7f647c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6498103110 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f649c816640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 0x7f647c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.710+0000 7f649c816640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 0x7f647c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6484004a60 tx=0x7f64840049f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.718+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f64980d3420 con 0x7f64900d5000 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.718+0000 7fedb6ace640 1 Processor -- start 2024-04-23T10:13:03.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.718+0000 7fedb6ace640 1 -- start start 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c01b070 con 0x7f3718049ca0 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37180e6690 con 0x7f3718049ca0 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37180c8f10 con 0x7f3718049ca0 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb6ace640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb6ace640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fedb015b0b0 0x7fedb015b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb6ace640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedb015beb0 con 0x7fedb00cda50 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb6ace640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fedb00cca40 con 0x7fedb015b0b0 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb6ace640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedb00ccc90 con 0x7fedb0155350 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:55948/0 (socket says 172.21.15.26:55948) 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 -- 172.21.15.26:0/391331299 learned_addr learned my addr 172.21.15.26:0/391331299 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e6c018980 con 0x7f3e740c36f0 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 -- 172.21.15.26:0/391331299 >> v2:172.21.15.26:3300/0 conn(0x7fedb015b0b0 msgr2=0x7fedb015b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 --2- 172.21.15.26:0/391331299 >> v2:172.21.15.26:3300/0 conn(0x7fedb015b0b0 0x7fedb015b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 -- 172.21.15.26:0/391331299 >> v1:172.21.15.26:6789/0 conn(0x7fedb00cda50 legacy=0x7fedb00cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 -- 172.21.15.26:0/391331299 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb00ccf70 con 0x7fedb0155350 2024-04-23T10:13:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37180053a0 con 0x7f3718049ca0 2024-04-23T10:13:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.722+0000 7fedb486a640 1 --2- 172.21.15.26:0/391331299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401ed10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=c4e97a29e503e6f7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.730+0000 7fedaf7fe640 1 -- 172.21.15.26:0/391331299 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40b5070 con 0x7fedb0155350 2024-04-23T10:13:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.730+0000 7fedaf7fe640 1 -- 172.21.15.26:0/391331299 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda40a89d0 con 0x7fedb0155350 2024-04-23T10:13:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.730+0000 7fedaf7fe640 1 -- 172.21.15.26:0/391331299 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40a8da0 con 0x7fedb0155350 2024-04-23T10:13:03.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.730+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa870016130 con 0x7fa87806ce30 2024-04-23T10:13:03.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/391331299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 msgr2=0x7fedb00c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- 172.21.15.26:0/391331299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7feda4009870 tx=0x7feda401ed10 comp rx=0 tx=0).stop 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/391331299 shutdown_connections 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- 172.21.15.26:0/391331299 >> v2:172.21.15.26:3300/0 conn(0x7fedb015b0b0 0x7fedb015b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- 172.21.15.26:0/391331299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb00c59c0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/391331299 >> 172.21.15.26:0/391331299 conn(0x7fedb006cc30 msgr2=0x7fedb006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/391331299 shutdown_connections 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/391331299 wait complete. 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 Processor -- start 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- start start 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb01f1170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb015b0b0 0x7fedb014b200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb486a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb486a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50530/0 (socket says 172.21.15.26:50530) 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb486a640 1 -- 172.21.15.26:0/4148543394 learned_addr learned my addr 172.21.15.26:0/4148543394 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fedb0155730 con 0x7fedb00cda50 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedb00cd530 con 0x7fedb015b0b0 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedb015e860 con 0x7fedb0155350 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.734+0000 7fedaffff640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb01f1170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb506b640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb015b0b0 0x7fedb014b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 -- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 msgr2=0x7fedb01f1170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb01f1170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 -- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb015b0b0 msgr2=0x7fedb014b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb015b0b0 0x7fedb014b200 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb00b6760 con 0x7fedb00cda50 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedaffff640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb01f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb486a640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feda40b3040 tx=0x7feda401bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40c0070 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feda40b08b0 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedb015c410 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feda40b5040 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedb015c6b0 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.738+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedb0075df0 con 0x7fedb00cda50 2024-04-23T10:13:03.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feda40c3070 con 0x7fedb00cda50 2024-04-23T10:13:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efce0022070 con 0x7efcf006d0b0 2024-04-23T10:13:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f371c007d00 con 0x7f3718049ca0 2024-04-23T10:13:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f371c025060 con 0x7f3718049ca0 2024-04-23T10:13:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f371c01e070 con 0x7f3718049ca0 2024-04-23T10:13:03.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7fedad7fa640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 0x7fed9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f3716ffd640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 0x7f370406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f371c089d70 con 0x7f3718049ca0 2024-04-23T10:13:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7feda4123fd0 con 0x7fedb00cda50 2024-04-23T10:13:03.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7fedaffff640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 0x7fed9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f37261f8640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 0x7f370406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:03.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7fedaffff640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 0x7fed9406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedb008e090 tx=0x7fed9c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.742+0000 7f37261f8640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 0x7f370406a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3718045940 tx=0x7f372012b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.750+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f371c059980 con 0x7f3718049ca0 2024-04-23T10:13:03.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.750+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feda4018870 con 0x7fedb00cda50 2024-04-23T10:13:03.988 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-04-23T10:13:03.985+0000 7fe22ca3b640 -1 mds.pinger is_rank_lagging: rank=1 was never sent ping request. 2024-04-23T10:13:03.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.994+0000 7f6b004c1640 1 -- 172.21.15.26:0/3142280722 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 6} v 0) -- 0x7f6ae0005590 con 0x7f6af8072a50 2024-04-23T10:13:03.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.994+0000 7f6aeeffd640 1 -- 172.21.15.26:0/3142280722 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 6}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6af405b0a0 con 0x7f6af8072a50 2024-04-23T10:13:03.995 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:03.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 msgr2=0x7f6adc06a940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 0x7f6adc06a940 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f6af00b2000 tx=0x7f6af000a040 comp rx=0 tx=0).stop 2024-04-23T10:13:03.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 msgr2=0x7f6af815a5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:03.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f6af400e930 tx=0x7f6af400edf0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 shutdown_connections 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6adc068480 0x7f6adc06a940 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6af8157100 0x7f6af80cb4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6af81512d0 0x7f6af81428a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 --2- 172.21.15.26:0/3142280722 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6af8072a50 0x7f6af815a5f0 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 >> 172.21.15.26:0/3142280722 conn(0x7f6af80c9050 msgr2=0x7f6af8155c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 shutdown_connections 2024-04-23T10:13:03.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:03.998+0000 7f6aecff9640 1 -- 172.21.15.26:0/3142280722 wait complete. 2024-04-23T10:13:04.020 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.6 2024-04-23T10:13:04.020 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.030+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) -- 0x7fb34c04b850 con 0x7fb344004810 2024-04-23T10:13:04.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.030+0000 7fb3517fa640 1 -- 172.21.15.26:0/3360070018 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fb348056dc0 con 0x7fb344004810 2024-04-23T10:13:04.030 INFO:teuthology.orchestra.run.smithi026.stdout:55834574858 2024-04-23T10:13:04.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.030+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 msgr2=0x7fb33806a910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.030+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 0x7fb33806a910 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7fb3400017f0 tx=0x7fb340001280 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 msgr2=0x7fb34c179690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb348011c10 tx=0x7fb34800f610 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 shutdown_connections 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb338068450 0x7fb33806a910 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb34c0477f0 0x7fb34c047c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb34c0d5e00 0x7fb34c04bcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 --2- 172.21.15.26:0/3360070018 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb344004810 0x7fb34c179690 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 >> 172.21.15.26:0/3360070018 conn(0x7fb34c050190 msgr2=0x7fb34c04f540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 shutdown_connections 2024-04-23T10:13:04.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.034+0000 7fb359a60640 1 -- 172.21.15.26:0/3360070018 wait complete. 2024-04-23T10:13:04.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.042+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7f3e7406c650 con 0x7f3e740c36f0 2024-04-23T10:13:04.041 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.042+0000 7f3e717fa640 1 -- 172.21.15.26:0/2815081073 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3e6c0f02f0 con 0x7f3e740c36f0 2024-04-23T10:13:04.041 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:04.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f649d818640 1 -- 172.21.15.26:0/3556629009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) -- 0x7f6478005860 con 0x7f64900d5000 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 msgr2=0x7f3e5806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 0x7f3e5806a870 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f3e68009c60 tx=0x7f3e68009190 comp rx=0 tx=0).stop 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 msgr2=0x7f3e74165040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 0x7f3e74165040 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7f3e6c0af000 tx=0x7f3e6c01bb30 comp rx=0 tx=0).stop 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 shutdown_connections 2024-04-23T10:13:04.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f64957fa640 1 -- 172.21.15.26:0/3556629009 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f64980d2d20 con 0x7f64900d5000 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e580683b0 0x7f3e5806a870 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e740c36f0 0x7f3e74165040 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e7406ebf0 0x7f3e74165970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 --2- 172.21.15.26:0/2815081073 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7406ce30 0x7f3e7420cb40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 >> 172.21.15.26:0/2815081073 conn(0x7f3e7406e0d0 msgr2=0x7f3e74169af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.046 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:04.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 shutdown_connections 2024-04-23T10:13:04.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f3e79f67640 1 -- 172.21.15.26:0/2815081073 wait complete. 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 msgr2=0x7f647c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 0x7f647c06a840 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f6484004a60 tx=0x7f64840049f0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 msgr2=0x7f64900d6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.046+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f6498069360 tx=0x7f649806db60 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 shutdown_connections 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f647c068380 0x7f647c06a840 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f64900d5000 0x7f64900d6920 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f64900470a0 0x7f64900db2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 --2- 172.21.15.26:0/3556629009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f64900458a0 0x7f64900cce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 >> 172.21.15.26:0/3556629009 conn(0x7f64900505e0 msgr2=0x7f6490004a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 shutdown_connections 2024-04-23T10:13:04.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.050+0000 7f6482ffd640 1 -- 172.21.15.26:0/3556629009 wait complete. 2024-04-23T10:13:04.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574858 got 55834574858 for osd.5 2024-04-23T10:13:04.050 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.058+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7fa87806c650 con 0x7fa87806ce30 2024-04-23T10:13:04.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.058+0000 7fa874ff9640 1 -- 172.21.15.26:0/2844841881 <== mon.2 v2:172.21.15.190:3301/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fa8700f0aa0 con 0x7fa87806ce30 2024-04-23T10:13:04.059 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 msgr2=0x7fa86406a980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 0x7fa86406a980 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7fa878069080 tx=0x7fa860008040 comp rx=0 tx=0).stop 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 msgr2=0x7fa878172930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7fa8700ae040 tx=0x7fa87001ad60 comp rx=0 tx=0).stop 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 shutdown_connections 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa8640684c0 0x7fa86406a980 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa878072940 0x7fa8780cb480 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa878073810 0x7fa878172e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 --2- 172.21.15.26:0/2844841881 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa87806ce30 0x7fa878172930 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 >> 172.21.15.26:0/2844841881 conn(0x7fa87806e0d0 msgr2=0x7fa878168e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 shutdown_connections 2024-04-23T10:13:04.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.062+0000 7fa87d471640 1 -- 172.21.15.26:0/2844841881 wait complete. 2024-04-23T10:13:04.067 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.4 2024-04-23T10:13:04.068 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.072 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.3 2024-04-23T10:13:04.072 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.074+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7efcd4005590 con 0x7efcf006d0b0 2024-04-23T10:13:04.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.074+0000 7efcdeffd640 1 -- 172.21.15.26:0/3395154174 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7efce0010040 con 0x7efcf006d0b0 2024-04-23T10:13:04.075 INFO:teuthology.orchestra.run.smithi026.stdout:55834574860 2024-04-23T10:13:04.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f371804b850 con 0x7f3718049ca0 2024-04-23T10:13:04.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7f3716ffd640 1 -- 172.21.15.26:0/1006569796 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f371804b850 con 0x7f3718049ca0 2024-04-23T10:13:04.078 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 msgr2=0x7efcd006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 0x7efcd006a840 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7efce80b9000 tx=0x7efce8008040 comp rx=0 tx=0).stop 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 msgr2=0x7efcf01ed570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7efce0009dd0 tx=0x7efce000c490 comp rx=0 tx=0).stop 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 shutdown_connections 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efcd0068380 0x7efcd006a840 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efcf00c8a10 0x7efcf00ccff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efcf00c8630 0x7efcf014e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 --2- 172.21.15.26:0/3395154174 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efcf006d0b0 0x7efcf01ed570 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 >> 172.21.15.26:0/3395154174 conn(0x7efcf00ca0d0 msgr2=0x7efcf0073b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 shutdown_connections 2024-04-23T10:13:04.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.078+0000 7efcdcff9640 1 -- 172.21.15.26:0/3395154174 wait complete. 2024-04-23T10:13:04.081 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.0 2024-04-23T10:13:04.081 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 msgr2=0x7f370406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 0x7f370406a870 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f3718045940 tx=0x7f372012b040 comp rx=0 tx=0).stop 2024-04-23T10:13:04.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 msgr2=0x7f37180e5090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f371c00faf0 tx=0x7f371c005740 comp rx=0 tx=0).stop 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 shutdown_connections 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f37040683b0 0x7f370406a870 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3718049ca0 0x7f37180e5090 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f37180e71f0 0x7f37180c6f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 --2- 172.21.15.26:0/1006569796 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f37180462a0 0x7f37180e5a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 >> 172.21.15.26:0/1006569796 conn(0x7f3718050190 msgr2=0x7f371804f0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 shutdown_connections 2024-04-23T10:13:04.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7f37271fa640 1 -- 172.21.15.26:0/1006569796 wait complete. 2024-04-23T10:13:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 7} v 0) -- 0x7fedb00d0730 con 0x7fedb00cda50 2024-04-23T10:13:04.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedad7fa640 1 -- 172.21.15.26:0/4148543394 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 7}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feda40f4120 con 0x7fedb00cda50 2024-04-23T10:13:04.083 INFO:teuthology.orchestra.run.smithi026.stdout:55834574859 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 msgr2=0x7fed9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 0x7fed9406a840 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7fedb008e090 tx=0x7fed9c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 msgr2=0x7fedb01e4760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7feda40b3040 tx=0x7feda401bab0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 shutdown_connections 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fed94068380 0x7fed9406a840 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb015b0b0 0x7fedb014b200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb0155350 0x7fedb01f1170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 --2- 172.21.15.26:0/4148543394 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb00cda50 0x7fedb01e4760 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 >> 172.21.15.26:0/4148543394 conn(0x7fedb006cc30 msgr2=0x7fedb0158cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 shutdown_connections 2024-04-23T10:13:04.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.082+0000 7fedb6ace640 1 -- 172.21.15.26:0/4148543394 wait complete. 2024-04-23T10:13:04.099 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574860 got 55834574860 for osd.2 2024-04-23T10:13:04.100 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.100 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.1 2024-04-23T10:13:04.100 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.103 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574859 got 55834574859 for osd.7 2024-04-23T10:13:04.103 DEBUG:teuthology.parallel:result is None 2024-04-23T10:13:04.103 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T10:13:04.103 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 Processor -- start 2024-04-23T10:13:04.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 -- start start 2024-04-23T10:13:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c9415ee20 0x7f6c940c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6c9406f700 0x7f6c940c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6c940c4e80 con 0x7f6c94155300 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6c940c4230 con 0x7f6c9415ee20 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c99c14640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6c940c5770 con 0x7f6c9406f700 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c92ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6c9415ee20 0x7f6c940c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c937fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f6c94155300 0x7f6c9415e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57636/0 (socket says 172.21.15.26:57636) 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c937fe640 1 -- 172.21.15.26:0/2317573489 learned_addr learned my addr 172.21.15.26:0/2317573489 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c93fff640 1 --2- 172.21.15.26:0/2317573489 >> v2:172.21.15.190:3300/0 conn(0x7f6c9406f700 0x7f6c940c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c92ffd640 1 -- 172.21.15.26:0/2317573489 >> v2:172.21.15.190:3300/0 conn(0x7f6c9406f700 msgr2=0x7f6c940c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c92ffd640 1 --2- 172.21.15.26:0/2317573489 >> v2:172.21.15.190:3300/0 conn(0x7f6c9406f700 0x7f6c940c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c92ffd640 1 -- 172.21.15.26:0/2317573489 >> v1:172.21.15.26:6789/0 conn(0x7f6c94155300 legacy=0x7f6c9415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c927fc640 1 -- 172.21.15.26:0/2317573489 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3388037083 0 0) 0x7f6c940c4e80 con 0x7f6c94155300 2024-04-23T10:13:04.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.254+0000 7f6c92ffd640 1 -- 172.21.15.26:0/2317573489 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c9415f320 con 0x7f6c9415ee20 2024-04-23T10:13:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c92ffd640 1 --2- 172.21.15.26:0/2317573489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c940c3cf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c940c3a70 tx=0x7f6c8801c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69615f1bc9d244c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c927fc640 1 -- 172.21.15.26:0/2317573489 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880b2070 con 0x7f6c9415ee20 2024-04-23T10:13:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c927fc640 1 -- 172.21.15.26:0/2317573489 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c880a58e0 con 0x7f6c9415ee20 2024-04-23T10:13:04.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c927fc640 1 -- 172.21.15.26:0/2317573489 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c880a5cb0 con 0x7f6c9415ee20 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- 172.21.15.26:0/2317573489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 msgr2=0x7f6c940c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 --2- 172.21.15.26:0/2317573489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c940c3cf0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f6c940c3a70 tx=0x7f6c8801c930 comp rx=0 tx=0).stop 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- 172.21.15.26:0/2317573489 shutdown_connections 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 --2- 172.21.15.26:0/2317573489 >> v2:172.21.15.190:3300/0 conn(0x7f6c9406f700 0x7f6c940c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 --2- 172.21.15.26:0/2317573489 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c940c3cf0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- 172.21.15.26:0/2317573489 >> 172.21.15.26:0/2317573489 conn(0x7f6c9406b9d0 msgr2=0x7f6c9406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- 172.21.15.26:0/2317573489 shutdown_connections 2024-04-23T10:13:04.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- 172.21.15.26:0/2317573489 wait complete. 2024-04-23T10:13:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 Processor -- start 2024-04-23T10:13:04.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.258+0000 7f6c99c14640 1 -- start start 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c9406f700 0x7f6c94073260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 0x7f6c941f4420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6c940681d0 con 0x7f6c9415ee20 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6c9415f600 con 0x7f6c94155300 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6c94068350 con 0x7f6c9406f700 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50558/0 (socket says 172.21.15.26:50558) 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 -- 172.21.15.26:0/618556444 learned_addr learned my addr 172.21.15.26:0/618556444 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c92ffd640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 0x7f6c941f4420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c937fe640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c9406f700 0x7f6c94073260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 -- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c9406f700 msgr2=0x7f6c94073260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c9406f700 0x7f6c94073260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 -- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 msgr2=0x7f6c941f4420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 0x7f6c941f4420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 -- 172.21.15.26:0/618556444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6c941592a0 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c92ffd640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 0x7f6c941f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c93fff640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400e930 tx=0x7f6c8400edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c84017070 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6c8400c9a0 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6c94073c00 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6c8400cd70 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6c940741c0 con 0x7f6c9415ee20 2024-04-23T10:13:04.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6c94075df0 con 0x7f6c9415ee20 2024-04-23T10:13:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6c8401a070 con 0x7f6c9415ee20 2024-04-23T10:13:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 0x7f6c8006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f6c84086cf0 con 0x7f6c9415ee20 2024-04-23T10:13:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.262+0000 7f6c937fe640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 0x7f6c8006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.266+0000 7f6c937fe640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 0x7f6c8006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000f70 tx=0x7f6c8c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.266+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6c84057020 con 0x7f6c9415ee20 2024-04-23T10:13:04.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.418+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f6c9406bed0 con 0x7f6c80068380 2024-04-23T10:13:04.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.442+0000 7f6c7bfff640 1 -- 172.21.15.26:0/618556444 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f6c9406bed0 con 0x7f6c80068380 2024-04-23T10:13:04.446 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:04.448 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 msgr2=0x7f6c8006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 0x7f6c8006a840 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f6c8c000f70 tx=0x7f6c8c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 msgr2=0x7f6c941f4960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f6c8400e930 tx=0x7f6c8400edf0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 shutdown_connections 2024-04-23T10:13:04.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6c80068380 0x7f6c8006a840 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6c9415ee20 0x7f6c941f4960 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6c94155300 0x7f6c941f4420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 --2- 172.21.15.26:0/618556444 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6c9406f700 0x7f6c94073260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 >> 172.21.15.26:0/618556444 conn(0x7f6c9406b9d0 msgr2=0x7f6c94151a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 shutdown_connections 2024-04-23T10:13:04.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.446+0000 7f6c99c14640 1 -- 172.21.15.26:0/618556444 wait complete. 2024-04-23T10:13:04.463 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-23T10:13:02.924140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004707"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694720+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:12:40.694720+0000","last_peered":"2024-04-23T10:12:40.694720+0000","last_clean":"2024-04-23T10:12:40.694720+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:12:40.694720+0000","last_undegraded":"2024-04-23T10:12:40.694720+0000","last_fullsized":"2024-04-23T10:12:40.694720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227927+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:12:40.227927+0000","last_peered":"2024-04-23T10:12:40.227927+0000","last_clean":"2024-04-23T10:12:40.227927+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:12:40.227927+0000","last_undegraded":"2024-04-23T10:12:40.227927+0000","last_fullsized":"2024-04-23T10:12:40.227927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227263+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:12:40.227263+0000","last_peered":"2024-04-23T10:12:40.227263+0000","last_clean":"2024-04-23T10:12:40.227263+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:12:40.227263+0000","last_undegraded":"2024-04-23T10:12:40.227263+0000","last_fullsized":"2024-04-23T10:12:40.227263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228161+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:12:40.228161+0000","last_peered":"2024-04-23T10:12:40.228161+0000","last_clean":"2024-04-23T10:12:40.228161+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:12:40.228161+0000","last_undegraded":"2024-04-23T10:12:40.228161+0000","last_fullsized":"2024-04-23T10:12:40.228161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694410+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:12:40.694410+0000","last_peered":"2024-04-23T10:12:40.694410+0000","last_clean":"2024-04-23T10:12:40.694410+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:12:40.694410+0000","last_undegraded":"2024-04-23T10:12:40.694410+0000","last_fullsized":"2024-04-23T10:12:40.694410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081420+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:12:40.081420+0000","last_peered":"2024-04-23T10:12:40.081420+0000","last_clean":"2024-04-23T10:12:40.081420+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:12:40.081420+0000","last_undegraded":"2024-04-23T10:12:40.081420+0000","last_fullsized":"2024-04-23T10:12:40.081420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736750+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:12:40.736750+0000","last_peered":"2024-04-23T10:12:40.736750+0000","last_clean":"2024-04-23T10:12:40.736750+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:12:40.736750+0000","last_undegraded":"2024-04-23T10:12:40.736750+0000","last_fullsized":"2024-04-23T10:12:40.736750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084060+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:12:40.084060+0000","last_peered":"2024-04-23T10:12:40.084060+0000","last_clean":"2024-04-23T10:12:40.084060+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:12:40.084060+0000","last_undegraded":"2024-04-23T10:12:40.084060+0000","last_fullsized":"2024-04-23T10:12:40.084060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084168+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:12:40.084168+0000","last_peered":"2024-04-23T10:12:40.084168+0000","last_clean":"2024-04-23T10:12:40.084168+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:12:40.084168+0000","last_undegraded":"2024-04-23T10:12:40.084168+0000","last_fullsized":"2024-04-23T10:12:40.084168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736000+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:12:40.736000+0000","last_peered":"2024-04-23T10:12:40.736000+0000","last_clean":"2024-04-23T10:12:40.736000+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:12:40.736000+0000","last_undegraded":"2024-04-23T10:12:40.736000+0000","last_fullsized":"2024-04-23T10:12:40.736000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085309+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:12:40.085309+0000","last_peered":"2024-04-23T10:12:40.085309+0000","last_clean":"2024-04-23T10:12:40.085309+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:12:40.085309+0000","last_undegraded":"2024-04-23T10:12:40.085309+0000","last_fullsized":"2024-04-23T10:12:40.085309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083415+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:12:40.083415+0000","last_peered":"2024-04-23T10:12:40.083415+0000","last_clean":"2024-04-23T10:12:40.083415+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:12:40.083415+0000","last_undegraded":"2024-04-23T10:12:40.083415+0000","last_fullsized":"2024-04-23T10:12:40.083415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222560+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:12:40.222560+0000","last_peered":"2024-04-23T10:12:40.222560+0000","last_clean":"2024-04-23T10:12:40.222560+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:12:40.222560+0000","last_undegraded":"2024-04-23T10:12:40.222560+0000","last_fullsized":"2024-04-23T10:12:40.222560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736705+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:12:40.736705+0000","last_peered":"2024-04-23T10:12:40.736705+0000","last_clean":"2024-04-23T10:12:40.736705+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:12:40.736705+0000","last_undegraded":"2024-04-23T10:12:40.736705+0000","last_fullsized":"2024-04-23T10:12:40.736705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082157+0000","last_change":"2024-04-23T10:12:39.086678+0000","last_active":"2024-04-23T10:12:40.082157+0000","last_peered":"2024-04-23T10:12:40.082157+0000","last_clean":"2024-04-23T10:12:40.082157+0000","last_became_active":"2024-04-23T10:12:39.085373+0000","last_became_peered":"2024-04-23T10:12:39.085373+0000","last_unstale":"2024-04-23T10:12:40.082157+0000","last_undegraded":"2024-04-23T10:12:40.082157+0000","last_fullsized":"2024-04-23T10:12:40.082157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:40.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227424+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:12:40.227424+0000","last_peered":"2024-04-23T10:12:40.227424+0000","last_clean":"2024-04-23T10:12:40.227424+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:12:40.227424+0000","last_undegraded":"2024-04-23T10:12:40.227424+0000","last_fullsized":"2024-04-23T10:12:40.227424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424566+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:12:40.424566+0000","last_peered":"2024-04-23T10:12:40.424566+0000","last_clean":"2024-04-23T10:12:40.424566+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:12:40.424566+0000","last_undegraded":"2024-04-23T10:12:40.424566+0000","last_fullsized":"2024-04-23T10:12:40.424566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082075+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:12:40.082075+0000","last_peered":"2024-04-23T10:12:40.082075+0000","last_clean":"2024-04-23T10:12:40.082075+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:12:40.082075+0000","last_undegraded":"2024-04-23T10:12:40.082075+0000","last_fullsized":"2024-04-23T10:12:40.082075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227769+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:12:40.227769+0000","last_peered":"2024-04-23T10:12:40.227769+0000","last_clean":"2024-04-23T10:12:40.227769+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:12:40.227769+0000","last_undegraded":"2024-04-23T10:12:40.227769+0000","last_fullsized":"2024-04-23T10:12:40.227769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423933+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:12:40.423933+0000","last_peered":"2024-04-23T10:12:40.423933+0000","last_clean":"2024-04-23T10:12:40.423933+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:12:40.423933+0000","last_undegraded":"2024-04-23T10:12:40.423933+0000","last_fullsized":"2024-04-23T10:12:40.423933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425198+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:12:40.425198+0000","last_peered":"2024-04-23T10:12:40.425198+0000","last_clean":"2024-04-23T10:12:40.425198+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:12:40.425198+0000","last_undegraded":"2024-04-23T10:12:40.425198+0000","last_fullsized":"2024-04-23T10:12:40.425198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082399+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:12:40.082399+0000","last_peered":"2024-04-23T10:12:40.082399+0000","last_clean":"2024-04-23T10:12:40.082399+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:12:40.082399+0000","last_undegraded":"2024-04-23T10:12:40.082399+0000","last_fullsized":"2024-04-23T10:12:40.082399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735517+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:12:40.735517+0000","last_peered":"2024-04-23T10:12:40.735517+0000","last_clean":"2024-04-23T10:12:40.735517+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:12:40.735517+0000","last_undegraded":"2024-04-23T10:12:40.735517+0000","last_fullsized":"2024-04-23T10:12:40.735517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081599+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:12:40.081599+0000","last_peered":"2024-04-23T10:12:40.081599+0000","last_clean":"2024-04-23T10:12:40.081599+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:12:40.081599+0000","last_undegraded":"2024-04-23T10:12:40.081599+0000","last_fullsized":"2024-04-23T10:12:40.081599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695149+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:12:40.695149+0000","last_peered":"2024-04-23T10:12:40.695149+0000","last_clean":"2024-04-23T10:12:40.695149+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:12:40.695149+0000","last_undegraded":"2024-04-23T10:12:40.695149+0000","last_fullsized":"2024-04-23T10:12:40.695149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224406+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:12:40.224406+0000","last_peered":"2024-04-23T10:12:40.224406+0000","last_clean":"2024-04-23T10:12:40.224406+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:12:40.224406+0000","last_undegraded":"2024-04-23T10:12:40.224406+0000","last_fullsized":"2024-04-23T10:12:40.224406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081842+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:12:40.081842+0000","last_peered":"2024-04-23T10:12:40.081842+0000","last_clean":"2024-04-23T10:12:40.081842+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:12:40.081842+0000","last_undegraded":"2024-04-23T10:12:40.081842+0000","last_fullsized":"2024-04-23T10:12:40.081842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228252+0000","last_change":"2024-04-23T10:12:35.046012+0000","last_active":"2024-04-23T10:12:40.228252+0000","last_peered":"2024-04-23T10:12:40.228252+0000","last_clean":"2024-04-23T10:12:40.228252+0000","last_became_active":"2024-04-23T10:12:35.045699+0000","last_became_peered":"2024-04-23T10:12:35.045699+0000","last_unstale":"2024-04-23T10:12:40.228252+0000","last_undegraded":"2024-04-23T10:12:40.228252+0000","last_fullsized":"2024-04-23T10:12:40.228252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:23.156695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425569+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:12:40.425569+0000","last_peered":"2024-04-23T10:12:40.425569+0000","last_clean":"2024-04-23T10:12:40.425569+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:12:40.425569+0000","last_undegraded":"2024-04-23T10:12:40.425569+0000","last_fullsized":"2024-04-23T10:12:40.425569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227374+0000","last_change":"2024-04-23T10:12:39.140751+0000","last_active":"2024-04-23T10:12:40.227374+0000","last_peered":"2024-04-23T10:12:40.227374+0000","last_clean":"2024-04-23T10:12:40.227374+0000","last_became_active":"2024-04-23T10:12:39.140324+0000","last_became_peered":"2024-04-23T10:12:39.140324+0000","last_unstale":"2024-04-23T10:12:40.227374+0000","last_undegraded":"2024-04-23T10:12:40.227374+0000","last_fullsized":"2024-04-23T10:12:40.227374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:14:47.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425248+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:12:40.425248+0000","last_peered":"2024-04-23T10:12:40.425248+0000","last_clean":"2024-04-23T10:12:40.425248+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:12:40.425248+0000","last_undegraded":"2024-04-23T10:12:40.425248+0000","last_fullsized":"2024-04-23T10:12:40.425248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736899+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:12:40.736899+0000","last_peered":"2024-04-23T10:12:40.736899+0000","last_clean":"2024-04-23T10:12:40.736899+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:12:40.736899+0000","last_undegraded":"2024-04-23T10:12:40.736899+0000","last_fullsized":"2024-04-23T10:12:40.736899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694067+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:12:40.694067+0000","last_peered":"2024-04-23T10:12:40.694067+0000","last_clean":"2024-04-23T10:12:40.694067+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:12:40.694067+0000","last_undegraded":"2024-04-23T10:12:40.694067+0000","last_fullsized":"2024-04-23T10:12:40.694067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085565+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:12:40.085565+0000","last_peered":"2024-04-23T10:12:40.085565+0000","last_clean":"2024-04-23T10:12:40.085565+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:12:40.085565+0000","last_undegraded":"2024-04-23T10:12:40.085565+0000","last_fullsized":"2024-04-23T10:12:40.085565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425505+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:12:40.425505+0000","last_peered":"2024-04-23T10:12:40.425505+0000","last_clean":"2024-04-23T10:12:40.425505+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:12:40.425505+0000","last_undegraded":"2024-04-23T10:12:40.425505+0000","last_fullsized":"2024-04-23T10:12:40.425505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424225+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:12:40.424225+0000","last_peered":"2024-04-23T10:12:40.424225+0000","last_clean":"2024-04-23T10:12:40.424225+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:12:40.424225+0000","last_undegraded":"2024-04-23T10:12:40.424225+0000","last_fullsized":"2024-04-23T10:12:40.424225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084798+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:12:40.084798+0000","last_peered":"2024-04-23T10:12:40.084798+0000","last_clean":"2024-04-23T10:12:40.084798+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:12:40.084798+0000","last_undegraded":"2024-04-23T10:12:40.084798+0000","last_fullsized":"2024-04-23T10:12:40.084798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082819+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:12:40.082819+0000","last_peered":"2024-04-23T10:12:40.082819+0000","last_clean":"2024-04-23T10:12:40.082819+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:12:40.082819+0000","last_undegraded":"2024-04-23T10:12:40.082819+0000","last_fullsized":"2024-04-23T10:12:40.082819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425110+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:12:40.425110+0000","last_peered":"2024-04-23T10:12:40.425110+0000","last_clean":"2024-04-23T10:12:40.425110+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:12:40.425110+0000","last_undegraded":"2024-04-23T10:12:40.425110+0000","last_fullsized":"2024-04-23T10:12:40.425110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424421+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:12:40.424421+0000","last_peered":"2024-04-23T10:12:40.424421+0000","last_clean":"2024-04-23T10:12:40.424421+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:12:40.424421+0000","last_undegraded":"2024-04-23T10:12:40.424421+0000","last_fullsized":"2024-04-23T10:12:40.424421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080451+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:12:40.080451+0000","last_peered":"2024-04-23T10:12:40.080451+0000","last_clean":"2024-04-23T10:12:40.080451+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:12:40.080451+0000","last_undegraded":"2024-04-23T10:12:40.080451+0000","last_fullsized":"2024-04-23T10:12:40.080451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425432+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:12:40.425432+0000","last_peered":"2024-04-23T10:12:40.425432+0000","last_clean":"2024-04-23T10:12:40.425432+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:12:40.425432+0000","last_undegraded":"2024-04-23T10:12:40.425432+0000","last_fullsized":"2024-04-23T10:12:40.425432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.693709+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:12:40.693709+0000","last_peered":"2024-04-23T10:12:40.693709+0000","last_clean":"2024-04-23T10:12:40.693709+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:12:40.693709+0000","last_undegraded":"2024-04-23T10:12:40.693709+0000","last_fullsized":"2024-04-23T10:12:40.693709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735754+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:12:40.735754+0000","last_peered":"2024-04-23T10:12:40.735754+0000","last_clean":"2024-04-23T10:12:40.735754+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:12:40.735754+0000","last_undegraded":"2024-04-23T10:12:40.735754+0000","last_fullsized":"2024-04-23T10:12:40.735754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695103+0000","last_change":"2024-04-23T10:12:39.144005+0000","last_active":"2024-04-23T10:12:40.695103+0000","last_peered":"2024-04-23T10:12:40.695103+0000","last_clean":"2024-04-23T10:12:40.695103+0000","last_became_active":"2024-04-23T10:12:39.143429+0000","last_became_peered":"2024-04-23T10:12:39.143429+0000","last_unstale":"2024-04-23T10:12:40.695103+0000","last_undegraded":"2024-04-23T10:12:40.695103+0000","last_fullsized":"2024-04-23T10:12:40.695103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:28:05.706347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227291+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:12:40.227291+0000","last_peered":"2024-04-23T10:12:40.227291+0000","last_clean":"2024-04-23T10:12:40.227291+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:12:40.227291+0000","last_undegraded":"2024-04-23T10:12:40.227291+0000","last_fullsized":"2024-04-23T10:12:40.227291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083722+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:12:40.083722+0000","last_peered":"2024-04-23T10:12:40.083722+0000","last_clean":"2024-04-23T10:12:40.083722+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:12:40.083722+0000","last_undegraded":"2024-04-23T10:12:40.083722+0000","last_fullsized":"2024-04-23T10:12:40.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736031+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:12:40.736031+0000","last_peered":"2024-04-23T10:12:40.736031+0000","last_clean":"2024-04-23T10:12:40.736031+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:12:40.736031+0000","last_undegraded":"2024-04-23T10:12:40.736031+0000","last_fullsized":"2024-04-23T10:12:40.736031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222912+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:12:40.222912+0000","last_peered":"2024-04-23T10:12:40.222912+0000","last_clean":"2024-04-23T10:12:40.222912+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:12:40.222912+0000","last_undegraded":"2024-04-23T10:12:40.222912+0000","last_fullsized":"2024-04-23T10:12:40.222912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736371+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:12:40.736371+0000","last_peered":"2024-04-23T10:12:40.736371+0000","last_clean":"2024-04-23T10:12:40.736371+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:12:40.736371+0000","last_undegraded":"2024-04-23T10:12:40.736371+0000","last_fullsized":"2024-04-23T10:12:40.736371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080981+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:12:40.080981+0000","last_peered":"2024-04-23T10:12:40.080981+0000","last_clean":"2024-04-23T10:12:40.080981+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:12:40.080981+0000","last_undegraded":"2024-04-23T10:12:40.080981+0000","last_fullsized":"2024-04-23T10:12:40.080981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224993+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:12:40.224993+0000","last_peered":"2024-04-23T10:12:40.224993+0000","last_clean":"2024-04-23T10:12:40.224993+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:12:40.224993+0000","last_undegraded":"2024-04-23T10:12:40.224993+0000","last_fullsized":"2024-04-23T10:12:40.224993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084202+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:12:40.084202+0000","last_peered":"2024-04-23T10:12:40.084202+0000","last_clean":"2024-04-23T10:12:40.084202+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:12:40.084202+0000","last_undegraded":"2024-04-23T10:12:40.084202+0000","last_fullsized":"2024-04-23T10:12:40.084202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425618+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:12:40.425618+0000","last_peered":"2024-04-23T10:12:40.425618+0000","last_clean":"2024-04-23T10:12:40.425618+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:12:40.425618+0000","last_undegraded":"2024-04-23T10:12:40.425618+0000","last_fullsized":"2024-04-23T10:12:40.425618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694791+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:12:40.694791+0000","last_peered":"2024-04-23T10:12:40.694791+0000","last_clean":"2024-04-23T10:12:40.694791+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:12:40.694791+0000","last_undegraded":"2024-04-23T10:12:40.694791+0000","last_fullsized":"2024-04-23T10:12:40.694791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737351+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:12:40.737351+0000","last_peered":"2024-04-23T10:12:40.737351+0000","last_clean":"2024-04-23T10:12:40.737351+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:12:40.737351+0000","last_undegraded":"2024-04-23T10:12:40.737351+0000","last_fullsized":"2024-04-23T10:12:40.737351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081400+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:12:40.081400+0000","last_peered":"2024-04-23T10:12:40.081400+0000","last_clean":"2024-04-23T10:12:40.081400+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:12:40.081400+0000","last_undegraded":"2024-04-23T10:12:40.081400+0000","last_fullsized":"2024-04-23T10:12:40.081400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080961+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:12:40.080961+0000","last_peered":"2024-04-23T10:12:40.080961+0000","last_clean":"2024-04-23T10:12:40.080961+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:12:40.080961+0000","last_undegraded":"2024-04-23T10:12:40.080961+0000","last_fullsized":"2024-04-23T10:12:40.080961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736518+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:12:40.736518+0000","last_peered":"2024-04-23T10:12:40.736518+0000","last_clean":"2024-04-23T10:12:40.736518+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:12:40.736518+0000","last_undegraded":"2024-04-23T10:12:40.736518+0000","last_fullsized":"2024-04-23T10:12:40.736518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085364+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:12:40.085364+0000","last_peered":"2024-04-23T10:12:40.085364+0000","last_clean":"2024-04-23T10:12:40.085364+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:12:40.085364+0000","last_undegraded":"2024-04-23T10:12:40.085364+0000","last_fullsized":"2024-04-23T10:12:40.085364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081041+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:12:40.081041+0000","last_peered":"2024-04-23T10:12:40.081041+0000","last_clean":"2024-04-23T10:12:40.081041+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:12:40.081041+0000","last_undegraded":"2024-04-23T10:12:40.081041+0000","last_fullsized":"2024-04-23T10:12:40.081041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736041+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:12:40.736041+0000","last_peered":"2024-04-23T10:12:40.736041+0000","last_clean":"2024-04-23T10:12:40.736041+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:12:40.736041+0000","last_undegraded":"2024-04-23T10:12:40.736041+0000","last_fullsized":"2024-04-23T10:12:40.736041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080265+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:12:40.080265+0000","last_peered":"2024-04-23T10:12:40.080265+0000","last_clean":"2024-04-23T10:12:40.080265+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:12:40.080265+0000","last_undegraded":"2024-04-23T10:12:40.080265+0000","last_fullsized":"2024-04-23T10:12:40.080265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694649+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:12:40.694649+0000","last_peered":"2024-04-23T10:12:40.694649+0000","last_clean":"2024-04-23T10:12:40.694649+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:12:40.694649+0000","last_undegraded":"2024-04-23T10:12:40.694649+0000","last_fullsized":"2024-04-23T10:12:40.694649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222505+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:12:40.222505+0000","last_peered":"2024-04-23T10:12:40.222505+0000","last_clean":"2024-04-23T10:12:40.222505+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:12:40.222505+0000","last_undegraded":"2024-04-23T10:12:40.222505+0000","last_fullsized":"2024-04-23T10:12:40.222505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223019+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:12:40.223019+0000","last_peered":"2024-04-23T10:12:40.223019+0000","last_clean":"2024-04-23T10:12:40.223019+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:12:40.223019+0000","last_undegraded":"2024-04-23T10:12:40.223019+0000","last_fullsized":"2024-04-23T10:12:40.223019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228197+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:12:40.228197+0000","last_peered":"2024-04-23T10:12:40.228197+0000","last_clean":"2024-04-23T10:12:40.228197+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:12:40.228197+0000","last_undegraded":"2024-04-23T10:12:40.228197+0000","last_fullsized":"2024-04-23T10:12:40.228197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736505+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:12:40.736505+0000","last_peered":"2024-04-23T10:12:40.736505+0000","last_clean":"2024-04-23T10:12:40.736505+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:12:40.736505+0000","last_undegraded":"2024-04-23T10:12:40.736505+0000","last_fullsized":"2024-04-23T10:12:40.736505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083055+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:12:40.083055+0000","last_peered":"2024-04-23T10:12:40.083055+0000","last_clean":"2024-04-23T10:12:40.083055+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:12:40.083055+0000","last_undegraded":"2024-04-23T10:12:40.083055+0000","last_fullsized":"2024-04-23T10:12:40.083055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228406+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:12:40.228406+0000","last_peered":"2024-04-23T10:12:40.228406+0000","last_clean":"2024-04-23T10:12:40.228406+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:12:40.228406+0000","last_undegraded":"2024-04-23T10:12:40.228406+0000","last_fullsized":"2024-04-23T10:12:40.228406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694309+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:12:40.694309+0000","last_peered":"2024-04-23T10:12:40.694309+0000","last_clean":"2024-04-23T10:12:40.694309+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:12:40.694309+0000","last_undegraded":"2024-04-23T10:12:40.694309+0000","last_fullsized":"2024-04-23T10:12:40.694309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694950+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:12:40.694950+0000","last_peered":"2024-04-23T10:12:40.694950+0000","last_clean":"2024-04-23T10:12:40.694950+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:12:40.694950+0000","last_undegraded":"2024-04-23T10:12:40.694950+0000","last_fullsized":"2024-04-23T10:12:40.694950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085118+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:12:40.085118+0000","last_peered":"2024-04-23T10:12:40.085118+0000","last_clean":"2024-04-23T10:12:40.085118+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:12:40.085118+0000","last_undegraded":"2024-04-23T10:12:40.085118+0000","last_fullsized":"2024-04-23T10:12:40.085118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736101+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:12:40.736101+0000","last_peered":"2024-04-23T10:12:40.736101+0000","last_clean":"2024-04-23T10:12:40.736101+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:12:40.736101+0000","last_undegraded":"2024-04-23T10:12:40.736101+0000","last_fullsized":"2024-04-23T10:12:40.736101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:50.524048+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:12:50.524048+0000","last_peered":"2024-04-23T10:12:50.524048+0000","last_clean":"2024-04-23T10:12:50.524048+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:12:50.524048+0000","last_undegraded":"2024-04-23T10:12:50.524048+0000","last_fullsized":"2024-04-23T10:12:50.524048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424501+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:12:40.424501+0000","last_peered":"2024-04-23T10:12:40.424501+0000","last_clean":"2024-04-23T10:12:40.424501+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:12:40.424501+0000","last_undegraded":"2024-04-23T10:12:40.424501+0000","last_fullsized":"2024-04-23T10:12:40.424501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083129+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:12:40.083129+0000","last_peered":"2024-04-23T10:12:40.083129+0000","last_clean":"2024-04-23T10:12:40.083129+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:12:40.083129+0000","last_undegraded":"2024-04-23T10:12:40.083129+0000","last_fullsized":"2024-04-23T10:12:40.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425386+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:12:40.425386+0000","last_peered":"2024-04-23T10:12:40.425386+0000","last_clean":"2024-04-23T10:12:40.425386+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:12:40.425386+0000","last_undegraded":"2024-04-23T10:12:40.425386+0000","last_fullsized":"2024-04-23T10:12:40.425386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083595+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:12:40.083595+0000","last_peered":"2024-04-23T10:12:40.083595+0000","last_clean":"2024-04-23T10:12:40.083595+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:12:40.083595+0000","last_undegraded":"2024-04-23T10:12:40.083595+0000","last_fullsized":"2024-04-23T10:12:40.083595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694569+0000","last_change":"2024-04-23T10:12:35.029157+0000","last_active":"2024-04-23T10:12:40.694569+0000","last_peered":"2024-04-23T10:12:40.694569+0000","last_clean":"2024-04-23T10:12:40.694569+0000","last_became_active":"2024-04-23T10:12:35.028122+0000","last_became_peered":"2024-04-23T10:12:35.028122+0000","last_unstale":"2024-04-23T10:12:40.694569+0000","last_undegraded":"2024-04-23T10:12:40.694569+0000","last_fullsized":"2024-04-23T10:12:40.694569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:58:30.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085259+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:12:40.085259+0000","last_peered":"2024-04-23T10:12:40.085259+0000","last_clean":"2024-04-23T10:12:40.085259+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:12:40.085259+0000","last_undegraded":"2024-04-23T10:12:40.085259+0000","last_fullsized":"2024-04-23T10:12:40.085259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227674+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:12:40.227674+0000","last_peered":"2024-04-23T10:12:40.227674+0000","last_clean":"2024-04-23T10:12:40.227674+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:12:40.227674+0000","last_undegraded":"2024-04-23T10:12:40.227674+0000","last_fullsized":"2024-04-23T10:12:40.227674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085010+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:12:40.085010+0000","last_peered":"2024-04-23T10:12:40.085010+0000","last_clean":"2024-04-23T10:12:40.085010+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:12:40.085010+0000","last_undegraded":"2024-04-23T10:12:40.085010+0000","last_fullsized":"2024-04-23T10:12:40.085010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224170+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:12:40.224170+0000","last_peered":"2024-04-23T10:12:40.224170+0000","last_clean":"2024-04-23T10:12:40.224170+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:12:40.224170+0000","last_undegraded":"2024-04-23T10:12:40.224170+0000","last_fullsized":"2024-04-23T10:12:40.224170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227262+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:12:40.227262+0000","last_peered":"2024-04-23T10:12:40.227262+0000","last_clean":"2024-04-23T10:12:40.227262+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:12:40.227262+0000","last_undegraded":"2024-04-23T10:12:40.227262+0000","last_fullsized":"2024-04-23T10:12:40.227262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423747+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:12:40.423747+0000","last_peered":"2024-04-23T10:12:40.423747+0000","last_clean":"2024-04-23T10:12:40.423747+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:12:40.423747+0000","last_undegraded":"2024-04-23T10:12:40.423747+0000","last_fullsized":"2024-04-23T10:12:40.423747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081194+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:12:40.081194+0000","last_peered":"2024-04-23T10:12:40.081194+0000","last_clean":"2024-04-23T10:12:40.081194+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:12:40.081194+0000","last_undegraded":"2024-04-23T10:12:40.081194+0000","last_fullsized":"2024-04-23T10:12:40.081194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224019+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:12:40.224019+0000","last_peered":"2024-04-23T10:12:40.224019+0000","last_clean":"2024-04-23T10:12:40.224019+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:12:40.224019+0000","last_undegraded":"2024-04-23T10:12:40.224019+0000","last_fullsized":"2024-04-23T10:12:40.224019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227536+0000","last_change":"2024-04-23T10:12:35.031938+0000","last_active":"2024-04-23T10:12:40.227536+0000","last_peered":"2024-04-23T10:12:40.227536+0000","last_clean":"2024-04-23T10:12:40.227536+0000","last_became_active":"2024-04-23T10:12:35.031645+0000","last_became_peered":"2024-04-23T10:12:35.031645+0000","last_unstale":"2024-04-23T10:12:40.227536+0000","last_undegraded":"2024-04-23T10:12:40.227536+0000","last_fullsized":"2024-04-23T10:12:40.227536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:26.960607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:12:40.227565+0000","last_peered":"2024-04-23T10:12:40.227565+0000","last_clean":"2024-04-23T10:12:40.227565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:12:40.227565+0000","last_undegraded":"2024-04-23T10:12:40.227565+0000","last_fullsized":"2024-04-23T10:12:40.227565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223106+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:12:40.223106+0000","last_peered":"2024-04-23T10:12:40.223106+0000","last_clean":"2024-04-23T10:12:40.223106+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:12:40.223106+0000","last_undegraded":"2024-04-23T10:12:40.223106+0000","last_fullsized":"2024-04-23T10:12:40.223106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081034+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:12:40.081034+0000","last_peered":"2024-04-23T10:12:40.081034+0000","last_clean":"2024-04-23T10:12:40.081034+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:12:40.081034+0000","last_undegraded":"2024-04-23T10:12:40.081034+0000","last_fullsized":"2024-04-23T10:12:40.081034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227530+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:12:40.227530+0000","last_peered":"2024-04-23T10:12:40.227530+0000","last_clean":"2024-04-23T10:12:40.227530+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:12:40.227530+0000","last_undegraded":"2024-04-23T10:12:40.227530+0000","last_fullsized":"2024-04-23T10:12:40.227530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083585+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:12:40.083585+0000","last_peered":"2024-04-23T10:12:40.083585+0000","last_clean":"2024-04-23T10:12:40.083585+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:12:40.083585+0000","last_undegraded":"2024-04-23T10:12:40.083585+0000","last_fullsized":"2024-04-23T10:12:40.083585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227924+0000","last_change":"2024-04-23T10:12:39.089619+0000","last_active":"2024-04-23T10:12:40.227924+0000","last_peered":"2024-04-23T10:12:40.227924+0000","last_clean":"2024-04-23T10:12:40.227924+0000","last_became_active":"2024-04-23T10:12:39.080595+0000","last_became_peered":"2024-04-23T10:12:39.080595+0000","last_unstale":"2024-04-23T10:12:40.227924+0000","last_undegraded":"2024-04-23T10:12:40.227924+0000","last_fullsized":"2024-04-23T10:12:40.227924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:22.568699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222192+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:12:40.222192+0000","last_peered":"2024-04-23T10:12:40.222192+0000","last_clean":"2024-04-23T10:12:40.222192+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:12:40.222192+0000","last_undegraded":"2024-04-23T10:12:40.222192+0000","last_fullsized":"2024-04-23T10:12:40.222192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080449+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:12:40.080449+0000","last_peered":"2024-04-23T10:12:40.080449+0000","last_clean":"2024-04-23T10:12:40.080449+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:12:40.080449+0000","last_undegraded":"2024-04-23T10:12:40.080449+0000","last_fullsized":"2024-04-23T10:12:40.080449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082564+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:12:40.082564+0000","last_peered":"2024-04-23T10:12:40.082564+0000","last_clean":"2024-04-23T10:12:40.082564+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:12:40.082564+0000","last_undegraded":"2024-04-23T10:12:40.082564+0000","last_fullsized":"2024-04-23T10:12:40.082564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694554+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:12:40.694554+0000","last_peered":"2024-04-23T10:12:40.694554+0000","last_clean":"2024-04-23T10:12:40.694554+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:12:40.694554+0000","last_undegraded":"2024-04-23T10:12:40.694554+0000","last_fullsized":"2024-04-23T10:12:40.694554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228250+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:12:40.228250+0000","last_peered":"2024-04-23T10:12:40.228250+0000","last_clean":"2024-04-23T10:12:40.228250+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:12:40.228250+0000","last_undegraded":"2024-04-23T10:12:40.228250+0000","last_fullsized":"2024-04-23T10:12:40.228250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424882+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:12:40.424882+0000","last_peered":"2024-04-23T10:12:40.424882+0000","last_clean":"2024-04-23T10:12:40.424882+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:12:40.424882+0000","last_undegraded":"2024-04-23T10:12:40.424882+0000","last_fullsized":"2024-04-23T10:12:40.424882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223845+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:12:40.223845+0000","last_peered":"2024-04-23T10:12:40.223845+0000","last_clean":"2024-04-23T10:12:40.223845+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:12:40.223845+0000","last_undegraded":"2024-04-23T10:12:40.223845+0000","last_fullsized":"2024-04-23T10:12:40.223845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228257+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:12:40.228257+0000","last_peered":"2024-04-23T10:12:40.228257+0000","last_clean":"2024-04-23T10:12:40.228257+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:12:40.228257+0000","last_undegraded":"2024-04-23T10:12:40.228257+0000","last_fullsized":"2024-04-23T10:12:40.228257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081108+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:12:40.081108+0000","last_peered":"2024-04-23T10:12:40.081108+0000","last_clean":"2024-04-23T10:12:40.081108+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:12:40.081108+0000","last_undegraded":"2024-04-23T10:12:40.081108+0000","last_fullsized":"2024-04-23T10:12:40.081108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227349+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:12:40.227349+0000","last_peered":"2024-04-23T10:12:40.227349+0000","last_clean":"2024-04-23T10:12:40.227349+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:12:40.227349+0000","last_undegraded":"2024-04-23T10:12:40.227349+0000","last_fullsized":"2024-04-23T10:12:40.227349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082447+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:12:40.082447+0000","last_peered":"2024-04-23T10:12:40.082447+0000","last_clean":"2024-04-23T10:12:40.082447+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:12:40.082447+0000","last_undegraded":"2024-04-23T10:12:40.082447+0000","last_fullsized":"2024-04-23T10:12:40.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223339+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:12:40.223339+0000","last_peered":"2024-04-23T10:12:40.223339+0000","last_clean":"2024-04-23T10:12:40.223339+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:12:40.223339+0000","last_undegraded":"2024-04-23T10:12:40.223339+0000","last_fullsized":"2024-04-23T10:12:40.223339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736824+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:12:40.736824+0000","last_peered":"2024-04-23T10:12:40.736824+0000","last_clean":"2024-04-23T10:12:40.736824+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:12:40.736824+0000","last_undegraded":"2024-04-23T10:12:40.736824+0000","last_fullsized":"2024-04-23T10:12:40.736824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081276+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:12:40.081276+0000","last_peered":"2024-04-23T10:12:40.081276+0000","last_clean":"2024-04-23T10:12:40.081276+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:12:40.081276+0000","last_undegraded":"2024-04-23T10:12:40.081276+0000","last_fullsized":"2024-04-23T10:12:40.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.086183+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:12:40.086183+0000","last_peered":"2024-04-23T10:12:40.086183+0000","last_clean":"2024-04-23T10:12:40.086183+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:12:40.086183+0000","last_undegraded":"2024-04-23T10:12:40.086183+0000","last_fullsized":"2024-04-23T10:12:40.086183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080933+0000","last_change":"2024-04-23T10:12:35.032838+0000","last_active":"2024-04-23T10:12:40.080933+0000","last_peered":"2024-04-23T10:12:40.080933+0000","last_clean":"2024-04-23T10:12:40.080933+0000","last_became_active":"2024-04-23T10:12:35.032273+0000","last_became_peered":"2024-04-23T10:12:35.032273+0000","last_unstale":"2024-04-23T10:12:40.080933+0000","last_undegraded":"2024-04-23T10:12:40.080933+0000","last_fullsized":"2024-04-23T10:12:40.080933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:24:44.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423818+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:12:40.423818+0000","last_peered":"2024-04-23T10:12:40.423818+0000","last_clean":"2024-04-23T10:12:40.423818+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:12:40.423818+0000","last_undegraded":"2024-04-23T10:12:40.423818+0000","last_fullsized":"2024-04-23T10:12:40.423818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694211+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:12:40.694211+0000","last_peered":"2024-04-23T10:12:40.694211+0000","last_clean":"2024-04-23T10:12:40.694211+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:12:40.694211+0000","last_undegraded":"2024-04-23T10:12:40.694211+0000","last_fullsized":"2024-04-23T10:12:40.694211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227425+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:12:40.227425+0000","last_peered":"2024-04-23T10:12:40.227425+0000","last_clean":"2024-04-23T10:12:40.227425+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:12:40.227425+0000","last_undegraded":"2024-04-23T10:12:40.227425+0000","last_fullsized":"2024-04-23T10:12:40.227425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082582+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:12:40.082582+0000","last_peered":"2024-04-23T10:12:40.082582+0000","last_clean":"2024-04-23T10:12:40.082582+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:12:40.082582+0000","last_undegraded":"2024-04-23T10:12:40.082582+0000","last_fullsized":"2024-04-23T10:12:40.082582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223336+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:12:40.223336+0000","last_peered":"2024-04-23T10:12:40.223336+0000","last_clean":"2024-04-23T10:12:40.223336+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:12:40.223336+0000","last_undegraded":"2024-04-23T10:12:40.223336+0000","last_fullsized":"2024-04-23T10:12:40.223336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223648+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:12:40.223648+0000","last_peered":"2024-04-23T10:12:40.223648+0000","last_clean":"2024-04-23T10:12:40.223648+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:12:40.223648+0000","last_undegraded":"2024-04-23T10:12:40.223648+0000","last_fullsized":"2024-04-23T10:12:40.223648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737307+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:12:40.737307+0000","last_peered":"2024-04-23T10:12:40.737307+0000","last_clean":"2024-04-23T10:12:40.737307+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:12:40.737307+0000","last_undegraded":"2024-04-23T10:12:40.737307+0000","last_fullsized":"2024-04-23T10:12:40.737307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227175+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:12:40.227175+0000","last_peered":"2024-04-23T10:12:40.227175+0000","last_clean":"2024-04-23T10:12:40.227175+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:12:40.227175+0000","last_undegraded":"2024-04-23T10:12:40.227175+0000","last_fullsized":"2024-04-23T10:12:40.227175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735764+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:12:40.735764+0000","last_peered":"2024-04-23T10:12:40.735764+0000","last_clean":"2024-04-23T10:12:40.735764+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:12:40.735764+0000","last_undegraded":"2024-04-23T10:12:40.735764+0000","last_fullsized":"2024-04-23T10:12:40.735764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082310+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:12:40.082310+0000","last_peered":"2024-04-23T10:12:40.082310+0000","last_clean":"2024-04-23T10:12:40.082310+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:12:40.082310+0000","last_undegraded":"2024-04-23T10:12:40.082310+0000","last_fullsized":"2024-04-23T10:12:40.082310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735994+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:12:40.735994+0000","last_peered":"2024-04-23T10:12:40.735994+0000","last_clean":"2024-04-23T10:12:40.735994+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:12:40.735994+0000","last_undegraded":"2024-04-23T10:12:40.735994+0000","last_fullsized":"2024-04-23T10:12:40.735994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083953+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:12:40.083953+0000","last_peered":"2024-04-23T10:12:40.083953+0000","last_clean":"2024-04-23T10:12:40.083953+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:12:40.083953+0000","last_undegraded":"2024-04-23T10:12:40.083953+0000","last_fullsized":"2024-04-23T10:12:40.083953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425202+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:12:40.425202+0000","last_peered":"2024-04-23T10:12:40.425202+0000","last_clean":"2024-04-23T10:12:40.425202+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:12:40.425202+0000","last_undegraded":"2024-04-23T10:12:40.425202+0000","last_fullsized":"2024-04-23T10:12:40.425202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737045+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:12:40.737045+0000","last_peered":"2024-04-23T10:12:40.737045+0000","last_clean":"2024-04-23T10:12:40.737045+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:12:40.737045+0000","last_undegraded":"2024-04-23T10:12:40.737045+0000","last_fullsized":"2024-04-23T10:12:40.737045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:04.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.622+0000 7f2a28756640 1 Processor -- start 2024-04-23T10:13:04.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.622+0000 7f2a28756640 1 -- start start 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a20155350 0x7f2a200c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a200cda50 0x7f2a200cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a2015beb0 con 0x7f2a200cbcf0 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2a200cca40 con 0x7f2a20155350 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2a200ccc90 con 0x7f2a200cda50 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a20155350 0x7f2a200c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a20155350 0x7f2a200c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50562/0 (socket says 172.21.15.26:50562) 2024-04-23T10:13:04.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 -- 172.21.15.26:0/2997325777 learned_addr learned my addr 172.21.15.26:0/2997325777 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:04.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a25cf1640 1 --2- 172.21.15.26:0/2997325777 >> v2:172.21.15.190:3300/0 conn(0x7f2a200cda50 0x7f2a200cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 -- 172.21.15.26:0/2997325777 >> v2:172.21.15.190:3300/0 conn(0x7f2a200cda50 msgr2=0x7f2a200cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:04.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 --2- 172.21.15.26:0/2997325777 >> v2:172.21.15.190:3300/0 conn(0x7f2a200cda50 0x7f2a200cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 -- 172.21.15.26:0/2997325777 >> v1:172.21.15.190:6789/0 conn(0x7f2a200cbcf0 legacy=0x7f2a2015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 -- 172.21.15.26:0/2997325777 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a200ccf70 con 0x7f2a20155350 2024-04-23T10:13:04.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a264f2640 1 --2- 172.21.15.26:0/2997325777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20155350 0x7f2a200c59c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a200ce540 tx=0x7f2a1c01f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e8b7158ef4f8292e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a254f0640 1 -- 172.21.15.26:0/2997325777 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0b4070 con 0x7f2a20155350 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a254f0640 1 -- 172.21.15.26:0/2997325777 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1c0af400 con 0x7f2a20155350 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a254f0640 1 -- 172.21.15.26:0/2997325777 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1c0af7d0 con 0x7f2a20155350 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- 172.21.15.26:0/2997325777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20155350 msgr2=0x7f2a200c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 --2- 172.21.15.26:0/2997325777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20155350 0x7f2a200c59c0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f2a200ce540 tx=0x7f2a1c01f1e0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- 172.21.15.26:0/2997325777 shutdown_connections 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 --2- 172.21.15.26:0/2997325777 >> v2:172.21.15.190:3300/0 conn(0x7f2a200cda50 0x7f2a200cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 --2- 172.21.15.26:0/2997325777 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a20155350 0x7f2a200c59c0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- 172.21.15.26:0/2997325777 >> 172.21.15.26:0/2997325777 conn(0x7f2a2006cc30 msgr2=0x7f2a2006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- 172.21.15.26:0/2997325777 shutdown_connections 2024-04-23T10:13:04.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.626+0000 7f2a28756640 1 -- 172.21.15.26:0/2997325777 wait complete. 2024-04-23T10:13:04.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 Processor -- start 2024-04-23T10:13:04.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- start start 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 0x7f2a20158610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a20155350 0x7f2a200b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2a20155730 con 0x7f2a200cda50 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2a200cd530 con 0x7f2a20155350 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2a2015e860 con 0x7f2a200cbcf0 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50564/0 (socket says 172.21.15.26:50564) 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 -- 172.21.15.26:0/1374325442 learned_addr learned my addr 172.21.15.26:0/1374325442 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a26cf3640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a20155350 0x7f2a200b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a264f2640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 0x7f2a20158610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 -- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 msgr2=0x7f2a20158610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 0x7f2a20158610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 -- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a20155350 msgr2=0x7f2a200b5f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a20155350 0x7f2a200b5f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 -- 172.21.15.26:0/1374325442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a201f0fc0 con 0x7f2a200cda50 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a264f2640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 0x7f2a20158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a25cf1640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000e930 tx=0x7f2a1000edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a10017070 con 0x7f2a200cda50 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a1000ca00 con 0x7f2a200cda50 2024-04-23T10:13:04.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a201f4fe0 con 0x7f2a200cda50 2024-04-23T10:13:04.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a1000cdb0 con 0x7f2a200cda50 2024-04-23T10:13:04.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a201f1280 con 0x7f2a200cda50 2024-04-23T10:13:04.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a20075df0 con 0x7f2a200cda50 2024-04-23T10:13:04.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.630+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a1001a070 con 0x7f2a200cda50 2024-04-23T10:13:04.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.634+0000 7f2a16ffd640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 0x7f2a0406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.634+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2a100870d0 con 0x7f2a200cda50 2024-04-23T10:13:04.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.634+0000 7f2a264f2640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 0x7f2a0406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.634+0000 7f2a264f2640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 0x7f2a0406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0b1000 tx=0x7f2a1c0aa000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.638+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a10057410 con 0x7f2a200cda50 2024-04-23T10:13:04.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.790+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f2a2014f3e0 con 0x7f2a04068380 2024-04-23T10:13:04.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.814+0000 7f2a16ffd640 1 -- 172.21.15.26:0/1374325442 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332534 (secure 0 0 0) 0x7f2a2014f3e0 con 0x7f2a04068380 2024-04-23T10:13:04.816 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:04.818 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 msgr2=0x7f2a0406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 0x7f2a0406a840 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7f2a1c0b1000 tx=0x7f2a1c0aa000 comp rx=0 tx=0).stop 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 msgr2=0x7f2a20155c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7f2a1000e930 tx=0x7f2a1000edf0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 shutdown_connections 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a04068380 0x7f2a0406a840 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a20155350 0x7f2a200b5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a200cda50 0x7f2a20155c10 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 --2- 172.21.15.26:0/1374325442 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a200cbcf0 0x7f2a20158610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 >> 172.21.15.26:0/1374325442 conn(0x7f2a2006cc30 msgr2=0x7f2a200d01a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 shutdown_connections 2024-04-23T10:13:04.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.818+0000 7f2a28756640 1 -- 172.21.15.26:0/1374325442 wait complete. 2024-04-23T10:13:04.832 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":38,"stamp":"2024-04-23T10:13:02.924140+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595008,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":207,"num_write_kb":2434,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":159,"ondisk_log_size":159,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236008,"kb_used_data":3208,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738712,"statfs":{"total":773094113280,"available":772852441088,"internally_reserved":0,"allocated":3284992,"data_stored":1992064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":2230,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004707"},"pg_stats":[{"pgid":"2.1f","version":"23'4","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694720+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:12:40.694720+0000","last_peered":"2024-04-23T10:12:40.694720+0000","last_clean":"2024-04-23T10:12:40.694720+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:12:40.694720+0000","last_undegraded":"2024-04-23T10:12:40.694720+0000","last_fullsized":"2024-04-23T10:12:40.694720+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227927+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:12:40.227927+0000","last_peered":"2024-04-23T10:12:40.227927+0000","last_clean":"2024-04-23T10:12:40.227927+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:12:40.227927+0000","last_undegraded":"2024-04-23T10:12:40.227927+0000","last_fullsized":"2024-04-23T10:12:40.227927+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227263+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:12:40.227263+0000","last_peered":"2024-04-23T10:12:40.227263+0000","last_clean":"2024-04-23T10:12:40.227263+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:12:40.227263+0000","last_undegraded":"2024-04-23T10:12:40.227263+0000","last_fullsized":"2024-04-23T10:12:40.227263+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228161+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:12:40.228161+0000","last_peered":"2024-04-23T10:12:40.228161+0000","last_clean":"2024-04-23T10:12:40.228161+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:12:40.228161+0000","last_undegraded":"2024-04-23T10:12:40.228161+0000","last_fullsized":"2024-04-23T10:12:40.228161+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694410+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:12:40.694410+0000","last_peered":"2024-04-23T10:12:40.694410+0000","last_clean":"2024-04-23T10:12:40.694410+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:12:40.694410+0000","last_undegraded":"2024-04-23T10:12:40.694410+0000","last_fullsized":"2024-04-23T10:12:40.694410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081420+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:12:40.081420+0000","last_peered":"2024-04-23T10:12:40.081420+0000","last_clean":"2024-04-23T10:12:40.081420+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:12:40.081420+0000","last_undegraded":"2024-04-23T10:12:40.081420+0000","last_fullsized":"2024-04-23T10:12:40.081420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736750+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:12:40.736750+0000","last_peered":"2024-04-23T10:12:40.736750+0000","last_clean":"2024-04-23T10:12:40.736750+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:12:40.736750+0000","last_undegraded":"2024-04-23T10:12:40.736750+0000","last_fullsized":"2024-04-23T10:12:40.736750+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084060+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:12:40.084060+0000","last_peered":"2024-04-23T10:12:40.084060+0000","last_clean":"2024-04-23T10:12:40.084060+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:12:40.084060+0000","last_undegraded":"2024-04-23T10:12:40.084060+0000","last_fullsized":"2024-04-23T10:12:40.084060+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084168+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:12:40.084168+0000","last_peered":"2024-04-23T10:12:40.084168+0000","last_clean":"2024-04-23T10:12:40.084168+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:12:40.084168+0000","last_undegraded":"2024-04-23T10:12:40.084168+0000","last_fullsized":"2024-04-23T10:12:40.084168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736000+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:12:40.736000+0000","last_peered":"2024-04-23T10:12:40.736000+0000","last_clean":"2024-04-23T10:12:40.736000+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:12:40.736000+0000","last_undegraded":"2024-04-23T10:12:40.736000+0000","last_fullsized":"2024-04-23T10:12:40.736000+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085309+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:12:40.085309+0000","last_peered":"2024-04-23T10:12:40.085309+0000","last_clean":"2024-04-23T10:12:40.085309+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:12:40.085309+0000","last_undegraded":"2024-04-23T10:12:40.085309+0000","last_fullsized":"2024-04-23T10:12:40.085309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083415+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:12:40.083415+0000","last_peered":"2024-04-23T10:12:40.083415+0000","last_clean":"2024-04-23T10:12:40.083415+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:12:40.083415+0000","last_undegraded":"2024-04-23T10:12:40.083415+0000","last_fullsized":"2024-04-23T10:12:40.083415+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222560+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:12:40.222560+0000","last_peered":"2024-04-23T10:12:40.222560+0000","last_clean":"2024-04-23T10:12:40.222560+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:12:40.222560+0000","last_undegraded":"2024-04-23T10:12:40.222560+0000","last_fullsized":"2024-04-23T10:12:40.222560+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736705+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:12:40.736705+0000","last_peered":"2024-04-23T10:12:40.736705+0000","last_clean":"2024-04-23T10:12:40.736705+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:12:40.736705+0000","last_undegraded":"2024-04-23T10:12:40.736705+0000","last_fullsized":"2024-04-23T10:12:40.736705+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082157+0000","last_change":"2024-04-23T10:12:39.086678+0000","last_active":"2024-04-23T10:12:40.082157+0000","last_peered":"2024-04-23T10:12:40.082157+0000","last_clean":"2024-04-23T10:12:40.082157+0000","last_became_active":"2024-04-23T10:12:39.085373+0000","last_became_peered":"2024-04-23T10:12:39.085373+0000","last_unstale":"2024-04-23T10:12:40.082157+0000","last_undegraded":"2024-04-23T10:12:40.082157+0000","last_fullsized":"2024-04-23T10:12:40.082157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:40.393022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,1],"acting":[4,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227424+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:12:40.227424+0000","last_peered":"2024-04-23T10:12:40.227424+0000","last_clean":"2024-04-23T10:12:40.227424+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:12:40.227424+0000","last_undegraded":"2024-04-23T10:12:40.227424+0000","last_fullsized":"2024-04-23T10:12:40.227424+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424566+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:12:40.424566+0000","last_peered":"2024-04-23T10:12:40.424566+0000","last_clean":"2024-04-23T10:12:40.424566+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:12:40.424566+0000","last_undegraded":"2024-04-23T10:12:40.424566+0000","last_fullsized":"2024-04-23T10:12:40.424566+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082075+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:12:40.082075+0000","last_peered":"2024-04-23T10:12:40.082075+0000","last_clean":"2024-04-23T10:12:40.082075+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:12:40.082075+0000","last_undegraded":"2024-04-23T10:12:40.082075+0000","last_fullsized":"2024-04-23T10:12:40.082075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227769+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:12:40.227769+0000","last_peered":"2024-04-23T10:12:40.227769+0000","last_clean":"2024-04-23T10:12:40.227769+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:12:40.227769+0000","last_undegraded":"2024-04-23T10:12:40.227769+0000","last_fullsized":"2024-04-23T10:12:40.227769+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423933+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:12:40.423933+0000","last_peered":"2024-04-23T10:12:40.423933+0000","last_clean":"2024-04-23T10:12:40.423933+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:12:40.423933+0000","last_undegraded":"2024-04-23T10:12:40.423933+0000","last_fullsized":"2024-04-23T10:12:40.423933+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425198+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:12:40.425198+0000","last_peered":"2024-04-23T10:12:40.425198+0000","last_clean":"2024-04-23T10:12:40.425198+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:12:40.425198+0000","last_undegraded":"2024-04-23T10:12:40.425198+0000","last_fullsized":"2024-04-23T10:12:40.425198+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082399+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:12:40.082399+0000","last_peered":"2024-04-23T10:12:40.082399+0000","last_clean":"2024-04-23T10:12:40.082399+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:12:40.082399+0000","last_undegraded":"2024-04-23T10:12:40.082399+0000","last_fullsized":"2024-04-23T10:12:40.082399+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735517+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:12:40.735517+0000","last_peered":"2024-04-23T10:12:40.735517+0000","last_clean":"2024-04-23T10:12:40.735517+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:12:40.735517+0000","last_undegraded":"2024-04-23T10:12:40.735517+0000","last_fullsized":"2024-04-23T10:12:40.735517+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081599+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:12:40.081599+0000","last_peered":"2024-04-23T10:12:40.081599+0000","last_clean":"2024-04-23T10:12:40.081599+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:12:40.081599+0000","last_undegraded":"2024-04-23T10:12:40.081599+0000","last_fullsized":"2024-04-23T10:12:40.081599+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695149+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:12:40.695149+0000","last_peered":"2024-04-23T10:12:40.695149+0000","last_clean":"2024-04-23T10:12:40.695149+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:12:40.695149+0000","last_undegraded":"2024-04-23T10:12:40.695149+0000","last_fullsized":"2024-04-23T10:12:40.695149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"23'2","reported_seq":24,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224406+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:12:40.224406+0000","last_peered":"2024-04-23T10:12:40.224406+0000","last_clean":"2024-04-23T10:12:40.224406+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:12:40.224406+0000","last_undegraded":"2024-04-23T10:12:40.224406+0000","last_fullsized":"2024-04-23T10:12:40.224406+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081842+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:12:40.081842+0000","last_peered":"2024-04-23T10:12:40.081842+0000","last_clean":"2024-04-23T10:12:40.081842+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:12:40.081842+0000","last_undegraded":"2024-04-23T10:12:40.081842+0000","last_fullsized":"2024-04-23T10:12:40.081842+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228252+0000","last_change":"2024-04-23T10:12:35.046012+0000","last_active":"2024-04-23T10:12:40.228252+0000","last_peered":"2024-04-23T10:12:40.228252+0000","last_clean":"2024-04-23T10:12:40.228252+0000","last_became_active":"2024-04-23T10:12:35.045699+0000","last_became_peered":"2024-04-23T10:12:35.045699+0000","last_unstale":"2024-04-23T10:12:40.228252+0000","last_undegraded":"2024-04-23T10:12:40.228252+0000","last_fullsized":"2024-04-23T10:12:40.228252+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:30:23.156695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"24'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425569+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:12:40.425569+0000","last_peered":"2024-04-23T10:12:40.425569+0000","last_clean":"2024-04-23T10:12:40.425569+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:12:40.425569+0000","last_undegraded":"2024-04-23T10:12:40.425569+0000","last_fullsized":"2024-04-23T10:12:40.425569+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227374+0000","last_change":"2024-04-23T10:12:39.140751+0000","last_active":"2024-04-23T10:12:40.227374+0000","last_peered":"2024-04-23T10:12:40.227374+0000","last_clean":"2024-04-23T10:12:40.227374+0000","last_became_active":"2024-04-23T10:12:39.140324+0000","last_became_peered":"2024-04-23T10:12:39.140324+0000","last_unstale":"2024-04-23T10:12:40.227374+0000","last_undegraded":"2024-04-23T10:12:40.227374+0000","last_fullsized":"2024-04-23T10:12:40.227374+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:14:47.370248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,0,1],"acting":[3,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425248+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:12:40.425248+0000","last_peered":"2024-04-23T10:12:40.425248+0000","last_clean":"2024-04-23T10:12:40.425248+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:12:40.425248+0000","last_undegraded":"2024-04-23T10:12:40.425248+0000","last_fullsized":"2024-04-23T10:12:40.425248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736899+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:12:40.736899+0000","last_peered":"2024-04-23T10:12:40.736899+0000","last_clean":"2024-04-23T10:12:40.736899+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:12:40.736899+0000","last_undegraded":"2024-04-23T10:12:40.736899+0000","last_fullsized":"2024-04-23T10:12:40.736899+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694067+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:12:40.694067+0000","last_peered":"2024-04-23T10:12:40.694067+0000","last_clean":"2024-04-23T10:12:40.694067+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:12:40.694067+0000","last_undegraded":"2024-04-23T10:12:40.694067+0000","last_fullsized":"2024-04-23T10:12:40.694067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085565+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:12:40.085565+0000","last_peered":"2024-04-23T10:12:40.085565+0000","last_clean":"2024-04-23T10:12:40.085565+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:12:40.085565+0000","last_undegraded":"2024-04-23T10:12:40.085565+0000","last_fullsized":"2024-04-23T10:12:40.085565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425505+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:12:40.425505+0000","last_peered":"2024-04-23T10:12:40.425505+0000","last_clean":"2024-04-23T10:12:40.425505+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:12:40.425505+0000","last_undegraded":"2024-04-23T10:12:40.425505+0000","last_fullsized":"2024-04-23T10:12:40.425505+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424225+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:12:40.424225+0000","last_peered":"2024-04-23T10:12:40.424225+0000","last_clean":"2024-04-23T10:12:40.424225+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:12:40.424225+0000","last_undegraded":"2024-04-23T10:12:40.424225+0000","last_fullsized":"2024-04-23T10:12:40.424225+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084798+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:12:40.084798+0000","last_peered":"2024-04-23T10:12:40.084798+0000","last_clean":"2024-04-23T10:12:40.084798+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:12:40.084798+0000","last_undegraded":"2024-04-23T10:12:40.084798+0000","last_fullsized":"2024-04-23T10:12:40.084798+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082819+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:12:40.082819+0000","last_peered":"2024-04-23T10:12:40.082819+0000","last_clean":"2024-04-23T10:12:40.082819+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:12:40.082819+0000","last_undegraded":"2024-04-23T10:12:40.082819+0000","last_fullsized":"2024-04-23T10:12:40.082819+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425110+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:12:40.425110+0000","last_peered":"2024-04-23T10:12:40.425110+0000","last_clean":"2024-04-23T10:12:40.425110+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:12:40.425110+0000","last_undegraded":"2024-04-23T10:12:40.425110+0000","last_fullsized":"2024-04-23T10:12:40.425110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424421+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:12:40.424421+0000","last_peered":"2024-04-23T10:12:40.424421+0000","last_clean":"2024-04-23T10:12:40.424421+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:12:40.424421+0000","last_undegraded":"2024-04-23T10:12:40.424421+0000","last_fullsized":"2024-04-23T10:12:40.424421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080451+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:12:40.080451+0000","last_peered":"2024-04-23T10:12:40.080451+0000","last_clean":"2024-04-23T10:12:40.080451+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:12:40.080451+0000","last_undegraded":"2024-04-23T10:12:40.080451+0000","last_fullsized":"2024-04-23T10:12:40.080451+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425432+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:12:40.425432+0000","last_peered":"2024-04-23T10:12:40.425432+0000","last_clean":"2024-04-23T10:12:40.425432+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:12:40.425432+0000","last_undegraded":"2024-04-23T10:12:40.425432+0000","last_fullsized":"2024-04-23T10:12:40.425432+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.693709+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:12:40.693709+0000","last_peered":"2024-04-23T10:12:40.693709+0000","last_clean":"2024-04-23T10:12:40.693709+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:12:40.693709+0000","last_undegraded":"2024-04-23T10:12:40.693709+0000","last_fullsized":"2024-04-23T10:12:40.693709+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735754+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:12:40.735754+0000","last_peered":"2024-04-23T10:12:40.735754+0000","last_clean":"2024-04-23T10:12:40.735754+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:12:40.735754+0000","last_undegraded":"2024-04-23T10:12:40.735754+0000","last_fullsized":"2024-04-23T10:12:40.735754+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.695103+0000","last_change":"2024-04-23T10:12:39.144005+0000","last_active":"2024-04-23T10:12:40.695103+0000","last_peered":"2024-04-23T10:12:40.695103+0000","last_clean":"2024-04-23T10:12:40.695103+0000","last_became_active":"2024-04-23T10:12:39.143429+0000","last_became_peered":"2024-04-23T10:12:39.143429+0000","last_unstale":"2024-04-23T10:12:40.695103+0000","last_undegraded":"2024-04-23T10:12:40.695103+0000","last_fullsized":"2024-04-23T10:12:40.695103+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:28:05.706347+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,7],"acting":[0,1,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227291+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:12:40.227291+0000","last_peered":"2024-04-23T10:12:40.227291+0000","last_clean":"2024-04-23T10:12:40.227291+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:12:40.227291+0000","last_undegraded":"2024-04-23T10:12:40.227291+0000","last_fullsized":"2024-04-23T10:12:40.227291+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083722+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:12:40.083722+0000","last_peered":"2024-04-23T10:12:40.083722+0000","last_clean":"2024-04-23T10:12:40.083722+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:12:40.083722+0000","last_undegraded":"2024-04-23T10:12:40.083722+0000","last_fullsized":"2024-04-23T10:12:40.083722+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":178,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736031+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:12:40.736031+0000","last_peered":"2024-04-23T10:12:40.736031+0000","last_clean":"2024-04-23T10:12:40.736031+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:12:40.736031+0000","last_undegraded":"2024-04-23T10:12:40.736031+0000","last_fullsized":"2024-04-23T10:12:40.736031+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222912+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:12:40.222912+0000","last_peered":"2024-04-23T10:12:40.222912+0000","last_clean":"2024-04-23T10:12:40.222912+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:12:40.222912+0000","last_undegraded":"2024-04-23T10:12:40.222912+0000","last_fullsized":"2024-04-23T10:12:40.222912+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736371+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:12:40.736371+0000","last_peered":"2024-04-23T10:12:40.736371+0000","last_clean":"2024-04-23T10:12:40.736371+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:12:40.736371+0000","last_undegraded":"2024-04-23T10:12:40.736371+0000","last_fullsized":"2024-04-23T10:12:40.736371+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080981+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:12:40.080981+0000","last_peered":"2024-04-23T10:12:40.080981+0000","last_clean":"2024-04-23T10:12:40.080981+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:12:40.080981+0000","last_undegraded":"2024-04-23T10:12:40.080981+0000","last_fullsized":"2024-04-23T10:12:40.080981+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224993+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:12:40.224993+0000","last_peered":"2024-04-23T10:12:40.224993+0000","last_clean":"2024-04-23T10:12:40.224993+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:12:40.224993+0000","last_undegraded":"2024-04-23T10:12:40.224993+0000","last_fullsized":"2024-04-23T10:12:40.224993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.084202+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:12:40.084202+0000","last_peered":"2024-04-23T10:12:40.084202+0000","last_clean":"2024-04-23T10:12:40.084202+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:12:40.084202+0000","last_undegraded":"2024-04-23T10:12:40.084202+0000","last_fullsized":"2024-04-23T10:12:40.084202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425618+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:12:40.425618+0000","last_peered":"2024-04-23T10:12:40.425618+0000","last_clean":"2024-04-23T10:12:40.425618+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:12:40.425618+0000","last_undegraded":"2024-04-23T10:12:40.425618+0000","last_fullsized":"2024-04-23T10:12:40.425618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694791+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:12:40.694791+0000","last_peered":"2024-04-23T10:12:40.694791+0000","last_clean":"2024-04-23T10:12:40.694791+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:12:40.694791+0000","last_undegraded":"2024-04-23T10:12:40.694791+0000","last_fullsized":"2024-04-23T10:12:40.694791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737351+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:12:40.737351+0000","last_peered":"2024-04-23T10:12:40.737351+0000","last_clean":"2024-04-23T10:12:40.737351+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:12:40.737351+0000","last_undegraded":"2024-04-23T10:12:40.737351+0000","last_fullsized":"2024-04-23T10:12:40.737351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081400+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:12:40.081400+0000","last_peered":"2024-04-23T10:12:40.081400+0000","last_clean":"2024-04-23T10:12:40.081400+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:12:40.081400+0000","last_undegraded":"2024-04-23T10:12:40.081400+0000","last_fullsized":"2024-04-23T10:12:40.081400+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080961+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:12:40.080961+0000","last_peered":"2024-04-23T10:12:40.080961+0000","last_clean":"2024-04-23T10:12:40.080961+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:12:40.080961+0000","last_undegraded":"2024-04-23T10:12:40.080961+0000","last_fullsized":"2024-04-23T10:12:40.080961+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736518+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:12:40.736518+0000","last_peered":"2024-04-23T10:12:40.736518+0000","last_clean":"2024-04-23T10:12:40.736518+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:12:40.736518+0000","last_undegraded":"2024-04-23T10:12:40.736518+0000","last_fullsized":"2024-04-23T10:12:40.736518+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085364+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:12:40.085364+0000","last_peered":"2024-04-23T10:12:40.085364+0000","last_clean":"2024-04-23T10:12:40.085364+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:12:40.085364+0000","last_undegraded":"2024-04-23T10:12:40.085364+0000","last_fullsized":"2024-04-23T10:12:40.085364+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081041+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:12:40.081041+0000","last_peered":"2024-04-23T10:12:40.081041+0000","last_clean":"2024-04-23T10:12:40.081041+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:12:40.081041+0000","last_undegraded":"2024-04-23T10:12:40.081041+0000","last_fullsized":"2024-04-23T10:12:40.081041+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736041+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:12:40.736041+0000","last_peered":"2024-04-23T10:12:40.736041+0000","last_clean":"2024-04-23T10:12:40.736041+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:12:40.736041+0000","last_undegraded":"2024-04-23T10:12:40.736041+0000","last_fullsized":"2024-04-23T10:12:40.736041+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"23'8","reported_seq":29,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080265+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:12:40.080265+0000","last_peered":"2024-04-23T10:12:40.080265+0000","last_clean":"2024-04-23T10:12:40.080265+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:12:40.080265+0000","last_undegraded":"2024-04-23T10:12:40.080265+0000","last_fullsized":"2024-04-23T10:12:40.080265+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694649+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:12:40.694649+0000","last_peered":"2024-04-23T10:12:40.694649+0000","last_clean":"2024-04-23T10:12:40.694649+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:12:40.694649+0000","last_undegraded":"2024-04-23T10:12:40.694649+0000","last_fullsized":"2024-04-23T10:12:40.694649+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222505+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:12:40.222505+0000","last_peered":"2024-04-23T10:12:40.222505+0000","last_clean":"2024-04-23T10:12:40.222505+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:12:40.222505+0000","last_undegraded":"2024-04-23T10:12:40.222505+0000","last_fullsized":"2024-04-23T10:12:40.222505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223019+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:12:40.223019+0000","last_peered":"2024-04-23T10:12:40.223019+0000","last_clean":"2024-04-23T10:12:40.223019+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:12:40.223019+0000","last_undegraded":"2024-04-23T10:12:40.223019+0000","last_fullsized":"2024-04-23T10:12:40.223019+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228197+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:12:40.228197+0000","last_peered":"2024-04-23T10:12:40.228197+0000","last_clean":"2024-04-23T10:12:40.228197+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:12:40.228197+0000","last_undegraded":"2024-04-23T10:12:40.228197+0000","last_fullsized":"2024-04-23T10:12:40.228197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736505+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:12:40.736505+0000","last_peered":"2024-04-23T10:12:40.736505+0000","last_clean":"2024-04-23T10:12:40.736505+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:12:40.736505+0000","last_undegraded":"2024-04-23T10:12:40.736505+0000","last_fullsized":"2024-04-23T10:12:40.736505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083055+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:12:40.083055+0000","last_peered":"2024-04-23T10:12:40.083055+0000","last_clean":"2024-04-23T10:12:40.083055+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:12:40.083055+0000","last_undegraded":"2024-04-23T10:12:40.083055+0000","last_fullsized":"2024-04-23T10:12:40.083055+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228406+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:12:40.228406+0000","last_peered":"2024-04-23T10:12:40.228406+0000","last_clean":"2024-04-23T10:12:40.228406+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:12:40.228406+0000","last_undegraded":"2024-04-23T10:12:40.228406+0000","last_fullsized":"2024-04-23T10:12:40.228406+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694309+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:12:40.694309+0000","last_peered":"2024-04-23T10:12:40.694309+0000","last_clean":"2024-04-23T10:12:40.694309+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:12:40.694309+0000","last_undegraded":"2024-04-23T10:12:40.694309+0000","last_fullsized":"2024-04-23T10:12:40.694309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"23'2","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694950+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:12:40.694950+0000","last_peered":"2024-04-23T10:12:40.694950+0000","last_clean":"2024-04-23T10:12:40.694950+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:12:40.694950+0000","last_undegraded":"2024-04-23T10:12:40.694950+0000","last_fullsized":"2024-04-23T10:12:40.694950+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":34,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085118+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:12:40.085118+0000","last_peered":"2024-04-23T10:12:40.085118+0000","last_clean":"2024-04-23T10:12:40.085118+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:12:40.085118+0000","last_undegraded":"2024-04-23T10:12:40.085118+0000","last_fullsized":"2024-04-23T10:12:40.085118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736101+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:12:40.736101+0000","last_peered":"2024-04-23T10:12:40.736101+0000","last_clean":"2024-04-23T10:12:40.736101+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:12:40.736101+0000","last_undegraded":"2024-04-23T10:12:40.736101+0000","last_fullsized":"2024-04-23T10:12:40.736101+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"24'9","reported_seq":31,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:50.524048+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:12:50.524048+0000","last_peered":"2024-04-23T10:12:50.524048+0000","last_clean":"2024-04-23T10:12:50.524048+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:12:50.524048+0000","last_undegraded":"2024-04-23T10:12:50.524048+0000","last_fullsized":"2024-04-23T10:12:50.524048+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3842,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424501+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:12:40.424501+0000","last_peered":"2024-04-23T10:12:40.424501+0000","last_clean":"2024-04-23T10:12:40.424501+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:12:40.424501+0000","last_undegraded":"2024-04-23T10:12:40.424501+0000","last_fullsized":"2024-04-23T10:12:40.424501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083129+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:12:40.083129+0000","last_peered":"2024-04-23T10:12:40.083129+0000","last_clean":"2024-04-23T10:12:40.083129+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:12:40.083129+0000","last_undegraded":"2024-04-23T10:12:40.083129+0000","last_fullsized":"2024-04-23T10:12:40.083129+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"23'3","reported_seq":25,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425386+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:12:40.425386+0000","last_peered":"2024-04-23T10:12:40.425386+0000","last_clean":"2024-04-23T10:12:40.425386+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:12:40.425386+0000","last_undegraded":"2024-04-23T10:12:40.425386+0000","last_fullsized":"2024-04-23T10:12:40.425386+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083595+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:12:40.083595+0000","last_peered":"2024-04-23T10:12:40.083595+0000","last_clean":"2024-04-23T10:12:40.083595+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:12:40.083595+0000","last_undegraded":"2024-04-23T10:12:40.083595+0000","last_fullsized":"2024-04-23T10:12:40.083595+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694569+0000","last_change":"2024-04-23T10:12:35.029157+0000","last_active":"2024-04-23T10:12:40.694569+0000","last_peered":"2024-04-23T10:12:40.694569+0000","last_clean":"2024-04-23T10:12:40.694569+0000","last_became_active":"2024-04-23T10:12:35.028122+0000","last_became_peered":"2024-04-23T10:12:35.028122+0000","last_unstale":"2024-04-23T10:12:40.694569+0000","last_undegraded":"2024-04-23T10:12:40.694569+0000","last_fullsized":"2024-04-23T10:12:40.694569+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:58:30.644364+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085259+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:12:40.085259+0000","last_peered":"2024-04-23T10:12:40.085259+0000","last_clean":"2024-04-23T10:12:40.085259+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:12:40.085259+0000","last_undegraded":"2024-04-23T10:12:40.085259+0000","last_fullsized":"2024-04-23T10:12:40.085259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227674+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:12:40.227674+0000","last_peered":"2024-04-23T10:12:40.227674+0000","last_clean":"2024-04-23T10:12:40.227674+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:12:40.227674+0000","last_undegraded":"2024-04-23T10:12:40.227674+0000","last_fullsized":"2024-04-23T10:12:40.227674+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.085010+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:12:40.085010+0000","last_peered":"2024-04-23T10:12:40.085010+0000","last_clean":"2024-04-23T10:12:40.085010+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:12:40.085010+0000","last_undegraded":"2024-04-23T10:12:40.085010+0000","last_fullsized":"2024-04-23T10:12:40.085010+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224170+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:12:40.224170+0000","last_peered":"2024-04-23T10:12:40.224170+0000","last_clean":"2024-04-23T10:12:40.224170+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:12:40.224170+0000","last_undegraded":"2024-04-23T10:12:40.224170+0000","last_fullsized":"2024-04-23T10:12:40.224170+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227262+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:12:40.227262+0000","last_peered":"2024-04-23T10:12:40.227262+0000","last_clean":"2024-04-23T10:12:40.227262+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:12:40.227262+0000","last_undegraded":"2024-04-23T10:12:40.227262+0000","last_fullsized":"2024-04-23T10:12:40.227262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423747+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:12:40.423747+0000","last_peered":"2024-04-23T10:12:40.423747+0000","last_clean":"2024-04-23T10:12:40.423747+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:12:40.423747+0000","last_undegraded":"2024-04-23T10:12:40.423747+0000","last_fullsized":"2024-04-23T10:12:40.423747+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"0'0","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081194+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:12:40.081194+0000","last_peered":"2024-04-23T10:12:40.081194+0000","last_clean":"2024-04-23T10:12:40.081194+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:12:40.081194+0000","last_undegraded":"2024-04-23T10:12:40.081194+0000","last_fullsized":"2024-04-23T10:12:40.081194+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.224019+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:12:40.224019+0000","last_peered":"2024-04-23T10:12:40.224019+0000","last_clean":"2024-04-23T10:12:40.224019+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:12:40.224019+0000","last_undegraded":"2024-04-23T10:12:40.224019+0000","last_fullsized":"2024-04-23T10:12:40.224019+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227536+0000","last_change":"2024-04-23T10:12:35.031938+0000","last_active":"2024-04-23T10:12:40.227536+0000","last_peered":"2024-04-23T10:12:40.227536+0000","last_clean":"2024-04-23T10:12:40.227536+0000","last_became_active":"2024-04-23T10:12:35.031645+0000","last_became_peered":"2024-04-23T10:12:35.031645+0000","last_unstale":"2024-04-23T10:12:40.227536+0000","last_undegraded":"2024-04-23T10:12:40.227536+0000","last_fullsized":"2024-04-23T10:12:40.227536+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:26.960607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.19","version":"0'0","reported_seq":21,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:12:40.227565+0000","last_peered":"2024-04-23T10:12:40.227565+0000","last_clean":"2024-04-23T10:12:40.227565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:12:40.227565+0000","last_undegraded":"2024-04-23T10:12:40.227565+0000","last_fullsized":"2024-04-23T10:12:40.227565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"23'1","reported_seq":23,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223106+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:12:40.223106+0000","last_peered":"2024-04-23T10:12:40.223106+0000","last_clean":"2024-04-23T10:12:40.223106+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:12:40.223106+0000","last_undegraded":"2024-04-23T10:12:40.223106+0000","last_fullsized":"2024-04-23T10:12:40.223106+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694872+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:12:40.694872+0000","last_peered":"2024-04-23T10:12:40.694872+0000","last_clean":"2024-04-23T10:12:40.694872+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:12:40.694872+0000","last_undegraded":"2024-04-23T10:12:40.694872+0000","last_fullsized":"2024-04-23T10:12:40.694872+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081034+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:12:40.081034+0000","last_peered":"2024-04-23T10:12:40.081034+0000","last_clean":"2024-04-23T10:12:40.081034+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:12:40.081034+0000","last_undegraded":"2024-04-23T10:12:40.081034+0000","last_fullsized":"2024-04-23T10:12:40.081034+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"23'1","reported_seq":22,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227530+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:12:40.227530+0000","last_peered":"2024-04-23T10:12:40.227530+0000","last_clean":"2024-04-23T10:12:40.227530+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:12:40.227530+0000","last_undegraded":"2024-04-23T10:12:40.227530+0000","last_fullsized":"2024-04-23T10:12:40.227530+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083585+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:12:40.083585+0000","last_peered":"2024-04-23T10:12:40.083585+0000","last_clean":"2024-04-23T10:12:40.083585+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:12:40.083585+0000","last_undegraded":"2024-04-23T10:12:40.083585+0000","last_fullsized":"2024-04-23T10:12:40.083585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":14,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227924+0000","last_change":"2024-04-23T10:12:39.089619+0000","last_active":"2024-04-23T10:12:40.227924+0000","last_peered":"2024-04-23T10:12:40.227924+0000","last_clean":"2024-04-23T10:12:40.227924+0000","last_became_active":"2024-04-23T10:12:39.080595+0000","last_became_peered":"2024-04-23T10:12:39.080595+0000","last_unstale":"2024-04-23T10:12:40.227924+0000","last_undegraded":"2024-04-23T10:12:40.227924+0000","last_fullsized":"2024-04-23T10:12:40.227924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:22.568699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,4,2],"acting":[3,1,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.222192+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:12:40.222192+0000","last_peered":"2024-04-23T10:12:40.222192+0000","last_clean":"2024-04-23T10:12:40.222192+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:12:40.222192+0000","last_undegraded":"2024-04-23T10:12:40.222192+0000","last_fullsized":"2024-04-23T10:12:40.222192+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080449+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:12:40.080449+0000","last_peered":"2024-04-23T10:12:40.080449+0000","last_clean":"2024-04-23T10:12:40.080449+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:12:40.080449+0000","last_undegraded":"2024-04-23T10:12:40.080449+0000","last_fullsized":"2024-04-23T10:12:40.080449+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082564+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:12:40.082564+0000","last_peered":"2024-04-23T10:12:40.082564+0000","last_clean":"2024-04-23T10:12:40.082564+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:12:40.082564+0000","last_undegraded":"2024-04-23T10:12:40.082564+0000","last_fullsized":"2024-04-23T10:12:40.082564+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694554+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:12:40.694554+0000","last_peered":"2024-04-23T10:12:40.694554+0000","last_clean":"2024-04-23T10:12:40.694554+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:12:40.694554+0000","last_undegraded":"2024-04-23T10:12:40.694554+0000","last_fullsized":"2024-04-23T10:12:40.694554+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228250+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:12:40.228250+0000","last_peered":"2024-04-23T10:12:40.228250+0000","last_clean":"2024-04-23T10:12:40.228250+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:12:40.228250+0000","last_undegraded":"2024-04-23T10:12:40.228250+0000","last_fullsized":"2024-04-23T10:12:40.228250+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.424882+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:12:40.424882+0000","last_peered":"2024-04-23T10:12:40.424882+0000","last_clean":"2024-04-23T10:12:40.424882+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:12:40.424882+0000","last_undegraded":"2024-04-23T10:12:40.424882+0000","last_fullsized":"2024-04-23T10:12:40.424882+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223845+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:12:40.223845+0000","last_peered":"2024-04-23T10:12:40.223845+0000","last_clean":"2024-04-23T10:12:40.223845+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:12:40.223845+0000","last_undegraded":"2024-04-23T10:12:40.223845+0000","last_fullsized":"2024-04-23T10:12:40.223845+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.228257+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:12:40.228257+0000","last_peered":"2024-04-23T10:12:40.228257+0000","last_clean":"2024-04-23T10:12:40.228257+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:12:40.228257+0000","last_undegraded":"2024-04-23T10:12:40.228257+0000","last_fullsized":"2024-04-23T10:12:40.228257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081108+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:12:40.081108+0000","last_peered":"2024-04-23T10:12:40.081108+0000","last_clean":"2024-04-23T10:12:40.081108+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:12:40.081108+0000","last_undegraded":"2024-04-23T10:12:40.081108+0000","last_fullsized":"2024-04-23T10:12:40.081108+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227349+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:12:40.227349+0000","last_peered":"2024-04-23T10:12:40.227349+0000","last_clean":"2024-04-23T10:12:40.227349+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:12:40.227349+0000","last_undegraded":"2024-04-23T10:12:40.227349+0000","last_fullsized":"2024-04-23T10:12:40.227349+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082447+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:12:40.082447+0000","last_peered":"2024-04-23T10:12:40.082447+0000","last_clean":"2024-04-23T10:12:40.082447+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:12:40.082447+0000","last_undegraded":"2024-04-23T10:12:40.082447+0000","last_fullsized":"2024-04-23T10:12:40.082447+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223339+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:12:40.223339+0000","last_peered":"2024-04-23T10:12:40.223339+0000","last_clean":"2024-04-23T10:12:40.223339+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:12:40.223339+0000","last_undegraded":"2024-04-23T10:12:40.223339+0000","last_fullsized":"2024-04-23T10:12:40.223339+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.736824+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:12:40.736824+0000","last_peered":"2024-04-23T10:12:40.736824+0000","last_clean":"2024-04-23T10:12:40.736824+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:12:40.736824+0000","last_undegraded":"2024-04-23T10:12:40.736824+0000","last_fullsized":"2024-04-23T10:12:40.736824+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.081276+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:12:40.081276+0000","last_peered":"2024-04-23T10:12:40.081276+0000","last_clean":"2024-04-23T10:12:40.081276+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:12:40.081276+0000","last_undegraded":"2024-04-23T10:12:40.081276+0000","last_fullsized":"2024-04-23T10:12:40.081276+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.086183+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:12:40.086183+0000","last_peered":"2024-04-23T10:12:40.086183+0000","last_clean":"2024-04-23T10:12:40.086183+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:12:40.086183+0000","last_undegraded":"2024-04-23T10:12:40.086183+0000","last_fullsized":"2024-04-23T10:12:40.086183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.080933+0000","last_change":"2024-04-23T10:12:35.032838+0000","last_active":"2024-04-23T10:12:40.080933+0000","last_peered":"2024-04-23T10:12:40.080933+0000","last_clean":"2024-04-23T10:12:40.080933+0000","last_became_active":"2024-04-23T10:12:35.032273+0000","last_became_peered":"2024-04-23T10:12:35.032273+0000","last_unstale":"2024-04-23T10:12:40.080933+0000","last_undegraded":"2024-04-23T10:12:40.080933+0000","last_fullsized":"2024-04-23T10:12:40.080933+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:24:44.150683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.423818+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:12:40.423818+0000","last_peered":"2024-04-23T10:12:40.423818+0000","last_clean":"2024-04-23T10:12:40.423818+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:12:40.423818+0000","last_undegraded":"2024-04-23T10:12:40.423818+0000","last_fullsized":"2024-04-23T10:12:40.423818+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694211+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:12:40.694211+0000","last_peered":"2024-04-23T10:12:40.694211+0000","last_clean":"2024-04-23T10:12:40.694211+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:12:40.694211+0000","last_undegraded":"2024-04-23T10:12:40.694211+0000","last_fullsized":"2024-04-23T10:12:40.694211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227425+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:12:40.227425+0000","last_peered":"2024-04-23T10:12:40.227425+0000","last_clean":"2024-04-23T10:12:40.227425+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:12:40.227425+0000","last_undegraded":"2024-04-23T10:12:40.227425+0000","last_fullsized":"2024-04-23T10:12:40.227425+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082582+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:12:40.082582+0000","last_peered":"2024-04-23T10:12:40.082582+0000","last_clean":"2024-04-23T10:12:40.082582+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:12:40.082582+0000","last_undegraded":"2024-04-23T10:12:40.082582+0000","last_fullsized":"2024-04-23T10:12:40.082582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223336+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:12:40.223336+0000","last_peered":"2024-04-23T10:12:40.223336+0000","last_clean":"2024-04-23T10:12:40.223336+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:12:40.223336+0000","last_undegraded":"2024-04-23T10:12:40.223336+0000","last_fullsized":"2024-04-23T10:12:40.223336+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.223648+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:12:40.223648+0000","last_peered":"2024-04-23T10:12:40.223648+0000","last_clean":"2024-04-23T10:12:40.223648+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:12:40.223648+0000","last_undegraded":"2024-04-23T10:12:40.223648+0000","last_fullsized":"2024-04-23T10:12:40.223648+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737307+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:12:40.737307+0000","last_peered":"2024-04-23T10:12:40.737307+0000","last_clean":"2024-04-23T10:12:40.737307+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:12:40.737307+0000","last_undegraded":"2024-04-23T10:12:40.737307+0000","last_fullsized":"2024-04-23T10:12:40.737307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.227175+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:12:40.227175+0000","last_peered":"2024-04-23T10:12:40.227175+0000","last_clean":"2024-04-23T10:12:40.227175+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:12:40.227175+0000","last_undegraded":"2024-04-23T10:12:40.227175+0000","last_fullsized":"2024-04-23T10:12:40.227175+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735764+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:12:40.735764+0000","last_peered":"2024-04-23T10:12:40.735764+0000","last_clean":"2024-04-23T10:12:40.735764+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:12:40.735764+0000","last_undegraded":"2024-04-23T10:12:40.735764+0000","last_fullsized":"2024-04-23T10:12:40.735764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.082310+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:12:40.082310+0000","last_peered":"2024-04-23T10:12:40.082310+0000","last_clean":"2024-04-23T10:12:40.082310+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:12:40.082310+0000","last_undegraded":"2024-04-23T10:12:40.082310+0000","last_fullsized":"2024-04-23T10:12:40.082310+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.735994+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:12:40.735994+0000","last_peered":"2024-04-23T10:12:40.735994+0000","last_clean":"2024-04-23T10:12:40.735994+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:12:40.735994+0000","last_undegraded":"2024-04-23T10:12:40.735994+0000","last_fullsized":"2024-04-23T10:12:40.735994+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.083953+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:12:40.083953+0000","last_peered":"2024-04-23T10:12:40.083953+0000","last_clean":"2024-04-23T10:12:40.083953+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:12:40.083953+0000","last_undegraded":"2024-04-23T10:12:40.083953+0000","last_fullsized":"2024-04-23T10:12:40.083953+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":19,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.694253+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:12:40.694253+0000","last_peered":"2024-04-23T10:12:40.694253+0000","last_clean":"2024-04-23T10:12:40.694253+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:12:40.694253+0000","last_undegraded":"2024-04-23T10:12:40.694253+0000","last_fullsized":"2024-04-23T10:12:40.694253+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.425202+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:12:40.425202+0000","last_peered":"2024-04-23T10:12:40.425202+0000","last_clean":"2024-04-23T10:12:40.425202+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:12:40.425202+0000","last_undegraded":"2024-04-23T10:12:40.425202+0000","last_fullsized":"2024-04-23T10:12:40.425202+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":20,"reported_epoch":24,"state":"active+clean","last_fresh":"2024-04-23T10:12:40.737045+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:12:40.737045+0000","last_peered":"2024-04-23T10:12:40.737045+0000","last_clean":"2024-04-23T10:12:40.737045+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:12:40.737045+0000","last_undegraded":"2024-04-23T10:12:40.737045+0000","last_fullsized":"2024-04-23T10:12:40.737045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":4640,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":18,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":9280,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":42,"ondisk_log_size":42,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27852,"kb_used_data":832,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343988,"statfs":{"total":96636764160,"available":96608243712,"internally_reserved":0,"allocated":851968,"data_stored":691206,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574858,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27276,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344564,"statfs":{"total":96636764160,"available":96608833536,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":252,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":258048,"data_stored":100346,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27280,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344560,"statfs":{"total":96636764160,"available":96608829440,"internally_reserved":0,"allocated":266240,"data_stored":100382,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574860,"num_pgs":49,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":260,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":266240,"data_stored":104098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":23,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31428,"kb_used_data":248,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340412,"statfs":{"total":96636764160,"available":96604581888,"internally_reserved":0,"allocated":253952,"data_stored":100256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31436,"kb_used_data":256,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340404,"statfs":{"total":96636764160,"available":96604573696,"internally_reserved":0,"allocated":262144,"data_stored":100416,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574859,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32020,"kb_used_data":840,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339820,"statfs":{"total":96636764160,"available":96603975680,"internally_reserved":0,"allocated":860160,"data_stored":691262,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":638,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":160,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":126,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":90,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":3842,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":582,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:04.837 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T10:13:04.837 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-23T10:13:04.837 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-23T10:13:04.837 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:13:04.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 Processor -- start 2024-04-23T10:13:04.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 -- start start 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2cfc14ffa0 0x7f2cfc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2cfc0c5d70 con 0x7f2cfc074100 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2cfc0c6050 con 0x7f2cfc14ffa0 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d03f15640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2cfc0c6330 con 0x7f2cfc14fbc0 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d024b2640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2cfc074100 0x7f2cfc0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57646/0 (socket says 172.21.15.26:57646) 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d024b2640 1 -- 172.21.15.26:0/1266938369 learned_addr learned my addr 172.21.15.26:0/1266938369 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d014b0640 1 --2- 172.21.15.26:0/1266938369 >> v2:172.21.15.26:3300/0 conn(0x7f2cfc14ffa0 0x7f2cfc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d01cb1640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d00caf640 1 -- 172.21.15.26:0/1266938369 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3115063630 0 0) 0x7f2cfc0c5d70 con 0x7f2cfc074100 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d00caf640 1 -- 172.21.15.26:0/1266938369 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2ce8003530 con 0x7f2cfc074100 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d014b0640 1 -- 172.21.15.26:0/1266938369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 msgr2=0x7f2cfc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d014b0640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d014b0640 1 -- 172.21.15.26:0/1266938369 >> v1:172.21.15.26:6789/0 conn(0x7f2cfc074100 legacy=0x7f2cfc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.994+0000 7f2d014b0640 1 -- 172.21.15.26:0/1266938369 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc0c6610 con 0x7f2cfc14ffa0 2024-04-23T10:13:04.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d014b0640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c8220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0097c0 tx=0x7f2cec01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c277000f9b714af1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:04.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d00caf640 1 -- 172.21.15.26:0/1266938369 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0aa620 con 0x7f2cfc14ffa0 2024-04-23T10:13:04.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d00caf640 1 -- 172.21.15.26:0/1266938369 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cec0af070 con 0x7f2cfc14ffa0 2024-04-23T10:13:04.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d00caf640 1 -- 172.21.15.26:0/1266938369 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cec0aa9e0 con 0x7f2cfc14ffa0 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- 172.21.15.26:0/1266938369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc14ffa0 msgr2=0x7f2cfc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c8220 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0097c0 tx=0x7f2cec01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- 172.21.15.26:0/1266938369 shutdown_connections 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c8220 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 --2- 172.21.15.26:0/1266938369 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- 172.21.15.26:0/1266938369 >> 172.21.15.26:0/1266938369 conn(0x7f2cfc06b9d0 msgr2=0x7f2cfc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:04.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- 172.21.15.26:0/1266938369 shutdown_connections 2024-04-23T10:13:05.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- 172.21.15.26:0/1266938369 wait complete. 2024-04-23T10:13:05.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 Processor -- start 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:04.998+0000 7f2d03f15640 1 -- start start 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c48c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc166420 con 0x7f2cfc074100 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2cfc1662a0 con 0x7f2cfc14ffa0 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2cfc1665a0 con 0x7f2cfc14fbc0 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50584/0 (socket says 172.21.15.26:50584) 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 -- 172.21.15.26:0/4243133406 learned_addr learned my addr 172.21.15.26:0/4243133406 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:05.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d024b2640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c48c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 -- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 msgr2=0x7f2cfc144650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 -- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cfc14ffa0 msgr2=0x7f2cfc0c48c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c48c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 -- 172.21.15.26:0/4243133406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2cfc15cee0 con 0x7f2cfc074100 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d01cb1640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e960 tx=0x7f2cf800ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf8017070 con 0x7f2cfc074100 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2cf800ca00 con 0x7f2cfc074100 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2cfc0ca580 con 0x7f2cfc074100 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2cf800cdb0 con 0x7f2cfc074100 2024-04-23T10:13:05.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2cfc0cab40 con 0x7f2cfc074100 2024-04-23T10:13:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2cfc075df0 con 0x7f2cfc074100 2024-04-23T10:13:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2cf801a070 con 0x7f2cfc074100 2024-04-23T10:13:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 0x7f2ce006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:05.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f2cf8086cd0 con 0x7f2cfc074100 2024-04-23T10:13:05.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.002+0000 7f2d014b0640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 0x7f2ce006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:05.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.006+0000 7f2d014b0640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 0x7f2ce006a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ae000 tx=0x7f2cec004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:05.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.006+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2cf8056fe0 con 0x7f2cfc074100 2024-04-23T10:13:05.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.198+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f2cfc149a20 con 0x7f2cfc074100 2024-04-23T10:13:05.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.198+0000 7f2cf27fc640 1 -- 172.21.15.26:0/4243133406 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f2cf805be20 con 0x7f2cfc074100 2024-04-23T10:13:05.199 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:05.199 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 msgr2=0x7f2ce006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 0x7f2ce006a840 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f2cec0ae000 tx=0x7f2cec004740 comp rx=0 tx=0).stop 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 msgr2=0x7f2cfc15be70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7f2cf800e960 tx=0x7f2cf800ee20 comp rx=0 tx=0).stop 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 shutdown_connections 2024-04-23T10:13:05.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2ce0068380 0x7f2ce006a840 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2cfc14ffa0 0x7f2cfc0c48c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2cfc14fbc0 0x7f2cfc144650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 --2- 172.21.15.26:0/4243133406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2cfc074100 0x7f2cfc15be70 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 >> 172.21.15.26:0/4243133406 conn(0x7f2cfc06b9d0 msgr2=0x7f2cfc14e670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 shutdown_connections 2024-04-23T10:13:05.202 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:05.202+0000 7f2d03f15640 1 -- 172.21.15.26:0/4243133406 wait complete. 2024-04-23T10:13:05.504 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:13:05.507 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:13:08.218 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:13:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 Processor -- start 2024-04-23T10:13:08.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 -- start start 2024-04-23T10:13:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f53ec0c8a70 0x7f53ec152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec15b740 con 0x7f53ec0c8250 2024-04-23T10:13:08.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f53ec0c40f0 con 0x7f53ec0c8630 2024-04-23T10:13:08.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f2a5c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f53ec0c6490 con 0x7f53ec0c8a70 2024-04-23T10:13:08.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53ebfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f53ec0c8250 0x7f53ec0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:57650/0 (socket says 172.21.15.26:57650) 2024-04-23T10:13:08.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53ebfff640 1 -- 172.21.15.26:0/985214739 learned_addr learned my addr 172.21.15.26:0/985214739 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.346+0000 7f53f0ff9640 1 --2- 172.21.15.26:0/985214739 >> v2:172.21.15.190:3300/0 conn(0x7f53ec0c8a70 0x7f53ec152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 5434749 0 0) 0x7f53ec15b740 con 0x7f53ec0c8250 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f53d8003530 con 0x7f53ec0c8250 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1579687963 0 0) 0x7f53d8003530 con 0x7f53ec0c8250 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 >> v2:172.21.15.190:3300/0 conn(0x7f53ec0c8a70 msgr2=0x7f53ec152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 --2- 172.21.15.26:0/985214739 >> v2:172.21.15.190:3300/0 conn(0x7f53ec0c8a70 0x7f53ec152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 >> v1:172.21.15.190:6789/0 conn(0x7f53ec0c8630 legacy=0x7f53ec151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec0c58c0 con 0x7f53ec0c8250 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f53dc001680 con 0x7f53ec0c8250 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 >> v1:172.21.15.26:6789/0 conn(0x7f53ec0c8250 legacy=0x7f53ec0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80039c0 0x7f53d8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0c6490 con 0x7f53d8004810 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f53d800c170 con 0x7f53d80051d0 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f53d800c370 con 0x7f53d80039c0 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f0ff9640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53ebfff640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80039c0 0x7f53d8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 -- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80039c0 msgr2=0x7f53d8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d80039c0 0x7f53d8003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 -- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80051d0 msgr2=0x7f53d800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53d80051d0 0x7f53d800b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 -- 172.21.15.26:0/985214739 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53d8003530 con 0x7f53d8004810 2024-04-23T10:13:08.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f0ff9640 1 -- 172.21.15.26:0/985214739 reap_dead start 2024-04-23T10:13:08.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eb7fe640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f53d4001780 tx=0x7f53d401c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b55e240d99ac1ba1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d40013a0 con 0x7f53d8004810 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53d40052f0 con 0x7f53d8004810 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53eaffd640 1 -- 172.21.15.26:0/985214739 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53d4003840 con 0x7f53d8004810 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 -- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 msgr2=0x7f53d8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f53d4001780 tx=0x7f53d401c400 comp rx=0 tx=0).stop 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 -- 172.21.15.26:0/985214739 shutdown_connections 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/985214739 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53d8004810 0x7f53d8004c90 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 -- 172.21.15.26:0/985214739 >> 172.21.15.26:0/985214739 conn(0x7f53ec06b9d0 msgr2=0x7f53ec06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 -- 172.21.15.26:0/985214739 shutdown_connections 2024-04-23T10:13:08.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.350+0000 7f53f2a5c640 1 -- 172.21.15.26:0/985214739 wait complete. 2024-04-23T10:13:08.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 Processor -- start 2024-04-23T10:13:08.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- start start 2024-04-23T10:13:08.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d8004810 0x7f53ec073870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53ec156270 0x7f53ec157250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec15b400 con 0x7f53ec157790 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f53ec0721a0 con 0x7f53ec156270 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f53ec0c6920 con 0x7f53d8004810 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50604/0 (socket says 172.21.15.26:50604) 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 -- 172.21.15.26:0/1198677947 learned_addr learned my addr 172.21.15.26:0/1198677947 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53ebfff640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d8004810 0x7f53ec073870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53eb7fe640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53ec156270 0x7f53ec157250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 -- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d8004810 msgr2=0x7f53ec073870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d8004810 0x7f53ec073870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 -- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53ec156270 msgr2=0x7f53ec157250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53ec156270 0x7f53ec157250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 -- 172.21.15.26:0/1198677947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f53ec157c10 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f0ff9640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53ec070da0 tx=0x7f53e4007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4013640 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f53e4013800 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f53ec152a30 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f53e4013bf0 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f53ec1590e0 con 0x7f53ec157790 2024-04-23T10:13:08.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.354+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f53ec075df0 con 0x7f53ec157790 2024-04-23T10:13:08.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.358+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f53e401b020 con 0x7f53ec157790 2024-04-23T10:13:08.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.358+0000 7f53e8ff9640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 0x7f53cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:08.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.358+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f53e408a0c0 con 0x7f53ec157790 2024-04-23T10:13:08.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.358+0000 7f53ebfff640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 0x7f53cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:08.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.358+0000 7f53ebfff640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 0x7f53cc06a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001ec0 tx=0x7f53dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:08.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.362+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f53e4022060 con 0x7f53ec157790 2024-04-23T10:13:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.562+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f53ec071570 con 0x7f53ec157790 2024-04-23T10:13:08.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.562+0000 7f53e8ff9640 1 -- 172.21.15.26:0/1198677947 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f53ec157c10 con 0x7f53ec157790 2024-04-23T10:13:08.563 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:08.563 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 msgr2=0x7f53cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 0x7f53cc06a870 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7f53dc001ec0 tx=0x7f53dc009040 comp rx=0 tx=0).stop 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 msgr2=0x7f53ec143c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7f53ec070da0 tx=0x7f53e4007700 comp rx=0 tx=0).stop 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 shutdown_connections 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f53cc0683b0 0x7f53cc06a870 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f53ec157790 0x7f53ec143c10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f53ec156270 0x7f53ec157250 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 --2- 172.21.15.26:0/1198677947 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f53d8004810 0x7f53ec073870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 >> 172.21.15.26:0/1198677947 conn(0x7f53ec06b9d0 msgr2=0x7f53ec14fd40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 shutdown_connections 2024-04-23T10:13:08.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:08.566+0000 7f53f2a5c640 1 -- 172.21.15.26:0/1198677947 wait complete. 2024-04-23T10:13:08.999 INFO:tasks.ceph.mds.f.smithi190.stderr:2024-04-23T10:13:08.997+0000 7fe22f240640 -1 quiesce.mds.0 failed to decode message of type 1286 v1: End of buffer [buffer:2] 2024-04-23T10:13:11.582 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:13:11.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 Processor -- start 2024-04-23T10:13:11.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 -- start start 2024-04-23T10:13:11.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f902806d1c0 0x7f90280c88a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f902806d5a0 0x7f902806ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f90280c4be0 con 0x7f90280c6d50 2024-04-23T10:13:11.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f90280c8de0 con 0x7f902806d5a0 2024-04-23T10:13:11.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.714+0000 7f902f336640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9028070490 con 0x7f902806d1c0 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f902806d5a0 0x7f902806ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f902806d5a0 0x7f902806ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50620/0 (socket says 172.21.15.26:50620) 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 -- 172.21.15.26:0/3787687526 learned_addr learned my addr 172.21.15.26:0/3787687526 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902d0d2640 1 --2- 172.21.15.26:0/3787687526 >> v2:172.21.15.190:3300/0 conn(0x7f902806d1c0 0x7f90280c88a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 -- 172.21.15.26:0/3787687526 >> v2:172.21.15.190:3300/0 conn(0x7f902806d1c0 msgr2=0x7f90280c88a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 --2- 172.21.15.26:0/3787687526 >> v2:172.21.15.190:3300/0 conn(0x7f902806d1c0 0x7f90280c88a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 -- 172.21.15.26:0/3787687526 >> v1:172.21.15.190:6789/0 conn(0x7f90280c6d50 legacy=0x7f90280c71a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 -- 172.21.15.26:0/3787687526 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90280c9dd0 con 0x7f902806d5a0 2024-04-23T10:13:11.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902c8d1640 1 --2- 172.21.15.26:0/3787687526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f902806d5a0 0x7f902806ff50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9024009870 tx=0x7f902401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68f87b47feeb2ebb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:11.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f901ffff640 1 -- 172.21.15.26:0/3787687526 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240ab610 con 0x7f902806d5a0 2024-04-23T10:13:11.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f901ffff640 1 -- 172.21.15.26:0/3787687526 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f90240b0070 con 0x7f902806d5a0 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f901ffff640 1 -- 172.21.15.26:0/3787687526 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f90240ab9d0 con 0x7f902806d5a0 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 -- 172.21.15.26:0/3787687526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f902806d5a0 msgr2=0x7f902806ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 --2- 172.21.15.26:0/3787687526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f902806d5a0 0x7f902806ff50 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f9024009870 tx=0x7f902401c520 comp rx=0 tx=0).stop 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 -- 172.21.15.26:0/3787687526 shutdown_connections 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 --2- 172.21.15.26:0/3787687526 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f902806d5a0 0x7f902806ff50 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 --2- 172.21.15.26:0/3787687526 >> v2:172.21.15.190:3300/0 conn(0x7f902806d1c0 0x7f90280c88a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 -- 172.21.15.26:0/3787687526 >> 172.21.15.26:0/3787687526 conn(0x7f90280ca570 msgr2=0x7f90280ca980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 -- 172.21.15.26:0/3787687526 shutdown_connections 2024-04-23T10:13:11.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.718+0000 7f902f336640 1 -- 172.21.15.26:0/3787687526 wait complete. 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 Processor -- start 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- start start 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902806d1c0 0x7f90281f5960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902806d5a0 0x7f90281f18e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f90281531d0 con 0x7f90280c6d50 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9028070a00 con 0x7f902806d1c0 2024-04-23T10:13:11.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9028153350 con 0x7f902806d5a0 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50630/0 (socket says 172.21.15.26:50630) 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 -- 172.21.15.26:0/3994174835 learned_addr learned my addr 172.21.15.26:0/3994174835 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d0d2640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902806d1c0 0x7f90281f5960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902c8d1640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902806d5a0 0x7f90281f18e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 -- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902806d5a0 msgr2=0x7f90281f18e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902806d5a0 0x7f90281f18e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 -- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902806d1c0 msgr2=0x7f90281f5960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902806d1c0 0x7f90281f5960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 -- 172.21.15.26:0/3994174835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f90281f4ef0 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902d8d3640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f902000c760 tx=0x7f902000cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9020003b80 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9020003d20 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f902000aa30 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f902814a500 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.722+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f90281f5160 con 0x7f90280c6d50 2024-04-23T10:13:11.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9028075df0 con 0x7f90280c6d50 2024-04-23T10:13:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f902000abd0 con 0x7f90280c6d50 2024-04-23T10:13:11.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f901dffb640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 0x7f900c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 6532+0+0 (secure 0 0 0) 0x7f9020086aa0 con 0x7f90280c6d50 2024-04-23T10:13:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f902d0d2640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 0x7f900c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:11.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.726+0000 7f902d0d2640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 0x7f900c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90180079c0 tx=0x7f9018008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:11.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.730+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9020056d20 con 0x7f90280c6d50 2024-04-23T10:13:11.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f90281633e0 con 0x7f90280c6d50 2024-04-23T10:13:11.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f901dffb640 1 -- 172.21.15.26:0/3994174835 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+196 (secure 0 0 0) 0x7f9020056620 con 0x7f90280c6d50 2024-04-23T10:13:11.929 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:11.929 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_WARN","checks":{"MDS_UP_LESS_THAN_MAX":{"severity":"HEALTH_WARN","summary":{"message":"1 filesystem is online with fewer MDS than max_mds","count":1},"muted":false}},"mutes":[]} 2024-04-23T10:13:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 msgr2=0x7f900c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 0x7f900c06a840 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f90180079c0 tx=0x7f9018008040 comp rx=0 tx=0).stop 2024-04-23T10:13:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 msgr2=0x7f90281495a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f902000c760 tx=0x7f902000cc20 comp rx=0 tx=0).stop 2024-04-23T10:13:11.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 shutdown_connections 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f900c068380 0x7f900c06a840 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f90280c6d50 0x7f90281495a0 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f902806d5a0 0x7f90281f18e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 --2- 172.21.15.26:0/3994174835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f902806d1c0 0x7f90281f5960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 >> 172.21.15.26:0/3994174835 conn(0x7f90280ca570 msgr2=0x7f90280cc450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 shutdown_connections 2024-04-23T10:13:11.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:11.930+0000 7f902f336640 1 -- 172.21.15.26:0/3994174835 wait complete. 2024-04-23T10:13:14.948 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-23T10:13:15.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.085+0000 7fedd3b39640 1 Processor -- start 2024-04-23T10:13:15.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.085+0000 7fedd3b39640 1 -- start start 2024-04-23T10:13:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.085+0000 7fedd3b39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedcc0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd3b39640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc15beb0 con 0x7fedcc155350 2024-04-23T10:13:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd3b39640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fedcc0ccc90 con 0x7fedcc15b0b0 2024-04-23T10:13:15.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd3b39640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc0cca40 con 0x7fedcc0cda50 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd18d5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fedcc155350 0x7fedcc0cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32796/0 (socket says 172.21.15.26:32796) 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd18d5640 1 -- 172.21.15.26:0/3203938904 learned_addr learned my addr 172.21.15.26:0/3203938904 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedcc0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 845195845 0 0) 0x7fedcc15beb0 con 0x7fedcc155350 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fedb8003530 con 0x7fedcc155350 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2700640922 0 0) 0x7fedb8003530 con 0x7fedcc155350 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 msgr2=0x7fedcc0c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedcc0c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 >> v1:172.21.15.190:6789/0 conn(0x7fedcc15b0b0 legacy=0x7fedcc15b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc0ccf70 con 0x7fedcc155350 2024-04-23T10:13:15.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fedc8001680 con 0x7fedcc155350 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 >> v1:172.21.15.26:6789/0 conn(0x7fedcc155350 legacy=0x7fedcc0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb80039f0 0x7fedb8003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb8004810 0x7fedb8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedb80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc0cca40 con 0x7fedb8004810 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedb800bb10 con 0x7fedb80039f0 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedb800bd10 con 0x7fedcc0cda50 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb8004810 0x7fedb8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd18d5640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb80039f0 0x7fedb8003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd20d6640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedb80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 -- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 msgr2=0x7fedb80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedcc0cda50 0x7fedb80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 -- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb80039f0 msgr2=0x7fedb8003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedb80039f0 0x7fedb8003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 -- 172.21.15.26:0/3203938904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedb8003530 con 0x7fedb8004810 2024-04-23T10:13:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd10d4640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb8004810 0x7fedb8004c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009ab0 tx=0x7fedc001ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=411b080aa6eefbea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc00b2070 con 0x7fedb8004810 2024-04-23T10:13:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc00a5620 con 0x7fedb8004810 2024-04-23T10:13:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.089+0000 7fedd08d3640 1 -- 172.21.15.26:0/3203938904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc00096b0 con 0x7fedb8004810 2024-04-23T10:13:15.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/3203938904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb8004810 msgr2=0x7fedb8004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 --2- 172.21.15.26:0/3203938904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedb8004810 0x7fedb8004c90 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fedc0009ab0 tx=0x7fedc001ca30 comp rx=0 tx=0).stop 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 -- 172.21.15.26:0/3203938904 reap_dead start 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/3203938904 shutdown_connections 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/3203938904 >> 172.21.15.26:0/3203938904 conn(0x7fedcc06cc30 msgr2=0x7fedcc06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/3203938904 shutdown_connections 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/3203938904 wait complete. 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 Processor -- start 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- start start 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb8004810 0x7fedcc1f1a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedcc151710 0x7fedcc0c7f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc0cd530 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fedcc15bc50 con 0x7fedcc151710 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fedcc155730 con 0x7fedb8004810 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34112/0 (socket says 172.21.15.26:34112) 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 -- 172.21.15.26:0/1681174257 learned_addr learned my addr 172.21.15.26:0/1681174257 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd10d4640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedcc151710 0x7fedcc0c7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd18d5640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb8004810 0x7fedcc1f1a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 -- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb8004810 msgr2=0x7fedcc1f1a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb8004810 0x7fedcc1f1a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 -- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedcc151710 msgr2=0x7fedcc0c7f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedcc151710 0x7fedcc0c7f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 -- 172.21.15.26:0/1681174257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fedcc0c9780 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd20d6640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06d2c0 tx=0x7fedc400e9e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc4003b90 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedc4018070 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fedcc155d20 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fedc40050d0 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.093+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fedcc1562a0 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fedcc075df0 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fedc4005270 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedbe7fc640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 0x7fedb006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7fedc4086b50 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedd18d5640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 0x7fedb006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.097+0000 7fedd18d5640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 0x7fedb006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c10 tx=0x7fedc8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.101+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fedc4056610 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.301+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7fedcc0cc610 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.301+0000 7fedbe7fc640 1 -- 172.21.15.26:0/1681174257 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7fedc405a910 con 0x7fedcc0ca5d0 2024-04-23T10:13:15.303 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:15.303 INFO:teuthology.orchestra.run.smithi026.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 msgr2=0x7fedb006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 0x7fedb006a840 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fedc8000c10 tx=0x7fedc8009040 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 msgr2=0x7fedcc14b0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7fedcc06d2c0 tx=0x7fedc400e9e0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 shutdown_connections 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fedb0068380 0x7fedb006a840 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fedcc0ca5d0 0x7fedcc14b0e0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fedcc151710 0x7fedcc0c7f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 --2- 172.21.15.26:0/1681174257 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fedb8004810 0x7fedcc1f1a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 >> 172.21.15.26:0/1681174257 conn(0x7fedcc06cc30 msgr2=0x7fedcc158cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 shutdown_connections 2024-04-23T10:13:15.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.305+0000 7fedd3b39640 1 -- 172.21.15.26:0/1681174257 wait complete. 2024-04-23T10:13:15.323 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-23T10:13:15.323 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 Processor -- start 2024-04-23T10:13:15.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 -- start start 2024-04-23T10:13:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 0x7f01a006e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01a00c2000 0x7f01a00cd3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f01a015e590 con 0x7f01a00c7a50 2024-04-23T10:13:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00c24b0 con 0x7f01a00c2000 2024-04-23T10:13:15.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a6e23640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f01a00c2700 con 0x7f01a0073fd0 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01a00c2000 0x7f01a00cd3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01a00c2000 0x7f01a00cd3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34120/0 (socket says 172.21.15.26:34120) 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 -- 172.21.15.26:0/4062286806 learned_addr learned my addr 172.21.15.26:0/4062286806 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a4bbf640 1 --2- 172.21.15.26:0/4062286806 >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 0x7f01a006e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 -- 172.21.15.26:0/4062286806 >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 msgr2=0x7f01a006e970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 --2- 172.21.15.26:0/4062286806 >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 0x7f01a006e970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 -- 172.21.15.26:0/4062286806 >> v1:172.21.15.190:6789/0 conn(0x7f01a00c7a50 legacy=0x7f01a015c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a53c0640 1 -- 172.21.15.26:0/4062286806 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a015e830 con 0x7f01a00c2000 2024-04-23T10:13:15.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.441+0000 7f01a4bbf640 1 --2- 172.21.15.26:0/4062286806 >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 0x7f01a006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:15.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a53c0640 1 --2- 172.21.15.26:0/4062286806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a00c2000 0x7f01a00cd3e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0198009e50 tx=0x7f019801f1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bf9bc7769a1c5f22 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019f7fe640 1 -- 172.21.15.26:0/4062286806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980b4070 con 0x7f01a00c2000 2024-04-23T10:13:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019f7fe640 1 -- 172.21.15.26:0/4062286806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01980af400 con 0x7f01a00c2000 2024-04-23T10:13:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019f7fe640 1 -- 172.21.15.26:0/4062286806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01980af7d0 con 0x7f01a00c2000 2024-04-23T10:13:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/4062286806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a00c2000 msgr2=0x7f01a00cd3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- 172.21.15.26:0/4062286806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a00c2000 0x7f01a00cd3e0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f0198009e50 tx=0x7f019801f1e0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/4062286806 shutdown_connections 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- 172.21.15.26:0/4062286806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a00c2000 0x7f01a00cd3e0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- 172.21.15.26:0/4062286806 >> v2:172.21.15.190:3300/0 conn(0x7f01a0073fd0 0x7f01a006e970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/4062286806 >> 172.21.15.26:0/4062286806 conn(0x7f01a006bdd0 msgr2=0x7f01a006c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/4062286806 shutdown_connections 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/4062286806 wait complete. 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 Processor -- start 2024-04-23T10:13:15.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- start start 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01a00c2000 0x7f01a00c9b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01a00c7a50 0x7f01a0071990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f01a00c29e0 con 0x7f01a0073fd0 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01a015edf0 con 0x7f01a00c7a50 2024-04-23T10:13:15.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01a00c2b60 con 0x7f01a00c2000 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34130/0 (socket says 172.21.15.26:34130) 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 -- 172.21.15.26:0/3451060302 learned_addr learned my addr 172.21.15.26:0/3451060302 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a53c0640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01a00c7a50 0x7f01a0071990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019ffff640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01a00c2000 0x7f01a00c9b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 -- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01a00c2000 msgr2=0x7f01a00c9b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01a00c2000 0x7f01a00c9b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 -- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01a00c7a50 msgr2=0x7f01a0071990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01a00c7a50 0x7f01a0071990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 -- 172.21.15.26:0/3451060302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01a014a5c0 con 0x7f01a0073fd0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a4bbf640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f019000e810 tx=0x7f019000ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0190017070 con 0x7f01a0073fd0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f019000c8d0 con 0x7f01a0073fd0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f01a015c920 con 0x7f01a0073fd0 2024-04-23T10:13:15.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.445+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f019000f040 con 0x7f01a0073fd0 2024-04-23T10:13:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01a015cee0 con 0x7f01a0073fd0 2024-04-23T10:13:15.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f01a0075df0 con 0x7f01a0073fd0 2024-04-23T10:13:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f019001a070 con 0x7f01a0073fd0 2024-04-23T10:13:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f019d7fa640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 0x7f018c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7f0190086a60 con 0x7f01a0073fd0 2024-04-23T10:13:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f019ffff640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 0x7f018c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.449+0000 7f019ffff640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 0x7f018c06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01a0155470 tx=0x7f0194009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.453+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0190056b80 con 0x7f01a0073fd0 2024-04-23T10:13:15.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.617+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f01a0073770 con 0x7f01a0073fd0 2024-04-23T10:13:15.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f019d7fa640 1 -- 172.21.15.26:0/3451060302 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v25) ==== 74+0+18936 (secure 0 0 0) 0x7f0190056480 con 0x7f01a0073fd0 2024-04-23T10:13:15.622 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:15.622 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":25,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:15.001272+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:15.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 msgr2=0x7f018c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 0x7f018c06a840 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7f01a0155470 tx=0x7f0194009040 comp rx=0 tx=0).stop 2024-04-23T10:13:15.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 msgr2=0x7f01a014a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f019000e810 tx=0x7f019000ecd0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 shutdown_connections 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f018c068380 0x7f018c06a840 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01a00c7a50 0x7f01a0071990 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01a00c2000 0x7f01a00c9b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 --2- 172.21.15.26:0/3451060302 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01a0073fd0 0x7f01a014a080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 >> 172.21.15.26:0/3451060302 conn(0x7f01a006bdd0 msgr2=0x7f01a0151740 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 shutdown_connections 2024-04-23T10:13:15.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.621+0000 7f01a6e23640 1 -- 172.21.15.26:0/3451060302 wait complete. 2024-04-23T10:13:15.641 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:13:15.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:13:15.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.765+0000 7f45b0f83640 1 Processor -- start 2024-04-23T10:13:15.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.765+0000 7f45b0f83640 1 -- start start 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45b0f83640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f45ac15f800 0x7f45ac15fbe0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45b0f83640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ac0c4800 con 0x7f45ac160120 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45b0f83640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f45ac0c4ac0 con 0x7f45ac159ac0 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45b0f83640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f45ac0c4da0 con 0x7f45ac15f800 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f45ac160120 0x7f45ac1593b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32812/0 (socket says 172.21.15.26:32812) 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 -- 172.21.15.26:0/3668945412 learned_addr learned my addr 172.21.15.26:0/3668945412 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:15.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45aa59c640 1 --2- 172.21.15.26:0/3668945412 >> v2:172.21.15.190:3300/0 conn(0x7f45ac15f800 0x7f45ac15fbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3499323075 0 0) 0x7f45ac0c4800 con 0x7f45ac160120 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4598003530 con 0x7f45ac160120 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3003117471 0 0) 0x7f4598003530 con 0x7f45ac160120 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 >> v2:172.21.15.190:3300/0 conn(0x7f45ac15f800 msgr2=0x7f45ac15fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 --2- 172.21.15.26:0/3668945412 >> v2:172.21.15.190:3300/0 conn(0x7f45ac15f800 0x7f45ac15fbe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 >> v1:172.21.15.190:6789/0 conn(0x7f45ac159ac0 legacy=0x7f45ac0c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ac0c5080 con 0x7f45ac160120 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4594001680 con 0x7f45ac160120 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 >> v1:172.21.15.26:6789/0 conn(0x7f45ac160120 legacy=0x7f45ac1593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45980039c0 0x7f4598003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f4598004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45980051d0 0x7f459800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac0c4da0 con 0x7f4598004810 2024-04-23T10:13:15.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f459800c070 con 0x7f45980039c0 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f459800c270 con 0x7f45980051d0 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f4598004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45aa59c640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45980039c0 0x7f4598003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45aad9d640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45980051d0 0x7f459800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 -- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45980051d0 msgr2=0x7f459800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45980051d0 0x7f459800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 -- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45980039c0 msgr2=0x7f4598003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45980039c0 0x7f4598003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45a1d9b640 1 -- 172.21.15.26:0/3668945412 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4598003530 con 0x7f4598004810 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45aad9d640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45980051d0 0x7f459800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:15.772 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.769+0000 7f45aad9d640 1 -- 172.21.15.26:0/3668945412 reap_dead start 2024-04-23T10:13:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f4598004c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f459400c1c0 tx=0x7f459401f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=debcb7bff497d276 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594007d00 con 0x7f4598004810 2024-04-23T10:13:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4594005b00 con 0x7f4598004810 2024-04-23T10:13:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45a9d9b640 1 -- 172.21.15.26:0/3668945412 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4594007070 con 0x7f4598004810 2024-04-23T10:13:15.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 msgr2=0x7f4598004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f4598004c90 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f459400c1c0 tx=0x7f459401f3d0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- 172.21.15.26:0/3668945412 shutdown_connections 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 --2- 172.21.15.26:0/3668945412 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f4598004c90 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- 172.21.15.26:0/3668945412 >> 172.21.15.26:0/3668945412 conn(0x7f45ac06b9d0 msgr2=0x7f45ac06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- 172.21.15.26:0/3668945412 shutdown_connections 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- 172.21.15.26:0/3668945412 wait complete. 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 Processor -- start 2024-04-23T10:13:15.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- start start 2024-04-23T10:13:15.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45ac14e6d0 0x7f45ac151200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45ac15c580 0x7f45ac15ca00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac0c4510 con 0x7f4598004810 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f45ac0c5640 con 0x7f45ac14e6d0 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45b0f83640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f45ac06f700 con 0x7f45ac15c580 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34140/0 (socket says 172.21.15.26:34140) 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 -- 172.21.15.26:0/2091834118 learned_addr learned my addr 172.21.15.26:0/2091834118 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aad9d640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45ac15c580 0x7f45ac15ca00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45ac14e6d0 0x7f45ac151200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 -- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45ac15c580 msgr2=0x7f45ac15ca00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45ac15c580 0x7f45ac15ca00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 -- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45ac14e6d0 msgr2=0x7f45ac151200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45ac14e6d0 0x7f45ac151200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.773+0000 7f45aa59c640 1 -- 172.21.15.26:0/2091834118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f45ac153480 con 0x7f4598004810 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45aa59c640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f459c011660 tx=0x7f459c011b20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c00f960 con 0x7f4598004810 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f459c00fb00 con 0x7f4598004810 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f459c015460 con 0x7f4598004810 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f45ac1f5a50 con 0x7f4598004810 2024-04-23T10:13:15.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f45ac1531a0 con 0x7f4598004810 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f45ac075df0 con 0x7f4598004810 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f459c015600 con 0x7f4598004810 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 0x7f458c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 6764+0+0 (secure 0 0 0) 0x7f459c087780 con 0x7f4598004810 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 0x7f458c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:15.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.777+0000 7f45a1d9b640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 0x7f458c06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45940ae000 tx=0x7f4594007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:15.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.781+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f459c019030 con 0x7f4598004810 2024-04-23T10:13:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.945+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f45ac0ca940 con 0x7f4598004810 2024-04-23T10:13:15.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45a37fe640 1 -- 172.21.15.26:0/2091834118 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v25) ==== 93+0+10 (secure 0 0 0) 0x7f459c057920 con 0x7f4598004810 2024-04-23T10:13:15.948 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 msgr2=0x7f458c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 0x7f458c06a870 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7f45940ae000 tx=0x7f4594007040 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 msgr2=0x7f45ac152310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f459c011660 tx=0x7f459c011b20 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 shutdown_connections 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f458c0683b0 0x7f458c06a870 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f45ac15c580 0x7f45ac15ca00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f45ac14e6d0 0x7f45ac151200 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 --2- 172.21.15.26:0/2091834118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4598004810 0x7f45ac152310 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:15.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 >> 172.21.15.26:0/2091834118 conn(0x7f45ac06b9d0 msgr2=0x7f45ac0c37c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 shutdown_connections 2024-04-23T10:13:15.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:15.949+0000 7f45b0f83640 1 -- 172.21.15.26:0/2091834118 wait complete. 2024-04-23T10:13:15.968 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:13:16.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.093+0000 7f191b475640 1 Processor -- start 2024-04-23T10:13:16.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.093+0000 7f191b475640 1 -- start start 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f191b475640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f191414ffa0 0x7f191406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f191b475640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19140c5d70 con 0x7f1914074100 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f191b475640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19140c6050 con 0x7f191414fbc0 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f191b475640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f19140c6330 con 0x7f191414ffa0 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1919a12640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1914074100 0x7f19140c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32824/0 (socket says 172.21.15.26:32824) 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1919a12640 1 -- 172.21.15.26:0/1883763633 learned_addr learned my addr 172.21.15.26:0/1883763633 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f191414ffa0 0x7f191406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3518309732 0 0) 0x7f19140c5d70 con 0x7f1914074100 2024-04-23T10:13:16.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1900003530 con 0x7f1914074100 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3493560382 0 0) 0x7f19140c6050 con 0x7f191414fbc0 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f19140c5d70 con 0x7f191414fbc0 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 977786683 0 0) 0x7f1900003530 con 0x7f1914074100 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f191414ffa0 msgr2=0x7f191406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f191414ffa0 0x7f191406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 >> v1:172.21.15.190:6789/0 conn(0x7f191414fbc0 legacy=0x7f19140c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19140c6610 con 0x7f1914074100 2024-04-23T10:13:16.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f190c001a00 con 0x7f1914074100 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 >> v1:172.21.15.26:6789/0 conn(0x7f1914074100 legacy=0x7f19140c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1900003b80 0x7f1900003f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1900004810 0x7f1900004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19000051d0 0x7f190000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19140c6330 con 0x7f1900004810 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f190000bfc0 con 0x7f19000051d0 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f190000c1c0 con 0x7f1900003b80 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f191414ffa0 0x7f191406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1900004810 0x7f1900004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1919a12640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19000051d0 0x7f190000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1919211640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1900003b80 0x7f1900003f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 -- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1900003b80 msgr2=0x7f1900003f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1900003b80 0x7f1900003f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 -- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19000051d0 msgr2=0x7f190000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:16.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f19000051d0 0x7f190000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.097+0000 7f1918a10640 1 -- 172.21.15.26:0/1883763633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1900003530 con 0x7f1900004810 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1900004810 0x7f1900004c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f191406cfa0 tx=0x7f190401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62db9f0bf5e0cb1e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040097f0 con 0x7f1900004810 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1904004030 con 0x7f1900004810 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f190bfff640 1 -- 172.21.15.26:0/1883763633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1904004400 con 0x7f1900004810 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/1883763633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1900004810 msgr2=0x7f1900004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 --2- 172.21.15.26:0/1883763633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1900004810 0x7f1900004c90 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f191406cfa0 tx=0x7f190401cab0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1919a12640 1 -- 172.21.15.26:0/1883763633 reap_dead start 2024-04-23T10:13:16.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/1883763633 shutdown_connections 2024-04-23T10:13:16.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/1883763633 >> 172.21.15.26:0/1883763633 conn(0x7f191406b9d0 msgr2=0x7f191406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/1883763633 shutdown_connections 2024-04-23T10:13:16.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/1883763633 wait complete. 2024-04-23T10:13:16.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 Processor -- start 2024-04-23T10:13:16.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- start start 2024-04-23T10:13:16.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1900004810 0x7f1914143ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19140c5190 0x7f1914159160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1914068350 con 0x7f19140c4d70 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f19140681d0 con 0x7f1900004810 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f19140c8930 con 0x7f19140c5190 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34160/0 (socket says 172.21.15.26:34160) 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 -- 172.21.15.26:0/498602946 learned_addr learned my addr 172.21.15.26:0/498602946 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1919211640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1900004810 0x7f1914143ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1919a12640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19140c5190 0x7f1914159160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 -- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19140c5190 msgr2=0x7f1914159160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19140c5190 0x7f1914159160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 -- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1900004810 msgr2=0x7f1914143ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1900004810 0x7f1914143ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 -- 172.21.15.26:0/498602946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19140c3ff0 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1918a10640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f190401cf90 tx=0x7f1900005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040a5a70 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19040bc070 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f19141f14c0 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19040a5e10 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.101+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19140c4570 con 0x7f19140c4d70 2024-04-23T10:13:16.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1914075df0 con 0x7f19140c4d70 2024-04-23T10:13:16.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1904003620 con 0x7f19140c4d70 2024-04-23T10:13:16.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f1909ffb640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 0x7f18f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1904120b70 con 0x7f19140c4d70 2024-04-23T10:13:16.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f1919211640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 0x7f18f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.105+0000 7f1919211640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 0x7f18f806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1910005630 tx=0x7f1910009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.109+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f19040c5020 con 0x7f19140c4d70 2024-04-23T10:13:16.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.265+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f19140c7df0 con 0x7f19140c4d70 2024-04-23T10:13:16.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.265+0000 7f1909ffb640 1 -- 172.21.15.26:0/498602946 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f19040167c0 con 0x7f19140c4d70 2024-04-23T10:13:16.267 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 msgr2=0x7f18f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 0x7f18f806a840 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f1910005630 tx=0x7f1910009040 comp rx=0 tx=0).stop 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 msgr2=0x7f1914158c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f190401cf90 tx=0x7f1900005840 comp rx=0 tx=0).stop 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 shutdown_connections 2024-04-23T10:13:16.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18f8068380 0x7f18f806a840 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19140c5190 0x7f1914159160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f19140c4d70 0x7f1914158c20 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 --2- 172.21.15.26:0/498602946 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1900004810 0x7f1914143ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 >> 172.21.15.26:0/498602946 conn(0x7f191406b9d0 msgr2=0x7f191406f440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 shutdown_connections 2024-04-23T10:13:16.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.269+0000 7f191b475640 1 -- 172.21.15.26:0/498602946 wait complete. 2024-04-23T10:13:16.285 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:13:16.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.409+0000 7f7a8f0e7640 1 Processor -- start 2024-04-23T10:13:16.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.409+0000 7f7a8f0e7640 1 -- start start 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8f0e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 0x7f7a880c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8f0e7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a880c7eb0 0x7f7a880c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8f0e7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7a880cada0 con 0x7f7a880ca550 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8f0e7640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7a880cb080 con 0x7f7a880c7eb0 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8f0e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880c9360 con 0x7f7a88152ff0 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8d684640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7a880ca550 0x7f7a880cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32834/0 (socket says 172.21.15.26:32834) 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a87fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7a880c7eb0 0x7f7a880c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8d684640 1 -- 172.21.15.26:0/612258781 learned_addr learned my addr 172.21.15.26:0/612258781 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 0x7f7a880c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a877fe640 1 -- 172.21.15.26:0/612258781 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1351810844 0 0) 0x7f7a880cada0 con 0x7f7a880ca550 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a877fe640 1 -- 172.21.15.26:0/612258781 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7a70003530 con 0x7f7a880ca550 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a87fff640 1 -- 172.21.15.26:0/612258781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 msgr2=0x7f7a880c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a87fff640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 0x7f7a880c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a87fff640 1 -- 172.21.15.26:0/612258781 >> v1:172.21.15.26:6789/0 conn(0x7f7a880ca550 legacy=0x7f7a880cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a87fff640 1 -- 172.21.15.26:0/612258781 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a880c9640 con 0x7f7a880c7eb0 2024-04-23T10:13:16.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.413+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 0x7f7a880c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:16.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a87fff640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a880c7eb0 0x7f7a880c6380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0097c0 tx=0x7f7a7c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=251790304798e738 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a877fe640 1 -- 172.21.15.26:0/612258781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0b5070 con 0x7f7a880c7eb0 2024-04-23T10:13:16.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a877fe640 1 -- 172.21.15.26:0/612258781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a7c0a8990 con 0x7f7a880c7eb0 2024-04-23T10:13:16.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a877fe640 1 -- 172.21.15.26:0/612258781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a7c0a8d60 con 0x7f7a880c7eb0 2024-04-23T10:13:16.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/612258781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a880c7eb0 msgr2=0x7f7a880c6380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a880c7eb0 0x7f7a880c6380 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7f7a7c0097c0 tx=0x7f7a7c01ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/612258781 shutdown_connections 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a880c7eb0 0x7f7a880c6380 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/612258781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a88152ff0 0x7f7a880c5730 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/612258781 >> 172.21.15.26:0/612258781 conn(0x7f7a880676a0 msgr2=0x7f7a88067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/612258781 shutdown_connections 2024-04-23T10:13:16.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/612258781 wait complete. 2024-04-23T10:13:16.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 Processor -- start 2024-04-23T10:13:16.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- start start 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 0x7f7a88151ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a880ca550 0x7f7a881f8890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880caaa0 con 0x7f7a88152ff0 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7a880c5e60 con 0x7f7a880ca550 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7a880c68c0 con 0x7f7a880c7eb0 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34166/0 (socket says 172.21.15.26:34166) 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 -- 172.21.15.26:0/1993272994 learned_addr learned my addr 172.21.15.26:0/1993272994 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 0x7f7a88151ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a87fff640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a880ca550 0x7f7a881f8890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 -- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 msgr2=0x7f7a88151ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 0x7f7a88151ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 -- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a880ca550 msgr2=0x7f7a881f8890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a880ca550 0x7f7a881f8890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 -- 172.21.15.26:0/1993272994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7a8806e180 con 0x7f7a88152ff0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 0x7f7a88151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8d684640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c480 tx=0x7f7a8000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a80017070 con 0x7f7a88152ff0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7a80005cf0 con 0x7f7a88152ff0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7a800072b0 con 0x7f7a88152ff0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.417+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7a88143580 con 0x7f7a88152ff0 2024-04-23T10:13:16.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7a8806e700 con 0x7f7a88152ff0 2024-04-23T10:13:16.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7a88075df0 con 0x7f7a88152ff0 2024-04-23T10:13:16.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7a8001a070 con 0x7f7a88152ff0 2024-04-23T10:13:16.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a857fa640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 0x7f7a7406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7a80086140 con 0x7f7a88152ff0 2024-04-23T10:13:16.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 0x7f7a7406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.421+0000 7f7a8ce83640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 0x7f7a7406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009fd0 tx=0x7f7a7800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.425+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7a80056370 con 0x7f7a88152ff0 2024-04-23T10:13:16.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f7a880ca000 con 0x7f7a88152ff0 2024-04-23T10:13:16.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a857fa640 1 -- 172.21.15.26:0/1993272994 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f7a8005c070 con 0x7f7a88152ff0 2024-04-23T10:13:16.594 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:13:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 msgr2=0x7f7a7406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 0x7f7a7406a840 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7f7a78009fd0 tx=0x7f7a7800b040 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 msgr2=0x7f7a881f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.593+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f7a8000c480 tx=0x7f7a8000c940 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 shutdown_connections 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7a74068380 0x7f7a7406a840 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7a88152ff0 0x7f7a881f8dd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7a880ca550 0x7f7a881f8890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 --2- 172.21.15.26:0/1993272994 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7a880c7eb0 0x7f7a88151ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 >> 172.21.15.26:0/1993272994 conn(0x7f7a880676a0 msgr2=0x7f7a880cb350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 shutdown_connections 2024-04-23T10:13:16.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.597+0000 7f7a8f0e7640 1 -- 172.21.15.26:0/1993272994 wait complete. 2024-04-23T10:13:16.614 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:13:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.745+0000 7f7d61c64640 1 Processor -- start 2024-04-23T10:13:16.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.745+0000 7f7d61c64640 1 -- start start 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d61c64640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7d5c0cb1e0 0x7f7d5c0cb670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d61c64640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0c8080 con 0x7f7d5c071530 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d61c64640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7d5c0c8360 con 0x7f7d5c159cf0 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d61c64640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7d5c0c5d80 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f7d5c071530 0x7f7d5c0c9370 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32838/0 (socket says 172.21.15.26:32838) 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5affd640 1 -- 172.21.15.26:0/3728870380 learned_addr learned my addr 172.21.15.26:0/3728870380 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5bfff640 1 --2- 172.21.15.26:0/3728870380 >> v2:172.21.15.26:3300/0 conn(0x7f7d5c0cb1e0 0x7f7d5c0cb670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5a7fc640 1 -- 172.21.15.26:0/3728870380 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4182538217 0 0) 0x7f7d5c0c8080 con 0x7f7d5c071530 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5a7fc640 1 -- 172.21.15.26:0/3728870380 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7d48003530 con 0x7f7d5c071530 2024-04-23T10:13:16.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5bfff640 1 -- 172.21.15.26:0/3728870380 >> v1:172.21.15.190:6789/0 conn(0x7f7d5c159cf0 legacy=0x7f7d5c0c6210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5bfff640 1 -- 172.21.15.26:0/3728870380 >> v1:172.21.15.26:6789/0 conn(0x7f7d5c071530 legacy=0x7f7d5c0c9370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.751 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5bfff640 1 -- 172.21.15.26:0/3728870380 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c0c8640 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5bfff640 1 --2- 172.21.15.26:0/3728870380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c0cb1e0 0x7f7d5c0cb670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009d90 tx=0x7f7d5401f150 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71340dd3dc2137a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5a7fc640 1 -- 172.21.15.26:0/3728870380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540b4070 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5a7fc640 1 -- 172.21.15.26:0/3728870380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d540af600 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.752 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.749+0000 7f7d5a7fc640 1 -- 172.21.15.26:0/3728870380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540af9d0 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/3728870380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c0cb1e0 msgr2=0x7f7d5c0cb670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 --2- 172.21.15.26:0/3728870380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c0cb1e0 0x7f7d5c0cb670 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009d90 tx=0x7f7d5401f150 comp rx=0 tx=0).stop 2024-04-23T10:13:16.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/3728870380 shutdown_connections 2024-04-23T10:13:16.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 --2- 172.21.15.26:0/3728870380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c0cb1e0 0x7f7d5c0cb670 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/3728870380 >> 172.21.15.26:0/3728870380 conn(0x7f7d5c0676a0 msgr2=0x7f7d5c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/3728870380 shutdown_connections 2024-04-23T10:13:16.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/3728870380 wait complete. 2024-04-23T10:13:16.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 Processor -- start 2024-04-23T10:13:16.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- start start 2024-04-23T10:13:16.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d5c071530 0x7f7d5c13c280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d5c0cb1e0 0x7f7d5c15ac30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c0c6920 con 0x7f7d5c159cf0 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7d5c0c8c00 con 0x7f7d5c071530 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7d5c071950 con 0x7f7d5c0cb1e0 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34192/0 (socket says 172.21.15.26:34192) 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 -- 172.21.15.26:0/1795623014 learned_addr learned my addr 172.21.15.26:0/1795623014 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5affd640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d5c0cb1e0 0x7f7d5c15ac30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5b7fe640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d5c071530 0x7f7d5c13c280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 -- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d5c0cb1e0 msgr2=0x7f7d5c15ac30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d5c0cb1e0 0x7f7d5c15ac30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 -- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d5c071530 msgr2=0x7f7d5c13c280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d5c071530 0x7f7d5c13c280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 -- 172.21.15.26:0/1795623014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7d5c06eb20 con 0x7f7d5c159cf0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d5bfff640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009d90 tx=0x7f7d5401bef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d540b4040 con 0x7f7d5c159cf0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7d540039a0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7d54009450 con 0x7f7d5c159cf0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.753+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7d5c15ccd0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7d5c06e4d0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7d5c075df0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7d540c4060 con 0x7f7d5c159cf0 2024-04-23T10:13:16.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d53fff640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 0x7f7d3c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:16.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7d54124a20 con 0x7f7d5c159cf0 2024-04-23T10:13:16.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d5b7fe640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 0x7f7d3c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:16.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.757+0000 7f7d5b7fe640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 0x7f7d3c06a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c000f70 tx=0x7f7d4c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:16.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.761+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7d54018cb0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.921+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f7d5c15a990 con 0x7f7d5c159cf0 2024-04-23T10:13:16.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d53fff640 1 -- 172.21.15.26:0/1795623014 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f7d540f4bc0 con 0x7f7d5c159cf0 2024-04-23T10:13:16.925 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 msgr2=0x7f7d3c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 0x7f7d3c06a870 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f7d4c000f70 tx=0x7f7d4c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 msgr2=0x7f7d5c15bb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f7d54009d90 tx=0x7f7d5401bef0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 shutdown_connections 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7d3c0683b0 0x7f7d3c06a870 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7d5c159cf0 0x7f7d5c15bb20 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7d5c0cb1e0 0x7f7d5c15ac30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 --2- 172.21.15.26:0/1795623014 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7d5c071530 0x7f7d5c13c280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:16.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 >> 172.21.15.26:0/1795623014 conn(0x7f7d5c0676a0 msgr2=0x7f7d5c15c530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:16.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 shutdown_connections 2024-04-23T10:13:16.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:16.925+0000 7f7d61c64640 1 -- 172.21.15.26:0/1795623014 wait complete. 2024-04-23T10:13:16.943 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:17.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.061+0000 7fb856c79640 1 Processor -- start 2024-04-23T10:13:17.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.061+0000 7fb856c79640 1 -- start start 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85014fbc0 0x7fb85006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb85014ffa0 0x7fb8500c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb850074100 0x7fb8500c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500c5d70 con 0x7fb850074100 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb8500c6050 con 0x7fb85014ffa0 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb856c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb8500c6330 con 0x7fb85014fbc0 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb850074100 0x7fb8500c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb850074100 0x7fb8500c8760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34194/0 (socket says 172.21.15.26:34194) 2024-04-23T10:13:17.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 -- 172.21.15.26:0/436515581 learned_addr learned my addr 172.21.15.26:0/436515581 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb854a15640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85014fbc0 0x7fb85006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb84ffff640 1 --2- 172.21.15.26:0/436515581 >> v2:172.21.15.190:3300/0 conn(0x7fb85014ffa0 0x7fb8500c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 -- 172.21.15.26:0/436515581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85014fbc0 msgr2=0x7fb85006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85014fbc0 0x7fb85006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 -- 172.21.15.26:0/436515581 >> v2:172.21.15.190:3300/0 conn(0x7fb85014ffa0 msgr2=0x7fb8500c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 --2- 172.21.15.26:0/436515581 >> v2:172.21.15.190:3300/0 conn(0x7fb85014ffa0 0x7fb8500c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 -- 172.21.15.26:0/436515581 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8500c6610 con 0x7fb850074100 2024-04-23T10:13:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.065+0000 7fb855216640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb850074100 0x7fb8500c8760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb85006a030 tx=0x7fb84801c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4801583e808cce06 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84f7fe640 1 -- 172.21.15.26:0/436515581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a5890 con 0x7fb850074100 2024-04-23T10:13:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84f7fe640 1 -- 172.21.15.26:0/436515581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480a5a30 con 0x7fb850074100 2024-04-23T10:13:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84f7fe640 1 -- 172.21.15.26:0/436515581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480a5e00 con 0x7fb850074100 2024-04-23T10:13:17.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- 172.21.15.26:0/436515581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb850074100 msgr2=0x7fb8500c8760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb850074100 0x7fb8500c8760 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7fb85006a030 tx=0x7fb84801c9f0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- 172.21.15.26:0/436515581 shutdown_connections 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb850074100 0x7fb8500c8760 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- 172.21.15.26:0/436515581 >> v2:172.21.15.190:3300/0 conn(0x7fb85014ffa0 0x7fb8500c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- 172.21.15.26:0/436515581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85014fbc0 0x7fb85006f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- 172.21.15.26:0/436515581 >> 172.21.15.26:0/436515581 conn(0x7fb85006b9d0 msgr2=0x7fb85006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- 172.21.15.26:0/436515581 shutdown_connections 2024-04-23T10:13:17.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- 172.21.15.26:0/436515581 wait complete. 2024-04-23T10:13:17.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 Processor -- start 2024-04-23T10:13:17.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- start start 2024-04-23T10:13:17.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb850074100 0x7fb8501ead00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb85014fbc0 0x7fb8501f44a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb8501592e0 con 0x7fb85014ffa0 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb850159160 con 0x7fb85014fbc0 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb856c79640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb850159460 con 0x7fb850074100 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34206/0 (socket says 172.21.15.26:34206) 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 -- 172.21.15.26:0/3679598310 learned_addr learned my addr 172.21.15.26:0/3679598310 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84ffff640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb85014fbc0 0x7fb8501f44a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb854a15640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb850074100 0x7fb8501ead00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 -- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb850074100 msgr2=0x7fb8501ead00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb850074100 0x7fb8501ead00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 -- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb85014fbc0 msgr2=0x7fb8501f44a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb85014fbc0 0x7fb8501f44a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 -- 172.21.15.26:0/3679598310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb8501f7e70 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb855216640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb84801b0a0 tx=0x7fb848019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480bc020 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8480a5de0 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.069+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb8480b86b0 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb8501f8150 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85015ce00 con 0x7fb85014ffa0 2024-04-23T10:13:17.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb850075df0 con 0x7fb85014ffa0 2024-04-23T10:13:17.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb8480bf020 con 0x7fb85014ffa0 2024-04-23T10:13:17.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb84d7fa640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 0x7fb83c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb848121790 con 0x7fb85014ffa0 2024-04-23T10:13:17.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb854a15640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 0x7fb83c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.073+0000 7fb854a15640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 0x7fb83c06a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb840009ae0 tx=0x7fb840009190 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.077+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8480c6030 con 0x7fb85014ffa0 2024-04-23T10:13:17.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.277+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fb8500c7df0 con 0x7fb85014ffa0 2024-04-23T10:13:17.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb84d7fa640 1 -- 172.21.15.26:0/3679598310 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7fb8480165e0 con 0x7fb85014ffa0 2024-04-23T10:13:17.281 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:17.281 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:15.016870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287,4284,4282,4275]},"id":1}]} 2024-04-23T10:13:17.281 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-23T10:13:17.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 msgr2=0x7fb83c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 0x7fb83c06a870 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fb840009ae0 tx=0x7fb840009190 comp rx=0 tx=0).stop 2024-04-23T10:13:17.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 msgr2=0x7fb8501f49e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7fb84801b0a0 tx=0x7fb848019790 comp rx=0 tx=0).stop 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 shutdown_connections 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb83c0683b0 0x7fb83c06a870 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85014ffa0 0x7fb8501f49e0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb85014fbc0 0x7fb8501f44a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 --2- 172.21.15.26:0/3679598310 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb850074100 0x7fb8501ead00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 >> 172.21.15.26:0/3679598310 conn(0x7fb85006b9d0 msgr2=0x7fb85014cb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 shutdown_connections 2024-04-23T10:13:17.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.281+0000 7fb856c79640 1 -- 172.21.15.26:0/3679598310 wait complete. 2024-04-23T10:13:17.300 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:17.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.417+0000 7fb0c70f5640 1 Processor -- start 2024-04-23T10:13:17.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.417+0000 7fb0c70f5640 1 -- start start 2024-04-23T10:13:17.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c70f5640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb0c014fbc0 0x7fb0c006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c70f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014ffa0 0x7fb0c00c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c70f5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb0c00c5d70 con 0x7fb0c0074100 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c70f5640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb0c00c6050 con 0x7fb0c014fbc0 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c70f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c00c6330 con 0x7fb0c014ffa0 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb0c0074100 0x7fb0c00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32844/0 (socket says 172.21.15.26:32844) 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 -- 172.21.15.26:0/3282738406 learned_addr learned my addr 172.21.15.26:0/3282738406 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bffff640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014ffa0 0x7fb0c00c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/3282738406 >> v2:172.21.15.190:3300/0 conn(0x7fb0c014fbc0 0x7fb0c006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1212147055 0 0) 0x7fb0c00c5d70 con 0x7fb0c0074100 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb0a8003530 con 0x7fb0c0074100 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2481350104 0 0) 0x7fb0a8003530 con 0x7fb0c0074100 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014ffa0 msgr2=0x7fb0c00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014ffa0 0x7fb0c00c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 >> v2:172.21.15.190:3300/0 conn(0x7fb0c014fbc0 msgr2=0x7fb0c006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 --2- 172.21.15.26:0/3282738406 >> v2:172.21.15.190:3300/0 conn(0x7fb0c014fbc0 0x7fb0c006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c00c6610 con 0x7fb0c0074100 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fb0b8001a00 con 0x7fb0c0074100 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 >> v1:172.21.15.26:6789/0 conn(0x7fb0c0074100 legacy=0x7fb0c00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0a80039c0 0x7fb0a8003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0a8004810 0x7fb0a8004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a80051d0 0x7fb0a800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00c6050 con 0x7fb0a80051d0 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00c6330 con 0x7fb0a80039c0 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0a800bf10 con 0x7fb0a8004810 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0bffff640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014ffa0 0x7fb0c00c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:17.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a80051d0 0x7fb0a800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0a80039c0 0x7fb0a8003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 -- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0a8004810 msgr2=0x7fb0a8004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0a8004810 0x7fb0a8004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 -- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0a80039c0 msgr2=0x7fb0a8003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0a80039c0 0x7fb0a8003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 -- 172.21.15.26:0/3282738406 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0a8003530 con 0x7fb0a80051d0 2024-04-23T10:13:17.427 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0a80039c0 0x7fb0a8003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.421+0000 7fb0c5692640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a80051d0 0x7fb0a800b9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800a880 tx=0x7fb0b801d360 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6e8cd8360792fdb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b800a4a0 con 0x7fb0a80051d0 2024-04-23T10:13:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b80ad630 con 0x7fb0a80051d0 2024-04-23T10:13:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bf7fe640 1 -- 172.21.15.26:0/3282738406 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b80ada60 con 0x7fb0a80051d0 2024-04-23T10:13:17.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/3282738406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a80051d0 msgr2=0x7fb0a800b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/3282738406 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0a80051d0 0x7fb0a800b9d0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb0b800a880 tx=0x7fb0b801d360 comp rx=0 tx=0).stop 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c5692640 1 -- 172.21.15.26:0/3282738406 reap_dead start 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/3282738406 shutdown_connections 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/3282738406 >> 172.21.15.26:0/3282738406 conn(0x7fb0c006b9d0 msgr2=0x7fb0c006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/3282738406 shutdown_connections 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/3282738406 wait complete. 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 Processor -- start 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- start start 2024-04-23T10:13:17.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014c400 0x7fb0c01f0810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 0x7fb0c01f0d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c0068350 con 0x7fb0c014c020 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb0c00681d0 con 0x7fb0c01503a0 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb0c00c7960 con 0x7fb0c014c400 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34224/0 (socket says 172.21.15.26:34224) 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 -- 172.21.15.26:0/1938742268 learned_addr learned my addr 172.21.15.26:0/1938742268 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:17.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bffff640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014c400 0x7fb0c01f0810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c5692640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 0x7fb0c01f0d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 -- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014c400 msgr2=0x7fb0c01f0810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014c400 0x7fb0c01f0810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 -- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 msgr2=0x7fb0c01f0d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 0x7fb0c01f0d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 -- 172.21.15.26:0/1938742268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb0c015ca30 con 0x7fb0c014c020 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c5692640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 0x7fb0c01f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c4e91640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00116a0 tx=0x7fb0b0011b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b0004220 con 0x7fb0c014c020 2024-04-23T10:13:17.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0b00043c0 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb0b000f980 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb0c015a0b0 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.425+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb0c015bcb0 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb0c0075df0 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb0b000fb20 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0bd7fa640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 0x7fb0ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb0b0087330 con 0x7fb0c014c020 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0bffff640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 0x7fb0ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.429+0000 7fb0bffff640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 0x7fb0ac06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00c3580 tx=0x7fb0b40095b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.433+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb0b0019030 con 0x7fb0c014c020 2024-04-23T10:13:17.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.589+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fb0c00c7df0 con 0x7fb0c014c020 2024-04-23T10:13:17.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0bd7fa640 1 -- 172.21.15.26:0/1938742268 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7fb0b0056f10 con 0x7fb0c014c020 2024-04-23T10:13:17.594 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:17.594 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 msgr2=0x7fb0ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 0x7fb0ac06a840 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7fb0c00c3580 tx=0x7fb0b40095b0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 msgr2=0x7fb0c01513e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb0b00116a0 tx=0x7fb0b0011b60 comp rx=0 tx=0).stop 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 shutdown_connections 2024-04-23T10:13:17.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb0ac068380 0x7fb0ac06a840 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb0c01503a0 0x7fb0c01f0d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb0c014c400 0x7fb0c01f0810 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 --2- 172.21.15.26:0/1938742268 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb0c014c020 0x7fb0c01513e0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 >> 172.21.15.26:0/1938742268 conn(0x7fb0c006b9d0 msgr2=0x7fb0c00729e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 shutdown_connections 2024-04-23T10:13:17.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.593+0000 7fb0c70f5640 1 -- 172.21.15.26:0/1938742268 wait complete. 2024-04-23T10:13:17.612 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:13:17.612 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:13:17.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 Processor -- start 2024-04-23T10:13:17.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 -- start start 2024-04-23T10:13:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2740cd8a0 0x7fb27415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb274144330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb274144870 con 0x7fb2740cdc80 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb274072420 con 0x7fb2740cd8a0 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27be77640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb27415b300 con 0x7fb274143f20 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2740cd8a0 0x7fb27415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb2740cd8a0 0x7fb27415f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34240/0 (socket says 172.21.15.26:34240) 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279412640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb2740cdc80 0x7fb2740c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32856/0 (socket says 172.21.15.26:32856) 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 -- 172.21.15.26:0/1896653465 learned_addr learned my addr 172.21.15.26:0/1896653465 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb27a414640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb274144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 -- 172.21.15.26:0/1896653465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 msgr2=0x7fb274144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb274144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 -- 172.21.15.26:0/1896653465 >> v1:172.21.15.26:6789/0 conn(0x7fb2740cdc80 legacy=0x7fb2740c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.737+0000 7fb279c13640 1 -- 172.21.15.26:0/1896653465 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb27415b5e0 con 0x7fb2740cd8a0 2024-04-23T10:13:17.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279c13640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cd8a0 0x7fb27415f2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb270009870 tx=0x7fb27001ed50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb12c0514bd86b34 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb278c11640 1 -- 172.21.15.26:0/1896653465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2700b5070 con 0x7fb2740cd8a0 2024-04-23T10:13:17.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb278c11640 1 -- 172.21.15.26:0/1896653465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2700a8a50 con 0x7fb2740cd8a0 2024-04-23T10:13:17.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb278c11640 1 -- 172.21.15.26:0/1896653465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2700a8e20 con 0x7fb2740cd8a0 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1896653465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cd8a0 msgr2=0x7fb27415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cd8a0 0x7fb27415f2b0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fb270009870 tx=0x7fb27001ed50 comp rx=0 tx=0).stop 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1896653465 shutdown_connections 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb274144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- 172.21.15.26:0/1896653465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cd8a0 0x7fb27415f2b0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1896653465 >> 172.21.15.26:0/1896653465 conn(0x7fb27406fca0 msgr2=0x7fb2740700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1896653465 shutdown_connections 2024-04-23T10:13:17.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1896653465 wait complete. 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 Processor -- start 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- start start 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2740cd8a0 0x7fb2741f4da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb2740c6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb27415be80 con 0x7fb2740cdc80 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb27415bba0 con 0x7fb2740cd8a0 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb27406bdb0 con 0x7fb274143f20 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34252/0 (socket says 172.21.15.26:34252) 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 -- 172.21.15.26:0/1995868619 learned_addr learned my addr 172.21.15.26:0/1995868619 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279c13640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2740cd8a0 0x7fb2741f4da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27a414640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb2740c6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 -- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 msgr2=0x7fb2740c6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb2740c6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 -- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2740cd8a0 msgr2=0x7fb2741f4da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2740cd8a0 0x7fb2741f4da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 -- 172.21.15.26:0/1995868619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2741f52e0 con 0x7fb2740cdc80 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb279412640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c450 tx=0x7fb26400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2640074e0 con 0x7fb2740cdc80 2024-04-23T10:13:17.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2640076a0 con 0x7fb2740cdc80 2024-04-23T10:13:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2740c5940 con 0x7fb2740cdc80 2024-04-23T10:13:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb264004a30 con 0x7fb2740cdc80 2024-04-23T10:13:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.741+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2740c6540 con 0x7fb2740cdc80 2024-04-23T10:13:17.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb274075df0 con 0x7fb2740cdc80 2024-04-23T10:13:17.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb26401a020 con 0x7fb2740cdc80 2024-04-23T10:13:17.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb26a7fc640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 0x7fb25806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:17.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb2640865d0 con 0x7fb2740cdc80 2024-04-23T10:13:17.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb279c13640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 0x7fb25806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:17.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.745+0000 7fb279c13640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 0x7fb25806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2700b2000 tx=0x7fb270008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:17.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.749+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb264056120 con 0x7fb2740cdc80 2024-04-23T10:13:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.913+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fb2740cca80 con 0x7fb2740cdc80 2024-04-23T10:13:17.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.913+0000 7fb26a7fc640 1 -- 172.21.15.26:0/1995868619 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fb26405a420 con 0x7fb2740cdc80 2024-04-23T10:13:17.915 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:13:17.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 msgr2=0x7fb25806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 0x7fb25806a840 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7fb2700b2000 tx=0x7fb270008040 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 msgr2=0x7fb274072b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7fb26400c450 tx=0x7fb26400c910 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 shutdown_connections 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb258068380 0x7fb25806a840 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb274143f20 0x7fb2740c6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2740cdc80 0x7fb274072b20 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 --2- 172.21.15.26:0/1995868619 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2740cd8a0 0x7fb2741f4da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 >> 172.21.15.26:0/1995868619 conn(0x7fb27406fca0 msgr2=0x7fb274073b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:17.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 shutdown_connections 2024-04-23T10:13:17.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:17.917+0000 7fb27be77640 1 -- 172.21.15.26:0/1995868619 wait complete. 2024-04-23T10:13:17.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:13:18.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 Processor -- start 2024-04-23T10:13:18.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 -- start start 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 0x7fe8700c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe8700cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe87015beb0 con 0x7fe8700cbcf0 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe8700cca40 con 0x7fe870155350 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe877d6c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8700ccc90 con 0x7fe8700cda50 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875307640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe8700cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875b08640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 0x7fe8700c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe876309640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fe8700cbcf0 0x7fe87015b0b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:44118/0 (socket says 172.21.15.26:44118) 2024-04-23T10:13:18.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe876309640 1 -- 172.21.15.26:0/342993643 learned_addr learned my addr 172.21.15.26:0/342993643 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe874b06640 1 -- 172.21.15.26:0/342993643 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2609779646 0 0) 0x7fe87015beb0 con 0x7fe8700cbcf0 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe874b06640 1 -- 172.21.15.26:0/342993643 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe85c003530 con 0x7fe8700cbcf0 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875307640 1 -- 172.21.15.26:0/342993643 >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 msgr2=0x7fe8700c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875307640 1 --2- 172.21.15.26:0/342993643 >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 0x7fe8700c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875307640 1 -- 172.21.15.26:0/342993643 >> v1:172.21.15.190:6789/0 conn(0x7fe8700cbcf0 legacy=0x7fe87015b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875307640 1 -- 172.21.15.26:0/342993643 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8700ccf70 con 0x7fe8700cda50 2024-04-23T10:13:18.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.049+0000 7fe875b08640 1 --2- 172.21.15.26:0/342993643 >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 0x7fe8700c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875307640 1 --2- 172.21.15.26:0/342993643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe8700cb7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8600097c0 tx=0x7fe86001ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=35eb11805fe88b40 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe874b06640 1 -- 172.21.15.26:0/342993643 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600b5070 con 0x7fe8700cda50 2024-04-23T10:13:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe874b06640 1 -- 172.21.15.26:0/342993643 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8600a8990 con 0x7fe8700cda50 2024-04-23T10:13:18.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe874b06640 1 -- 172.21.15.26:0/342993643 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe8600a8d40 con 0x7fe8700cda50 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- 172.21.15.26:0/342993643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 msgr2=0x7fe8700cb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- 172.21.15.26:0/342993643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe8700cb7b0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fe8600097c0 tx=0x7fe86001ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- 172.21.15.26:0/342993643 shutdown_connections 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- 172.21.15.26:0/342993643 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe8700cb7b0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- 172.21.15.26:0/342993643 >> v2:172.21.15.190:3300/0 conn(0x7fe870155350 0x7fe8700c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- 172.21.15.26:0/342993643 >> 172.21.15.26:0/342993643 conn(0x7fe87006cc30 msgr2=0x7fe87006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- 172.21.15.26:0/342993643 shutdown_connections 2024-04-23T10:13:18.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- 172.21.15.26:0/342993643 wait complete. 2024-04-23T10:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 Processor -- start 2024-04-23T10:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- start start 2024-04-23T10:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe870150f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe870155350 0x7fe870153dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe870155730 con 0x7fe8700cbcf0 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8700cd530 con 0x7fe870155350 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe877d6c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe87015e860 con 0x7fe8700cda50 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875307640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe870150f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34266/0 (socket says 172.21.15.26:34266) 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 -- 172.21.15.26:0/1328546263 learned_addr learned my addr 172.21.15.26:0/1328546263 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe876309640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe870155350 0x7fe870153dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 -- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 msgr2=0x7fe870150f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe870150f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 -- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe870155350 msgr2=0x7fe870153dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe870155350 0x7fe870153dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 -- 172.21.15.26:0/1328546263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8701549b0 con 0x7fe8700cbcf0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.053+0000 7fe875b08640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00e9b0 tx=0x7fe86c00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c017070 con 0x7fe8700cbcf0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe86c00ca00 con 0x7fe8700cbcf0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe87015ad10 con 0x7fe8700cbcf0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe86c00cdd0 con 0x7fe8700cbcf0 2024-04-23T10:13:18.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe8701f1390 con 0x7fe8700cbcf0 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe8701f1180 con 0x7fe8700cbcf0 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe86c01a070 con 0x7fe8700cbcf0 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 0x7fe85406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe86c086c60 con 0x7fe8700cbcf0 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe875307640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 0x7fe85406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.057+0000 7fe875307640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 0x7fe85406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe8600b2000 tx=0x7fe860008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.061+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe86c056720 con 0x7fe8700cbcf0 2024-04-23T10:13:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.217+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fe870075df0 con 0x7fe8700cbcf0 2024-04-23T10:13:18.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.217+0000 7fe8667fc640 1 -- 172.21.15.26:0/1328546263 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fe86c05aa20 con 0x7fe8700cbcf0 2024-04-23T10:13:18.219 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 msgr2=0x7fe85406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 0x7fe85406a840 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7fe8600b2000 tx=0x7fe860008040 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 msgr2=0x7fe8701f50b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7fe86c00e9b0 tx=0x7fe86c00ee70 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 shutdown_connections 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe854068380 0x7fe85406a840 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe870155350 0x7fe870153dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8700cda50 0x7fe870150f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 --2- 172.21.15.26:0/1328546263 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe8700cbcf0 0x7fe8701f50b0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 >> 172.21.15.26:0/1328546263 conn(0x7fe87006cc30 msgr2=0x7fe8700ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 shutdown_connections 2024-04-23T10:13:18.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.221+0000 7fe877d6c640 1 -- 172.21.15.26:0/1328546263 wait complete. 2024-04-23T10:13:18.236 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:13:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 Processor -- start 2024-04-23T10:13:18.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 -- start start 2024-04-23T10:13:18.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f182c14ffa0 0x7f182c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f182c0c5d70 con 0x7f182c074100 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f182c0c6050 con 0x7f182c14fbc0 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f1831491640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f182c0c6330 con 0x7f182c14ffa0 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182a7fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f182c14ffa0 0x7f182c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182b7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f182c074100 0x7f182c0c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32872/0 (socket says 172.21.15.26:32872) 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182b7fe640 1 -- 172.21.15.26:0/3286485564 learned_addr learned my addr 172.21.15.26:0/3286485564 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182a7fc640 1 -- 172.21.15.26:0/3286485564 >> v1:172.21.15.190:6789/0 conn(0x7f182c14fbc0 legacy=0x7f182c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182a7fc640 1 -- 172.21.15.26:0/3286485564 >> v1:172.21.15.26:6789/0 conn(0x7f182c074100 legacy=0x7f182c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.361+0000 7f182a7fc640 1 -- 172.21.15.26:0/3286485564 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c0c6610 con 0x7f182c14ffa0 2024-04-23T10:13:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f182a7fc640 1 --2- 172.21.15.26:0/3286485564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14ffa0 0x7f182c06f700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18200097f0 tx=0x7f182001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=141f625ce0685c2d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1829ffb640 1 -- 172.21.15.26:0/3286485564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18200aa620 con 0x7f182c14ffa0 2024-04-23T10:13:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1829ffb640 1 -- 172.21.15.26:0/3286485564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18200af070 con 0x7f182c14ffa0 2024-04-23T10:13:18.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1829ffb640 1 -- 172.21.15.26:0/3286485564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18200aa9e0 con 0x7f182c14ffa0 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- 172.21.15.26:0/3286485564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14ffa0 msgr2=0x7f182c06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 --2- 172.21.15.26:0/3286485564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14ffa0 0x7f182c06f700 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f18200097f0 tx=0x7f182001c4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- 172.21.15.26:0/3286485564 shutdown_connections 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 --2- 172.21.15.26:0/3286485564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14ffa0 0x7f182c06f700 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- 172.21.15.26:0/3286485564 >> 172.21.15.26:0/3286485564 conn(0x7f182c06b9d0 msgr2=0x7f182c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- 172.21.15.26:0/3286485564 shutdown_connections 2024-04-23T10:13:18.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- 172.21.15.26:0/3286485564 wait complete. 2024-04-23T10:13:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 Processor -- start 2024-04-23T10:13:18.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.365+0000 7f1831491640 1 -- start start 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182c074100 0x7f182c152900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f182c14ffa0 0x7f182c1f4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f182c167630 con 0x7f182c14fbc0 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f182c1674b0 con 0x7f182c14ffa0 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f182c1677b0 con 0x7f182c074100 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34278/0 (socket says 172.21.15.26:34278) 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 -- 172.21.15.26:0/2451278854 learned_addr learned my addr 172.21.15.26:0/2451278854 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182affd640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182c074100 0x7f182c152900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182b7fe640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f182c14ffa0 0x7f182c1f4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 -- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182c074100 msgr2=0x7f182c152900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182c074100 0x7f182c152900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 -- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f182c14ffa0 msgr2=0x7f182c1f4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f182c14ffa0 0x7f182c1f4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 -- 172.21.15.26:0/2451278854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f182c1457b0 con 0x7f182c14fbc0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182a7fc640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18200190b0 tx=0x7f182001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18200aadf0 con 0x7f182c14fbc0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18200be410 con 0x7f182c14fbc0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f182c1f66a0 con 0x7f182c14fbc0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18200be800 con 0x7f182c14fbc0 2024-04-23T10:13:18.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f182c071740 con 0x7f182c14fbc0 2024-04-23T10:13:18.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f182c075df0 con 0x7f182c14fbc0 2024-04-23T10:13:18.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18200bc020 con 0x7f182c14fbc0 2024-04-23T10:13:18.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1820120fb0 con 0x7f182c14fbc0 2024-04-23T10:13:18.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.369+0000 7f182affd640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.373+0000 7f182affd640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 0x7f181806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f181c001650 tx=0x7f181c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.373+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1820016090 con 0x7f182c14fbc0 2024-04-23T10:13:18.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f182c1f6870 con 0x7f182c14fbc0 2024-04-23T10:13:18.534 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f18137fe640 1 -- 172.21.15.26:0/2451278854 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f18200f1300 con 0x7f182c14fbc0 2024-04-23T10:13:18.534 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 msgr2=0x7f181806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 0x7f181806a870 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f181c001650 tx=0x7f181c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 msgr2=0x7f182c1f5c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f18200190b0 tx=0x7f182001ace0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 shutdown_connections 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f18180683b0 0x7f181806a870 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.533+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f182c14ffa0 0x7f182c1f4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.537+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f182c14fbc0 0x7f182c1f5c20 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.537+0000 7f1831491640 1 --2- 172.21.15.26:0/2451278854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f182c074100 0x7f182c152900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.537+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 >> 172.21.15.26:0/2451278854 conn(0x7f182c06b9d0 msgr2=0x7f182c071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.537+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 shutdown_connections 2024-04-23T10:13:18.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.537+0000 7f1831491640 1 -- 172.21.15.26:0/2451278854 wait complete. 2024-04-23T10:13:18.552 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:13:18.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 Processor -- start 2024-04-23T10:13:18.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 -- start start 2024-04-23T10:13:18.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feac815ec40 0x7feac80c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feac80c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feac80709b0 con 0x7feac806d1a0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7feac815bba0 con 0x7feac815ec40 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feacc98a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feac815b270 con 0x7feac806d580 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7feac806d1a0 0x7feac815e530 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32874/0 (socket says 172.21.15.26:32874) 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac659c640 1 -- 172.21.15.26:0/2393035986 learned_addr learned my addr 172.21.15.26:0/2393035986 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac6d9d640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feac80c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 --2- 172.21.15.26:0/2393035986 >> v2:172.21.15.190:3300/0 conn(0x7feac815ec40 0x7feac80c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 778480084 0 0) 0x7feac80709b0 con 0x7feac806d1a0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7feab0003530 con 0x7feac806d1a0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1848812962 0 0) 0x7feab0003530 con 0x7feac806d1a0 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 msgr2=0x7feac80c81d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feac80c81d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 >> v2:172.21.15.190:3300/0 conn(0x7feac815ec40 msgr2=0x7feac80c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 --2- 172.21.15.26:0/2393035986 >> v2:172.21.15.190:3300/0 conn(0x7feac815ec40 0x7feac80c9ae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac815b550 con 0x7feac806d1a0 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7feab8001680 con 0x7feac806d1a0 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 >> v1:172.21.15.26:6789/0 conn(0x7feac806d1a0 legacy=0x7feac815e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feab00039c0 0x7feab0003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab0004810 0x7feab0004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feab00051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feac815bba0 con 0x7feab0004810 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feac815b270 con 0x7feab00039c0 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feab000b9d0 con 0x7feac806d580 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab0004810 0x7feab0004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac6d9d640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feab00051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac659c640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feab00039c0 0x7feab0003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 -- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 msgr2=0x7feab00051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac806d580 0x7feab00051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 -- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feab00039c0 msgr2=0x7feab0003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feab00039c0 0x7feab0003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac5d9b640 1 -- 172.21.15.26:0/2393035986 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feab0003530 con 0x7feab0004810 2024-04-23T10:13:18.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.677+0000 7feac659c640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feab00039c0 0x7feab0003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:18.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feac5d9b640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab0004810 0x7feab0004c90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feabc01ccc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=370128077dd22463 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0b2070 con 0x7feab0004810 2024-04-23T10:13:18.686 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc0a5bf0 con 0x7feab0004810 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feac559a640 1 -- 172.21.15.26:0/2393035986 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc009c10 con 0x7feab0004810 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- 172.21.15.26:0/2393035986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab0004810 msgr2=0x7feab0004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 --2- 172.21.15.26:0/2393035986 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feab0004810 0x7feab0004c90 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7feabc009fc0 tx=0x7feabc01ccc0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feac6d9d640 1 -- 172.21.15.26:0/2393035986 reap_dead start 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- 172.21.15.26:0/2393035986 shutdown_connections 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- 172.21.15.26:0/2393035986 >> 172.21.15.26:0/2393035986 conn(0x7feac80ca540 msgr2=0x7feac80ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- 172.21.15.26:0/2393035986 shutdown_connections 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- 172.21.15.26:0/2393035986 wait complete. 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 Processor -- start 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.681+0000 7feacc98a640 1 -- start start 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac81539d0 0x7feac81542f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.687 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 0x7feac8147380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feac8070450 con 0x7feac8153db0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feac815af40 con 0x7feac8152b30 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feac80705d0 con 0x7feac81539d0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34292/0 (socket says 172.21.15.26:34292) 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 -- 172.21.15.26:0/4110671284 learned_addr learned my addr 172.21.15.26:0/4110671284 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac659c640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac81539d0 0x7feac81542f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac6d9d640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 0x7feac8147380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 -- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac81539d0 msgr2=0x7feac81542f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac81539d0 0x7feac81542f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 -- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 msgr2=0x7feac8147380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 0x7feac8147380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 -- 172.21.15.26:0/4110671284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feac81f4120 con 0x7feac8153db0 2024-04-23T10:13:18.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac6d9d640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 0x7feac8147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac5d9b640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feabc098710 tx=0x7feabc009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc0b2040 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feabc0a59f0 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feac81f4400 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feabc009c10 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feac81f49c0 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feac8075df0 con 0x7feac8153db0 2024-04-23T10:13:18.689 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feabc0bf030 con 0x7feac8153db0 2024-04-23T10:13:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 0x7feaa806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7feabc121220 con 0x7feac8153db0 2024-04-23T10:13:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac659c640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 0x7feaa806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.690 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.685+0000 7feac659c640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 0x7feaa806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feab8001930 tx=0x7feab8001600 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.691 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.689+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feabc0c6020 con 0x7feac8153db0 2024-04-23T10:13:18.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.853+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7feac80c8ca0 con 0x7feac8153db0 2024-04-23T10:13:18.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.853+0000 7feab6ffd640 1 -- 172.21.15.26:0/4110671284 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7feabc0169d0 con 0x7feac8153db0 2024-04-23T10:13:18.854 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:18.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 msgr2=0x7feaa806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 0x7feaa806a840 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7feab8001930 tx=0x7feab8001600 comp rx=0 tx=0).stop 2024-04-23T10:13:18.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 msgr2=0x7feac81525f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7feabc098710 tx=0x7feabc009750 comp rx=0 tx=0).stop 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 shutdown_connections 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feaa8068380 0x7feaa806a840 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feac8152b30 0x7feac8147380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feac8153db0 0x7feac81525f0 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 --2- 172.21.15.26:0/4110671284 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feac81539d0 0x7feac81542f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 >> 172.21.15.26:0/4110671284 conn(0x7feac80ca540 msgr2=0x7feac8158d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 shutdown_connections 2024-04-23T10:13:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.857+0000 7feacc98a640 1 -- 172.21.15.26:0/4110671284 wait complete. 2024-04-23T10:13:18.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:18.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 Processor -- start 2024-04-23T10:13:18.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 -- start start 2024-04-23T10:13:18.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f6d84067b00 0x7f6d84152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d84153220 0x7f6d8406ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6d840742d0 con 0x7f6d840723d0 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6d84153690 con 0x7f6d84153220 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d8951b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f6d84074550 con 0x7f6d84067b00 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d84153220 0x7f6d8406ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6d84153220 0x7f6d8406ddd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34304/0 (socket says 172.21.15.26:34304) 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 -- 172.21.15.26:0/3452028286 learned_addr learned my addr 172.21.15.26:0/3452028286 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d827fc640 1 --2- 172.21.15.26:0/3452028286 >> v2:172.21.15.190:3300/0 conn(0x7f6d84067b00 0x7f6d84152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 -- 172.21.15.26:0/3452028286 >> v2:172.21.15.190:3300/0 conn(0x7f6d84067b00 msgr2=0x7f6d84152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 --2- 172.21.15.26:0/3452028286 >> v2:172.21.15.190:3300/0 conn(0x7f6d84067b00 0x7f6d84152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 -- 172.21.15.26:0/3452028286 >> v1:172.21.15.190:6789/0 conn(0x7f6d840723d0 legacy=0x7f6d840727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.989+0000 7f6d837fe640 1 -- 172.21.15.26:0/3452028286 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d84159a60 con 0x7f6d84153220 2024-04-23T10:13:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- 172.21.15.26:0/3452028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d8406ddd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c75e0 tx=0x7f6d7c01c9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=167d67f6ac73cb1f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d81ffb640 1 -- 172.21.15.26:0/3452028286 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0a56c0 con 0x7f6d84153220 2024-04-23T10:13:18.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d81ffb640 1 -- 172.21.15.26:0/3452028286 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0a5860 con 0x7f6d84153220 2024-04-23T10:13:18.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d81ffb640 1 -- 172.21.15.26:0/3452028286 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0a5c30 con 0x7f6d84153220 2024-04-23T10:13:18.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/3452028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 msgr2=0x7f6d8406ddd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- 172.21.15.26:0/3452028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d8406ddd0 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7f6d840c75e0 tx=0x7f6d7c01c9f0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/3452028286 shutdown_connections 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- 172.21.15.26:0/3452028286 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d8406ddd0 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- 172.21.15.26:0/3452028286 >> v2:172.21.15.190:3300/0 conn(0x7f6d84067b00 0x7f6d84152ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/3452028286 >> 172.21.15.26:0/3452028286 conn(0x7f6d840c9a70 msgr2=0x7f6d840c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/3452028286 shutdown_connections 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/3452028286 wait complete. 2024-04-23T10:13:18.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 Processor -- start 2024-04-23T10:13:18.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- start start 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d84067b00 0x7f6d8415b540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d840723d0 0x7f6d84148b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6d840676a0 con 0x7f6d84153220 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6d84159d40 con 0x7f6d84067b00 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6d84067820 con 0x7f6d840723d0 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34316/0 (socket says 172.21.15.26:34316) 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 -- 172.21.15.26:0/5545551 learned_addr learned my addr 172.21.15.26:0/5545551 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d827fc640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d840723d0 0x7f6d84148b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d82ffd640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d84067b00 0x7f6d8415b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:18.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 -- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d840723d0 msgr2=0x7f6d84148b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d840723d0 0x7f6d84148b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 -- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d84067b00 msgr2=0x7f6d8415b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d84067b00 0x7f6d8415b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 -- 172.21.15.26:0/5545551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6d841563d0 con 0x7f6d84153220 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d837fe640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c019600 tx=0x7f6d7c019790 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c009510 con 0x7f6d84153220 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6d7c0be070 con 0x7f6d84153220 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6d7c0b8890 con 0x7f6d84153220 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6d8415ba80 con 0x7f6d84153220 2024-04-23T10:13:18.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.993+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6d84154a10 con 0x7f6d84153220 2024-04-23T10:13:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6d84075df0 con 0x7f6d84153220 2024-04-23T10:13:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6d7c0b8a30 con 0x7f6d84153220 2024-04-23T10:13:18.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d6b7fe640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6d7c121e00 con 0x7f6d84153220 2024-04-23T10:13:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d82ffd640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:18.997+0000 7f6d82ffd640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 0x7f6d7006a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d74001650 tx=0x7f6d74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.001+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6d7c0165e0 con 0x7f6d84153220 2024-04-23T10:13:19.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.205+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f6d841635b0 con 0x7f6d84153220 2024-04-23T10:13:19.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d6b7fe640 1 -- 172.21.15.26:0/5545551 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7f6d7c0f1fa0 con 0x7f6d84153220 2024-04-23T10:13:19.209 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:19.209 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:15.016870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287,4284,4282,4275]},"id":1}]} 2024-04-23T10:13:19.210 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 msgr2=0x7f6d7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 0x7f6d7006a840 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f6d74001650 tx=0x7f6d74009040 comp rx=0 tx=0).stop 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 msgr2=0x7f6d840c7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f6d7c019600 tx=0x7f6d7c019790 comp rx=0 tx=0).stop 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 shutdown_connections 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6d70068380 0x7f6d7006a840 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6d84153220 0x7f6d840c7760 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6d840723d0 0x7f6d84148b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 --2- 172.21.15.26:0/5545551 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6d84067b00 0x7f6d8415b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 >> 172.21.15.26:0/5545551 conn(0x7f6d840c9a70 msgr2=0x7f6d840c9e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 shutdown_connections 2024-04-23T10:13:19.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.209+0000 7f6d8951b640 1 -- 172.21.15.26:0/5545551 wait complete. 2024-04-23T10:13:19.228 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:19.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.337+0000 7eff6a089640 1 Processor -- start 2024-04-23T10:13:19.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.337+0000 7eff6a089640 1 -- start start 2024-04-23T10:13:19.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff6406d4f0 0x7eff640cb1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 0x7eff6415eba0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff641447d0 con 0x7eff641443f0 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7eff64071a20 con 0x7eff6406d4f0 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7eff6406d940 con 0x7eff640cb720 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff6406d4f0 0x7eff640cb1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff6406d4f0 0x7eff640cb1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34324/0 (socket says 172.21.15.26:34324) 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 -- 172.21.15.26:0/1974415913 learned_addr learned my addr 172.21.15.26:0/1974415913 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff637fe640 1 --1- 172.21.15.26:0/1974415913 >> v1:172.21.15.26:6789/0 conn(0x7eff641443f0 0x7eff64071310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32878/0 (socket says 172.21.15.26:32878) 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff63fff640 1 --2- 172.21.15.26:0/1974415913 >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 0x7eff6415eba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 -- 172.21.15.26:0/1974415913 >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 msgr2=0x7eff6415eba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 --2- 172.21.15.26:0/1974415913 >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 0x7eff6415eba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 -- 172.21.15.26:0/1974415913 >> v1:172.21.15.26:6789/0 conn(0x7eff641443f0 legacy=0x7eff64071310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 -- 172.21.15.26:0/1974415913 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff6415b400 con 0x7eff6406d4f0 2024-04-23T10:13:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff63fff640 1 --2- 172.21.15.26:0/1974415913 >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 0x7eff6415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff62ffd640 1 --2- 172.21.15.26:0/1974415913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff640cb1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff640cc600 tx=0x7eff5801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a07b4317772db0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff627fc640 1 -- 172.21.15.26:0/1974415913 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580ab430 con 0x7eff6406d4f0 2024-04-23T10:13:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff627fc640 1 -- 172.21.15.26:0/1974415913 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff580b0070 con 0x7eff6406d4f0 2024-04-23T10:13:19.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff627fc640 1 -- 172.21.15.26:0/1974415913 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff580ab7f0 con 0x7eff6406d4f0 2024-04-23T10:13:19.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- 172.21.15.26:0/1974415913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 msgr2=0x7eff640cb1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 --2- 172.21.15.26:0/1974415913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff640cb1e0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7eff640cc600 tx=0x7eff5801c520 comp rx=0 tx=0).stop 2024-04-23T10:13:19.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- 172.21.15.26:0/1974415913 shutdown_connections 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 --2- 172.21.15.26:0/1974415913 >> v2:172.21.15.190:3300/0 conn(0x7eff640cb720 0x7eff6415eba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 --2- 172.21.15.26:0/1974415913 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff640cb1e0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- 172.21.15.26:0/1974415913 >> 172.21.15.26:0/1974415913 conn(0x7eff640676a0 msgr2=0x7eff64067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- 172.21.15.26:0/1974415913 shutdown_connections 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.341+0000 7eff6a089640 1 -- 172.21.15.26:0/1974415913 wait complete. 2024-04-23T10:13:19.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 Processor -- start 2024-04-23T10:13:19.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- start start 2024-04-23T10:13:19.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 0x7eff6413cd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff641443f0 0x7eff641381d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7eff6415f4f0 con 0x7eff6406d4f0 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7eff6415bf80 con 0x7eff640cb720 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff64168370 con 0x7eff641443f0 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34332/0 (socket says 172.21.15.26:34332) 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 -- 172.21.15.26:0/3817597036 learned_addr learned my addr 172.21.15.26:0/3817597036 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff62ffd640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 0x7eff6413cd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff63fff640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff641443f0 0x7eff641381d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 -- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff641443f0 msgr2=0x7eff641381d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff641443f0 0x7eff641381d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 -- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 msgr2=0x7eff6413cd90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 0x7eff6413cd90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 -- 172.21.15.26:0/3817597036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff641f7e00 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff62ffd640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 0x7eff6413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff637fe640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c370 tx=0x7eff5400c830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff540074e0 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff54007680 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff54004a30 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff6413d2d0 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.345+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff6413f400 con 0x7eff6406d4f0 2024-04-23T10:13:19.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7eff64075df0 con 0x7eff6406d4f0 2024-04-23T10:13:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff5401a020 con 0x7eff6406d4f0 2024-04-23T10:13:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff4bfff640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 0x7eff5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff54086590 con 0x7eff6406d4f0 2024-04-23T10:13:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff62ffd640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 0x7eff5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.349+0000 7eff62ffd640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 0x7eff5006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff580af000 tx=0x7eff58008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.353+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7eff54056730 con 0x7eff6406d4f0 2024-04-23T10:13:19.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.509+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7eff640c9150 con 0x7eff6406d4f0 2024-04-23T10:13:19.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff4bfff640 1 -- 172.21.15.26:0/3817597036 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7eff54056030 con 0x7eff6406d4f0 2024-04-23T10:13:19.514 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:19.515 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:19.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 msgr2=0x7eff5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 0x7eff5006a840 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7eff580af000 tx=0x7eff58008040 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 msgr2=0x7eff641f78c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7eff5400c370 tx=0x7eff5400c830 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 shutdown_connections 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff50068380 0x7eff5006a840 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff641443f0 0x7eff641381d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff640cb720 0x7eff6413cd90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 --2- 172.21.15.26:0/3817597036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff6406d4f0 0x7eff641f78c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.513+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 >> 172.21.15.26:0/3817597036 conn(0x7eff640676a0 msgr2=0x7eff64067a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.517+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 shutdown_connections 2024-04-23T10:13:19.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.517+0000 7eff6a089640 1 -- 172.21.15.26:0/3817597036 wait complete. 2024-04-23T10:13:19.532 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 Processor -- start 2024-04-23T10:13:19.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 -- start start 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efeb014fbc0 0x7efeb006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00c5d70 con 0x7efeb014ffa0 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efeb00c6050 con 0x7efeb0074100 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb81df640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7efeb00c6330 con 0x7efeb014fbc0 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb5f7b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7efeb014fbc0 0x7efeb006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb577a640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7efeb014ffa0 0x7efeb00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32886/0 (socket says 172.21.15.26:32886) 2024-04-23T10:13:19.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb577a640 1 -- 172.21.15.26:0/44062471 learned_addr learned my addr 172.21.15.26:0/44062471 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb5f7b640 1 -- 172.21.15.26:0/44062471 >> v1:172.21.15.190:6789/0 conn(0x7efeb0074100 legacy=0x7efeb00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb5f7b640 1 -- 172.21.15.26:0/44062471 >> v1:172.21.15.26:6789/0 conn(0x7efeb014ffa0 legacy=0x7efeb00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb4f79640 1 -- 172.21.15.26:0/44062471 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 734407469 0 0) 0x7efeb00c5d70 con 0x7efeb014ffa0 2024-04-23T10:13:19.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.653+0000 7efeb5f7b640 1 -- 172.21.15.26:0/44062471 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb00c6610 con 0x7efeb014fbc0 2024-04-23T10:13:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb5f7b640 1 --2- 172.21.15.26:0/44062471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014fbc0 0x7efeb006f700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efeac0097f0 tx=0x7efeac01c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5c39c270376d617 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb4f79640 1 -- 172.21.15.26:0/44062471 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac0aa620 con 0x7efeb014fbc0 2024-04-23T10:13:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb4f79640 1 -- 172.21.15.26:0/44062471 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efeac0af070 con 0x7efeb014fbc0 2024-04-23T10:13:19.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb4f79640 1 -- 172.21.15.26:0/44062471 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efeac0aa9e0 con 0x7efeb014fbc0 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- 172.21.15.26:0/44062471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014fbc0 msgr2=0x7efeb006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 --2- 172.21.15.26:0/44062471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014fbc0 0x7efeb006f700 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7efeac0097f0 tx=0x7efeac01c4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- 172.21.15.26:0/44062471 shutdown_connections 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 --2- 172.21.15.26:0/44062471 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014fbc0 0x7efeb006f700 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- 172.21.15.26:0/44062471 >> 172.21.15.26:0/44062471 conn(0x7efeb006b9d0 msgr2=0x7efeb006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- 172.21.15.26:0/44062471 shutdown_connections 2024-04-23T10:13:19.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- 172.21.15.26:0/44062471 wait complete. 2024-04-23T10:13:19.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 Processor -- start 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- start start 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb0074100 0x7efeb01f7f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb014fbc0 0x7efeb01401d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7efeb0167630 con 0x7efeb014ffa0 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7efeb01674b0 con 0x7efeb014fbc0 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb81df640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7efeb01677b0 con 0x7efeb0074100 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34342/0 (socket says 172.21.15.26:34342) 2024-04-23T10:13:19.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 -- 172.21.15.26:0/183510347 learned_addr learned my addr 172.21.15.26:0/183510347 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb5f7b640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb0074100 0x7efeb01f7f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb577a640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb014fbc0 0x7efeb01401d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 -- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb0074100 msgr2=0x7efeb01f7f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb0074100 0x7efeb01f7f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 -- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb014fbc0 msgr2=0x7efeb01401d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb014fbc0 0x7efeb01401d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 -- 172.21.15.26:0/183510347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efeb01f8450 con 0x7efeb014ffa0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.657+0000 7efeb677c640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efea800c730 tx=0x7efea800cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea8003b80 con 0x7efeb014ffa0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efea8003d20 con 0x7efeb014ffa0 2024-04-23T10:13:19.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efeb0140710 con 0x7efeb014ffa0 2024-04-23T10:13:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7efea800aa90 con 0x7efeb014ffa0 2024-04-23T10:13:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efeb0142410 con 0x7efeb014ffa0 2024-04-23T10:13:19.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efeb0075df0 con 0x7efeb014ffa0 2024-04-23T10:13:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7efea800ac30 con 0x7efeb014ffa0 2024-04-23T10:13:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 0x7efe9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7efea8086bd0 con 0x7efeb014ffa0 2024-04-23T10:13:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efeb5f7b640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 0x7efe9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:19.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.661+0000 7efeb5f7b640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 0x7efe9406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efeac0ae000 tx=0x7efeac0a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:19.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.665+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7efea8056e00 con 0x7efeb014ffa0 2024-04-23T10:13:19.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.857+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7efeb00c39e0 con 0x7efeb014ffa0 2024-04-23T10:13:19.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.857+0000 7efea67fc640 1 -- 172.21.15.26:0/183510347 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 18 v18) ==== 94+0+6914 (secure 0 0 0) 0x7efea8056700 con 0x7efeb014ffa0 2024-04-23T10:13:19.859 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:19.859 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":18,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:15.016870+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:creating","state_seq":1,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4287,4284,4282,4275]},"id":1}]} 2024-04-23T10:13:19.860 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 18 2024-04-23T10:13:19.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 msgr2=0x7efe9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 0x7efe9406a840 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7efeac0ae000 tx=0x7efeac0a7000 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 msgr2=0x7efeb0152850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7efea800c730 tx=0x7efea800cbf0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 shutdown_connections 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7efe94068380 0x7efe9406a840 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7efeb014ffa0 0x7efeb0152850 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7efeb014fbc0 0x7efeb01401d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 --2- 172.21.15.26:0/183510347 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7efeb0074100 0x7efeb01f7f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 >> 172.21.15.26:0/183510347 conn(0x7efeb006b9d0 msgr2=0x7efeb014a980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 shutdown_connections 2024-04-23T10:13:19.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:19.861+0000 7efeb81df640 1 -- 172.21.15.26:0/183510347 wait complete. 2024-04-23T10:13:20.482 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 18, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:12:34.380485+0000', 'modified': '2024-04-23T10:13:15.016870+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4287, 'mds_1': 4284, 'mds_2': 4282, 'mds_3': 4275, 'mds_4': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 4, 'incarnation': 18, 'state': 'up:creating', 'state_seq': 1, 'addr': '172.21.15.26:6833/3926029460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 3926029460}, {'type': 'v1', 'addr': '172.21.15.26:6833', 'nonce': 3926029460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4275': {'gid': 4275, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.26:6836/2066596634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 2066596634}, {'type': 'v1', 'addr': '172.21.15.26:6836', 'nonce': 2066596634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.190:6837/1581526507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 1581526507}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1581526507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.26:6837/1290255157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6835', 'nonce': 1290255157}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 1290255157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.190:6838/585421961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 585421961}, {'type': 'v1', 'addr': '172.21.15.190:6838', 'nonce': 585421961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4287, 4284, 4282, 4275]} 2024-04-23T10:13:20.482 WARNING:tasks.cephfs.filesystem:Unhealthy mds state gid_4260:up:creating 2024-04-23T10:13:21.483 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.617+0000 7f10763b9640 1 Processor -- start 2024-04-23T10:13:21.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.617+0000 7f10763b9640 1 -- start start 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f10700c8630 0x7f1070151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f10700c8a70 0x7f1070152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107015b740 con 0x7f10700c8250 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f10700c6490 con 0x7f10700c8630 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f10701525c0 con 0x7f10700c8a70 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f10700c8250 0x7f10700c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:32896/0 (socket says 172.21.15.26:32896) 2024-04-23T10:13:21.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106ffff640 1 -- 172.21.15.26:0/2014534602 learned_addr learned my addr 172.21.15.26:0/2014534602 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 --2- 172.21.15.26:0/2014534602 >> v2:172.21.15.26:3300/0 conn(0x7f10700c8630 0x7f1070151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f1074956640 1 --2- 172.21.15.26:0/2014534602 >> v2:172.21.15.190:3300/0 conn(0x7f10700c8a70 0x7f1070152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 -- 172.21.15.26:0/2014534602 >> v2:172.21.15.190:3300/0 conn(0x7f10700c8a70 msgr2=0x7f1070152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 --2- 172.21.15.26:0/2014534602 >> v2:172.21.15.190:3300/0 conn(0x7f10700c8a70 0x7f1070152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 -- 172.21.15.26:0/2014534602 >> v1:172.21.15.26:6789/0 conn(0x7f10700c8250 legacy=0x7f10700c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106effd640 1 -- 172.21.15.26:0/2014534602 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4294873859 0 0) 0x7f107015b740 con 0x7f10700c8250 2024-04-23T10:13:21.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 -- 172.21.15.26:0/2014534602 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10700c40f0 con 0x7f10700c8630 2024-04-23T10:13:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106f7fe640 1 --2- 172.21.15.26:0/2014534602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8630 0x7f1070151b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1070072550 tx=0x7f106401c3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82ba4c0b1f0025 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106effd640 1 -- 172.21.15.26:0/2014534602 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10640b0070 con 0x7f10700c8630 2024-04-23T10:13:21.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106effd640 1 -- 172.21.15.26:0/2014534602 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10640ab600 con 0x7f10700c8630 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f106effd640 1 -- 172.21.15.26:0/2014534602 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10640ab9d0 con 0x7f10700c8630 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- 172.21.15.26:0/2014534602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8630 msgr2=0x7f1070151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 --2- 172.21.15.26:0/2014534602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8630 0x7f1070151b40 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1070072550 tx=0x7f106401c3f0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- 172.21.15.26:0/2014534602 shutdown_connections 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 --2- 172.21.15.26:0/2014534602 >> v2:172.21.15.190:3300/0 conn(0x7f10700c8a70 0x7f1070152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 --2- 172.21.15.26:0/2014534602 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8630 0x7f1070151b40 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- 172.21.15.26:0/2014534602 >> 172.21.15.26:0/2014534602 conn(0x7f107006b9d0 msgr2=0x7f107006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- 172.21.15.26:0/2014534602 shutdown_connections 2024-04-23T10:13:21.626 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.621+0000 7f10763b9640 1 -- 172.21.15.26:0/2014534602 wait complete. 2024-04-23T10:13:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 Processor -- start 2024-04-23T10:13:21.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- start start 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c8250 0x7f10701592e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700c8630 0x7f10701414d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f107015b400 con 0x7f10700c8a70 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10700721a0 con 0x7f10700c8250 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10700c6920 con 0x7f10700c8630 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:34366/0 (socket says 172.21.15.26:34366) 2024-04-23T10:13:21.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 -- 172.21.15.26:0/3662736267 learned_addr learned my addr 172.21.15.26:0/3662736267 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f106f7fe640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700c8630 0x7f10701414d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f106ffff640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c8250 0x7f10701592e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 -- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700c8630 msgr2=0x7f10701414d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700c8630 0x7f10701414d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 -- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c8250 msgr2=0x7f10701592e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c8250 0x7f10701592e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 -- 172.21.15.26:0/3662736267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1070144680 con 0x7f10700c8a70 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f1074956640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1068007e90 tx=0x7f106800e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068014420 con 0x7f10700c8a70 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1068019070 con 0x7f10700c8a70 2024-04-23T10:13:21.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1068014800 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10701440c0 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10701f5920 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.625+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1070075df0 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.629+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f10680149a0 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.629+0000 7f106cff9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.629+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1068087500 con 0x7f10700c8a70 2024-04-23T10:13:21.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.629+0000 7f106ffff640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:21.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.629+0000 7f106ffff640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 0x7f105c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1060007fd0 tx=0x7f1060007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:21.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.633+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1070144680 con 0x7f10700c8a70 2024-04-23T10:13:21.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.825+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f1070071620 con 0x7f10700c8a70 2024-04-23T10:13:21.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.825+0000 7f106cff9640 1 -- 172.21.15.26:0/3662736267 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f1068056fc0 con 0x7f10700c8a70 2024-04-23T10:13:21.827 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:21.828 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:13:21.828 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 msgr2=0x7f105c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 0x7f105c06a870 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f1060007fd0 tx=0x7f1060007d60 comp rx=0 tx=0).stop 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 msgr2=0x7f10701437a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7f1068007e90 tx=0x7f106800e4b0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 shutdown_connections 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f105c0683b0 0x7f105c06a870 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10700c8a70 0x7f10701437a0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10700c8630 0x7f10701414d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 --2- 172.21.15.26:0/3662736267 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10700c8250 0x7f10701592e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 >> 172.21.15.26:0/3662736267 conn(0x7f107006b9d0 msgr2=0x7f1070161c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 shutdown_connections 2024-04-23T10:13:21.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:21.829+0000 7f10763b9640 1 -- 172.21.15.26:0/3662736267 wait complete. 2024-04-23T10:13:22.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:12:34.380485+0000', 'modified': '2024-04-23T10:13:21.048533+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4287, 'mds_1': 4284, 'mds_2': 4282, 'mds_3': 4275, 'mds_4': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.26:6833/3926029460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 3926029460}, {'type': 'v1', 'addr': '172.21.15.26:6833', 'nonce': 3926029460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4275': {'gid': 4275, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.26:6836/2066596634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 2066596634}, {'type': 'v1', 'addr': '172.21.15.26:6836', 'nonce': 2066596634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.190:6837/1581526507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 1581526507}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1581526507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.26:6837/1290255157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6835', 'nonce': 1290255157}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 1290255157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.190:6838/585421961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 585421961}, {'type': 'v1', 'addr': '172.21.15.190:6838', 'nonce': 585421961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4260, 4275, 4282, 4284, 4287]} 2024-04-23T10:13:22.449 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:13:22.450 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-23T10:13:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.585+0000 7f7adac65640 1 Processor -- start 2024-04-23T10:13:22.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.585+0000 7f7adac65640 1 -- start start 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7ad40c8800 0x7f7ad40c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad40c5e90 0x7f7ad40c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ad40c8be0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad4158090 con 0x7f7ad40c5e90 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f7ad41585c0 con 0x7f7ad40c8800 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad40c5e90 0x7f7ad40c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7ad40c5e90 0x7f7ad40c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56044/0 (socket says 172.21.15.26:56044) 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 -- 172.21.15.26:0/3990133589 learned_addr learned my addr 172.21.15.26:0/3990133589 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/3990133589 >> v2:172.21.15.190:3300/0 conn(0x7f7ad40c8800 0x7f7ad40c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 -- 172.21.15.26:0/3990133589 >> v2:172.21.15.190:3300/0 conn(0x7f7ad40c8800 msgr2=0x7f7ad40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 --2- 172.21.15.26:0/3990133589 >> v2:172.21.15.190:3300/0 conn(0x7f7ad40c8800 0x7f7ad40c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 -- 172.21.15.26:0/3990133589 >> v1:172.21.15.190:6789/0 conn(0x7f7ad40c4b40 legacy=0x7f7ad40c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:22.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 -- 172.21.15.26:0/3990133589 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad40c4790 con 0x7f7ad40c5e90 2024-04-23T10:13:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7ad9202640 1 --2- 172.21.15.26:0/3990133589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c5e90 0x7f7ad40c3f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4070da0 tx=0x7f7acc01d9d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0a379dd36a01342 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7acb7fe640 1 -- 172.21.15.26:0/3990133589 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc00a2d0 con 0x7f7ad40c5e90 2024-04-23T10:13:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7acb7fe640 1 -- 172.21.15.26:0/3990133589 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7acc0a6850 con 0x7f7ad40c5e90 2024-04-23T10:13:22.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7acb7fe640 1 -- 172.21.15.26:0/3990133589 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0a6c20 con 0x7f7ad40c5e90 2024-04-23T10:13:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- 172.21.15.26:0/3990133589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c5e90 msgr2=0x7f7ad40c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 --2- 172.21.15.26:0/3990133589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c5e90 0x7f7ad40c3f20 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f7ad4070da0 tx=0x7f7acc01d9d0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- 172.21.15.26:0/3990133589 shutdown_connections 2024-04-23T10:13:22.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 --2- 172.21.15.26:0/3990133589 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c5e90 0x7f7ad40c3f20 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 --2- 172.21.15.26:0/3990133589 >> v2:172.21.15.190:3300/0 conn(0x7f7ad40c8800 0x7f7ad40c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- 172.21.15.26:0/3990133589 >> 172.21.15.26:0/3990133589 conn(0x7f7ad406b9d0 msgr2=0x7f7ad406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- 172.21.15.26:0/3990133589 shutdown_connections 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.589+0000 7f7adac65640 1 -- 172.21.15.26:0/3990133589 wait complete. 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 Processor -- start 2024-04-23T10:13:22.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- start start 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ad40c5e90 0x7f7ad4146d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ad40c8800 0x7f7ad41496d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad4068610 con 0x7f7ad40c4b40 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad40c52f0 con 0x7f7ad40c5e90 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad4068790 con 0x7f7ad40c8800 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56058/0 (socket says 172.21.15.26:56058) 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 -- 172.21.15.26:0/2417047152 learned_addr learned my addr 172.21.15.26:0/2417047152 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:22.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad9202640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ad40c8800 0x7f7ad41496d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7acbfff640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ad40c5e90 0x7f7ad4146d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 -- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ad40c8800 msgr2=0x7f7ad41496d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ad40c8800 0x7f7ad41496d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 -- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ad40c5e90 msgr2=0x7f7ad4146d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ad40c5e90 0x7f7ad4146d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 -- 172.21.15.26:0/2417047152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ad4147e50 con 0x7f7ad40c4b40 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000d5f0 tx=0x7f7ad000dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ac97fa640 1 -- 172.21.15.26:0/2417047152 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00125f0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ac97fa640 1 -- 172.21.15.26:0/2417047152 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0019070 con 0x7f7ad40c4b40 2024-04-23T10:13:22.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7ac97fa640 1 -- 172.21.15.26:0/2417047152 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad00129b0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ad40c5bb0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.593+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ad414dae0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7ac97fa640 1 -- 172.21.15.26:0/2417047152 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7ad0012b50 con 0x7f7ad40c4b40 2024-04-23T10:13:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7ac97fa640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 0x7f7ac006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7ac97fa640 1 -- 172.21.15.26:0/2417047152 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7ad00871c0 con 0x7f7ad40c4b40 2024-04-23T10:13:22.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 0x7f7ac006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 Processor -- start 2024-04-23T10:13:22.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 -- start start 2024-04-23T10:13:22.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 0x7f7ac006a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40015b0 tx=0x7f7ac4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bd190 0x55cffd3bd570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3f89a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cffd206420 con 0x55cffd3bdab0 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cffd1a0bf0 con 0x55cffd3bd190 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55cffd2023e0 con 0x55cffd3f85c0 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56074/0 (socket says 172.21.15.26:56074) 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 -- 172.21.15.26:0/3985242009 learned_addr learned my addr 172.21.15.26:0/3985242009 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bd190 0x55cffd3bd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7ad9202640 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3f89a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 -- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 msgr2=0x55cffd3f89a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3f89a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 -- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bd190 msgr2=0x55cffd3bd570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bd190 0x55cffd3bd570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 -- 172.21.15.26:0/3985242009 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cffd2ae450 con 0x55cffd3bdab0 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7acbfff640 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005280 tx=0x7f7ac4011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b677d01c0e23448 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7aba7fc640 1 -- 172.21.15.26:0/3985242009 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400e4b0 con 0x55cffd3bdab0 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7aba7fc640 1 -- 172.21.15.26:0/3985242009 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac400e650 con 0x55cffd3bdab0 2024-04-23T10:13:22.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.597+0000 7f7aba7fc640 1 -- 172.21.15.26:0/3985242009 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ac400ea00 con 0x55cffd3bdab0 2024-04-23T10:13:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/3985242009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 msgr2=0x55cffd3f8080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:22.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f7ac4005280 tx=0x7f7ac4011000 comp rx=0 tx=0).stop 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/3985242009 shutdown_connections 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3f89a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bdab0 0x55cffd3f8080 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- 172.21.15.26:0/3985242009 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bd190 0x55cffd3bd570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/3985242009 >> 172.21.15.26:0/3985242009 conn(0x55cffd3f4e40 msgr2=0x55cffd3f7260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/3985242009 shutdown_connections 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/3985242009 wait complete. 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- start start 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 Processor -- start 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bdab0 0x55cffd3ba0f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3ba630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cffd1a6ec0 con 0x55cffd3bd190 2024-04-23T10:13:22.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cffd287120 con 0x55cffd3bdab0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55cffd211350 con 0x55cffd3f85c0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 10 client.0 _ll_register_callbacks cb 0x55cffd1e34d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56088/0 (socket says 172.21.15.26:56088) 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 -- 172.21.15.26:0/1936056753 learned_addr learned my addr 172.21.15.26:0/1936056753 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad9202640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3ba630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bdab0 0x55cffd3ba0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 -- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 msgr2=0x55cffd3ba630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3ba630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 -- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bdab0 msgr2=0x55cffd3ba0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bdab0 0x55cffd3ba0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 -- 172.21.15.26:0/1936056753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cffd24bf80 con 0x55cffd3bd190 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad9202640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f310 tx=0x7f7ad0004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d8e870b5a4e12598 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:22.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0083060 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7ad00532d0 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ac400e650 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7ad0074050 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 10 client.4896 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55cffd1dff00 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ac400e650 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f7ad0013070 con 0x55cffd3bd190 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 10 client.4896 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 10 client.4896 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 20 client.4896 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 4 client.4896 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 --> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55cffd19fbc0 con 0x55cffd40cd90 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 -- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 msgr2=0x55cffd40f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_bulk peer close file descriptor 19 2024-04-23T10:13:22.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 -- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 msgr2=0x55cffd40f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).read_until read failed 2024-04-23T10:13:22.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 2024-04-23T10:13:22.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.601+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._fault waiting 0.200000 2024-04-23T10:13:22.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.805+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.805+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=57c249cbc9ee1996 server_cookie=5ff3d905048bf51d in_seq=0 out_seq=0 2024-04-23T10:13:22.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:22.805+0000 7f7ab37fe640 10 client.4896 ms_handle_connect on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1936056753 <== mds.4 v2:172.21.15.26:6832/3926029460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55cffd19fbc0 con 0x55cffd40cd90 2024-04-23T10:13:26.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7ab37fe640 10 client.4896 handle_command_reply: tid=0 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 client.4896 shutdown 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 msgr2=0x55cffd3b9bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7f7ad005f310 tx=0x7f7ad0004740 comp rx=0 tx=0).stop 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 shutdown_connections 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd40cd90 0x55cffd40f180 crc :-1 s=READY pgs=14 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3f85c0 0x55cffd3ba630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7ab37fe640 0 client.4896 ms_handle_reset on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3bdab0 0x55cffd3ba0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 --2- 172.21.15.26:0/1936056753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3b9bb0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 >> 172.21.15.26:0/1936056753 conn(0x55cffd3f4e40 msgr2=0x55cffd3f61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 shutdown_connections 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 1 -- 172.21.15.26:0/1936056753 wait complete. 2024-04-23T10:13:26.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.061+0000 7f7addde7000 20 client.4896 trim_cache size 0 max 16384 2024-04-23T10:13:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.093+0000 7f7addde7000 1 Processor -- start 2024-04-23T10:13:26.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.093+0000 7f7addde7000 1 -- start start 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd3f33d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd40f180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41ff490 con 0x55cffd3bd190 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7ad41ffb60 con 0x55cffd3f85c0 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7ad41fdd60 con 0x55cffd3bdab0 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56104/0 (socket says 172.21.15.26:56104) 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 -- 172.21.15.26:0/701746813 learned_addr learned my addr 172.21.15.26:0/701746813 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad9202640 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd40f180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7acbfff640 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd3f33d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 -- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 msgr2=0x55cffd3f33d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd3f33d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 -- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 msgr2=0x55cffd40f180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd40f180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 -- 172.21.15.26:0/701746813 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cffd18ce80 con 0x55cffd3bd190 2024-04-23T10:13:26.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ad006f340 tx=0x7f7ad0057f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d77c663ef2536d8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ab9ffb640 1 -- 172.21.15.26:0/701746813 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad0079070 con 0x55cffd3bd190 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ab9ffb640 1 -- 172.21.15.26:0/701746813 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0057360 con 0x55cffd3bd190 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7ab9ffb640 1 -- 172.21.15.26:0/701746813 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7ad006f070 con 0x55cffd3bd190 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- 172.21.15.26:0/701746813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 msgr2=0x55cffd3f2e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7f7ad006f340 tx=0x7f7ad0057f90 comp rx=0 tx=0).stop 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- 172.21.15.26:0/701746813 shutdown_connections 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd40f180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd3f33d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 --2- 172.21.15.26:0/701746813 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd3bd190 0x55cffd3f2e90 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- 172.21.15.26:0/701746813 >> 172.21.15.26:0/701746813 conn(0x55cffd3f4e40 msgr2=0x55cffd3b6ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.097+0000 7f7addde7000 1 -- 172.21.15.26:0/701746813 shutdown_connections 2024-04-23T10:13:26.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- 172.21.15.26:0/701746813 wait complete. 2024-04-23T10:13:26.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- start start 2024-04-23T10:13:26.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 Processor -- start 2024-04-23T10:13:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd4670d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd467610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55cffd205730 con 0x55cffd467d70 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55cffd1d29e0 con 0x55cffd3f85c0 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55cffd20aa50 con 0x55cffd3bdab0 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 10 client.0 _ll_register_callbacks cb 0x7f7ad00870f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56116/0 (socket says 172.21.15.26:56116) 2024-04-23T10:13:26.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 -- 172.21.15.26:0/1961368850 learned_addr learned my addr 172.21.15.26:0/1961368850 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7acbfff640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd467610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd4670d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 -- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 msgr2=0x55cffd4670d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd4670d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 -- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 msgr2=0x55cffd467610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd467610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 -- 172.21.15.26:0/1961368850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cffd1ceb30 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ad9202640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7acc01b600 tx=0x7f7acc01c210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7cb9a2558bbc7565 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ab37fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7acc0a69d0 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7acc0a6b70 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.101+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7ad0057360 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7acc0a6d70 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 10 client.4902 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55cffd2875b0 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ad0057360 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f7acc0c0070 con 0x55cffd467d70 2024-04-23T10:13:26.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 10 client.4902 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 10 client.4902 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 20 client.4902 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd468690 0x55cffd468a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 4 client.4902 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 --> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] -- command(tid 0: {"prefix": "status"}) -- 0x55cffd213e40 con 0x55cffd468690 2024-04-23T10:13:26.109 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd468690 0x55cffd468a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 10 client.4902 ms_handle_connect on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:26.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ad8a01640 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd468690 0x55cffd468a70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=80d7a39e17117560 server_cookie=28611453597705b5 in_seq=0 out_seq=0 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 1 -- 172.21.15.26:0/1961368850 <== mds.4 v2:172.21.15.26:6832/3926029460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+318 (crc 0 0 0) 0x55cffd213e40 con 0x55cffd468690 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 10 client.4902 handle_command_reply: tid=0 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 client.4902 shutdown 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 msgr2=0x55cffd468150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7f7acc01b600 tx=0x7f7acc01c210 comp rx=0 tx=0).stop 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 shutdown_connections 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x55cffd468690 0x55cffd468a70 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55cffd467d70 0x55cffd468150 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55cffd3f85c0 0x55cffd467610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 --2- 172.21.15.26:0/1961368850 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55cffd3bdab0 0x55cffd4670d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7ab37fe640 0 client.4902 ms_handle_reset on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:26.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 >> 172.21.15.26:0/1961368850 conn(0x55cffd3f4e40 msgr2=0x55cffd3b6110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 shutdown_connections 2024-04-23T10:13:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 1 -- 172.21.15.26:0/1961368850 wait complete. 2024-04-23T10:13:26.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7addde7000 20 client.4902 trim_cache size 0 max 16384 2024-04-23T10:13:26.112 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 4, 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4260, 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:26.113 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:26.114 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 11.07529128, 2024-04-23T10:13:26.114 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:26.114 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:26.114 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:26.115 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 58.148374161 2024-04-23T10:13:26.115 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 msgr2=0x7f7ac006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 0x7f7ac006a870 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7f7ac40015b0 tx=0x7f7ac4009040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 msgr2=0x7f7ad4156b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f7ad000d5f0 tx=0x7f7ad000dab0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 shutdown_connections 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7ac00683b0 0x7f7ac006a870 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7ad40c8800 0x7f7ad41496d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7ad40c5e90 0x7f7ad4146d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 --2- 172.21.15.26:0/2417047152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7ad40c4b40 0x7f7ad4156b20 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 >> 172.21.15.26:0/2417047152 conn(0x7f7ad406b9d0 msgr2=0x7f7ad4157290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 shutdown_connections 2024-04-23T10:13:26.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.105+0000 7f7adac65640 1 -- 172.21.15.26:0/2417047152 wait complete. 2024-04-23T10:13:26.133 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:13:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 Processor -- start 2024-04-23T10:13:26.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 -- start start 2024-04-23T10:13:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1f406e720 0x7fa1f40676a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f415b630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1f406ec60 con 0x7fa1f4158880 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa1f40b0540 con 0x7fa1f406e720 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f9373640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40afa00 con 0x7fa1f4073d50 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1f406e720 0x7fa1f40676a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1ebfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa1f406e720 0x7fa1f40676a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56120/0 (socket says 172.21.15.26:56120) 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1ebfff640 1 -- 172.21.15.26:0/994059076 learned_addr learned my addr 172.21.15.26:0/994059076 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.257+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f415b630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1ebfff640 1 -- 172.21.15.26:0/994059076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 msgr2=0x7fa1f415b630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f415b630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1ebfff640 1 -- 172.21.15.26:0/994059076 >> v1:172.21.15.190:6789/0 conn(0x7fa1f4158880 legacy=0x7fa1f40b1a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1ebfff640 1 -- 172.21.15.26:0/994059076 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f415b130 con 0x7fa1f406e720 2024-04-23T10:13:26.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f406e720 0x7fa1f40676a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009870 tx=0x7fa1dc01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66ffd766b12f6906 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f27fc640 1 -- 172.21.15.26:0/994059076 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0ab650 con 0x7fa1f406e720 2024-04-23T10:13:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f27fc640 1 -- 172.21.15.26:0/994059076 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1dc0b0070 con 0x7fa1f406e720 2024-04-23T10:13:26.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f27fc640 1 -- 172.21.15.26:0/994059076 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0aba10 con 0x7fa1f406e720 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 -- 172.21.15.26:0/994059076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f406e720 msgr2=0x7fa1f40676a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f406e720 0x7fa1f40676a0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009870 tx=0x7fa1dc01c560 comp rx=0 tx=0).stop 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 -- 172.21.15.26:0/994059076 shutdown_connections 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f415b630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 --2- 172.21.15.26:0/994059076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f406e720 0x7fa1f40676a0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 -- 172.21.15.26:0/994059076 >> 172.21.15.26:0/994059076 conn(0x7fa1f406f280 msgr2=0x7fa1f406f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 -- 172.21.15.26:0/994059076 shutdown_connections 2024-04-23T10:13:26.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.261+0000 7fa1f9373640 1 -- 172.21.15.26:0/994059076 wait complete. 2024-04-23T10:13:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 Processor -- start 2024-04-23T10:13:26.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- start start 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1f406e720 0x7fa1f41f8030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f406c4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f40b2120 con 0x7fa1f4158880 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f415bf80 con 0x7fa1f406e720 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f40b22a0 con 0x7fa1f4073d50 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56122/0 (socket says 172.21.15.26:56122) 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 -- 172.21.15.26:0/2293077011 learned_addr learned my addr 172.21.15.26:0/2293077011 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1f406e720 0x7fa1f41f8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f406c4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 -- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 msgr2=0x7fa1f406c4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f406c4a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 -- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1f406e720 msgr2=0x7fa1f41f8030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1f406e720 0x7fa1f41f8030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 -- 172.21.15.26:0/2293077011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1f4071c40 con 0x7fa1f4158880 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007e20 tx=0x7fa1ec00d4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1eb7fe640 1 -- 172.21.15.26:0/2293077011 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec01a070 con 0x7fa1f4158880 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1eb7fe640 1 -- 172.21.15.26:0/2293077011 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1ec003ba0 con 0x7fa1f4158880 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1eb7fe640 1 -- 172.21.15.26:0/2293077011 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec00de80 con 0x7fa1f4158880 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1f41f42c0 con 0x7fa1f4158880 2024-04-23T10:13:26.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.265+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1f41f4880 con 0x7fa1f4158880 2024-04-23T10:13:26.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1eb7fe640 1 -- 172.21.15.26:0/2293077011 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1ec01d070 con 0x7fa1f4158880 2024-04-23T10:13:26.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1eb7fe640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 0x7fa1d406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1eb7fe640 1 -- 172.21.15.26:0/2293077011 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1ec0870c0 con 0x7fa1f4158880 2024-04-23T10:13:26.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 0x7fa1d406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 Processor -- start 2024-04-23T10:13:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- start start 2024-04-23T10:13:26.270 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 0x7fa1d406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4001810 tx=0x7fa1e4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438ab0 0x558772473080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724739a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558772281420 con 0x558772438190 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55877221bbf0 con 0x5587724735c0 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55877227d3e0 con 0x558772438ab0 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56124/0 (socket says 172.21.15.26:56124) 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/2785226359 learned_addr learned my addr 172.21.15.26:0/2785226359 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438ab0 0x558772473080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.273 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724739a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438ab0 msgr2=0x558772473080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438ab0 0x558772473080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 msgr2=0x5587724739a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724739a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/2785226359 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772329450 con 0x558772438190 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400fa90 tx=0x7fa1e4000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db03c9d03f6178ea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1e8ff9640 1 -- 172.21.15.26:0/2785226359 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4025070 con 0x558772438190 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1e8ff9640 1 -- 172.21.15.26:0/2785226359 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4015bf0 con 0x558772438190 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1e8ff9640 1 -- 172.21.15.26:0/2785226359 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4020400 con 0x558772438190 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/2785226359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 msgr2=0x558772438570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400fa90 tx=0x7fa1e4000ee0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.274 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/2785226359 shutdown_connections 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724739a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438ab0 0x558772473080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/2785226359 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x558772438570 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/2785226359 >> 172.21.15.26:0/2785226359 conn(0x55877246fe40 msgr2=0x558772472260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/2785226359 shutdown_connections 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.269+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/2785226359 wait complete. 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- start start 2024-04-23T10:13:26.275 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 Processor -- start 2024-04-23T10:13:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x558772434c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.278 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724356a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558772221ec0 con 0x558772438ab0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558772302120 con 0x5587724735c0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55877228c350 con 0x558772438190 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 10 client.0 _ll_register_callbacks cb 0x55877225e4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56138/0 (socket says 172.21.15.26:56138) 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 -- 172.21.15.26:0/1847858354 learned_addr learned my addr 172.21.15.26:0/1847858354 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x558772434c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724356a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.279 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 -- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 msgr2=0x558772434c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x558772434c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 -- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 msgr2=0x5587724356a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724356a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 -- 172.21.15.26:0/1847858354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587722c6f80 con 0x558772438ab0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009870 tx=0x7fa1dc0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34532f3031322e7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1dc0abb90 con 0x558772438ab0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1dc0abd30 con 0x558772438ab0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e4015bf0 con 0x558772438ab0 2024-04-23T10:13:26.280 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1dc0c6050 con 0x558772438ab0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 10 client.4914 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55877225af00 con 0x558772438ab0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4015bf0 con 0x558772438ab0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fa1dc0c9020 con 0x558772438ab0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 10 client.4914 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 10 client.4914 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 20 client.4914 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x558772487d90 0x55877248a180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 4 client.4914 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 --> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55877221abc0 con 0x558772487d90 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x558772487d90 0x55877248a180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1d1ffb640 10 client.4914 ms_handle_connect on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.273+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x558772487d90 0x55877248a180 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=79c0b192cc9352a0 server_cookie=9ed0f030d350ef9d in_seq=0 out_seq=0 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/1847858354 <== mds.3 v2:172.21.15.26:6834/2066596634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55877221abc0 con 0x558772487d90 2024-04-23T10:13:26.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1d1ffb640 10 client.4914 handle_command_reply: tid=0 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 client.4914 shutdown 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 msgr2=0x558772435160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fa1dc009870 tx=0x7fa1dc0046d0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 shutdown_connections 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5587724735c0 0x5587724356a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x558772487d90 0x55877248a180 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438ab0 0x558772435160 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/1847858354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x558772434c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 >> 172.21.15.26:0/1847858354 conn(0x55877246fe40 msgr2=0x5587724711c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1d1ffb640 0 client.4914 ms_handle_reset on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 shutdown_connections 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/1847858354 wait complete. 2024-04-23T10:13:26.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.277+0000 7fa1fc4f5000 20 client.4914 trim_cache size 0 max 16384 2024-04-23T10:13:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 Processor -- start 2024-04-23T10:13:26.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 -- start start 2024-04-23T10:13:26.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x55877246e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587724735c0 0x5587724e14e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f42019a0 con 0x558772438190 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1f4202070 con 0x558772438ab0 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1f4157220 con 0x5587724735c0 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56140/0 (socket says 172.21.15.26:56140) 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/3078939916 learned_addr learned my addr 172.21.15.26:0/3078939916 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587724735c0 msgr2=0x5587724e14e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587724735c0 0x5587724e14e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 msgr2=0x55877246e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x55877246e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x55877246e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 -- 172.21.15.26:0/3078939916 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558772437940 con 0x558772438190 2024-04-23T10:13:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x55877246e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.293+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400f5a0 tx=0x7fa1e4014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13edb7c6e7c24a9e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d3fff640 1 -- 172.21.15.26:0/3078939916 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4025040 con 0x558772438190 2024-04-23T10:13:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d3fff640 1 -- 172.21.15.26:0/3078939916 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4032260 con 0x558772438190 2024-04-23T10:13:26.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d3fff640 1 -- 172.21.15.26:0/3078939916 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1e4032630 con 0x558772438190 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/3078939916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 msgr2=0x55877246de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x7fa1e400f5a0 tx=0x7fa1e4014000 comp rx=0 tx=0).stop 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/3078939916 shutdown_connections 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5587724735c0 0x5587724e14e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x55877246e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/3078939916 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558772438190 0x55877246de90 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/3078939916 >> 172.21.15.26:0/3078939916 conn(0x55877246fe40 msgr2=0x558772431ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/3078939916 shutdown_connections 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/3078939916 wait complete. 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- start start 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 Processor -- start 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x55877248cb80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x5587724e3540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558772280730 con 0x5587724735c0 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55877224d9e0 con 0x558772438ab0 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558772285a50 con 0x558772438190 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 10 client.0 _ll_register_callbacks cb 0x7fa1dc0096f0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56142/0 (socket says 172.21.15.26:56142) 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 -- 172.21.15.26:0/436982784 learned_addr learned my addr 172.21.15.26:0/436982784 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1ebfff640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x5587724e3540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x55877248cb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 -- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 msgr2=0x55877248cb80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x55877248cb80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 -- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 msgr2=0x5587724e3540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x5587724e3540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 -- 172.21.15.26:0/436982784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558772207e80 con 0x5587724735c0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f37fe640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec085130 tx=0x7fa1ec05f760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fda73ff4e816b224 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1ec05f410 con 0x5587724735c0 2024-04-23T10:13:26.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1ec055f30 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fa1e4032260 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fa1ec056130 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 10 client.4920 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558772249b30 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1e4032260 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fa1ec052830 con 0x5587724735c0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 10 client.4920 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 10 client.4920 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 20 client.4920 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x5587724e3fc0 0x5587724e2110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 4 client.4920 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 --> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] -- command(tid 0: {"prefix": "status"}) -- 0x55877228ee40 con 0x5587724e3fc0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.297+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x5587724e3fc0 0x5587724e2110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1d1ffb640 10 client.4920 ms_handle_connect on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:26.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f2ffd640 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x5587724e3fc0 0x5587724e2110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=42e477013ef13480 server_cookie=1e06fbd540e36cab in_seq=0 out_seq=0 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1d1ffb640 1 -- 172.21.15.26:0/436982784 <== mds.3 v2:172.21.15.26:6834/2066596634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55877228ee40 con 0x5587724e3fc0 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1d1ffb640 10 client.4920 handle_command_reply: tid=0 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 client.4920 shutdown 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 msgr2=0x5587724e3a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec085130 tx=0x7fa1ec05f760 comp rx=0 tx=0).stop 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 shutdown_connections 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x5587724e3fc0 0x5587724e2110 crc :-1 s=READY pgs=21 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5587724735c0 0x5587724e3a80 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558772438ab0 0x5587724e3540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1d1ffb640 0 client.4920 ms_handle_reset on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 --2- 172.21.15.26:0/436982784 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558772438190 0x55877248cb80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 >> 172.21.15.26:0/436982784 conn(0x55877246fe40 msgr2=0x55877246d600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 shutdown_connections 2024-04-23T10:13:26.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 1 -- 172.21.15.26:0/436982784 wait complete. 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1fc4f5000 20 client.4920 trim_cache size 0 max 16384 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 3, 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4275, 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 17.303013043, 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:26.307 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:26.308 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:26.308 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 58.333937851000002 2024-04-23T10:13:26.308 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:26.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 msgr2=0x7fa1d406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 0x7fa1d406a870 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fa1e4001810 tx=0x7fa1e4009040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 msgr2=0x7fa1f41522a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fa1ec007e20 tx=0x7fa1ec00d4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 shutdown_connections 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1d40683b0 0x7fa1d406a870 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1f4158880 0x7fa1f41522a0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1f4073d50 0x7fa1f406c4a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 --2- 172.21.15.26:0/2293077011 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1f406e720 0x7fa1f41f8030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 >> 172.21.15.26:0/2293077011 conn(0x7fa1f406f280 msgr2=0x7fa1f40c75f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 shutdown_connections 2024-04-23T10:13:26.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.301+0000 7fa1f9373640 1 -- 172.21.15.26:0/2293077011 wait complete. 2024-04-23T10:13:26.318 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T10:13:26.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.429+0000 7f69e6bb7640 1 Processor -- start 2024-04-23T10:13:26.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 -- start start 2024-04-23T10:13:26.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69e006cee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f69e00c8040 0x7f69e006d420 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69e0159a90 con 0x7f69e01596b0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f69e015f880 con 0x7f69e00c8040 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e6bb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69e015fb60 con 0x7f69e015f3d0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e4953640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69e01596b0 0x7f69e0163380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47602/0 (socket says 172.21.15.26:47602) 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e4953640 1 -- 172.21.15.26:0/540069282 learned_addr learned my addr 172.21.15.26:0/540069282 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69e006cee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e5154640 1 --2- 172.21.15.26:0/540069282 >> v2:172.21.15.190:3300/0 conn(0x7f69e00c8040 0x7f69e006d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1694363932 0 0) 0x7f69e0159a90 con 0x7f69e01596b0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f69c8003530 con 0x7f69e01596b0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2923221540 0 0) 0x7f69c8003530 con 0x7f69e01596b0 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 msgr2=0x7f69e006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69e006cee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 >> v2:172.21.15.190:3300/0 conn(0x7f69e00c8040 msgr2=0x7f69e006d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 --2- 172.21.15.26:0/540069282 >> v2:172.21.15.190:3300/0 conn(0x7f69e00c8040 0x7f69e006d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e015fe40 con 0x7f69e01596b0 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f69d8001a00 con 0x7f69e01596b0 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 >> v1:172.21.15.26:6789/0 conn(0x7f69e01596b0 legacy=0x7f69e0163380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69c80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69c8003f40 0x7f69c8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8004d50 0x7f69c80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69e015f880 con 0x7f69c8003f40 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f69e015fb60 con 0x7f69c8004d50 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69c800ba00 con 0x7f69e015f3d0 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69c8003f40 0x7f69c8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e5154640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8004d50 0x7f69c80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e4953640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69c80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 -- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 msgr2=0x7f69c80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e015f3d0 0x7f69c80039c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 -- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8004d50 msgr2=0x7f69c80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8004d50 0x7f69c80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69dffff640 1 -- 172.21.15.26:0/540069282 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69c8003530 con 0x7f69c8003f40 2024-04-23T10:13:26.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.433+0000 7f69e5154640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8004d50 0x7f69c80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69dffff640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69c8003f40 0x7f69c8004810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009ab0 tx=0x7f69d401ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f56a22f94097967e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40b2070 con 0x7f69c8003f40 2024-04-23T10:13:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40a5640 con 0x7f69c8003f40 2024-04-23T10:13:26.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69df7fe640 1 -- 172.21.15.26:0/540069282 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40096b0 con 0x7f69c8003f40 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- 172.21.15.26:0/540069282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69c8003f40 msgr2=0x7f69c8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/540069282 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69c8003f40 0x7f69c8004810 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7f69d4009ab0 tx=0x7f69d401ca50 comp rx=0 tx=0).stop 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 -- 172.21.15.26:0/540069282 reap_dead start 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- 172.21.15.26:0/540069282 shutdown_connections 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- 172.21.15.26:0/540069282 >> 172.21.15.26:0/540069282 conn(0x7f69e00ca540 msgr2=0x7f69e00ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- 172.21.15.26:0/540069282 shutdown_connections 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- 172.21.15.26:0/540069282 wait complete. 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 Processor -- start 2024-04-23T10:13:26.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- start start 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8003f40 0x7f69e014f100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 0x7f69e01614f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f69e006cee0 con 0x7f69e01f8380 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f69e0072270 con 0x7f69c8003f40 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e6bb7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69e006d060 con 0x7f69e01610b0 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56150/0 (socket says 172.21.15.26:56150) 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 -- 172.21.15.26:0/70442535 learned_addr learned my addr 172.21.15.26:0/70442535 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69dffff640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 0x7f69e01614f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 -- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 msgr2=0x7f69e01614f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 0x7f69e01614f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 -- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8003f40 msgr2=0x7f69e014f100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8003f40 0x7f69e014f100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69e5154640 1 -- 172.21.15.26:0/70442535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69e01f8d20 con 0x7f69e01f8380 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.437+0000 7f69dffff640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 0x7f69e01614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e5154640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69e0072060 tx=0x7f69d0010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 -- 172.21.15.26:0/70442535 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000f040 con 0x7f69e01f8380 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 -- 172.21.15.26:0/70442535 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d000e8a0 con 0x7f69e01f8380 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69e0155660 con 0x7f69e01f8380 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 -- 172.21.15.26:0/70442535 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d000ec70 con 0x7f69e01f8380 2024-04-23T10:13:26.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69e0154e20 con 0x7f69e01f8380 2024-04-23T10:13:26.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 -- 172.21.15.26:0/70442535 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f69d00253f0 con 0x7f69e01f8380 2024-04-23T10:13:26.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 0x7f69cc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69dd7fa640 1 -- 172.21.15.26:0/70442535 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f69d0087140 con 0x7f69e01f8380 2024-04-23T10:13:26.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e4953640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 0x7f69cc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e9d39000 1 Processor -- start 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e9d39000 1 -- start start 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.441+0000 7f69e4953640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 0x7f69cc06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007c50 tx=0x7f69d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ef570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb212a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560bb1f38420 con 0x560bb20efab0 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560bb1ed2bf0 con 0x560bb212a5c0 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560bb1f343e0 con 0x560bb20ef190 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56156/0 (socket says 172.21.15.26:56156) 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/3019990564 learned_addr learned my addr 172.21.15.26:0/3019990564 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e4953640 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ef570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e5154640 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb212a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 msgr2=0x560bb20ef570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ef570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 msgr2=0x560bb212a9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb212a9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/3019990564 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb1fe0450 con 0x560bb20efab0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000c10 tx=0x7f69d4004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c86ed94ba93fd068 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69c67fc640 1 -- 172.21.15.26:0/3019990564 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40bc070 con 0x560bb20efab0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69c67fc640 1 -- 172.21.15.26:0/3019990564 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40a5640 con 0x560bb20efab0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69c67fc640 1 -- 172.21.15.26:0/3019990564 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40b2040 con 0x560bb20efab0 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- 172.21.15.26:0/3019990564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 msgr2=0x560bb212a080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f69d4000c10 tx=0x7f69d4004740 comp rx=0 tx=0).stop 2024-04-23T10:13:26.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- 172.21.15.26:0/3019990564 shutdown_connections 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb212a9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb212a080 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3019990564 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ef570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- 172.21.15.26:0/3019990564 >> 172.21.15.26:0/3019990564 conn(0x560bb2126e40 msgr2=0x560bb2129260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- 172.21.15.26:0/3019990564 shutdown_connections 2024-04-23T10:13:26.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- 172.21.15.26:0/3019990564 wait complete. 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- start start 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 Processor -- start 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ebc20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb20ec6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560bb1ed8ec0 con 0x560bb20efab0 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560bb1fb9120 con 0x560bb212a5c0 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560bb1f43350 con 0x560bb20ef190 2024-04-23T10:13:26.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e9d39000 10 client.0 _ll_register_callbacks cb 0x560bb1f154d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56170/0 (socket says 172.21.15.26:56170) 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/1869092779 learned_addr learned my addr 172.21.15.26:0/1869092779 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e4953640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ebc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69e5154640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb20ec6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 msgr2=0x560bb20ebc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ebc20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 msgr2=0x560bb20ec6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb20ec6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.445+0000 7f69dffff640 1 -- 172.21.15.26:0/1869092779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb1f7df80 con 0x560bb20efab0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69dffff640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69d401d2f0 tx=0x7f69d40197f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd6e4f2f546b9571 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d40b2040 con 0x560bb20efab0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f69d40ad440 con 0x560bb20efab0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d40a5640 con 0x560bb20efab0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f69d40bc040 con 0x560bb20efab0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 10 client.4932 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560bb1f11f00 con 0x560bb20efab0 2024-04-23T10:13:26.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d40a5640 con 0x560bb20efab0 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f69d40cc750 con 0x560bb20efab0 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 10 client.4932 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 10 client.4932 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 20 client.4932 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb213ed90 0x560bb2141180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 4 client.4932 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 --> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x560bb1ed1bc0 con 0x560bb213ed90 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e4953640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb213ed90 0x560bb2141180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e4953640 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb213ed90 0x560bb2141180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=80fc0884c13893a6 server_cookie=ff7f949223ebc210 in_seq=0 out_seq=0 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 10 client.4932 ms_handle_connect on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 1 -- 172.21.15.26:0/1869092779 <== mds.2 v2:172.21.15.190:6835/1581526507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x560bb1ed1bc0 con 0x560bb213ed90 2024-04-23T10:13:26.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 10 client.4932 handle_command_reply: tid=0 2024-04-23T10:13:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 client.4932 shutdown 2024-04-23T10:13:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 msgr2=0x560bb20ec160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69d401d2f0 tx=0x7f69d40197f0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 shutdown_connections 2024-04-23T10:13:26.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb213ed90 0x560bb2141180 crc :-1 s=READY pgs=15 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb20ec6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb20efab0 0x560bb20ec160 secure :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f69d401d2f0 tx=0x7f69d40197f0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69bf7fe640 0 client.4932 ms_handle_reset on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 --2- 172.21.15.26:0/1869092779 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb20ebc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 >> 172.21.15.26:0/1869092779 conn(0x560bb2126e40 msgr2=0x560bb21281c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 shutdown_connections 2024-04-23T10:13:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 1 -- 172.21.15.26:0/1869092779 wait complete. 2024-04-23T10:13:26.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.449+0000 7f69e9d39000 20 client.4932 trim_cache size 0 max 16384 2024-04-23T10:13:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 Processor -- start 2024-04-23T10:13:26.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 -- start start 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 0x560bb2124e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb212a5c0 0x560bb21253d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560bb1f049e0 con 0x560bb219b510 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560bb1f37730 con 0x560bb20ef190 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560bb1f3ca50 con 0x560bb212a5c0 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56176/0 (socket says 172.21.15.26:56176) 2024-04-23T10:13:26.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 -- 172.21.15.26:0/4198487522 learned_addr learned my addr 172.21.15.26:0/4198487522 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69dffff640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb212a5c0 0x560bb21253d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e4953640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 0x560bb2124e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 -- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb212a5c0 msgr2=0x560bb21253d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb212a5c0 0x560bb21253d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 -- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 msgr2=0x560bb2124e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 0x560bb2124e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 -- 172.21.15.26:0/4198487522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560bb1ebee80 con 0x560bb219b510 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e4953640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 0x560bb2124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e5154640 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69d0001ec0 tx=0x7f69d0087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86ea532a684d1fb8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69c5ffb640 1 -- 172.21.15.26:0/4198487522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0055020 con 0x560bb219b510 2024-04-23T10:13:26.473 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69c5ffb640 1 -- 172.21.15.26:0/4198487522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d006f0d0 con 0x560bb219b510 2024-04-23T10:13:26.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69c5ffb640 1 -- 172.21.15.26:0/4198487522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0056170 con 0x560bb219b510 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 -- 172.21.15.26:0/4198487522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 msgr2=0x560bb219b8f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.469+0000 7f69e9d39000 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f69d0001ec0 tx=0x7f69d0087040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/4198487522 shutdown_connections 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb219b8f0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb212a5c0 0x560bb21253d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- 172.21.15.26:0/4198487522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb20ef190 0x560bb2124e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/4198487522 >> 172.21.15.26:0/4198487522 conn(0x560bb2126e40 msgr2=0x560bb20e8cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/4198487522 shutdown_connections 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/4198487522 wait complete. 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- start start 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 Processor -- start 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb219fd20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.479 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb21a0260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x560bb1f43350 con 0x560bb219b510 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x560bb1f45630 con 0x560bb212a5c0 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x560bb1ed8ec0 con 0x560bb20ef190 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 10 client.0 _ll_register_callbacks cb 0x7f69c8003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56188/0 (socket says 172.21.15.26:56188) 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 -- 172.21.15.26:0/3753359202 learned_addr learned my addr 172.21.15.26:0/3753359202 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69dffff640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb21a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.480 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e4953640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb219fd20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 -- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 msgr2=0x560bb219fd20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb219fd20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 -- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 msgr2=0x560bb21a0260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb21a0260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 -- 172.21.15.26:0/3753359202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560bb1f00b30 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e5154640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f69d0085330 tx=0x7f69d0059070 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ca84a3b16a1e8608 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69d0056370 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f69d005d220 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f69d006f0d0 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f69d0075050 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 10 client.4938 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x560bb1fb95b0 con 0x560bb219b510 2024-04-23T10:13:26.481 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69d006f0d0 con 0x560bb219b510 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f69d0024030 con 0x560bb219b510 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 10 client.4938 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 10 client.4938 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 20 client.4938 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb2142d30 0x560bb2143110 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 4 client.4938 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 --> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] -- command(tid 0: {"prefix": "status"}) -- 0x560bb1f45e40 con 0x560bb2142d30 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e4953640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb2142d30 0x560bb2143110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69e4953640 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb2142d30 0x560bb2143110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=70d58afbe3dadcd4 server_cookie=4b165b62253cf13 in_seq=0 out_seq=0 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.473+0000 7f69bf7fe640 10 client.4938 ms_handle_connect on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69bf7fe640 1 -- 172.21.15.26:0/3753359202 <== mds.2 v2:172.21.15.190:6835/1581526507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x560bb1f45e40 con 0x560bb2142d30 2024-04-23T10:13:26.482 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69bf7fe640 10 client.4938 handle_command_reply: tid=0 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 client.4938 shutdown 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 msgr2=0x560bb21423a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f69d0085330 tx=0x7f69d0059070 comp rx=0 tx=0).stop 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 shutdown_connections 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x560bb219b510 0x560bb21423a0 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x560bb2142d30 0x560bb2143110 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x560bb212a5c0 0x560bb21a0260 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 --2- 172.21.15.26:0/3753359202 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x560bb20ef190 0x560bb219fd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69bf7fe640 0 client.4938 ms_handle_reset on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 >> 172.21.15.26:0/3753359202 conn(0x560bb2126e40 msgr2=0x560bb20e7880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 shutdown_connections 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 1 -- 172.21.15.26:0/3753359202 wait complete. 2024-04-23T10:13:26.483 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e9d39000 20 client.4938 trim_cache size 0 max 16384 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 2, 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4282, 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 23.251263925, 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:26.484 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 58.503438346000003 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 msgr2=0x7f69cc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 0x7f69cc06a840 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7f69d8007c50 tx=0x7f69d8009040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 msgr2=0x7f69e01f87e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7f69e0072060 tx=0x7f69d0010b70 comp rx=0 tx=0).stop 2024-04-23T10:13:26.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 shutdown_connections 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f69cc068380 0x7f69cc06a840 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f69e01f8380 0x7f69e01f87e0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69e01610b0 0x7f69e01614f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 --2- 172.21.15.26:0/70442535 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f69c8003f40 0x7f69e014f100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 >> 172.21.15.26:0/70442535 conn(0x7f69e00ca540 msgr2=0x7f69e00c8520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 shutdown_connections 2024-04-23T10:13:26.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.477+0000 7f69e6bb7640 1 -- 172.21.15.26:0/70442535 wait complete. 2024-04-23T10:13:26.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-23T10:13:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 Processor -- start 2024-04-23T10:13:26.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 -- start start 2024-04-23T10:13:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb59c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59c0c5d70 con 0x7fb59c14ffa0 2024-04-23T10:13:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb59c0c6050 con 0x7fb59c074100 2024-04-23T10:13:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a3f44640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb59c0c6330 con 0x7fb59c14fbc0 2024-04-23T10:13:26.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a14df640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb59c14ffa0 0x7fb59c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47608/0 (socket says 172.21.15.26:47608) 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a14df640 1 -- 172.21.15.26:0/2762162379 learned_addr learned my addr 172.21.15.26:0/2762162379 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb59c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4155390995 0 0) 0x7fb59c0c5d70 con 0x7fb59c14ffa0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb588003530 con 0x7fb59c14ffa0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3405371126 0 0) 0x7fb588003530 con 0x7fb59c14ffa0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 msgr2=0x7fb59c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb59c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 >> v1:172.21.15.190:6789/0 conn(0x7fb59c074100 legacy=0x7fb59c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c0c6610 con 0x7fb59c14ffa0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fb598001680 con 0x7fb59c14ffa0 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 >> v1:172.21.15.26:6789/0 conn(0x7fb59c14ffa0 legacy=0x7fb59c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb5880039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588003f30 0x7fb588004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb5880051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0c6330 con 0x7fb588004d50 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb58800ba30 con 0x7fb588003f30 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb58800bc30 con 0x7fb59c14fbc0 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb5880051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588003f30 0x7fb588004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb5880039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 -- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 msgr2=0x7fb5880039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c14fbc0 0x7fb5880039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 -- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588003f30 msgr2=0x7fb588004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588003f30 0x7fb588004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a24e1640 1 -- 172.21.15.26:0/2762162379 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb588003530 con 0x7fb588004d50 2024-04-23T10:13:26.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.609+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb588003f30 0x7fb588004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb5880051d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0ca3b0 tx=0x7fb59401c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a902b7843eb452b5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb594001c10 con 0x7fb588004d50 2024-04-23T10:13:26.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb5940a66d0 con 0x7fb588004d50 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a0cde640 1 -- 172.21.15.26:0/2762162379 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb5940a6ac0 con 0x7fb588004d50 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 -- 172.21.15.26:0/2762162379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 msgr2=0x7fb5880051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/2762162379 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb5880051d0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7fb59c0ca3b0 tx=0x7fb59401c8c0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a24e1640 1 -- 172.21.15.26:0/2762162379 reap_dead start 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 -- 172.21.15.26:0/2762162379 shutdown_connections 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 -- 172.21.15.26:0/2762162379 >> 172.21.15.26:0/2762162379 conn(0x7fb59c06b9d0 msgr2=0x7fb59c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 -- 172.21.15.26:0/2762162379 shutdown_connections 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.613+0000 7fb5a3f44640 1 -- 172.21.15.26:0/2762162379 wait complete. 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 Processor -- start 2024-04-23T10:13:26.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- start start 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 0x7fb59c159080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c15a810 0x7fb59c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c068350 con 0x7fb588004d50 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb59c0681d0 con 0x7fb59c15a0b0 2024-04-23T10:13:26.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb59c0c8930 con 0x7fb59c15a810 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56192/0 (socket says 172.21.15.26:56192) 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3877630808 learned_addr learned my addr 172.21.15.26:0/3877630808 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c15a810 0x7fb59c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a14df640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 0x7fb59c159080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c15a810 msgr2=0x7fb59c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c15a810 0x7fb59c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 msgr2=0x7fb59c159080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 0x7fb59c159080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3877630808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb59c15d120 con 0x7fb588004d50 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a14df640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 0x7fb59c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0115e0 tx=0x7fb58c011aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5927fc640 1 -- 172.21.15.26:0/3877630808 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c015870 con 0x7fb588004d50 2024-04-23T10:13:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5927fc640 1 -- 172.21.15.26:0/3877630808 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c015a10 con 0x7fb588004d50 2024-04-23T10:13:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb59c15b830 con 0x7fb588004d50 2024-04-23T10:13:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5927fc640 1 -- 172.21.15.26:0/3877630808 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c015dc0 con 0x7fb588004d50 2024-04-23T10:13:26.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.617+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb59c15bad0 con 0x7fb588004d50 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 Processor -- start 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- start start 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 0x55f509f34570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f6f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f509d7d420 con 0x55f509f34ab0 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f509d17bf0 con 0x55f509f34190 2024-04-23T10:13:26.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f509d793e0 con 0x55f509f6f5c0 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5927fc640 1 -- 172.21.15.26:0/3877630808 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb58c00f480 con 0x7fb588004d50 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56200/0 (socket says 172.21.15.26:56200) 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3948299924 learned_addr learned my addr 172.21.15.26:0/3948299924 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a14df640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f6f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 0x55f509f34570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 msgr2=0x55f509f6f9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f6f9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 msgr2=0x55f509f34570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 0x55f509f34570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5927fc640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 0x7fb58006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/3948299924 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f509e25450 con 0x55f509f34ab0 2024-04-23T10:13:26.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a14df640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f6f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 0x55f509f34570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5927fc640 1 -- 172.21.15.26:0/3877630808 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb58c087700 con 0x7fb588004d50 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0606b0 tx=0x7fb58c053500 comp rx=0 tx=0).ready entity=mon.0 client_cookie=255f5e7e1aec740e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 0x7fb58006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb57f7fe640 1 -- 172.21.15.26:0/3948299924 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c056ce0 con 0x55f509f34ab0 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb57f7fe640 1 -- 172.21.15.26:0/3948299924 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c0571a0 con 0x55f509f34ab0 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb57f7fe640 1 -- 172.21.15.26:0/3948299924 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c056b00 con 0x55f509f34ab0 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- 172.21.15.26:0/3948299924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 msgr2=0x55f509f6f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0606b0 tx=0x7fb58c053500 comp rx=0 tx=0).stop 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- 172.21.15.26:0/3948299924 shutdown_connections 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f6f9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f6f080 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/3948299924 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34190 0x55f509f34570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- 172.21.15.26:0/3948299924 >> 172.21.15.26:0/3948299924 conn(0x55f509f6be40 msgr2=0x55f509f6e260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 0x7fb58006a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5940af000 tx=0x7fb5940016b0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- 172.21.15.26:0/3948299924 shutdown_connections 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- 172.21.15.26:0/3948299924 wait complete. 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 -- start start 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.621+0000 7fb5a70c6000 1 Processor -- start 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34ab0 0x55f509f31160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f316a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f509d1dec0 con 0x55f509f34190 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f509dfe120 con 0x55f509f34ab0 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f509d88350 con 0x55f509f6f5c0 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 10 client.0 _ll_register_callbacks cb 0x55f509d5a4d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56208/0 (socket says 172.21.15.26:56208) 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1327511465 learned_addr learned my addr 172.21.15.26:0/1327511465 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a14df640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34ab0 0x55f509f31160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f316a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 msgr2=0x55f509f316a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f316a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34ab0 msgr2=0x55f509f31160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34ab0 0x55f509f31160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1327511465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f509dc2f80 con 0x55f509f34190 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb58c014040 tx=0x7fb58c089c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39ec2c0798cd9107 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c080060 con 0x55f509f34190 2024-04-23T10:13:26.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb58c0554a0 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55f509d16bc0 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb58c056b00 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 10 client.4950 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f509d56f00 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55f509d16bc0 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb58c083050 con 0x55f509f34190 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 10 client.4950 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 10 client.4950 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 20 client.4950 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509f83d90 0x55f509f86180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 4 client.4950 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 --> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f509d8ae40 con 0x55f509f83d90 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a14df640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509f83d90 0x55f509f86180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 10 client.4950 ms_handle_connect on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a14df640 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509f83d90 0x55f509f86180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=8a0a476aa9867d6c server_cookie=eb81a106e8e2e4bb in_seq=0 out_seq=0 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 1 -- 172.21.15.26:0/1327511465 <== mds.1 v2:172.21.15.26:6835/1290255157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f509d8ae40 con 0x55f509f83d90 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 10 client.4950 handle_command_reply: tid=0 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 client.4950 shutdown 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 msgr2=0x55f509f30c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7fb58c014040 tx=0x7fb58c089c30 comp rx=0 tx=0).stop 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 shutdown_connections 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509f83d90 0x55f509f86180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509f6f5c0 0x55f509f316a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f34ab0 0x55f509f31160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1327511465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34190 0x55f509f30c20 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb57cff9640 0 client.4950 ms_handle_reset on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:26.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 >> 172.21.15.26:0/1327511465 conn(0x55f509f6be40 msgr2=0x55f509f6d1c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 shutdown_connections 2024-04-23T10:13:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1327511465 wait complete. 2024-04-23T10:13:26.637 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.625+0000 7fb5a70c6000 20 client.4950 trim_cache size 0 max 16384 2024-04-23T10:13:26.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 Processor -- start 2024-04-23T10:13:26.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- start start 2024-04-23T10:13:26.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509f6a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f509d499e0 con 0x55f509f34ab0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f509d7c730 con 0x55f509f6f5c0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f509d81a50 con 0x55f509fdd4e0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56220/0 (socket says 172.21.15.26:56220) 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1102430486 learned_addr learned my addr 172.21.15.26:0/1102430486 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a14df640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509f6a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 msgr2=0x55f509fdd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 msgr2=0x55f509f6a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509f6a3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/1102430486 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f509d03e80 con 0x55f509f34ab0 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a14df640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509f6a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb58c056ea0 tx=0x7fb58c087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eee6d4b5ad962427 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb57effd640 1 -- 172.21.15.26:0/1102430486 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c056ce0 con 0x55f509f34ab0 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb57effd640 1 -- 172.21.15.26:0/1102430486 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c05b550 con 0x55f509f34ab0 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb57effd640 1 -- 172.21.15.26:0/1102430486 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c05fd80 con 0x55f509f34ab0 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1102430486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 msgr2=0x55f509f69e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7fb58c056ea0 tx=0x7fb58c087040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1102430486 shutdown_connections 2024-04-23T10:13:26.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509f6a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/1102430486 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509f69e90 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1102430486 >> 172.21.15.26:0/1102430486 conn(0x55f509f6be40 msgr2=0x55f509f2dec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1102430486 shutdown_connections 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.645+0000 7fb5a70c6000 1 -- 172.21.15.26:0/1102430486 wait complete. 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- start start 2024-04-23T10:13:26.651 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 Processor -- start 2024-04-23T10:13:26.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509fdc5f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f509d88350 con 0x55f509f34ab0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f509d8a630 con 0x55f509f6f5c0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f509d1dec0 con 0x55f509fdd4e0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 10 client.0 _ll_register_callbacks cb 0x7fb58c08db50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56234/0 (socket says 172.21.15.26:56234) 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/2724236934 learned_addr learned my addr 172.21.15.26:0/2724236934 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509fdc5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a24e1640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 msgr2=0x55f509fdd8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 msgr2=0x55f509fdc5f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509fdc5f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 -- 172.21.15.26:0/2724236934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f509d45b30 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509fdc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a1ce0640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb58c056ea0 tx=0x7fb58c08d610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5f737107aa71a4b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb58c085860 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb58c08dcd0 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb58c05b550 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb58c05b170 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 10 client.4956 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f509dfe5b0 con 0x55f509f34ab0 2024-04-23T10:13:26.656 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb58c05b550 con 0x55f509f34ab0 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb58c083030 con 0x55f509f34ab0 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 10 client.4956 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 10 client.4956 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 20 client.4956 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509fde280 0x55f509fde660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 4 client.4956 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 --> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] -- command(tid 0: {"prefix": "status"}) -- 0x55f509d84cb0 con 0x55f509fde280 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509fde280 0x55f509fde660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 10 client.4956 ms_handle_connect on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a14df640 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509fde280 0x55f509fde660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=e2a43ee40fac9485 server_cookie=baf893b73f746685 in_seq=0 out_seq=0 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 1 -- 172.21.15.26:0/2724236934 <== mds.1 v2:172.21.15.26:6835/1290255157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+325 (crc 0 0 0) 0x55f509d84cb0 con 0x55f509fde280 2024-04-23T10:13:26.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 10 client.4956 handle_command_reply: tid=0 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 client.4956 shutdown 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 msgr2=0x55f509fdc0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7fb58c056ea0 tx=0x7fb58c08d610 comp rx=0 tx=0).stop 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 shutdown_connections 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55f509fde280 0x55f509fde660 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f509fdd4e0 0x55f509fdd8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f509f6f5c0 0x55f509fdc5f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 --2- 172.21.15.26:0/2724236934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f509f34ab0 0x55f509fdc0b0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb57cff9640 0 client.4956 ms_handle_reset on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 >> 172.21.15.26:0/2724236934 conn(0x55f509f6be40 msgr2=0x55f509f69600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 shutdown_connections 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 1 -- 172.21.15.26:0/2724236934 wait complete. 2024-04-23T10:13:26.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.649+0000 7fb5a70c6000 20 client.4956 trim_cache size 0 max 16384 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 1, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4284, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 29.474193217, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 58.684650826999999 2024-04-23T10:13:26.659 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 msgr2=0x7fb58006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 0x7fb58006a870 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7fb5940af000 tx=0x7fb5940016b0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 msgr2=0x7fb59c0c4b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7fb58c0115e0 tx=0x7fb58c011aa0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 shutdown_connections 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb5800683b0 0x7fb58006a870 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb59c15a810 0x7fb59c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb59c15a0b0 0x7fb59c159080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 --2- 172.21.15.26:0/3877630808 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb588004d50 0x7fb59c0c4b10 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 >> 172.21.15.26:0/3877630808 conn(0x7fb59c06b9d0 msgr2=0x7fb59c14d770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 shutdown_connections 2024-04-23T10:13:26.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.653+0000 7fb5a3f44640 1 -- 172.21.15.26:0/3877630808 wait complete. 2024-04-23T10:13:26.669 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.781+0000 7fcfafa70640 1 Processor -- start 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.781+0000 7fcfafa70640 1 -- start start 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfafa70640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 0x7fcfa80c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfafa70640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcfa80c9c10 0x7fcfa80c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfafa70640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcfa80ca960 con 0x7fcfa80c9700 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfafa70640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcfa80c7f30 con 0x7fcfa80c9c10 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfafa70640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa80ca0c0 con 0x7fcfa80c5f20 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 0x7fcfa80c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcfa80c9c10 0x7fcfa80c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 0x7fcfa80c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:44736/0 (socket says 172.21.15.26:44736) 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad80c640 1 -- 172.21.15.26:0/2903363245 learned_addr learned my addr 172.21.15.26:0/2903363245 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 -- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 msgr2=0x7fcfa80c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 --2- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 0x7fcfa80c86f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 -- 172.21.15.26:0/2903363245 >> v1:172.21.15.190:6789/0 conn(0x7fcfa80c9700 legacy=0x7fcfa8152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 -- 172.21.15.26:0/2903363245 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa80ca3a0 con 0x7fcfa80c9c10 2024-04-23T10:13:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfad00b640 1 --2- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9c10 0x7fcfa80c91c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0097c0 tx=0x7fcf9c01ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f5ff42dbbb03b610 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfac80a640 1 -- 172.21.15.26:0/2903363245 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0b5070 con 0x7fcfa80c9c10 2024-04-23T10:13:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfac80a640 1 -- 172.21.15.26:0/2903363245 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0a8990 con 0x7fcfa80c9c10 2024-04-23T10:13:26.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.785+0000 7fcfac80a640 1 -- 172.21.15.26:0/2903363245 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0a8d60 con 0x7fcfa80c9c10 2024-04-23T10:13:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9c10 msgr2=0x7fcfa80c91c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9c10 0x7fcfa80c91c0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0097c0 tx=0x7fcf9c01ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/2903363245 shutdown_connections 2024-04-23T10:13:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9c10 0x7fcfa80c91c0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- 172.21.15.26:0/2903363245 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c5f20 0x7fcfa80c86f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/2903363245 >> 172.21.15.26:0/2903363245 conn(0x7fcfa80676a0 msgr2=0x7fcfa8067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/2903363245 shutdown_connections 2024-04-23T10:13:26.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/2903363245 wait complete. 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 Processor -- start 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- start start 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9700 0x7fcfa8153820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c9c10 0x7fcfa81f2010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa80c8c30 con 0x7fcfa80c5f20 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa80c81d0 con 0x7fcfa80c9700 2024-04-23T10:13:26.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcfa80c5830 con 0x7fcfa80c9c10 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56250/0 (socket says 172.21.15.26:56250) 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 -- 172.21.15.26:0/3455231801 learned_addr learned my addr 172.21.15.26:0/3455231801 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9700 0x7fcfa8153820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfae00d640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c9c10 0x7fcfa81f2010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 -- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c9c10 msgr2=0x7fcfa81f2010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c9c10 0x7fcfa81f2010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 -- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9700 msgr2=0x7fcfa8153820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9700 0x7fcfa8153820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 -- 172.21.15.26:0/3455231801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcfa8155780 con 0x7fcfa80c5f20 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000efc0 tx=0x7fcfa000c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.793 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfa67fc640 1 -- 172.21.15.26:0/3455231801 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa000cd40 con 0x7fcfa80c5f20 2024-04-23T10:13:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfa67fc640 1 -- 172.21.15.26:0/3455231801 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa0019070 con 0x7fcfa80c5f20 2024-04-23T10:13:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcfa81f2c60 con 0x7fcfa80c5f20 2024-04-23T10:13:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfa67fc640 1 -- 172.21.15.26:0/3455231801 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0014680 con 0x7fcfa80c5f20 2024-04-23T10:13:26.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.789+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcfa81554a0 con 0x7fcfa80c5f20 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfa67fc640 1 -- 172.21.15.26:0/3455231801 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcfa0012050 con 0x7fcfa80c5f20 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfa67fc640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 0x7fcf9406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfa67fc640 1 -- 172.21.15.26:0/3455231801 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcfa00871f0 con 0x7fcfa80c5f20 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 0x7fcf9406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 Processor -- start 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 -- start start 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 0x7fcf9406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0b2000 tx=0x7fcf9c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eaa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ee59a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6cf3420 con 0x55d4f6eaaab0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6c8dbf0 con 0x55d4f6eaa190 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d4f6cef3e0 con 0x55d4f6ee55c0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56252/0 (socket says 172.21.15.26:56252) 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 -- 172.21.15.26:0/3732779844 learned_addr learned my addr 172.21.15.26:0/3732779844 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eaa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfae00d640 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ee59a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 -- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 msgr2=0x55d4f6ee59a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ee59a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 -- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 msgr2=0x55d4f6eaa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eaa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 -- 172.21.15.26:0/3732779844 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f6d9b450 con 0x55d4f6eaaab0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009580 tx=0x7fcf9c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=233d45e18a793f21 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcf8f7fe640 1 -- 172.21.15.26:0/3732779844 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0b5040 con 0x55d4f6eaaab0 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcf8f7fe640 1 -- 172.21.15.26:0/3732779844 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0a8ce0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.793+0000 7fcf8f7fe640 1 -- 172.21.15.26:0/3732779844 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0ba640 con 0x55d4f6eaaab0 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3732779844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 msgr2=0x55d4f6ee5080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c009580 tx=0x7fcf9c004740 comp rx=0 tx=0).stop 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3732779844 shutdown_connections 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ee59a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee5080 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3732779844 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eaa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3732779844 >> 172.21.15.26:0/3732779844 conn(0x55d4f6ee1e40 msgr2=0x55d4f6ee4260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3732779844 shutdown_connections 2024-04-23T10:13:26.799 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3732779844 wait complete. 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- start start 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 Processor -- start 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6ea6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ea76a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6c93ec0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6d74120 con 0x55d4f6eaa190 2024-04-23T10:13:26.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d4f6cfe350 con 0x55d4f6ee55c0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 10 client.0 _ll_register_callbacks cb 0x55d4f6cd04d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56260/0 (socket says 172.21.15.26:56260) 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 -- 172.21.15.26:0/279755610 learned_addr learned my addr 172.21.15.26:0/279755610 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfae00d640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ea76a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad80c640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6ea6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 -- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 msgr2=0x55d4f6ea76a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ea76a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 -- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 msgr2=0x55d4f6ea6c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6ea6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 -- 172.21.15.26:0/279755610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f6d38f80 con 0x55d4f6eaaab0 2024-04-23T10:13:26.804 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad00b640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c01c8c0 tx=0x7fcf9c01d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6667c4553377f0db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0b5040 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcf9c0a8ce0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcf9c0bab30 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcf9c0dd050 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 10 client.4965 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d4f6cccf00 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcf9c0a8ce0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fcf9c0e0020 con 0x55d4f6eaaab0 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 10 client.4965 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 10 client.4965 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 20 client.4965 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6ef9d90 0x55d4f6efc180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 4 client.4965 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d4f6c8cbc0 con 0x55d4f6ef9d90 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad80c640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6ef9d90 0x55d4f6efc180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcfad80c640 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6ef9d90 0x55d4f6efc180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d5bef78681e31b0 server_cookie=5b950efe3fc3f59b in_seq=0 out_seq=0 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.797+0000 7fcf8cff9640 10 client.4965 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcf8cff9640 1 -- 172.21.15.26:0/279755610 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d4f6c8cbc0 con 0x55d4f6ef9d90 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcf8cff9640 10 client.4965 handle_command_reply: tid=0 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 client.4965 shutdown 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 msgr2=0x55d4f6ea7160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c01c8c0 tx=0x7fcf9c01d4d0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 shutdown_connections 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6ef9d90 0x55d4f6efc180 crc :-1 s=READY pgs=26 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6ea76a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ea7160 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/279755610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6ea6c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcf8cff9640 0 client.4965 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 >> 172.21.15.26:0/279755610 conn(0x55d4f6ee1e40 msgr2=0x55d4f6ee31c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 shutdown_connections 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/279755610 wait complete. 2024-04-23T10:13:26.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.801+0000 7fcfb2bf2000 20 client.4965 trim_cache size 0 max 16384 2024-04-23T10:13:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 Processor -- start 2024-04-23T10:13:26.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 -- start start 2024-04-23T10:13:26.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee0a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f586f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcfa81fae90 con 0x55d4f6eaa190 2024-04-23T10:13:26.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6cbf9e0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d4f6cf2730 con 0x55d4f6ee55c0 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfad80c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56270/0 (socket says 172.21.15.26:56270) 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.817+0000 7fcfad80c640 1 -- 172.21.15.26:0/2603201636 learned_addr learned my addr 172.21.15.26:0/2603201636 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 -- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 msgr2=0x55d4f6f586f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f586f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 -- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaaab0 msgr2=0x55d4f6ee0a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee0a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee0a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 -- 172.21.15.26:0/2603201636 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d4f6c79e80 con 0x55d4f6eaa190 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00569b0 tx=0x7fcfa0087040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1582f40e3abe4f69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8effd640 1 -- 172.21.15.26:0/2603201636 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa0056cb0 con 0x55d4f6eaa190 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8effd640 1 -- 172.21.15.26:0/2603201636 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa006f070 con 0x55d4f6eaa190 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8effd640 1 -- 172.21.15.26:0/2603201636 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcfa005afb0 con 0x55d4f6eaa190 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/2603201636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 msgr2=0x55d4f6ee0500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fcfa00569b0 tx=0x7fcfa0087040 comp rx=0 tx=0).stop 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/2603201636 shutdown_connections 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f586f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaaab0 0x55d4f6ee0a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/2603201636 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaa190 0x55d4f6ee0500 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/2603201636 >> 172.21.15.26:0/2603201636 conn(0x55d4f6ee1e40 msgr2=0x55d4f6ea3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/2603201636 shutdown_connections 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/2603201636 wait complete. 2024-04-23T10:13:26.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- start start 2024-04-23T10:13:26.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 Processor -- start 2024-04-23T10:13:26.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eff300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f59c80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6d00630 con 0x55d4f6eaaab0 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d4f6cf7a50 con 0x55d4f6eaa190 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d4f6c93a40 con 0x55d4f6ee55c0 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 10 client.0 _ll_register_callbacks cb 0x7fcf9c009640 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56280/0 (socket says 172.21.15.26:56280) 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 -- 172.21.15.26:0/3000479113 learned_addr learned my addr 172.21.15.26:0/3000479113 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:26.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfae00d640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f59c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 -- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 msgr2=0x55d4f6f59c80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f59c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 -- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 msgr2=0x55d4f6eff300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eff300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 -- 172.21.15.26:0/3000479113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d4f6cbbb30 con 0x55d4f6eaaab0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad00b640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c004710 tx=0x7fcf9c0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da657db910d14ca server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcf9c0b5040 con 0x55d4f6eaaab0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcf9c0baa30 con 0x55d4f6eaaab0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fcfa006f070 con 0x55d4f6eaaab0 2024-04-23T10:13:26.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fcf9c0e6050 con 0x55d4f6eaaab0 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 10 client.4971 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d4f6d745b0 con 0x55d4f6eaaab0 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcfa006f070 con 0x55d4f6eaaab0 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fcf9c0e9080 con 0x55d4f6eaaab0 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 10 client.4971 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 10 client.4971 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 20 client.4971 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6f58520 0x55d4f6f58900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 4 client.4971 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "status"}) -- 0x55d4f6d00e40 con 0x55d4f6f58520 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.821+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6f58520 0x55d4f6f58900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:26.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfad80c640 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6f58520 0x55d4f6f58900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9ef50a02d6f6dc76 server_cookie=b5fcc36ef31512f3 in_seq=0 out_seq=0 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcf8cff9640 10 client.4971 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcf8cff9640 1 -- 172.21.15.26:0/3000479113 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d4f6d00e40 con 0x55d4f6f58520 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcf8cff9640 10 client.4971 handle_command_reply: tid=0 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 client.4971 shutdown 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 msgr2=0x55d4f6f59740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c004710 tx=0x7fcf9c0aa000 comp rx=0 tx=0).stop 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 shutdown_connections 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d4f6f58520 0x55d4f6f58900 crc :-1 s=READY pgs=27 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d4f6ee55c0 0x55d4f6f59c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d4f6eaaab0 0x55d4f6f59740 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcf8cff9640 0 client.4971 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 --2- 172.21.15.26:0/3000479113 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d4f6eaa190 0x55d4f6eff300 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 >> 172.21.15.26:0/3000479113 conn(0x55d4f6ee1e40 msgr2=0x55d4f6edfc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 shutdown_connections 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 1 -- 172.21.15.26:0/3000479113 wait complete. 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfb2bf2000 20 client.4971 trim_cache size 0 max 16384 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-23T10:13:26.833 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4287, 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 51.820774761000003, 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 58.852027800000002 2024-04-23T10:13:26.834 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 msgr2=0x7fcf9406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 0x7fcf9406a840 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7fcf9c0b2000 tx=0x7fcf9c0aa070 comp rx=0 tx=0).stop 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 msgr2=0x7fcfa81532e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7fcfa000efc0 tx=0x7fcfa000c490 comp rx=0 tx=0).stop 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 shutdown_connections 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcf94068380 0x7fcf9406a840 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcfa80c9c10 0x7fcfa81f2010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcfa80c9700 0x7fcfa8153820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 --2- 172.21.15.26:0/3455231801 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcfa80c5f20 0x7fcfa81532e0 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 >> 172.21.15.26:0/3455231801 conn(0x7fcfa80676a0 msgr2=0x7fcfa80cb110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 shutdown_connections 2024-04-23T10:13:26.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:26.825+0000 7fcfafa70640 1 -- 172.21.15.26:0/3455231801 wait complete. 2024-04-23T10:13:26.842 INFO:teuthology.run_tasks:Running task sequential... 2024-04-23T10:13:26.851 INFO:teuthology.task.sequential:In sequential, running task sequential... 2024-04-23T10:13:26.851 INFO:teuthology.task.sequential:In sequential, running task print... 2024-04-23T10:13:26.851 INFO:teuthology.task.print:Enabling mgr modules 2024-04-23T10:13:26.851 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-04-23T10:13:26.865 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-04-23T10:13:26.865 INFO:tasks.ceph_fuse:config is {'client.0': {}} 2024-04-23T10:13:26.865 INFO:tasks.ceph_fuse:client.0 config is {} 2024-04-23T10:13:26.866 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-04-23T10:13:26.866 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:26.866 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:26.866 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-23T10:13:26.873 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.admin (id: 0) 2024-04-23T10:13:26.874 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:26.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.admin 2024-04-23T10:13:26.927 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:26.927 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-04-23T10:13:27.138 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-04-23T10:13:27.138 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs ls 2024-04-23T10:13:27.265 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 Processor -- start 2024-04-23T10:13:27.281 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 -- start start 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f9406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f9414ffa0 0x7f7f940c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7f940c5d70 con 0x7f7f94074100 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f7f940c6050 con 0x7f7f9414ffa0 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f9b44f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7f940c6330 con 0x7f7f9414fbc0 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f9414ffa0 0x7f7f940c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f7f9414ffa0 0x7f7f940c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56286/0 (socket says 172.21.15.26:56286) 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 -- 172.21.15.26:0/1949036473 learned_addr learned my addr 172.21.15.26:0/1949036473 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f991eb640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f9406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 -- 172.21.15.26:0/1949036473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 msgr2=0x7f7f9406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:27.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f9406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 -- 172.21.15.26:0/1949036473 >> v1:172.21.15.190:6789/0 conn(0x7f7f94074100 legacy=0x7f7f940c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.265+0000 7f7f989ea640 1 -- 172.21.15.26:0/1949036473 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f940c6610 con 0x7f7f9414ffa0 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9414ffa0 0x7f7f940c8220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009870 tx=0x7f7f9001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=135a2e9e3decead2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f8bfff640 1 -- 172.21.15.26:0/1949036473 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900a9640 con 0x7f7f9414ffa0 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f8bfff640 1 -- 172.21.15.26:0/1949036473 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f900a97e0 con 0x7f7f9414ffa0 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f8bfff640 1 -- 172.21.15.26:0/1949036473 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f900a9bb0 con 0x7f7f9414ffa0 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1949036473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9414ffa0 msgr2=0x7f7f940c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9414ffa0 0x7f7f940c8220 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x7f7f90009870 tx=0x7f7f9001c560 comp rx=0 tx=0).stop 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1949036473 shutdown_connections 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f9414ffa0 0x7f7f940c8220 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1949036473 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f9406f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1949036473 >> 172.21.15.26:0/1949036473 conn(0x7f7f9406b9d0 msgr2=0x7f7f9406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1949036473 shutdown_connections 2024-04-23T10:13:27.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1949036473 wait complete. 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 Processor -- start 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- start start 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f94146ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f9414ffa0 0x7f7f941ebc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f7f94166420 con 0x7f7f94074100 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f7f941662a0 con 0x7f7f9414ffa0 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f9b44f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f7f941665a0 con 0x7f7f9414fbc0 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56302/0 (socket says 172.21.15.26:56302) 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 -- 172.21.15.26:0/1277716173 learned_addr learned my addr 172.21.15.26:0/1277716173 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f999ec640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f9414ffa0 0x7f7f941ebc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f94146ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 -- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 msgr2=0x7f7f94146ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f94146ac0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 -- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f9414ffa0 msgr2=0x7f7f941ebc70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f9414ffa0 0x7f7f941ebc70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 -- 172.21.15.26:0/1277716173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7f941f2c30 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f94146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.269+0000 7f7f991eb640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400d800 tx=0x7f7f8400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400b6c0 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7f84019070 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7f94147930 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7f8400ba60 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7f941eb4d0 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7f94075df0 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f7f8400bc00 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7f840872f0 con 0x7f7f94074100 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:27.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.273+0000 7f7f989ea640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 0x7f7f7806a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ae000 tx=0x7f7f900a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:27.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.277+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f7f941f2c30 con 0x7f7f94074100 2024-04-23T10:13:27.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.469+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs ls"} v 0) -- 0x7f7f940c7df0 con 0x7f7f94074100 2024-04-23T10:13:27.472 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.469+0000 7f7f89ffb640 1 -- 172.21.15.26:0/1277716173 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v19) ==== 53+0+88 (secure 0 0 0) 0x7f7f84057400 con 0x7f7f94074100 2024-04-23T10:13:27.472 INFO:teuthology.orchestra.run.smithi026.stdout:name: cephfs, metadata pool: cephfs_metadata, data pools: [cephfs_data cephfs_data_ec ] 2024-04-23T10:13:27.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 msgr2=0x7f7f7806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 0x7f7f7806a870 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x7f7f900ae000 tx=0x7f7f900a7000 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 msgr2=0x7f7f941f26f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f7f8400d800 tx=0x7f7f8400dcc0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 shutdown_connections 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f7f780683b0 0x7f7f7806a870 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7f9414ffa0 0x7f7f941ebc70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7f9414fbc0 0x7f7f94146ac0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 --2- 172.21.15.26:0/1277716173 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7f94074100 0x7f7f941f26f0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 >> 172.21.15.26:0/1277716173 conn(0x7f7f9406b9d0 msgr2=0x7f7f9414e880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 shutdown_connections 2024-04-23T10:13:27.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27.473+0000 7f7f9b44f640 1 -- 172.21.15.26:0/1277716173 wait complete. 2024-04-23T10:13:27.489 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-04-23T10:13:27.489 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-04-23T10:13:27.489 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi026.front.sepia.ceph.com 2024-04-23T10:13:27.489 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-04-23T10:13:27.490 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:27.490 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-04-23T10:13:27.490 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-04-23T10:13:27.490 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-04-23T10:13:27.490 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:13:27.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:27.490 DEBUG:teuthology.orchestra.run.smithi026:> ip addr 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: inet 127.0.0.1/8 scope host lo 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 ::1/128 scope host 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout:2: eno1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6a brd ff:ff:ff:ff:ff:ff 2024-04-23T10:13:27.496 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f0 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout:3: eno2: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 0c:c4:7a:6b:ee:6b brd ff:ff:ff:ff:ff:ff 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp7s0f1 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c0 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f0 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.21.15.26/20 brd 172.21.15.255 scope global dynamic ens1f0 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft 42451sec preferred_lft 42451sec 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: inet6 fe80::ae1f:6bff:fea5:cac0/64 scope link 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout:5: ens1f1: mtu 1500 qdisc noop state DOWN group default qlen 1000 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether ac:1f:6b:a5:ca:c1 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout: altname enp1s0f1 2024-04-23T10:13:27.497 INFO:teuthology.orchestra.run.smithi026.stdout:6: docker0: mtu 1500 qdisc noqueue state DOWN group default 2024-04-23T10:13:27.498 INFO:teuthology.orchestra.run.smithi026.stdout: link/ether 02:42:59:f5:18:b3 brd ff:ff:ff:ff:ff:ff 2024-04-23T10:13:27.498 INFO:teuthology.orchestra.run.smithi026.stdout: inet 172.17.0.1/16 brd 172.17.255.255 scope global docker0 2024-04-23T10:13:27.498 INFO:teuthology.orchestra.run.smithi026.stdout: valid_lft forever preferred_lft forever 2024-04-23T10:13:27.498 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add name ceph-brx type bridge 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr flush dev ceph-brx 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set ceph-brx up 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-04-23T10:13:27.498 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:13:27.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:13:27.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:27.625 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:27.625 DEBUG:teuthology.orchestra.run.smithi026:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-04-23T10:13:27.677 INFO:teuthology.orchestra.run.smithi026.stdout:1 2024-04-23T10:13:27.678 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:27.678 DEBUG:teuthology.orchestra.run.smithi026:> route 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:Kernel IP routing table 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:default _gateway 0.0.0.0 UG 0 0 0 ens1f0 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:172.17.0.0 0.0.0.0 255.255.0.0 U 0 0 0 docker0 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 0 0 0 ens1f0 2024-04-23T10:13:27.730 INFO:teuthology.orchestra.run.smithi026.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-04-23T10:13:27.730 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:13:27.730 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:13:27.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-04-23T10:13:27.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-04-23T10:13:27.731 DEBUG:teuthology.orchestra.run.smithi026:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-04-23T10:13:27.731 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:13:27.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:13:27.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:27 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:27.857 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:27.857 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-23T10:13:27.863 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:27.863 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list-id 2024-04-23T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-04-23T10:13:27.909 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:13:28.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:13:28.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:28.030 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-04-23T10:13:28.030 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:13:28.030 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:13:28.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-04-23T10:13:28.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-04-23T10:13:28.030 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-04-23T10:13:28.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-04-23T10:13:28.031 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-04-23T10:13:28.031 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:13:28.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:13:28.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:28.125 DEBUG:teuthology.orchestra.run.smithi026:> (cd / && exec stdin-killer --timeout=300 -- bash -c ' 2024-04-23T10:13:28.125 DEBUG:teuthology.orchestra.run.smithi026:> set -e 2024-04-23T10:13:28.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set brx.0 up 2024-04-23T10:13:28.125 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link set dev brx.0 master ceph-brx 2024-04-23T10:13:28.125 DEBUG:teuthology.orchestra.run.smithi026:> ') 2024-04-23T10:13:28.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: expiration expected; waiting 300 seconds for command to complete 2024-04-23T10:13:28.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:28 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:28.228 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-04-23T10:13:28.228 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:13:28.228 DEBUG:teuthology.orchestra.run.smithi026:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:28.277 INFO:teuthology.orchestra.run.smithi026.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-04-23T10:13:28.277 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-04-23T10:13:28.277 DEBUG:teuthology.orchestra.run.smithi026:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:28.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:13:28.382 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:13:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:13:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:13:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:13:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:13:28.430 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:13:28.431 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:28.432 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:28.433 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:28.433 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:13:28.481 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-04-23T10:13:28.481 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-04-23T10:13:28.526 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:13:28.541 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:13:28.590 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:13:28.591 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:28.592 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:28.592 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:13:28.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:2024-04-23T10:13:28.605+0000 7f3e40166580 -1 init, newargv = 0x562dad6a5330 newargc=15 2024-04-23T10:13:28.607 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[35719]: starting ceph client 2024-04-23T10:13:28.627 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[35719]: starting fuse 2024-04-23T10:13:29.714 DEBUG:teuthology.orchestra.run.smithi026:> sudo modprobe fuse 2024-04-23T10:13:29.730 DEBUG:teuthology.orchestra.run.smithi026:> cat /proc/self/mounts | awk '{print $2}' 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/sys 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/proc 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/dev 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/pts 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/run 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/ 2024-04-23T10:13:29.778 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/security 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/shm 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/run/lock 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/cgroup 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/pstore 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/bpf 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/sys/fs/binfmt_misc 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/hugepages 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/dev/mqueue 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/debug 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/tracing 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/proc/fs/nfsd 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/fs/fuse/connections 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/sys/kernel/config 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/run/credentials/systemd-sysusers.service 2024-04-23T10:13:29.779 INFO:teuthology.orchestra.run.smithi026.stdout:/run/rpc_pipefs 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/run/user/1000 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-0 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-1 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-2 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/var/lib/ceph/osd/ceph-3 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:13:29.780 INFO:teuthology.orchestra.run.smithi026.stdout:/home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:29.781 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:29.781 DEBUG:teuthology.orchestra.run.smithi026:> ls /sys/fs/fuse/connections 2024-04-23T10:13:29.829 INFO:teuthology.orchestra.run.smithi026.stdout:45 2024-04-23T10:13:29.829 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [45] 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> sudo stdin-killer -- python3 -c ' 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> import glob 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> import re 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> import os 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> import subprocess 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> def _find_admin_socket(client_name): 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> files = glob.glob(asok_path) 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> # Given a non-glob path, it better be there 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> if "*" not in asok_path: 2024-04-23T10:13:29.830 DEBUG:teuthology.orchestra.run.smithi026:> assert(len(files) == 1) 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> return files[0] 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> for f in files: 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> if os.path.exists("/proc/{0}".format(pid)): 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> contents = proc_f.read() 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> if mountpoint in contents: 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> return f 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> print(_find_admin_socket("client.0")) 2024-04-23T10:13:29.831 DEBUG:teuthology.orchestra.run.smithi026:> ' 2024-04-23T10:13:29.957 INFO:teuthology.orchestra.run.smithi026.stdout:/var/run/ceph/ceph-client.0.35719.asok 2024-04-23T10:13:29.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:29 stdin-killer INFO: command exited with status 0: exiting normally with same code! 2024-04-23T10:13:29.970 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.35719.asok 2024-04-23T10:13:29.970 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:29.970 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.35719.asok status 2024-04-23T10:13:30.134 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:30.134 INFO:teuthology.orchestra.run.smithi026.stdout: "metadata": { 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_sha1": "d69f13d827952bb07bb9b7973bca14f97d764d6f", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "ceph_version": "ceph version 19.0.0-3156-gd69f13d8 (d69f13d827952bb07bb9b7973bca14f97d764d6f) squid (dev)", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "entity_id": "0", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "hostname": "smithi026", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "pid": "35719", 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "root": "/" 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_count": 0, 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "dentry_pinned_count": 0, 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4986, 2024-04-23T10:13:30.135 INFO:teuthology.orchestra.run.smithi026.stdout: "inst": { 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "name": { 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "client", 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "num": 4986 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3076875170 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": { 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "type": "v1", 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "addr": "192.168.0.1:0", 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: "nonce": 3076875170 2024-04-23T10:13:30.136 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "inst_str": "client.4986 192.168.0.1:0/3076875170", 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "addr_str": "192.168.0.1:0/3076875170", 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "inode_count": 1, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "mds_epoch": 19, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch": 26, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "osd_epoch_barrier": 0, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "blocklisted": false, 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs" 2024-04-23T10:13:30.137 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:30.149 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:30.149 DEBUG:teuthology.orchestra.run.smithi026:> stat --file-system '--printf=%T 2024-04-23T10:13:30.149 DEBUG:teuthology.orchestra.run.smithi026:> ' -- /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:30.154 INFO:teuthology.orchestra.run.smithi026.stdout:fuseblk 2024-04-23T10:13:30.155 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:30.155 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:13:30.155 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:30.211 INFO:teuthology.run_tasks:Running task quiescer... 2024-04-23T10:13:30.222 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 Processor -- start 2024-04-23T10:13:30.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 -- start start 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1d2c15b0b0 0x7f1d2c15b500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d2c15beb0 con 0x7f1d2c155350 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2c0cca40 con 0x7f1d2c0cda50 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d3270c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1d2c0ccc90 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56314/0 (socket says 172.21.15.26:56314) 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 -- 172.21.15.26:0/1229362903 learned_addr learned my addr 172.21.15.26:0/1229362903 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 -- 172.21.15.26:0/1229362903 >> v2:172.21.15.190:3300/0 conn(0x7f1d2c15b0b0 msgr2=0x7f1d2c15b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 --2- 172.21.15.26:0/1229362903 >> v2:172.21.15.190:3300/0 conn(0x7f1d2c15b0b0 0x7f1d2c15b500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 -- 172.21.15.26:0/1229362903 >> v1:172.21.15.190:6789/0 conn(0x7f1d2c155350 legacy=0x7f1d2c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.381+0000 7f1d2b7fe640 1 -- 172.21.15.26:0/1229362903 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c0ccf70 con 0x7f1d2c0cda50 2024-04-23T10:13:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2b7fe640 1 --2- 172.21.15.26:0/1229362903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0b44e0 tx=0x7f1d2001ecd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cec7a89bf101727 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2affd640 1 -- 172.21.15.26:0/1229362903 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d200b5070 con 0x7f1d2c0cda50 2024-04-23T10:13:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2affd640 1 -- 172.21.15.26:0/1229362903 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d200a89d0 con 0x7f1d2c0cda50 2024-04-23T10:13:30.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2affd640 1 -- 172.21.15.26:0/1229362903 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d200a8da0 con 0x7f1d2c0cda50 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- 172.21.15.26:0/1229362903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c0cda50 msgr2=0x7f1d2c0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1229362903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f1d2c0b44e0 tx=0x7f1d2001ecd0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- 172.21.15.26:0/1229362903 shutdown_connections 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1229362903 >> v2:172.21.15.190:3300/0 conn(0x7f1d2c15b0b0 0x7f1d2c15b500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1229362903 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c0cda50 0x7f1d2c0c59c0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- 172.21.15.26:0/1229362903 >> 172.21.15.26:0/1229362903 conn(0x7f1d2c06cc30 msgr2=0x7f1d2c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:30.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- 172.21.15.26:0/1229362903 shutdown_connections 2024-04-23T10:13:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- 172.21.15.26:0/1229362903 wait complete. 2024-04-23T10:13:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 Processor -- start 2024-04-23T10:13:30.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- start start 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 0x7f1d2c154620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d2c155350 0x7f1d2c1f5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c155730 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d2c0cd530 con 0x7f1d2c155350 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d3270c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d2c15e860 con 0x7f1d2c0cda50 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56316/0 (socket says 172.21.15.26:56316) 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 -- 172.21.15.26:0/1321751460 learned_addr learned my addr 172.21.15.26:0/1321751460 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2b7fe640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d2c155350 0x7f1d2c1f5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2bfff640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 0x7f1d2c154620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 -- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 msgr2=0x7f1d2c154620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 0x7f1d2c154620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 -- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d2c155350 msgr2=0x7f1d2c1f5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d2c155350 0x7f1d2c1f5420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d30ca9640 1 -- 172.21.15.26:0/1321751460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d2c1540a0 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.385+0000 7f1d2bfff640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 0x7f1d2c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d30ca9640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b9e0 tx=0x7f1d2400bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24019070 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d2400cac0 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d2c1493b0 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d24014440 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d2c154340 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d2c075df0 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d2401c070 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 0x7f1d1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1d24086ac0 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d2bfff640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 0x7f1d1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.389+0000 7f1d2bfff640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 0x7f1d1806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0016e0 tx=0x7f1d1c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.393+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d24056c60 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.557+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1d2c0cc610 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.557+0000 7f1d28ff9640 1 -- 172.21.15.26:0/1321751460 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7f1d24056560 con 0x7f1d2c15b0b0 2024-04-23T10:13:30.559 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:30.559 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 msgr2=0x7f1d1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 0x7f1d1806a840 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f1d1c0016e0 tx=0x7f1d1c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 msgr2=0x7f1d2c0b6520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f1d2400b9e0 tx=0x7f1d2400bea0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 shutdown_connections 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d18068380 0x7f1d1806a840 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d2c15b0b0 0x7f1d2c0b6520 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d2c155350 0x7f1d2c1f5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 --2- 172.21.15.26:0/1321751460 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d2c0cda50 0x7f1d2c154620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 >> 172.21.15.26:0/1321751460 conn(0x7f1d2c06cc30 msgr2=0x7f1d2c14b630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 shutdown_connections 2024-04-23T10:13:30.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.561+0000 7f1d3270c640 1 -- 172.21.15.26:0/1321751460 wait complete. 2024-04-23T10:13:30.577 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:13:30.578 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:13:30.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 Processor -- start 2024-04-23T10:13:30.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 -- start start 2024-04-23T10:13:30.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc90814f810 0x7fc9080c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc908159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc9080c4c50 con 0x7fc90814fbf0 2024-04-23T10:13:30.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc908158fe0 con 0x7fc90814f810 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90fe2e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc9080c4f30 con 0x7fc9080c78c0 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90d3c9640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc90814fbf0 0x7fc9080cd640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47612/0 (socket says 172.21.15.26:47612) 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90d3c9640 1 -- 172.21.15.26:0/1301857344 learned_addr learned my addr 172.21.15.26:0/1301857344 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.693+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc908159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90dbca640 1 --2- 172.21.15.26:0/1301857344 >> v2:172.21.15.190:3300/0 conn(0x7fc90814f810 0x7fc9080c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1141210540 0 0) 0x7fc9080c4c50 con 0x7fc90814fbf0 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fc8f4003530 con 0x7fc90814fbf0 2024-04-23T10:13:30.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 776316246 0 0) 0x7fc8f4003530 con 0x7fc90814fbf0 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 msgr2=0x7fc908159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc908159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 >> v2:172.21.15.190:3300/0 conn(0x7fc90814f810 msgr2=0x7fc9080c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 --2- 172.21.15.26:0/1301857344 >> v2:172.21.15.190:3300/0 conn(0x7fc90814f810 0x7fc9080c9930 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080c5210 con 0x7fc90814fbf0 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fc8f8001680 con 0x7fc90814fbf0 2024-04-23T10:13:30.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 >> v1:172.21.15.26:6789/0 conn(0x7fc90814fbf0 legacy=0x7fc9080cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f40039c0 0x7fc8f4003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc8f4004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4004d50 0x7fc8f40051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc908158fe0 con 0x7fc8f4004d50 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080c4f30 con 0x7fc8f40039c0 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc8f400b9d0 con 0x7fc9080c78c0 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4004d50 0x7fc8f40051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.702 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90d3c9640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc8f4004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90dbca640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f40039c0 0x7fc8f4003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 -- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 msgr2=0x7fc8f4004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc9080c78c0 0x7fc8f4004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 -- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f40039c0 msgr2=0x7fc8f4003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f40039c0 0x7fc8f4003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 -- 172.21.15.26:0/1301857344 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc8f4003530 con 0x7fc8f4004d50 2024-04-23T10:13:30.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90dbca640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f40039c0 0x7fc8f4003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4004d50 0x7fc8f40051d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc900009fa0 tx=0x7fc90001cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90d0fa9ccca92879 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc9000b2070 con 0x7fc8f4004d50 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc9000a5d10 con 0x7fc8f4004d50 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90cbc8640 1 -- 172.21.15.26:0/1301857344 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc900009bf0 con 0x7fc8f4004d50 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 -- 172.21.15.26:0/1301857344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4004d50 msgr2=0x7fc8f40051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/1301857344 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc8f4004d50 0x7fc8f40051d0 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7fc900009fa0 tx=0x7fc90001cc40 comp rx=0 tx=0).stop 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90e3cb640 1 -- 172.21.15.26:0/1301857344 reap_dead start 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 -- 172.21.15.26:0/1301857344 shutdown_connections 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 -- 172.21.15.26:0/1301857344 >> 172.21.15.26:0/1301857344 conn(0x7fc90806fca0 msgr2=0x7fc9080700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:30.707 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 -- 172.21.15.26:0/1301857344 shutdown_connections 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.697+0000 7fc90fe2e640 1 -- 172.21.15.26:0/1301857344 wait complete. 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 Processor -- start 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- start start 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f4004d50 0x7fc9081487c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc90815c9a0 0x7fc90815ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc90806bb90 con 0x7fc9081f2730 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc9080c57d0 con 0x7fc8f4004d50 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc9080c9e70 con 0x7fc90815c9a0 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56332/0 (socket says 172.21.15.26:56332) 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 -- 172.21.15.26:0/3432267806 learned_addr learned my addr 172.21.15.26:0/3432267806 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90dbca640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f4004d50 0x7fc9081487c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90e3cb640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc90815c9a0 0x7fc90815ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 -- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc90815c9a0 msgr2=0x7fc90815ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc90815c9a0 0x7fc90815ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 -- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f4004d50 msgr2=0x7fc9081487c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f4004d50 0x7fc9081487c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 -- 172.21.15.26:0/3432267806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc9080cb700 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90d3c9640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800e7e0 tx=0x7fc8f800eca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800c8d0 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc8f8018070 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc9080cb9e0 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc8f800ccd0 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc9080cbfa0 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.701+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc908075df0 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.705+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc8f801d460 con 0x7fc9081f2730 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.705+0000 7fc8fe7fc640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 0x7fc8ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:30.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.705+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc8f8086d90 con 0x7fc9081f2730 2024-04-23T10:13:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.705+0000 7fc90dbca640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 0x7fc8ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.705+0000 7fc90dbca640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 0x7fc8ec06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc904009b40 tx=0x7fc904008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:30.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.709+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc8f8056f30 con 0x7fc9081f2730 2024-04-23T10:13:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc9081f2070 con 0x7fc9081f2730 2024-04-23T10:13:30.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc8fe7fc640 1 -- 172.21.15.26:0/3432267806 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc8f8056830 con 0x7fc9081f2730 2024-04-23T10:13:30.866 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:13:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 msgr2=0x7fc8ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 0x7fc8ec06a840 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x7fc904009b40 tx=0x7fc904008040 comp rx=0 tx=0).stop 2024-04-23T10:13:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 msgr2=0x7fc9081f2bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7fc8f800e7e0 tx=0x7fc8f800eca0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 shutdown_connections 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc8ec068380 0x7fc8ec06a840 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc90815c9a0 0x7fc90815ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc9081f2730 0x7fc9081f2bb0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 --2- 172.21.15.26:0/3432267806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc8f4004d50 0x7fc9081487c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 >> 172.21.15.26:0/3432267806 conn(0x7fc90806fca0 msgr2=0x7fc9080c8d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 shutdown_connections 2024-04-23T10:13:30.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:30.865+0000 7fc90fe2e640 1 -- 172.21.15.26:0/3432267806 wait complete. 2024-04-23T10:13:30.883 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:13:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.009+0000 7fdcdb64e640 1 Processor -- start 2024-04-23T10:13:31.012 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.009+0000 7fdcdb64e640 1 -- start start 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcdb64e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fdcd406d1a0 0x7fdcd40c9ae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcdb64e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdcd406d580 0x7fdcd40c81d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcdb64e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdcd40709b0 con 0x7fdcd4070450 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcdb64e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd415bba0 con 0x7fdcd406d580 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcdb64e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fdcd415b270 con 0x7fdcd406d1a0 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdcd406d580 0x7fdcd40c81d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fdcd406d580 0x7fdcd40c81d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56336/0 (socket says 172.21.15.26:56336) 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 -- 172.21.15.26:0/3191285422 learned_addr learned my addr 172.21.15.26:0/3191285422 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 -- 172.21.15.26:0/3191285422 >> v2:172.21.15.190:3300/0 conn(0x7fdcd406d1a0 msgr2=0x7fdcd40c9ae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 --2- 172.21.15.26:0/3191285422 >> v2:172.21.15.190:3300/0 conn(0x7fdcd406d1a0 0x7fdcd40c9ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 -- 172.21.15.26:0/3191285422 >> v1:172.21.15.190:6789/0 conn(0x7fdcd4070450 legacy=0x7fdcd415e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 -- 172.21.15.26:0/3191285422 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd415b550 con 0x7fdcd406d580 2024-04-23T10:13:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdcd8be9640 1 --2- 172.21.15.26:0/3191285422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd40c81d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406ca00 tx=0x7fdcc401c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=785987509a23a30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdccbfff640 1 -- 172.21.15.26:0/3191285422 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b0070 con 0x7fdcd406d580 2024-04-23T10:13:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdccbfff640 1 -- 172.21.15.26:0/3191285422 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc40ab600 con 0x7fdcd406d580 2024-04-23T10:13:31.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.013+0000 7fdccbfff640 1 -- 172.21.15.26:0/3191285422 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40ab9d0 con 0x7fdcd406d580 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/3191285422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 msgr2=0x7fdcd40c81d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/3191285422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd40c81d0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7fdcd406ca00 tx=0x7fdcc401c4e0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/3191285422 shutdown_connections 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/3191285422 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd40c81d0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/3191285422 >> v2:172.21.15.190:3300/0 conn(0x7fdcd406d1a0 0x7fdcd40c9ae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/3191285422 >> 172.21.15.26:0/3191285422 conn(0x7fdcd40ca540 msgr2=0x7fdcd40ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/3191285422 shutdown_connections 2024-04-23T10:13:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/3191285422 wait complete. 2024-04-23T10:13:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 Processor -- start 2024-04-23T10:13:31.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- start start 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcd406d1a0 0x7fdcd4155870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcd4070450 0x7fdcd41f5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4167c60 con 0x7fdcd406d580 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fdcd4167ae0 con 0x7fdcd4070450 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fdcd4167de0 con 0x7fdcd406d1a0 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56338/0 (socket says 172.21.15.26:56338) 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 -- 172.21.15.26:0/2614315076 learned_addr learned my addr 172.21.15.26:0/2614315076 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd93ea640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcd406d1a0 0x7fdcd4155870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd9beb640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcd4070450 0x7fdcd41f5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 -- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcd406d1a0 msgr2=0x7fdcd4155870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcd406d1a0 0x7fdcd4155870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 -- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcd4070450 msgr2=0x7fdcd41f5fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcd4070450 0x7fdcd41f5fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 -- 172.21.15.26:0/2614315076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdcd4150c10 con 0x7fdcd406d580 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcd8be9640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdcc401ab90 tx=0x7fdcc401ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b0040 con 0x7fdcd406d580 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdcc40bc070 con 0x7fdcd406d580 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdcd4150ef0 con 0x7fdcd406d580 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fdcc40b6880 con 0x7fdcd406d580 2024-04-23T10:13:31.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.017+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdcd41f57b0 con 0x7fdcd406d580 2024-04-23T10:13:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdcd4075df0 con 0x7fdcd406d580 2024-04-23T10:13:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fdcc40b6a20 con 0x7fdcd406d580 2024-04-23T10:13:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcc9ffb640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 0x7fdcb806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fdcc41211f0 con 0x7fdcd406d580 2024-04-23T10:13:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcd93ea640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 0x7fdcb806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.021+0000 7fdcd93ea640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 0x7fdcb806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009f20 tx=0x7fdccc0094f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.025+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fdcc40160d0 con 0x7fdcd406d580 2024-04-23T10:13:31.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.193+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7fdcd40c8ca0 con 0x7fdcd406d580 2024-04-23T10:13:31.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.193+0000 7fdcc9ffb640 1 -- 172.21.15.26:0/2614315076 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7fdcc40f7070 con 0x7fdcd406d580 2024-04-23T10:13:31.196 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:31.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 msgr2=0x7fdcb806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 0x7fdcb806a840 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7fdccc009f20 tx=0x7fdccc0094f0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 msgr2=0x7fdcd4152970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7fdcc401ab90 tx=0x7fdcc401ad20 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 shutdown_connections 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fdcb8068380 0x7fdcb806a840 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fdcd4070450 0x7fdcd41f5fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fdcd406d580 0x7fdcd4152970 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 --2- 172.21.15.26:0/2614315076 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fdcd406d1a0 0x7fdcd4155870 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 >> 172.21.15.26:0/2614315076 conn(0x7fdcd40ca540 msgr2=0x7fdcd40ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 shutdown_connections 2024-04-23T10:13:31.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.197+0000 7fdcdb64e640 1 -- 172.21.15.26:0/2614315076 wait complete. 2024-04-23T10:13:31.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:13:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 Processor -- start 2024-04-23T10:13:31.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 -- start start 2024-04-23T10:13:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 0x7fa694154f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69415ba60 con 0x7fa6940d0fd0 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa69415bd40 con 0x7fa694073e40 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa69b429640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa69415c020 con 0x7fa6940d13b0 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6991c5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa6940d0fd0 0x7fa69415b2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47626/0 (socket says 172.21.15.26:47626) 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6991c5640 1 -- 172.21.15.26:0/494233660 learned_addr learned my addr 172.21.15.26:0/494233660 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6999c6640 1 --2- 172.21.15.26:0/494233660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 0x7fa694154f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3258386460 0 0) 0x7fa69415ba60 con 0x7fa6940d0fd0 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa680003530 con 0x7fa6940d0fd0 2024-04-23T10:13:31.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6999c6640 1 -- 172.21.15.26:0/494233660 >> v1:172.21.15.190:6789/0 conn(0x7fa694073e40 legacy=0x7fa6940b4980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3775472399 0 0) 0x7fa69415bd40 con 0x7fa694073e40 2024-04-23T10:13:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6999c6640 1 -- 172.21.15.26:0/494233660 >> v1:172.21.15.26:6789/0 conn(0x7fa6940d0fd0 legacy=0x7fa69415b2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.345+0000 7fa6999c6640 1 -- 172.21.15.26:0/494233660 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940b4180 con 0x7fa6940d13b0 2024-04-23T10:13:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa6999c6640 1 --2- 172.21.15.26:0/494233660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 0x7fa694154f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0097f0 tx=0x7fa68c01eb10 comp rx=0 tx=0).ready entity=mon.2 client_cookie=1283e245d6e98ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa68c0b5070 con 0x7fa6940d13b0 2024-04-23T10:13:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa68c0a85d0 con 0x7fa6940d13b0 2024-04-23T10:13:31.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa68bfff640 1 -- 172.21.15.26:0/494233660 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa690001a00 con 0x7fa6940d13b0 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- 172.21.15.26:0/494233660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 msgr2=0x7fa694154f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 --2- 172.21.15.26:0/494233660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 0x7fa694154f80 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7fa68c0097f0 tx=0x7fa68c01eb10 comp rx=0 tx=0).stop 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- 172.21.15.26:0/494233660 shutdown_connections 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 --2- 172.21.15.26:0/494233660 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa6940d13b0 0x7fa694154f80 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- 172.21.15.26:0/494233660 >> 172.21.15.26:0/494233660 conn(0x7fa69406bad0 msgr2=0x7fa69406bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- 172.21.15.26:0/494233660 shutdown_connections 2024-04-23T10:13:31.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- 172.21.15.26:0/494233660 wait complete. 2024-04-23T10:13:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 Processor -- start 2024-04-23T10:13:31.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.349+0000 7fa69b429640 1 -- start start 2024-04-23T10:13:31.353 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 0x7fa6940cb2d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 0x7fa6941f1610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa69415e8a0 con 0x7fa6940d0fd0 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa6940b5320 con 0x7fa6940d13b0 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa69415ea20 con 0x7fa694073e40 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56344/0 (socket says 172.21.15.26:56344) 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 -- 172.21.15.26:0/222227209 learned_addr learned my addr 172.21.15.26:0/222227209 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6991c5640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 0x7fa6940cb2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6999c6640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 0x7fa6941f1610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 -- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 msgr2=0x7fa6940cb2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 0x7fa6940cb2d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 -- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 msgr2=0x7fa6941f1610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 0x7fa6941f1610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 -- 172.21.15.26:0/222227209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa6940c7d50 con 0x7fa6940d0fd0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6991c5640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 0x7fa6940cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6999c6640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 0x7fa6941f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6989c4640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ec0 tx=0x7fa68400c8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa684017070 con 0x7fa6940d0fd0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa684003600 con 0x7fa6940d0fd0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa6840039f0 con 0x7fa6940d0fd0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa6941f0e30 con 0x7fa6940d0fd0 2024-04-23T10:13:31.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa6940c9990 con 0x7fa6940d0fd0 2024-04-23T10:13:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa694075df0 con 0x7fa6940d0fd0 2024-04-23T10:13:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa68401a070 con 0x7fa6940d0fd0 2024-04-23T10:13:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 0x7fa67806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa6840860f0 con 0x7fa6940d0fd0 2024-04-23T10:13:31.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.353+0000 7fa6991c5640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 0x7fa67806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.357+0000 7fa6991c5640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 0x7fa67806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa690005fd0 tx=0x7fa690005c00 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.357+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa684056320 con 0x7fa6940d0fd0 2024-04-23T10:13:31.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.521+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fa694153d70 con 0x7fa6940d0fd0 2024-04-23T10:13:31.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.521+0000 7fa689ffb640 1 -- 172.21.15.26:0/222227209 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fa684055c20 con 0x7fa6940d0fd0 2024-04-23T10:13:31.523 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 msgr2=0x7fa67806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 0x7fa67806a840 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7fa690005fd0 tx=0x7fa690005c00 comp rx=0 tx=0).stop 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 msgr2=0x7fa6940ca620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7fa684001ec0 tx=0x7fa68400c8e0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 shutdown_connections 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa678068380 0x7fa67806a840 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa6940d13b0 0x7fa6941f1610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa6940d0fd0 0x7fa6940ca620 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 --2- 172.21.15.26:0/222227209 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa694073e40 0x7fa6940cb2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 >> 172.21.15.26:0/222227209 conn(0x7fa69406bad0 msgr2=0x7fa6940cf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 shutdown_connections 2024-04-23T10:13:31.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.525+0000 7fa69b429640 1 -- 172.21.15.26:0/222227209 wait complete. 2024-04-23T10:13:31.542 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:13:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.669+0000 7f645ae09640 1 Processor -- start 2024-04-23T10:13:31.672 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.669+0000 7f645ae09640 1 -- start start 2024-04-23T10:13:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f645ae09640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f64540c8630 0x7f6454151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f645ae09640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f645415b740 con 0x7f64540c8250 2024-04-23T10:13:31.673 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f645ae09640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f64540c40f0 con 0x7f64540c8a70 2024-04-23T10:13:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f645ae09640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f64540c6490 con 0x7f64540c8630 2024-04-23T10:13:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f64540c8250 0x7f64540c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:47628/0 (socket says 172.21.15.26:47628) 2024-04-23T10:13:31.674 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 -- 172.21.15.26:0/2133139122 learned_addr learned my addr 172.21.15.26:0/2133139122 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:31.676 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6453fff640 1 --2- 172.21.15.26:0/2133139122 >> v2:172.21.15.190:3300/0 conn(0x7f64540c8630 0x7f6454151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 991550914 0 0) 0x7f645415b740 con 0x7f64540c8250 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f643c003530 con 0x7f64540c8250 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1580391474 0 0) 0x7f643c003530 con 0x7f64540c8250 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 >> v2:172.21.15.190:3300/0 conn(0x7f64540c8630 msgr2=0x7f6454151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 --2- 172.21.15.26:0/2133139122 >> v2:172.21.15.190:3300/0 conn(0x7f64540c8630 0x7f6454151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 >> v1:172.21.15.190:6789/0 conn(0x7f64540c8a70 legacy=0x7f6454152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f64540c58c0 con 0x7f64540c8250 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f6448001680 con 0x7f64540c8250 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 >> v1:172.21.15.26:6789/0 conn(0x7f64540c8250 legacy=0x7f64540c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 0x7f643c003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c004810 0x7f643c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c005220 0x7f643c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f64540c6490 con 0x7f643c003a10 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f643c00c170 con 0x7f643c005220 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f643c00c370 con 0x7f643c004810 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 0x7f643c003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6453fff640 1 --2- 172.21.15.26:0/2133139122 >> v2:172.21.15.190:3300/0 conn(0x7f64540c8630 0x7f6454151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64593a6640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c005220 0x7f643c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 -- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c004810 msgr2=0x7f643c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f643c004810 0x7f643c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 -- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c005220 msgr2=0x7f643c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c005220 0x7f643c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f6458ba5640 1 -- 172.21.15.26:0/2133139122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f643c003530 con 0x7f643c003a10 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64593a6640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c005220 0x7f643c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:31.678 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.673+0000 7f64593a6640 1 -- 172.21.15.26:0/2133139122 reap_dead start 2024-04-23T10:13:31.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f6458ba5640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 0x7f643c003e30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f644800c0e0 tx=0x7f644801cb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbe920cd3d4447d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448007c30 con 0x7f643c003a10 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f64480a9020 con 0x7f643c003a10 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f64537fe640 1 -- 172.21.15.26:0/2133139122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6448005ae0 con 0x7f643c003a10 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 msgr2=0x7f643c003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 0x7f643c003e30 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7f644800c0e0 tx=0x7f644801cb40 comp rx=0 tx=0).stop 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- 172.21.15.26:0/2133139122 shutdown_connections 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 --2- 172.21.15.26:0/2133139122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f643c003a10 0x7f643c003e30 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- 172.21.15.26:0/2133139122 >> 172.21.15.26:0/2133139122 conn(0x7f645406b9d0 msgr2=0x7f645406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- 172.21.15.26:0/2133139122 shutdown_connections 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- 172.21.15.26:0/2133139122 wait complete. 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 Processor -- start 2024-04-23T10:13:31.680 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 -- start start 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c003a10 0x7f645414c8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.677+0000 7f645ae09640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6454152350 0x7f64541527d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f645415b400 con 0x7f6454073fd0 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f64540721a0 con 0x7f643c003a10 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f64540c6900 con 0x7f6454152350 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:56352/0 (socket says 172.21.15.26:56352) 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 -- 172.21.15.26:0/545421662 learned_addr learned my addr 172.21.15.26:0/545421662 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6458ba5640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c003a10 0x7f645414c8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64593a6640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6454152350 0x7f64541527d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 -- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6454152350 msgr2=0x7f64541527d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6454152350 0x7f64541527d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 -- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c003a10 msgr2=0x7f645414c8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c003a10 0x7f645414c8c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 -- 172.21.15.26:0/545421662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f645414dfe0 con 0x7f6454073fd0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6453fff640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb90 tx=0x7f644400c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6444017070 con 0x7f6454073fd0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f644400ee90 con 0x7f6454073fd0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f644400ce50 con 0x7f6454073fd0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f645414e280 con 0x7f6454073fd0 2024-04-23T10:13:31.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f645414e520 con 0x7f6454073fd0 2024-04-23T10:13:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6454075df0 con 0x7f6454073fd0 2024-04-23T10:13:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f644401a070 con 0x7f6454073fd0 2024-04-23T10:13:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 0x7f644006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6444086e40 con 0x7f6454073fd0 2024-04-23T10:13:31.684 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.681+0000 7f6458ba5640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 0x7f644006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.685 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.685+0000 7f6458ba5640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 0x7f644006a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64480aa000 tx=0x7f64540c6400 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.688 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.685+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6444056fe0 con 0x7f6454073fd0 2024-04-23T10:13:31.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.849+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f645406ca20 con 0x7f6454073fd0 2024-04-23T10:13:31.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.849+0000 7f64517fa640 1 -- 172.21.15.26:0/545421662 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f644405be20 con 0x7f6454073fd0 2024-04-23T10:13:31.852 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 msgr2=0x7f644006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 0x7f644006a870 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f64480aa000 tx=0x7f64540c6400 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 msgr2=0x7f64540cbb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f644400eb90 tx=0x7f644400c520 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 shutdown_connections 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f64400683b0 0x7f644006a870 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6454152350 0x7f64541527d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6454073fd0 0x7f64540cbb30 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 --2- 172.21.15.26:0/545421662 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f643c003a10 0x7f645414c8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 >> 172.21.15.26:0/545421662 conn(0x7f645406b9d0 msgr2=0x7f645406ee60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 shutdown_connections 2024-04-23T10:13:31.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.853+0000 7f645ae09640 1 -- 172.21.15.26:0/545421662 wait complete. 2024-04-23T10:13:31.874 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:31.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 Processor -- start 2024-04-23T10:13:31.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 -- start start 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd380ca960 con 0x7fcd380c9700 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcd380c7f30 con 0x7fcd380c9c10 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd3e1e0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380ca0c0 con 0x7fcd380c5f20 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd36ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:38938/0 (socket says 172.21.15.26:38938) 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 -- 172.21.15.26:0/1980277996 learned_addr learned my addr 172.21.15.26:0/1980277996 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd36ffd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:50708/0 (socket says 172.21.15.26:50708) 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 -- 172.21.15.26:0/1980277996 >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 msgr2=0x7fcd380c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 --2- 172.21.15.26:0/1980277996 >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 -- 172.21.15.26:0/1980277996 >> v1:172.21.15.190:6789/0 conn(0x7fcd380c9700 legacy=0x7fcd38152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd377fe640 1 -- 172.21.15.26:0/1980277996 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd380ca3a0 con 0x7fcd380c5f20 2024-04-23T10:13:31.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.989+0000 7fcd36ffd640 1 --2- 172.21.15.26:0/1980277996 >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:13:31.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd377fe640 1 --2- 172.21.15.26:0/1980277996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009870 tx=0x7fcd2801ed50 comp rx=0 tx=0).ready entity=mon.2 client_cookie=5a12e07c3255fc7b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:31.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd367fc640 1 -- 172.21.15.26:0/1980277996 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd280b5070 con 0x7fcd380c5f20 2024-04-23T10:13:31.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd367fc640 1 -- 172.21.15.26:0/1980277996 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd280a8a50 con 0x7fcd380c5f20 2024-04-23T10:13:31.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd367fc640 1 -- 172.21.15.26:0/1980277996 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd280a8e20 con 0x7fcd380c5f20 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1980277996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 msgr2=0x7fcd380c86f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1980277996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7fcd28009870 tx=0x7fcd2801ed50 comp rx=0 tx=0).stop 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1980277996 shutdown_connections 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1980277996 >> v2:172.21.15.190:3300/0 conn(0x7fcd380c9c10 0x7fcd380c91c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1980277996 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c5f20 0x7fcd380c86f0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1980277996 >> 172.21.15.26:0/1980277996 conn(0x7fcd380676a0 msgr2=0x7fcd38067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1980277996 shutdown_connections 2024-04-23T10:13:31.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.993+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1980277996 wait complete. 2024-04-23T10:13:31.996 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 Processor -- start 2024-04-23T10:13:31.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- start start 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd380c5f20 0x7fcd381ec5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c9700 0x7fcd381f1d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380c8c30 con 0x7fcd380c9c10 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd380c81d0 con 0x7fcd380c5f20 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcd380c5830 con 0x7fcd380c9700 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:31.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49516/0 (socket says 172.21.15.26:49516) 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 -- 172.21.15.26:0/1486282192 learned_addr learned my addr 172.21.15.26:0/1486282192 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd36ffd640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c9700 0x7fcd381f1d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd377fe640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd380c5f20 0x7fcd381ec5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 -- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c9700 msgr2=0x7fcd381f1d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c9700 0x7fcd381f1d90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 -- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd380c5f20 msgr2=0x7fcd381ec5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd380c5f20 0x7fcd381ec5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 -- 172.21.15.26:0/1486282192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd3814db60 con 0x7fcd380c9c10 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd37fff640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c700 tx=0x7fcd3000cbc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd30003b80 con 0x7fcd380c9c10 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd30003d20 con 0x7fcd380c9c10 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd3000aa90 con 0x7fcd380c9c10 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd3814e3c0 con 0x7fcd380c9c10 2024-04-23T10:13:32.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd3814e980 con 0x7fcd380c9c10 2024-04-23T10:13:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:31.997+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd38075df0 con 0x7fcd380c9c10 2024-04-23T10:13:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.001+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd3000ac30 con 0x7fcd380c9c10 2024-04-23T10:13:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.001+0000 7fcd2ffff640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 0x7fcd1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.001+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcd30086ca0 con 0x7fcd380c9c10 2024-04-23T10:13:32.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.001+0000 7fcd377fe640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 0x7fcd1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.001+0000 7fcd377fe640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 0x7fcd1806a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b2000 tx=0x7fcd28008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.005+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd30056e40 con 0x7fcd380c9c10 2024-04-23T10:13:32.174 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.173+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fcd380cda20 con 0x7fcd380c9c10 2024-04-23T10:13:32.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd2ffff640 1 -- 172.21.15.26:0/1486282192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7fcd30056740 con 0x7fcd380c9c10 2024-04-23T10:13:32.177 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:32.177 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:32.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 msgr2=0x7fcd1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 0x7fcd1806a840 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7fcd280b2000 tx=0x7fcd28008040 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 msgr2=0x7fcd381f22d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fcd3000c700 tx=0x7fcd3000cbc0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 shutdown_connections 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd18068380 0x7fcd1806a840 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd380c9c10 0x7fcd381f22d0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd380c9700 0x7fcd381f1d90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 --2- 172.21.15.26:0/1486282192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd380c5f20 0x7fcd381ec5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 >> 172.21.15.26:0/1486282192 conn(0x7fcd380676a0 msgr2=0x7fcd3815ca70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 shutdown_connections 2024-04-23T10:13:32.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.177+0000 7fcd3e1e0640 1 -- 172.21.15.26:0/1486282192 wait complete. 2024-04-23T10:13:32.197 INFO:tasks.quiescer.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:13:32.197 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:13:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 Processor -- start 2024-04-23T10:13:32.329 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 -- start start 2024-04-23T10:13:32.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc60c0c8250 0x7fc60c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 0x7fc60c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc60c15b740 con 0x7fc60c0c8a70 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc60c0c6490 con 0x7fc60c0c8250 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc6119a2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c0c58c0 con 0x7fc60c0c8630 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc60c0c8250 0x7fc60c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc60c0c8250 0x7fc60c0c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49520/0 (socket says 172.21.15.26:49520) 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 -- 172.21.15.26:0/3446400396 learned_addr learned my addr 172.21.15.26:0/3446400396 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 -- 172.21.15.26:0/3446400396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 msgr2=0x7fc60c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60a7fc640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 0x7fc60c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 0x7fc60c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 -- 172.21.15.26:0/3446400396 >> v1:172.21.15.190:6789/0 conn(0x7fc60c0c8a70 legacy=0x7fc60c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60affd640 1 -- 172.21.15.26:0/3446400396 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c0c5b60 con 0x7fc60c0c8250 2024-04-23T10:13:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.329+0000 7fc60a7fc640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 0x7fc60c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc60affd640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8250 0x7fc60c0c39e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00bb40 tx=0x7fc5fc01eb40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1a221e7306dc37 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc609ffb640 1 -- 172.21.15.26:0/3446400396 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0b4070 con 0x7fc60c0c8250 2024-04-23T10:13:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc609ffb640 1 -- 172.21.15.26:0/3446400396 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc5fc0a79c0 con 0x7fc60c0c8250 2024-04-23T10:13:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc609ffb640 1 -- 172.21.15.26:0/3446400396 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc5fc0a7d90 con 0x7fc60c0c8250 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- 172.21.15.26:0/3446400396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8250 msgr2=0x7fc60c0c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8250 0x7fc60c0c39e0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc00bb40 tx=0x7fc5fc01eb40 comp rx=0 tx=0).stop 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- 172.21.15.26:0/3446400396 shutdown_connections 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8630 0x7fc60c151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 --2- 172.21.15.26:0/3446400396 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8250 0x7fc60c0c39e0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- 172.21.15.26:0/3446400396 >> 172.21.15.26:0/3446400396 conn(0x7fc60c06b9d0 msgr2=0x7fc60c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- 172.21.15.26:0/3446400396 shutdown_connections 2024-04-23T10:13:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- 172.21.15.26:0/3446400396 wait complete. 2024-04-23T10:13:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 Processor -- start 2024-04-23T10:13:32.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.333+0000 7fc6119a2640 1 -- start start 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8250 0x7fc60c150cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c0c8630 0x7fc60c0ca9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c0c6920 con 0x7fc60c0c8a70 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc60c15b400 con 0x7fc60c0c8630 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc60c0681d0 con 0x7fc60c0c8250 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49526/0 (socket says 172.21.15.26:49526) 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 -- 172.21.15.26:0/2432425540 learned_addr learned my addr 172.21.15.26:0/2432425540 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60affd640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8250 0x7fc60c150cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60a7fc640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c0c8630 0x7fc60c0ca9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 -- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8250 msgr2=0x7fc60c150cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8250 0x7fc60c150cd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 -- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c0c8630 msgr2=0x7fc60c0ca9f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c0c8630 0x7fc60c0ca9f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 -- 172.21.15.26:0/2432425540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc60c159e30 con 0x7fc60c0c8a70 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60b7fe640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c780 tx=0x7fc60400cc40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc604004b70 con 0x7fc60c0c8a70 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc604004d10 con 0x7fc60c0c8a70 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc60c15a0d0 con 0x7fc60c0c8a70 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc60400aa90 con 0x7fc60c0c8a70 2024-04-23T10:13:32.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc60c15a690 con 0x7fc60c0c8a70 2024-04-23T10:13:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fc60c075df0 con 0x7fc60c0c8a70 2024-04-23T10:13:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc60400ac30 con 0x7fc60c0c8a70 2024-04-23T10:13:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 0x7fc5f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc604087130 con 0x7fc60c0c8a70 2024-04-23T10:13:32.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.337+0000 7fc60affd640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 0x7fc5f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.341+0000 7fc60affd640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 0x7fc5f806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0b1000 tx=0x7fc5fc0a9070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.341+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fc604020070 con 0x7fc60c0c8a70 2024-04-23T10:13:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fc60c071e50 con 0x7fc60c0c8a70 2024-04-23T10:13:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc5f3fff640 1 -- 172.21.15.26:0/2432425540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fc6040571a0 con 0x7fc60c0c8a70 2024-04-23T10:13:32.510 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:13:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 msgr2=0x7fc5f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 0x7fc5f806a840 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc5fc0b1000 tx=0x7fc5fc0a9070 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 msgr2=0x7fc60c0caf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fc60400c780 tx=0x7fc60400cc40 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 shutdown_connections 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc5f8068380 0x7fc5f806a840 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc60c0c8a70 0x7fc60c0caf30 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc60c0c8630 0x7fc60c0ca9f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 --2- 172.21.15.26:0/2432425540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc60c0c8250 0x7fc60c150cd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 >> 172.21.15.26:0/2432425540 conn(0x7fc60c06b9d0 msgr2=0x7fc60c141200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 shutdown_connections 2024-04-23T10:13:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.509+0000 7fc6119a2640 1 -- 172.21.15.26:0/2432425540 wait complete. 2024-04-23T10:13:32.529 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:13:32.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.649+0000 7f107dc6c640 1 Processor -- start 2024-04-23T10:13:32.652 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 -- start start 2024-04-23T10:13:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.653 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f10780c8a70 0x7f1078152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f107815b740 con 0x7f10780c8250 2024-04-23T10:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f10780c6490 con 0x7f10780c8a70 2024-04-23T10:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f107dc6c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10781525c0 con 0x7f10780c8630 2024-04-23T10:13:32.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:38966/0 (socket says 172.21.15.26:38966) 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 -- 172.21.15.26:0/2707226836 learned_addr learned my addr 172.21.15.26:0/2707226836 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1077fff640 1 --2- 172.21.15.26:0/2707226836 >> v2:172.21.15.190:3300/0 conn(0x7f10780c8a70 0x7f1078152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 -- 172.21.15.26:0/2707226836 >> v2:172.21.15.190:3300/0 conn(0x7f10780c8a70 msgr2=0x7f1078152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 --2- 172.21.15.26:0/2707226836 >> v2:172.21.15.190:3300/0 conn(0x7f10780c8a70 0x7f1078152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 -- 172.21.15.26:0/2707226836 >> v1:172.21.15.190:6789/0 conn(0x7f10780c8250 legacy=0x7f10780c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.655 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.653+0000 7f1076ffd640 1 -- 172.21.15.26:0/2707226836 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10780c40f0 con 0x7f10780c8630 2024-04-23T10:13:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f1076ffd640 1 --2- 172.21.15.26:0/2707226836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f106c0098a0 tx=0x7f106c01c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bc2af6a7e0a612c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f10767fc640 1 -- 172.21.15.26:0/2707226836 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b0070 con 0x7f10780c8630 2024-04-23T10:13:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f10767fc640 1 -- 172.21.15.26:0/2707226836 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0ab600 con 0x7f10780c8630 2024-04-23T10:13:32.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f10767fc640 1 -- 172.21.15.26:0/2707226836 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0ab9d0 con 0x7f10780c8630 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- 172.21.15.26:0/2707226836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 msgr2=0x7f1078151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2707226836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f106c0098a0 tx=0x7f106c01c4b0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- 172.21.15.26:0/2707226836 shutdown_connections 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2707226836 >> v2:172.21.15.190:3300/0 conn(0x7f10780c8a70 0x7f1078152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2707226836 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8630 0x7f1078151b40 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- 172.21.15.26:0/2707226836 >> 172.21.15.26:0/2707226836 conn(0x7f107806b9d0 msgr2=0x7f107806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- 172.21.15.26:0/2707226836 shutdown_connections 2024-04-23T10:13:32.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- 172.21.15.26:0/2707226836 wait complete. 2024-04-23T10:13:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 Processor -- start 2024-04-23T10:13:32.659 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- start start 2024-04-23T10:13:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8250 0x7f1078160f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10780c8a70 0x7f10780728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f107815b400 con 0x7f10780c8630 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10780721a0 con 0x7f10780c8a70 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f107dc6c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10780c6900 con 0x7f10780c8250 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f1076ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49540/0 (socket says 172.21.15.26:49540) 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.657+0000 7f1076ffd640 1 -- 172.21.15.26:0/2442093597 learned_addr learned my addr 172.21.15.26:0/2442093597 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f10777fe640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8250 0x7f1078160f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1077fff640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10780c8a70 0x7f10780728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 -- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8250 msgr2=0x7f1078160f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8250 0x7f1078160f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 -- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10780c8a70 msgr2=0x7f10780728b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10780c8a70 0x7f10780728b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 -- 172.21.15.26:0/2442093597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10781f4150 con 0x7f10780c8630 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f1076ffd640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f106c01a0e0 tx=0x7f106c019250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.662 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b0040 con 0x7f10780c8630 2024-04-23T10:13:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f106c0b4420 con 0x7f10780c8630 2024-04-23T10:13:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1078161530 con 0x7f10780c8630 2024-04-23T10:13:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f106c0b47d0 con 0x7f10780c8630 2024-04-23T10:13:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10781f4410 con 0x7f10780c8630 2024-04-23T10:13:32.663 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1078075df0 con 0x7f10780c8630 2024-04-23T10:13:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f106c0b4970 con 0x7f10780c8630 2024-04-23T10:13:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 0x7f106406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f106c120850 con 0x7f10780c8630 2024-04-23T10:13:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f10777fe640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 0x7f106406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.664 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.661+0000 7f10777fe640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 0x7f106406a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1068001650 tx=0x7f1068009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.667 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.665+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f106c016130 con 0x7f10780c8630 2024-04-23T10:13:32.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1078071e50 con 0x7f10780c8630 2024-04-23T10:13:32.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f105ffff640 1 -- 172.21.15.26:0/2442093597 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f106c0f0a80 con 0x7f10780c8630 2024-04-23T10:13:32.830 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:32.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 msgr2=0x7f106406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 0x7f106406a840 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f1068001650 tx=0x7f1068009040 comp rx=0 tx=0).stop 2024-04-23T10:13:32.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 msgr2=0x7f10780732b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7f106c01a0e0 tx=0x7f106c019250 comp rx=0 tx=0).stop 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 shutdown_connections 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1064068380 0x7f106406a840 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f10780c8a70 0x7f10780728b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f10780c8630 0x7f10780732b0 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 --2- 172.21.15.26:0/2442093597 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f10780c8250 0x7f1078160f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 >> 172.21.15.26:0/2442093597 conn(0x7f107806b9d0 msgr2=0x7f10780c6ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 shutdown_connections 2024-04-23T10:13:32.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.829+0000 7f107dc6c640 1 -- 172.21.15.26:0/2442093597 wait complete. 2024-04-23T10:13:32.848 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:13:32.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.965+0000 7f6cd0f05640 1 Processor -- start 2024-04-23T10:13:32.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.965+0000 7f6cd0f05640 1 -- start start 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ccc14ffa0 0x7f6ccc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 0x7f6ccc0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6ccc0c5d70 con 0x7f6ccc14fbc0 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f6ccc0c6050 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc0c6330 con 0x7f6ccc074100 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ccc14ffa0 0x7f6ccc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f6ccc14ffa0 0x7f6ccc06f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49546/0 (socket says 172.21.15.26:49546) 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 -- 172.21.15.26:0/411958762 learned_addr learned my addr 172.21.15.26:0/411958762 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6ccad9d640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 0x7f6ccc0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 -- 172.21.15.26:0/411958762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 msgr2=0x7f6ccc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 0x7f6ccc0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 -- 172.21.15.26:0/411958762 >> v1:172.21.15.190:6789/0 conn(0x7f6ccc14fbc0 legacy=0x7f6ccc0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:32.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 -- 172.21.15.26:0/411958762 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc0c6610 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6ccad9d640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 0x7f6ccc0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:32.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc14ffa0 0x7f6ccc06f700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc001c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=44ab915924f9dbc3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc959a640 1 -- 172.21.15.26:0/411958762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00aa660 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc959a640 1 -- 172.21.15.26:0/411958762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cc00af070 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cc959a640 1 -- 172.21.15.26:0/411958762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cc00aaa20 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 -- 172.21.15.26:0/411958762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc14ffa0 msgr2=0x7f6ccc06f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.969+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc14ffa0 0x7f6ccc06f700 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x7f6cc0009870 tx=0x7f6cc001c520 comp rx=0 tx=0).stop 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/411958762 shutdown_connections 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc074100 0x7f6ccc0c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/411958762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc14ffa0 0x7f6ccc06f700 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/411958762 >> 172.21.15.26:0/411958762 conn(0x7f6ccc06b9d0 msgr2=0x7f6ccc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/411958762 shutdown_connections 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/411958762 wait complete. 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 Processor -- start 2024-04-23T10:13:32.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- start start 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 0x7f6ccc1428b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc14ffa0 0x7f6ccc0cb8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0c8ab0 con 0x7f6ccc074100 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f6ccc0c8930 con 0x7f6ccc14fbc0 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6ccc166090 con 0x7f6ccc14ffa0 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49552/0 (socket says 172.21.15.26:49552) 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 -- 172.21.15.26:0/1102952972 learned_addr learned my addr 172.21.15.26:0/1102952972 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 -- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc14ffa0 msgr2=0x7f6ccc0cb8c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6ccad9d640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc14ffa0 0x7f6ccc0cb8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc14ffa0 0x7f6ccc0cb8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 -- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 msgr2=0x7f6ccc1428b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 0x7f6ccc1428b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 0x7f6ccc1428b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 -- 172.21.15.26:0/1102952972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6ccc149a40 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 0x7f6ccc1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cca59c640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c450 tx=0x7f6cbc00c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc012830 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6cbc017070 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6ccc152f30 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6cbc012c30 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6ccc1f3530 con 0x7f6ccc074100 2024-04-23T10:13:32.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.973+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6ccc1f3320 con 0x7f6ccc074100 2024-04-23T10:13:32.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.977+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6cbc01c460 con 0x7f6ccc074100 2024-04-23T10:13:32.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.977+0000 7f6cbaffd640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 0x7f6cac06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:32.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.977+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6cbc086c80 con 0x7f6ccc074100 2024-04-23T10:13:32.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.977+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 0x7f6cac06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:32.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.977+0000 7f6cc9d9b640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 0x7f6cac06a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00ae000 tx=0x7f6cc00a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:32.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:32.981+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f6cbc056cf0 con 0x7f6ccc074100 2024-04-23T10:13:33.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.141+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f6ccc075df0 con 0x7f6ccc074100 2024-04-23T10:13:33.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.141+0000 7f6cbaffd640 1 -- 172.21.15.26:0/1102952972 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f6cbc0565f0 con 0x7f6ccc074100 2024-04-23T10:13:33.144 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 msgr2=0x7f6cac06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 0x7f6cac06a870 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x7f6cc00ae000 tx=0x7f6cc00a7000 comp rx=0 tx=0).stop 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 msgr2=0x7f6ccc151e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7f6cbc00c450 tx=0x7f6cbc00c910 comp rx=0 tx=0).stop 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 shutdown_connections 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f6cac0683b0 0x7f6cac06a870 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f6ccc14ffa0 0x7f6ccc0cb8c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6ccc14fbc0 0x7f6ccc1428b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 --2- 172.21.15.26:0/1102952972 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6ccc074100 0x7f6ccc151e00 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 >> 172.21.15.26:0/1102952972 conn(0x7f6ccc06b9d0 msgr2=0x7f6ccc0ca3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 shutdown_connections 2024-04-23T10:13:33.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.145+0000 7f6cd0f05640 1 -- 172.21.15.26:0/1102952972 wait complete. 2024-04-23T10:13:33.163 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:13:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 Processor -- start 2024-04-23T10:13:33.282 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 -- start start 2024-04-23T10:13:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 0x7f0b500c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0b5015b740 con 0x7f0b500c8a70 2024-04-23T10:13:33.283 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f0b500c6490 con 0x7f0b500c8250 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b549ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500c58c0 con 0x7f0b500c8630 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 0x7f0b500c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:39012/0 (socket says 172.21.15.26:39012) 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4e59c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 0x7f0b500c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:50778/0 (socket says 172.21.15.26:50778) 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 -- 172.21.15.26:0/1142119037 learned_addr learned my addr 172.21.15.26:0/1142119037 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 -- 172.21.15.26:0/1142119037 >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 msgr2=0x7f0b500c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:33.284 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 --2- 172.21.15.26:0/1142119037 >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 0x7f0b500c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 -- 172.21.15.26:0/1142119037 >> v1:172.21.15.190:6789/0 conn(0x7f0b500c8a70 legacy=0x7f0b50152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.281+0000 7f0b4dd9b640 1 -- 172.21.15.26:0/1142119037 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b500c5b60 con 0x7f0b500c8630 2024-04-23T10:13:33.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b4dd9b640 1 --2- 172.21.15.26:0/1142119037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b440098a0 tx=0x7f0b4401c4b0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=dc7ffc653b2d2ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b4d59a640 1 -- 172.21.15.26:0/1142119037 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440b0070 con 0x7f0b500c8630 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b4d59a640 1 -- 172.21.15.26:0/1142119037 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b440ab600 con 0x7f0b500c8630 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b4d59a640 1 -- 172.21.15.26:0/1142119037 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b440ab9d0 con 0x7f0b500c8630 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- 172.21.15.26:0/1142119037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 msgr2=0x7f0b50151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 --2- 172.21.15.26:0/1142119037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7f0b440098a0 tx=0x7f0b4401c4b0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- 172.21.15.26:0/1142119037 shutdown_connections 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 --2- 172.21.15.26:0/1142119037 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50151b40 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 --2- 172.21.15.26:0/1142119037 >> v2:172.21.15.190:3300/0 conn(0x7f0b500c8250 0x7f0b500c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- 172.21.15.26:0/1142119037 >> 172.21.15.26:0/1142119037 conn(0x7f0b5006b9d0 msgr2=0x7f0b5006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- 172.21.15.26:0/1142119037 shutdown_connections 2024-04-23T10:13:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- 172.21.15.26:0/1142119037 wait complete. 2024-04-23T10:13:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 Processor -- start 2024-04-23T10:13:33.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.285+0000 7f0b549ed640 1 -- start start 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b500c8250 0x7f0b500cb590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50153d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0b500c6900 con 0x7f0b500c8a70 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0b5015b400 con 0x7f0b500c8250 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0b500681d0 con 0x7f0b500c8630 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49568/0 (socket says 172.21.15.26:49568) 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 -- 172.21.15.26:0/819077879 learned_addr learned my addr 172.21.15.26:0/819077879 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4e59c640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b500c8250 0x7f0b500cb590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4dd9b640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50153d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 -- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 msgr2=0x7f0b50153d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50153d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 -- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b500c8250 msgr2=0x7f0b500cb590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b500c8250 0x7f0b500cb590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 -- 172.21.15.26:0/819077879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0b50152940 con 0x7f0b500c8a70 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4ed9d640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c770 tx=0x7f0b4800cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b48003b80 con 0x7f0b500c8a70 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0b48003d20 con 0x7f0b500c8a70 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0b50152c20 con 0x7f0b500c8a70 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0b4800aa90 con 0x7f0b500c8a70 2024-04-23T10:13:33.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0b501531e0 con 0x7f0b500c8a70 2024-04-23T10:13:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0b50075df0 con 0x7f0b500c8a70 2024-04-23T10:13:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0b4800ac30 con 0x7f0b500c8a70 2024-04-23T10:13:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 0x7f0b3006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0b48086c50 con 0x7f0b500c8a70 2024-04-23T10:13:33.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.289+0000 7f0b4e59c640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 0x7f0b3006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.293+0000 7f0b4e59c640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 0x7f0b3006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000bcf0 tx=0x7f0b4000b3a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.293+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0b48056e60 con 0x7f0b500c8a70 2024-04-23T10:13:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.453+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f0b50071e50 con 0x7f0b500c8a70 2024-04-23T10:13:33.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b3effd640 1 -- 172.21.15.26:0/819077879 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f0b48056760 con 0x7f0b500c8a70 2024-04-23T10:13:33.456 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 msgr2=0x7f0b3006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 0x7f0b3006a870 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f0b4000bcf0 tx=0x7f0b4000b3a0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 msgr2=0x7f0b50154270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7f0b4800c770 tx=0x7f0b4800cc30 comp rx=0 tx=0).stop 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 shutdown_connections 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0b300683b0 0x7f0b3006a870 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0b500c8a70 0x7f0b50154270 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0b500c8630 0x7f0b50153d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 --2- 172.21.15.26:0/819077879 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0b500c8250 0x7f0b500cb590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 >> 172.21.15.26:0/819077879 conn(0x7f0b5006b9d0 msgr2=0x7f0b50140cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 shutdown_connections 2024-04-23T10:13:33.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.457+0000 7f0b549ed640 1 -- 172.21.15.26:0/819077879 wait complete. 2024-04-23T10:13:33.475 INFO:tasks.quiescer.ceph_manager:waiting for clean 2024-04-23T10:13:33.475 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:33.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 Processor -- start 2024-04-23T10:13:33.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 -- start start 2024-04-23T10:13:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1e40cdc80 0x7fe1e415f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe1e4143f20 0x7fe1e4144330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe1e4144870 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e4072420 con 0x7fe1e40cdc80 2024-04-23T10:13:33.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e9dcb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe1e415b300 con 0x7fe1e4143f20 2024-04-23T10:13:33.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1e40cdc80 0x7fe1e415f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe1e40cdc80 0x7fe1e415f2b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49570/0 (socket says 172.21.15.26:49570) 2024-04-23T10:13:33.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 -- 172.21.15.26:0/3309782870 learned_addr learned my addr 172.21.15.26:0/3309782870 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e3fff640 1 --2- 172.21.15.26:0/3309782870 >> v2:172.21.15.190:3300/0 conn(0x7fe1e4143f20 0x7fe1e4144330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 -- 172.21.15.26:0/3309782870 >> v2:172.21.15.190:3300/0 conn(0x7fe1e4143f20 msgr2=0x7fe1e4144330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 --2- 172.21.15.26:0/3309782870 >> v2:172.21.15.190:3300/0 conn(0x7fe1e4143f20 0x7fe1e4144330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 -- 172.21.15.26:0/3309782870 >> v1:172.21.15.190:6789/0 conn(0x7fe1e40cd8a0 legacy=0x7fe1e40c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:33.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.585+0000 7fe1e2ffd640 1 -- 172.21.15.26:0/3309782870 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e415b5e0 con 0x7fe1e40cdc80 2024-04-23T10:13:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e2ffd640 1 --2- 172.21.15.26:0/3309782870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cdc80 0x7fe1e415f2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406ecc0 tx=0x7fe1d801ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d341ea0f4bd7002b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e27fc640 1 -- 172.21.15.26:0/3309782870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80b5070 con 0x7fe1e40cdc80 2024-04-23T10:13:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e27fc640 1 -- 172.21.15.26:0/3309782870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d80a89b0 con 0x7fe1e40cdc80 2024-04-23T10:13:33.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e27fc640 1 -- 172.21.15.26:0/3309782870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d80a8d80 con 0x7fe1e40cdc80 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/3309782870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cdc80 msgr2=0x7fe1e415f2b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/3309782870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cdc80 0x7fe1e415f2b0 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7fe1e406ecc0 tx=0x7fe1d801ecb0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/3309782870 shutdown_connections 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/3309782870 >> v2:172.21.15.190:3300/0 conn(0x7fe1e4143f20 0x7fe1e4144330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/3309782870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cdc80 0x7fe1e415f2b0 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/3309782870 >> 172.21.15.26:0/3309782870 conn(0x7fe1e406fca0 msgr2=0x7fe1e40700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/3309782870 shutdown_connections 2024-04-23T10:13:33.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/3309782870 wait complete. 2024-04-23T10:13:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 Processor -- start 2024-04-23T10:13:33.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- start start 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e40cdc80 0x7fe1e4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 0x7fe1e41e63f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e415be80 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe1e415bba0 con 0x7fe1e4143f20 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe1e406bdb0 con 0x7fe1e40cdc80 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49580/0 (socket says 172.21.15.26:49580) 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 -- 172.21.15.26:0/2799196110 learned_addr learned my addr 172.21.15.26:0/2799196110 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e2ffd640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e40cdc80 0x7fe1e4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e3fff640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 0x7fe1e41e63f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 -- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e40cdc80 msgr2=0x7fe1e4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e40cdc80 0x7fe1e4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 -- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 msgr2=0x7fe1e41e63f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 0x7fe1e41e63f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 -- 172.21.15.26:0/2799196110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe1e4155b40 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e3fff640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 0x7fe1e41e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e37fe640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c450 tx=0x7fe1d400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011790 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe1d4017070 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe1e4155e00 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe1d4011b90 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.589+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe1e41563c0 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe1e4075df0 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe1d4011d30 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1cbfff640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 0x7fe1d006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe1d4086b40 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1e2ffd640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 0x7fe1d006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.593+0000 7fe1e2ffd640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 0x7fe1d006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80b2000 tx=0x7fe1d8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.597+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe1d4056ce0 con 0x7fe1e40cd8a0 2024-04-23T10:13:33.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.749+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe1e40733f0 con 0x7fe1d0068380 2024-04-23T10:13:33.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.773+0000 7fe1cbfff640 1 -- 172.21.15.26:0/2799196110 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332694 (secure 0 0 0) 0x7fe1e40733f0 con 0x7fe1d0068380 2024-04-23T10:13:33.777 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:33.779 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 msgr2=0x7fe1d006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 0x7fe1d006a840 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7fe1d80b2000 tx=0x7fe1d8009040 comp rx=0 tx=0).stop 2024-04-23T10:13:33.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 msgr2=0x7fe1e41f0970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7fe1d400c450 tx=0x7fe1d400c910 comp rx=0 tx=0).stop 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 shutdown_connections 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe1d0068380 0x7fe1d006a840 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe1e4143f20 0x7fe1e41e63f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe1e40cdc80 0x7fe1e4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 --2- 172.21.15.26:0/2799196110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe1e40cd8a0 0x7fe1e41f0970 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 >> 172.21.15.26:0/2799196110 conn(0x7fe1e406fca0 msgr2=0x7fe1e4073910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 shutdown_connections 2024-04-23T10:13:33.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.777+0000 7fe1e9dcb640 1 -- 172.21.15.26:0/2799196110 wait complete. 2024-04-23T10:13:33.794 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-23T10:13:32.935395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004516"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046610+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:13:20.046610+0000","last_peered":"2024-04-23T10:13:20.046610+0000","last_clean":"2024-04-23T10:13:20.046610+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:13:20.046610+0000","last_undegraded":"2024-04-23T10:13:20.046610+0000","last_fullsized":"2024-04-23T10:13:20.046610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019065+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:13:16.019065+0000","last_peered":"2024-04-23T10:13:16.019065+0000","last_clean":"2024-04-23T10:13:16.019065+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:13:16.019065+0000","last_undegraded":"2024-04-23T10:13:16.019065+0000","last_fullsized":"2024-04-23T10:13:16.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017119+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:13:16.017119+0000","last_peered":"2024-04-23T10:13:16.017119+0000","last_clean":"2024-04-23T10:13:16.017119+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:13:16.017119+0000","last_undegraded":"2024-04-23T10:13:16.017119+0000","last_fullsized":"2024-04-23T10:13:16.017119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019233+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:13:16.019233+0000","last_peered":"2024-04-23T10:13:16.019233+0000","last_clean":"2024-04-23T10:13:16.019233+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:13:16.019233+0000","last_undegraded":"2024-04-23T10:13:16.019233+0000","last_fullsized":"2024-04-23T10:13:16.019233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024766+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:13:16.024766+0000","last_peered":"2024-04-23T10:13:16.024766+0000","last_clean":"2024-04-23T10:13:16.024766+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:13:16.024766+0000","last_undegraded":"2024-04-23T10:13:16.024766+0000","last_fullsized":"2024-04-23T10:13:16.024766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020029+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:13:16.020029+0000","last_peered":"2024-04-23T10:13:16.020029+0000","last_clean":"2024-04-23T10:13:16.020029+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:13:16.020029+0000","last_undegraded":"2024-04-23T10:13:16.020029+0000","last_fullsized":"2024-04-23T10:13:16.020029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.045304+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:13:20.045304+0000","last_peered":"2024-04-23T10:13:20.045304+0000","last_clean":"2024-04-23T10:13:20.045304+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:13:20.045304+0000","last_undegraded":"2024-04-23T10:13:20.045304+0000","last_fullsized":"2024-04-23T10:13:20.045304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021916+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:13:16.021916+0000","last_peered":"2024-04-23T10:13:16.021916+0000","last_clean":"2024-04-23T10:13:16.021916+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:13:16.021916+0000","last_undegraded":"2024-04-23T10:13:16.021916+0000","last_fullsized":"2024-04-23T10:13:16.021916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025938+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:13:16.025938+0000","last_peered":"2024-04-23T10:13:16.025938+0000","last_clean":"2024-04-23T10:13:16.025938+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:13:16.025938+0000","last_undegraded":"2024-04-23T10:13:16.025938+0000","last_fullsized":"2024-04-23T10:13:16.025938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.048154+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:13:20.048154+0000","last_peered":"2024-04-23T10:13:20.048154+0000","last_clean":"2024-04-23T10:13:20.048154+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:13:20.048154+0000","last_undegraded":"2024-04-23T10:13:20.048154+0000","last_fullsized":"2024-04-23T10:13:20.048154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021936+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:13:16.021936+0000","last_peered":"2024-04-23T10:13:16.021936+0000","last_clean":"2024-04-23T10:13:16.021936+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:13:16.021936+0000","last_undegraded":"2024-04-23T10:13:16.021936+0000","last_fullsized":"2024-04-23T10:13:16.021936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022781+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:13:16.022781+0000","last_peered":"2024-04-23T10:13:16.022781+0000","last_clean":"2024-04-23T10:13:16.022781+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:13:16.022781+0000","last_undegraded":"2024-04-23T10:13:16.022781+0000","last_fullsized":"2024-04-23T10:13:16.022781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931819+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:13:16.931819+0000","last_peered":"2024-04-23T10:13:16.931819+0000","last_clean":"2024-04-23T10:13:16.931819+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:13:16.931819+0000","last_undegraded":"2024-04-23T10:13:16.931819+0000","last_fullsized":"2024-04-23T10:13:16.931819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569675+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:13:16.569675+0000","last_peered":"2024-04-23T10:13:16.569675+0000","last_clean":"2024-04-23T10:13:16.569675+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:13:16.569675+0000","last_undegraded":"2024-04-23T10:13:16.569675+0000","last_fullsized":"2024-04-23T10:13:16.569675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029363+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:13:16.029363+0000","last_peered":"2024-04-23T10:13:16.029363+0000","last_clean":"2024-04-23T10:13:16.029363+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:13:16.029363+0000","last_undegraded":"2024-04-23T10:13:16.029363+0000","last_fullsized":"2024-04-23T10:13:16.029363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018319+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:13:16.018319+0000","last_peered":"2024-04-23T10:13:16.018319+0000","last_clean":"2024-04-23T10:13:16.018319+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:13:16.018319+0000","last_undegraded":"2024-04-23T10:13:16.018319+0000","last_fullsized":"2024-04-23T10:13:16.018319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887576+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:13:16.887576+0000","last_peered":"2024-04-23T10:13:16.887576+0000","last_clean":"2024-04-23T10:13:16.887576+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:13:16.887576+0000","last_undegraded":"2024-04-23T10:13:16.887576+0000","last_fullsized":"2024-04-23T10:13:16.887576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024348+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:13:16.024348+0000","last_peered":"2024-04-23T10:13:16.024348+0000","last_clean":"2024-04-23T10:13:16.024348+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:13:16.024348+0000","last_undegraded":"2024-04-23T10:13:16.024348+0000","last_fullsized":"2024-04-23T10:13:16.024348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017388+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:13:16.017388+0000","last_peered":"2024-04-23T10:13:16.017388+0000","last_clean":"2024-04-23T10:13:16.017388+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:13:16.017388+0000","last_undegraded":"2024-04-23T10:13:16.017388+0000","last_fullsized":"2024-04-23T10:13:16.017388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047434+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:13:20.047434+0000","last_peered":"2024-04-23T10:13:20.047434+0000","last_clean":"2024-04-23T10:13:20.047434+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:13:20.047434+0000","last_undegraded":"2024-04-23T10:13:20.047434+0000","last_fullsized":"2024-04-23T10:13:20.047434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889029+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:13:16.889029+0000","last_peered":"2024-04-23T10:13:16.889029+0000","last_clean":"2024-04-23T10:13:16.889029+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:13:16.889029+0000","last_undegraded":"2024-04-23T10:13:16.889029+0000","last_fullsized":"2024-04-23T10:13:16.889029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023383+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:13:16.023383+0000","last_peered":"2024-04-23T10:13:16.023383+0000","last_clean":"2024-04-23T10:13:16.023383+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:13:16.023383+0000","last_undegraded":"2024-04-23T10:13:16.023383+0000","last_fullsized":"2024-04-23T10:13:16.023383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569061+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:13:16.569061+0000","last_peered":"2024-04-23T10:13:16.569061+0000","last_clean":"2024-04-23T10:13:16.569061+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:13:16.569061+0000","last_undegraded":"2024-04-23T10:13:16.569061+0000","last_fullsized":"2024-04-23T10:13:16.569061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024366+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:13:16.024366+0000","last_peered":"2024-04-23T10:13:16.024366+0000","last_clean":"2024-04-23T10:13:16.024366+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:13:16.024366+0000","last_undegraded":"2024-04-23T10:13:16.024366+0000","last_fullsized":"2024-04-23T10:13:16.024366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025541+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:13:16.025541+0000","last_peered":"2024-04-23T10:13:16.025541+0000","last_clean":"2024-04-23T10:13:16.025541+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:13:16.025541+0000","last_undegraded":"2024-04-23T10:13:16.025541+0000","last_fullsized":"2024-04-23T10:13:16.025541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047236+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:13:20.047236+0000","last_peered":"2024-04-23T10:13:20.047236+0000","last_clean":"2024-04-23T10:13:20.047236+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:13:20.047236+0000","last_undegraded":"2024-04-23T10:13:20.047236+0000","last_fullsized":"2024-04-23T10:13:20.047236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023004+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:13:16.023004+0000","last_peered":"2024-04-23T10:13:16.023004+0000","last_clean":"2024-04-23T10:13:16.023004+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:13:16.023004+0000","last_undegraded":"2024-04-23T10:13:16.023004+0000","last_fullsized":"2024-04-23T10:13:16.023004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.572546+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:13:16.572546+0000","last_peered":"2024-04-23T10:13:16.572546+0000","last_clean":"2024-04-23T10:13:16.572546+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:13:16.572546+0000","last_undegraded":"2024-04-23T10:13:16.572546+0000","last_fullsized":"2024-04-23T10:13:16.572546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889277+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:13:16.889277+0000","last_peered":"2024-04-23T10:13:16.889277+0000","last_clean":"2024-04-23T10:13:16.889277+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:13:16.889277+0000","last_undegraded":"2024-04-23T10:13:16.889277+0000","last_fullsized":"2024-04-23T10:13:16.889277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891510+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:13:16.891510+0000","last_peered":"2024-04-23T10:13:16.891510+0000","last_clean":"2024-04-23T10:13:16.891510+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:13:16.891510+0000","last_undegraded":"2024-04-23T10:13:16.891510+0000","last_fullsized":"2024-04-23T10:13:16.891510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889028+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:13:16.889028+0000","last_peered":"2024-04-23T10:13:16.889028+0000","last_clean":"2024-04-23T10:13:16.889028+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:13:16.889028+0000","last_undegraded":"2024-04-23T10:13:16.889028+0000","last_fullsized":"2024-04-23T10:13:16.889028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570186+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:13:16.570186+0000","last_peered":"2024-04-23T10:13:16.570186+0000","last_clean":"2024-04-23T10:13:16.570186+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:13:16.570186+0000","last_undegraded":"2024-04-23T10:13:16.570186+0000","last_fullsized":"2024-04-23T10:13:16.570186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024412+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:13:16.024412+0000","last_peered":"2024-04-23T10:13:16.024412+0000","last_clean":"2024-04-23T10:13:16.024412+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:13:16.024412+0000","last_undegraded":"2024-04-23T10:13:16.024412+0000","last_fullsized":"2024-04-23T10:13:16.024412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021967+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:13:16.021967+0000","last_peered":"2024-04-23T10:13:16.021967+0000","last_clean":"2024-04-23T10:13:16.021967+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:13:16.021967+0000","last_undegraded":"2024-04-23T10:13:16.021967+0000","last_fullsized":"2024-04-23T10:13:16.021967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889344+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:13:16.889344+0000","last_peered":"2024-04-23T10:13:16.889344+0000","last_clean":"2024-04-23T10:13:16.889344+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:13:16.889344+0000","last_undegraded":"2024-04-23T10:13:16.889344+0000","last_fullsized":"2024-04-23T10:13:16.889344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886856+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:13:16.886856+0000","last_peered":"2024-04-23T10:13:16.886856+0000","last_clean":"2024-04-23T10:13:16.886856+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:13:16.886856+0000","last_undegraded":"2024-04-23T10:13:16.886856+0000","last_fullsized":"2024-04-23T10:13:16.886856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024771+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:13:16.024771+0000","last_peered":"2024-04-23T10:13:16.024771+0000","last_clean":"2024-04-23T10:13:16.024771+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:13:16.024771+0000","last_undegraded":"2024-04-23T10:13:16.024771+0000","last_fullsized":"2024-04-23T10:13:16.024771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043830+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:13:20.043830+0000","last_peered":"2024-04-23T10:13:20.043830+0000","last_clean":"2024-04-23T10:13:20.043830+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:13:20.043830+0000","last_undegraded":"2024-04-23T10:13:20.043830+0000","last_fullsized":"2024-04-23T10:13:20.043830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888499+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:13:16.888499+0000","last_peered":"2024-04-23T10:13:16.888499+0000","last_clean":"2024-04-23T10:13:16.888499+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:13:16.888499+0000","last_undegraded":"2024-04-23T10:13:16.888499+0000","last_fullsized":"2024-04-23T10:13:16.888499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887022+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:13:16.887022+0000","last_peered":"2024-04-23T10:13:16.887022+0000","last_clean":"2024-04-23T10:13:16.887022+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:13:16.887022+0000","last_undegraded":"2024-04-23T10:13:16.887022+0000","last_fullsized":"2024-04-23T10:13:16.887022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.040904+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:13:20.040904+0000","last_peered":"2024-04-23T10:13:20.040904+0000","last_clean":"2024-04-23T10:13:20.040904+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:13:20.040904+0000","last_undegraded":"2024-04-23T10:13:20.040904+0000","last_fullsized":"2024-04-23T10:13:20.040904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889168+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:13:16.889168+0000","last_peered":"2024-04-23T10:13:16.889168+0000","last_clean":"2024-04-23T10:13:16.889168+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:13:16.889168+0000","last_undegraded":"2024-04-23T10:13:16.889168+0000","last_fullsized":"2024-04-23T10:13:16.889168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024139+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:13:16.024139+0000","last_peered":"2024-04-23T10:13:16.024139+0000","last_clean":"2024-04-23T10:13:16.024139+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:13:16.024139+0000","last_undegraded":"2024-04-23T10:13:16.024139+0000","last_fullsized":"2024-04-23T10:13:16.024139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569577+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:13:16.569577+0000","last_peered":"2024-04-23T10:13:16.569577+0000","last_clean":"2024-04-23T10:13:16.569577+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:13:16.569577+0000","last_undegraded":"2024-04-23T10:13:16.569577+0000","last_fullsized":"2024-04-23T10:13:16.569577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.574008+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:13:16.574008+0000","last_peered":"2024-04-23T10:13:16.574008+0000","last_clean":"2024-04-23T10:13:16.574008+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:13:16.574008+0000","last_undegraded":"2024-04-23T10:13:16.574008+0000","last_fullsized":"2024-04-23T10:13:16.574008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017537+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:13:16.017537+0000","last_peered":"2024-04-23T10:13:16.017537+0000","last_clean":"2024-04-23T10:13:16.017537+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:13:16.017537+0000","last_undegraded":"2024-04-23T10:13:16.017537+0000","last_fullsized":"2024-04-23T10:13:16.017537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021779+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:13:16.021779+0000","last_peered":"2024-04-23T10:13:16.021779+0000","last_clean":"2024-04-23T10:13:16.021779+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:13:16.021779+0000","last_undegraded":"2024-04-23T10:13:16.021779+0000","last_fullsized":"2024-04-23T10:13:16.021779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569733+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:13:16.569733+0000","last_peered":"2024-04-23T10:13:16.569733+0000","last_clean":"2024-04-23T10:13:16.569733+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:13:16.569733+0000","last_undegraded":"2024-04-23T10:13:16.569733+0000","last_fullsized":"2024-04-23T10:13:16.569733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932370+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:13:16.932370+0000","last_peered":"2024-04-23T10:13:16.932370+0000","last_clean":"2024-04-23T10:13:16.932370+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:13:16.932370+0000","last_undegraded":"2024-04-23T10:13:16.932370+0000","last_fullsized":"2024-04-23T10:13:16.932370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569024+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:13:16.569024+0000","last_peered":"2024-04-23T10:13:16.569024+0000","last_clean":"2024-04-23T10:13:16.569024+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:13:16.569024+0000","last_undegraded":"2024-04-23T10:13:16.569024+0000","last_fullsized":"2024-04-23T10:13:16.569024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021712+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:13:16.021712+0000","last_peered":"2024-04-23T10:13:16.021712+0000","last_clean":"2024-04-23T10:13:16.021712+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:13:16.021712+0000","last_undegraded":"2024-04-23T10:13:16.021712+0000","last_fullsized":"2024-04-23T10:13:16.021712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931725+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:13:16.931725+0000","last_peered":"2024-04-23T10:13:16.931725+0000","last_clean":"2024-04-23T10:13:16.931725+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:13:16.931725+0000","last_undegraded":"2024-04-23T10:13:16.931725+0000","last_fullsized":"2024-04-23T10:13:16.931725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022224+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:13:16.022224+0000","last_peered":"2024-04-23T10:13:16.022224+0000","last_clean":"2024-04-23T10:13:16.022224+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:13:16.022224+0000","last_undegraded":"2024-04-23T10:13:16.022224+0000","last_fullsized":"2024-04-23T10:13:16.022224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888952+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:13:16.888952+0000","last_peered":"2024-04-23T10:13:16.888952+0000","last_clean":"2024-04-23T10:13:16.888952+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:13:16.888952+0000","last_undegraded":"2024-04-23T10:13:16.888952+0000","last_fullsized":"2024-04-23T10:13:16.888952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024715+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:13:16.024715+0000","last_peered":"2024-04-23T10:13:16.024715+0000","last_clean":"2024-04-23T10:13:16.024715+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:13:16.024715+0000","last_undegraded":"2024-04-23T10:13:16.024715+0000","last_fullsized":"2024-04-23T10:13:16.024715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570090+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:13:16.570090+0000","last_peered":"2024-04-23T10:13:16.570090+0000","last_clean":"2024-04-23T10:13:16.570090+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:13:16.570090+0000","last_undegraded":"2024-04-23T10:13:16.570090+0000","last_fullsized":"2024-04-23T10:13:16.570090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.041591+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:13:20.041591+0000","last_peered":"2024-04-23T10:13:20.041591+0000","last_clean":"2024-04-23T10:13:20.041591+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:13:20.041591+0000","last_undegraded":"2024-04-23T10:13:20.041591+0000","last_fullsized":"2024-04-23T10:13:20.041591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020888+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:13:16.020888+0000","last_peered":"2024-04-23T10:13:16.020888+0000","last_clean":"2024-04-23T10:13:16.020888+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:13:16.020888+0000","last_undegraded":"2024-04-23T10:13:16.020888+0000","last_fullsized":"2024-04-23T10:13:16.020888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569592+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:13:16.569592+0000","last_peered":"2024-04-23T10:13:16.569592+0000","last_clean":"2024-04-23T10:13:16.569592+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:13:16.569592+0000","last_undegraded":"2024-04-23T10:13:16.569592+0000","last_fullsized":"2024-04-23T10:13:16.569592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024919+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:13:16.024919+0000","last_peered":"2024-04-23T10:13:16.024919+0000","last_clean":"2024-04-23T10:13:16.024919+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:13:16.024919+0000","last_undegraded":"2024-04-23T10:13:16.024919+0000","last_fullsized":"2024-04-23T10:13:16.024919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019854+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:13:16.019854+0000","last_peered":"2024-04-23T10:13:16.019854+0000","last_clean":"2024-04-23T10:13:16.019854+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:13:16.019854+0000","last_undegraded":"2024-04-23T10:13:16.019854+0000","last_fullsized":"2024-04-23T10:13:16.019854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569940+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:13:16.569940+0000","last_peered":"2024-04-23T10:13:16.569940+0000","last_clean":"2024-04-23T10:13:16.569940+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:13:16.569940+0000","last_undegraded":"2024-04-23T10:13:16.569940+0000","last_fullsized":"2024-04-23T10:13:16.569940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021026+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:13:16.021026+0000","last_peered":"2024-04-23T10:13:16.021026+0000","last_clean":"2024-04-23T10:13:16.021026+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:13:16.021026+0000","last_undegraded":"2024-04-23T10:13:16.021026+0000","last_fullsized":"2024-04-23T10:13:16.021026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024747+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:13:16.024747+0000","last_peered":"2024-04-23T10:13:16.024747+0000","last_clean":"2024-04-23T10:13:16.024747+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:13:16.024747+0000","last_undegraded":"2024-04-23T10:13:16.024747+0000","last_fullsized":"2024-04-23T10:13:16.024747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932091+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:13:16.932091+0000","last_peered":"2024-04-23T10:13:16.932091+0000","last_clean":"2024-04-23T10:13:16.932091+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:13:16.932091+0000","last_undegraded":"2024-04-23T10:13:16.932091+0000","last_fullsized":"2024-04-23T10:13:16.932091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932214+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:13:16.932214+0000","last_peered":"2024-04-23T10:13:16.932214+0000","last_clean":"2024-04-23T10:13:16.932214+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:13:16.932214+0000","last_undegraded":"2024-04-23T10:13:16.932214+0000","last_fullsized":"2024-04-23T10:13:16.932214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019066+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:13:16.019066+0000","last_peered":"2024-04-23T10:13:16.019066+0000","last_clean":"2024-04-23T10:13:16.019066+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:13:16.019066+0000","last_undegraded":"2024-04-23T10:13:16.019066+0000","last_fullsized":"2024-04-23T10:13:16.019066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569434+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:13:16.569434+0000","last_peered":"2024-04-23T10:13:16.569434+0000","last_clean":"2024-04-23T10:13:16.569434+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:13:16.569434+0000","last_undegraded":"2024-04-23T10:13:16.569434+0000","last_fullsized":"2024-04-23T10:13:16.569434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021371+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:13:16.021371+0000","last_peered":"2024-04-23T10:13:16.021371+0000","last_clean":"2024-04-23T10:13:16.021371+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:13:16.021371+0000","last_undegraded":"2024-04-23T10:13:16.021371+0000","last_fullsized":"2024-04-23T10:13:16.021371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018636+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:13:16.018636+0000","last_peered":"2024-04-23T10:13:16.018636+0000","last_clean":"2024-04-23T10:13:16.018636+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:13:16.018636+0000","last_undegraded":"2024-04-23T10:13:16.018636+0000","last_fullsized":"2024-04-23T10:13:16.018636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024461+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:13:16.024461+0000","last_peered":"2024-04-23T10:13:16.024461+0000","last_clean":"2024-04-23T10:13:16.024461+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:13:16.024461+0000","last_undegraded":"2024-04-23T10:13:16.024461+0000","last_fullsized":"2024-04-23T10:13:16.024461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043352+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:13:20.043352+0000","last_peered":"2024-04-23T10:13:20.043352+0000","last_clean":"2024-04-23T10:13:20.043352+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:13:20.043352+0000","last_undegraded":"2024-04-23T10:13:20.043352+0000","last_fullsized":"2024-04-23T10:13:20.043352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021878+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:13:16.021878+0000","last_peered":"2024-04-23T10:13:16.021878+0000","last_clean":"2024-04-23T10:13:16.021878+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:13:16.021878+0000","last_undegraded":"2024-04-23T10:13:16.021878+0000","last_fullsized":"2024-04-23T10:13:16.021878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570096+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:13:16.570096+0000","last_peered":"2024-04-23T10:13:16.570096+0000","last_clean":"2024-04-23T10:13:16.570096+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:13:16.570096+0000","last_undegraded":"2024-04-23T10:13:16.570096+0000","last_fullsized":"2024-04-23T10:13:16.570096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:28.628833+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:13:28.628833+0000","last_peered":"2024-04-23T10:13:28.628833+0000","last_clean":"2024-04-23T10:13:28.628833+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:13:28.628833+0000","last_undegraded":"2024-04-23T10:13:28.628833+0000","last_fullsized":"2024-04-23T10:13:28.628833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887133+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:13:16.887133+0000","last_peered":"2024-04-23T10:13:16.887133+0000","last_clean":"2024-04-23T10:13:16.887133+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:13:16.887133+0000","last_undegraded":"2024-04-23T10:13:16.887133+0000","last_fullsized":"2024-04-23T10:13:16.887133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025287+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:13:16.025287+0000","last_peered":"2024-04-23T10:13:16.025287+0000","last_clean":"2024-04-23T10:13:16.025287+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:13:16.025287+0000","last_undegraded":"2024-04-23T10:13:16.025287+0000","last_fullsized":"2024-04-23T10:13:16.025287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888751+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:13:16.888751+0000","last_peered":"2024-04-23T10:13:16.888751+0000","last_clean":"2024-04-23T10:13:16.888751+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:13:16.888751+0000","last_undegraded":"2024-04-23T10:13:16.888751+0000","last_fullsized":"2024-04-23T10:13:16.888751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023945+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:13:16.023945+0000","last_peered":"2024-04-23T10:13:16.023945+0000","last_clean":"2024-04-23T10:13:16.023945+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:13:16.023945+0000","last_undegraded":"2024-04-23T10:13:16.023945+0000","last_fullsized":"2024-04-23T10:13:16.023945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891269+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:13:16.891269+0000","last_peered":"2024-04-23T10:13:16.891269+0000","last_clean":"2024-04-23T10:13:16.891269+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:13:16.891269+0000","last_undegraded":"2024-04-23T10:13:16.891269+0000","last_fullsized":"2024-04-23T10:13:16.891269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046189+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:13:20.046189+0000","last_peered":"2024-04-23T10:13:20.046189+0000","last_clean":"2024-04-23T10:13:20.046189+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:13:20.046189+0000","last_undegraded":"2024-04-23T10:13:20.046189+0000","last_fullsized":"2024-04-23T10:13:20.046189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017213+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:13:16.017213+0000","last_peered":"2024-04-23T10:13:16.017213+0000","last_clean":"2024-04-23T10:13:16.017213+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:13:16.017213+0000","last_undegraded":"2024-04-23T10:13:16.017213+0000","last_fullsized":"2024-04-23T10:13:16.017213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022505+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:13:16.022505+0000","last_peered":"2024-04-23T10:13:16.022505+0000","last_clean":"2024-04-23T10:13:16.022505+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:13:16.022505+0000","last_undegraded":"2024-04-23T10:13:16.022505+0000","last_fullsized":"2024-04-23T10:13:16.022505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.933003+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:13:16.933003+0000","last_peered":"2024-04-23T10:13:16.933003+0000","last_clean":"2024-04-23T10:13:16.933003+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:13:16.933003+0000","last_undegraded":"2024-04-23T10:13:16.933003+0000","last_fullsized":"2024-04-23T10:13:16.933003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017176+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:13:16.017176+0000","last_peered":"2024-04-23T10:13:16.017176+0000","last_clean":"2024-04-23T10:13:16.017176+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:13:16.017176+0000","last_undegraded":"2024-04-23T10:13:16.017176+0000","last_fullsized":"2024-04-23T10:13:16.017176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024581+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:13:16.024581+0000","last_peered":"2024-04-23T10:13:16.024581+0000","last_clean":"2024-04-23T10:13:16.024581+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:13:16.024581+0000","last_undegraded":"2024-04-23T10:13:16.024581+0000","last_fullsized":"2024-04-23T10:13:16.024581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886778+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:13:16.886778+0000","last_peered":"2024-04-23T10:13:16.886778+0000","last_clean":"2024-04-23T10:13:16.886778+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:13:16.886778+0000","last_undegraded":"2024-04-23T10:13:16.886778+0000","last_fullsized":"2024-04-23T10:13:16.886778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022144+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:13:16.022144+0000","last_peered":"2024-04-23T10:13:16.022144+0000","last_clean":"2024-04-23T10:13:16.022144+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:13:16.022144+0000","last_undegraded":"2024-04-23T10:13:16.022144+0000","last_fullsized":"2024-04-23T10:13:16.022144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932630+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:13:16.932630+0000","last_peered":"2024-04-23T10:13:16.932630+0000","last_clean":"2024-04-23T10:13:16.932630+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:13:16.932630+0000","last_undegraded":"2024-04-23T10:13:16.932630+0000","last_fullsized":"2024-04-23T10:13:16.932630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029183+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:13:16.029183+0000","last_peered":"2024-04-23T10:13:16.029183+0000","last_clean":"2024-04-23T10:13:16.029183+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:13:16.029183+0000","last_undegraded":"2024-04-23T10:13:16.029183+0000","last_fullsized":"2024-04-23T10:13:16.029183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:13:16.017565+0000","last_peered":"2024-04-23T10:13:16.017565+0000","last_clean":"2024-04-23T10:13:16.017565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:13:16.017565+0000","last_undegraded":"2024-04-23T10:13:16.017565+0000","last_fullsized":"2024-04-23T10:13:16.017565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931915+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:13:16.931915+0000","last_peered":"2024-04-23T10:13:16.931915+0000","last_clean":"2024-04-23T10:13:16.931915+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:13:16.931915+0000","last_undegraded":"2024-04-23T10:13:16.931915+0000","last_fullsized":"2024-04-23T10:13:16.931915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024846+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:13:16.024846+0000","last_peered":"2024-04-23T10:13:16.024846+0000","last_clean":"2024-04-23T10:13:16.024846+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:13:16.024846+0000","last_undegraded":"2024-04-23T10:13:16.024846+0000","last_fullsized":"2024-04-23T10:13:16.024846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021473+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:13:16.021473+0000","last_peered":"2024-04-23T10:13:16.021473+0000","last_clean":"2024-04-23T10:13:16.021473+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:13:16.021473+0000","last_undegraded":"2024-04-23T10:13:16.021473+0000","last_fullsized":"2024-04-23T10:13:16.021473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018439+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:13:16.018439+0000","last_peered":"2024-04-23T10:13:16.018439+0000","last_clean":"2024-04-23T10:13:16.018439+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:13:16.018439+0000","last_undegraded":"2024-04-23T10:13:16.018439+0000","last_fullsized":"2024-04-23T10:13:16.018439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023744+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:13:16.023744+0000","last_peered":"2024-04-23T10:13:16.023744+0000","last_clean":"2024-04-23T10:13:16.023744+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:13:16.023744+0000","last_undegraded":"2024-04-23T10:13:16.023744+0000","last_fullsized":"2024-04-23T10:13:16.023744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.027505+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:13:16.027505+0000","last_peered":"2024-04-23T10:13:16.027505+0000","last_clean":"2024-04-23T10:13:16.027505+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:13:16.027505+0000","last_undegraded":"2024-04-23T10:13:16.027505+0000","last_fullsized":"2024-04-23T10:13:16.027505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931744+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:13:16.931744+0000","last_peered":"2024-04-23T10:13:16.931744+0000","last_clean":"2024-04-23T10:13:16.931744+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:13:16.931744+0000","last_undegraded":"2024-04-23T10:13:16.931744+0000","last_fullsized":"2024-04-23T10:13:16.931744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021237+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:13:16.021237+0000","last_peered":"2024-04-23T10:13:16.021237+0000","last_clean":"2024-04-23T10:13:16.021237+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:13:16.021237+0000","last_undegraded":"2024-04-23T10:13:16.021237+0000","last_fullsized":"2024-04-23T10:13:16.021237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021239+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:13:16.021239+0000","last_peered":"2024-04-23T10:13:16.021239+0000","last_clean":"2024-04-23T10:13:16.021239+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:13:16.021239+0000","last_undegraded":"2024-04-23T10:13:16.021239+0000","last_fullsized":"2024-04-23T10:13:16.021239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024751+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:13:16.024751+0000","last_peered":"2024-04-23T10:13:16.024751+0000","last_clean":"2024-04-23T10:13:16.024751+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:13:16.024751+0000","last_undegraded":"2024-04-23T10:13:16.024751+0000","last_fullsized":"2024-04-23T10:13:16.024751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018890+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:13:16.018890+0000","last_peered":"2024-04-23T10:13:16.018890+0000","last_clean":"2024-04-23T10:13:16.018890+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:13:16.018890+0000","last_undegraded":"2024-04-23T10:13:16.018890+0000","last_fullsized":"2024-04-23T10:13:16.018890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888505+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:13:16.888505+0000","last_peered":"2024-04-23T10:13:16.888505+0000","last_clean":"2024-04-23T10:13:16.888505+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:13:16.888505+0000","last_undegraded":"2024-04-23T10:13:16.888505+0000","last_fullsized":"2024-04-23T10:13:16.888505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932655+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:13:16.932655+0000","last_peered":"2024-04-23T10:13:16.932655+0000","last_clean":"2024-04-23T10:13:16.932655+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:13:16.932655+0000","last_undegraded":"2024-04-23T10:13:16.932655+0000","last_fullsized":"2024-04-23T10:13:16.932655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019178+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:13:16.019178+0000","last_peered":"2024-04-23T10:13:16.019178+0000","last_clean":"2024-04-23T10:13:16.019178+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:13:16.019178+0000","last_undegraded":"2024-04-23T10:13:16.019178+0000","last_fullsized":"2024-04-23T10:13:16.019178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021724+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:13:16.021724+0000","last_peered":"2024-04-23T10:13:16.021724+0000","last_clean":"2024-04-23T10:13:16.021724+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:13:16.021724+0000","last_undegraded":"2024-04-23T10:13:16.021724+0000","last_fullsized":"2024-04-23T10:13:16.021724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017320+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:13:16.017320+0000","last_peered":"2024-04-23T10:13:16.017320+0000","last_clean":"2024-04-23T10:13:16.017320+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:13:16.017320+0000","last_undegraded":"2024-04-23T10:13:16.017320+0000","last_fullsized":"2024-04-23T10:13:16.017320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021273+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:13:16.021273+0000","last_peered":"2024-04-23T10:13:16.021273+0000","last_clean":"2024-04-23T10:13:16.021273+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:13:16.021273+0000","last_undegraded":"2024-04-23T10:13:16.021273+0000","last_fullsized":"2024-04-23T10:13:16.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024565+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:13:16.024565+0000","last_peered":"2024-04-23T10:13:16.024565+0000","last_clean":"2024-04-23T10:13:16.024565+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:13:16.024565+0000","last_undegraded":"2024-04-23T10:13:16.024565+0000","last_fullsized":"2024-04-23T10:13:16.024565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932257+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:13:16.932257+0000","last_peered":"2024-04-23T10:13:16.932257+0000","last_clean":"2024-04-23T10:13:16.932257+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:13:16.932257+0000","last_undegraded":"2024-04-23T10:13:16.932257+0000","last_fullsized":"2024-04-23T10:13:16.932257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569748+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:13:16.569748+0000","last_peered":"2024-04-23T10:13:16.569748+0000","last_clean":"2024-04-23T10:13:16.569748+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:13:16.569748+0000","last_undegraded":"2024-04-23T10:13:16.569748+0000","last_fullsized":"2024-04-23T10:13:16.569748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021598+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:13:16.021598+0000","last_peered":"2024-04-23T10:13:16.021598+0000","last_clean":"2024-04-23T10:13:16.021598+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:13:16.021598+0000","last_undegraded":"2024-04-23T10:13:16.021598+0000","last_fullsized":"2024-04-23T10:13:16.021598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022975+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:13:16.022975+0000","last_peered":"2024-04-23T10:13:16.022975+0000","last_clean":"2024-04-23T10:13:16.022975+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:13:16.022975+0000","last_undegraded":"2024-04-23T10:13:16.022975+0000","last_fullsized":"2024-04-23T10:13:16.022975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.028684+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:13:16.028684+0000","last_peered":"2024-04-23T10:13:16.028684+0000","last_clean":"2024-04-23T10:13:16.028684+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:13:16.028684+0000","last_undegraded":"2024-04-23T10:13:16.028684+0000","last_fullsized":"2024-04-23T10:13:16.028684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887057+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:13:16.887057+0000","last_peered":"2024-04-23T10:13:16.887057+0000","last_clean":"2024-04-23T10:13:16.887057+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:13:16.887057+0000","last_undegraded":"2024-04-23T10:13:16.887057+0000","last_fullsized":"2024-04-23T10:13:16.887057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024410+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:13:16.024410+0000","last_peered":"2024-04-23T10:13:16.024410+0000","last_clean":"2024-04-23T10:13:16.024410+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:13:16.024410+0000","last_undegraded":"2024-04-23T10:13:16.024410+0000","last_fullsized":"2024-04-23T10:13:16.024410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018218+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:13:16.018218+0000","last_peered":"2024-04-23T10:13:16.018218+0000","last_clean":"2024-04-23T10:13:16.018218+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:13:16.018218+0000","last_undegraded":"2024-04-23T10:13:16.018218+0000","last_fullsized":"2024-04-23T10:13:16.018218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025006+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:13:16.025006+0000","last_peered":"2024-04-23T10:13:16.025006+0000","last_clean":"2024-04-23T10:13:16.025006+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:13:16.025006+0000","last_undegraded":"2024-04-23T10:13:16.025006+0000","last_fullsized":"2024-04-23T10:13:16.025006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932289+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:13:16.932289+0000","last_peered":"2024-04-23T10:13:16.932289+0000","last_clean":"2024-04-23T10:13:16.932289+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:13:16.932289+0000","last_undegraded":"2024-04-23T10:13:16.932289+0000","last_fullsized":"2024-04-23T10:13:16.932289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932585+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:13:16.932585+0000","last_peered":"2024-04-23T10:13:16.932585+0000","last_clean":"2024-04-23T10:13:16.932585+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:13:16.932585+0000","last_undegraded":"2024-04-23T10:13:16.932585+0000","last_fullsized":"2024-04-23T10:13:16.932585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570022+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:13:16.570022+0000","last_peered":"2024-04-23T10:13:16.570022+0000","last_clean":"2024-04-23T10:13:16.570022+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:13:16.570022+0000","last_undegraded":"2024-04-23T10:13:16.570022+0000","last_fullsized":"2024-04-23T10:13:16.570022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017199+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:13:16.017199+0000","last_peered":"2024-04-23T10:13:16.017199+0000","last_clean":"2024-04-23T10:13:16.017199+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:13:16.017199+0000","last_undegraded":"2024-04-23T10:13:16.017199+0000","last_fullsized":"2024-04-23T10:13:16.017199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569870+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:13:16.569870+0000","last_peered":"2024-04-23T10:13:16.569870+0000","last_clean":"2024-04-23T10:13:16.569870+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:13:16.569870+0000","last_undegraded":"2024-04-23T10:13:16.569870+0000","last_fullsized":"2024-04-23T10:13:16.569870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021154+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:13:16.021154+0000","last_peered":"2024-04-23T10:13:16.021154+0000","last_clean":"2024-04-23T10:13:16.021154+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:13:16.021154+0000","last_undegraded":"2024-04-23T10:13:16.021154+0000","last_fullsized":"2024-04-23T10:13:16.021154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.568995+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:13:16.568995+0000","last_peered":"2024-04-23T10:13:16.568995+0000","last_clean":"2024-04-23T10:13:16.568995+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:13:16.568995+0000","last_undegraded":"2024-04-23T10:13:16.568995+0000","last_fullsized":"2024-04-23T10:13:16.568995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021733+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:13:16.021733+0000","last_peered":"2024-04-23T10:13:16.021733+0000","last_clean":"2024-04-23T10:13:16.021733+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:13:16.021733+0000","last_undegraded":"2024-04-23T10:13:16.021733+0000","last_fullsized":"2024-04-23T10:13:16.021733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024566+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:13:16.024566+0000","last_peered":"2024-04-23T10:13:16.024566+0000","last_clean":"2024-04-23T10:13:16.024566+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:13:16.024566+0000","last_undegraded":"2024-04-23T10:13:16.024566+0000","last_fullsized":"2024-04-23T10:13:16.024566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889699+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:13:16.889699+0000","last_peered":"2024-04-23T10:13:16.889699+0000","last_clean":"2024-04-23T10:13:16.889699+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:13:16.889699+0000","last_undegraded":"2024-04-23T10:13:16.889699+0000","last_fullsized":"2024-04-23T10:13:16.889699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569674+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:13:16.569674+0000","last_peered":"2024-04-23T10:13:16.569674+0000","last_clean":"2024-04-23T10:13:16.569674+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:13:16.569674+0000","last_undegraded":"2024-04-23T10:13:16.569674+0000","last_fullsized":"2024-04-23T10:13:16.569674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:33.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:33.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 Processor -- start 2024-04-23T10:13:33.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 -- start start 2024-04-23T10:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f36f814fbc0 0x7f36f806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36f814ffa0 0x7f36f80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f36f80c5d70 con 0x7f36f8074100 2024-04-23T10:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80c6050 con 0x7f36f814ffa0 2024-04-23T10:13:33.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36fd905640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f36f80c6330 con 0x7f36f814fbc0 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36f814ffa0 0x7f36f80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f36f814ffa0 0x7f36f80c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49588/0 (socket says 172.21.15.26:49588) 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 -- 172.21.15.26:0/3650663407 learned_addr learned my addr 172.21.15.26:0/3650663407 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f6ffd640 1 --2- 172.21.15.26:0/3650663407 >> v2:172.21.15.190:3300/0 conn(0x7f36f814fbc0 0x7f36f806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 -- 172.21.15.26:0/3650663407 >> v2:172.21.15.190:3300/0 conn(0x7f36f814fbc0 msgr2=0x7f36f806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 --2- 172.21.15.26:0/3650663407 >> v2:172.21.15.190:3300/0 conn(0x7f36f814fbc0 0x7f36f806f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 -- 172.21.15.26:0/3650663407 >> v1:172.21.15.190:6789/0 conn(0x7f36f8074100 legacy=0x7f36f80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:33.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 -- 172.21.15.26:0/3650663407 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f80c6610 con 0x7f36f814ffa0 2024-04-23T10:13:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.953+0000 7f36f67fc640 1 --2- 172.21.15.26:0/3650663407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f814ffa0 0x7f36f80c8220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009870 tx=0x7f36e001c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6f57e414291fe43c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f5ffb640 1 -- 172.21.15.26:0/3650663407 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00aa660 con 0x7f36f814ffa0 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f5ffb640 1 -- 172.21.15.26:0/3650663407 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36e00af070 con 0x7f36f814ffa0 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f5ffb640 1 -- 172.21.15.26:0/3650663407 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36e00aaa20 con 0x7f36f814ffa0 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3650663407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f814ffa0 msgr2=0x7f36f80c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- 172.21.15.26:0/3650663407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f814ffa0 0x7f36f80c8220 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f36e0009870 tx=0x7f36e001c4e0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3650663407 shutdown_connections 2024-04-23T10:13:33.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- 172.21.15.26:0/3650663407 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f814ffa0 0x7f36f80c8220 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- 172.21.15.26:0/3650663407 >> v2:172.21.15.190:3300/0 conn(0x7f36f814fbc0 0x7f36f806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3650663407 >> 172.21.15.26:0/3650663407 conn(0x7f36f806b9d0 msgr2=0x7f36f806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3650663407 shutdown_connections 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3650663407 wait complete. 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 Processor -- start 2024-04-23T10:13:33.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- start start 2024-04-23T10:13:33.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36f814fbc0 0x7f36f81f4690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 0x7f36f81f4bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f36f8166420 con 0x7f36f8074100 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f36f81662a0 con 0x7f36f814ffa0 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f36f81665a0 con 0x7f36f814fbc0 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49602/0 (socket says 172.21.15.26:49602) 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 -- 172.21.15.26:0/3971623762 learned_addr learned my addr 172.21.15.26:0/3971623762 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f67fc640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36f814fbc0 0x7f36f81f4690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f77fe640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 0x7f36f81f4bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 -- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36f814fbc0 msgr2=0x7f36f81f4690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36f814fbc0 0x7f36f81f4690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 -- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 msgr2=0x7f36f81f4bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 0x7f36f81f4bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 -- 172.21.15.26:0/3971623762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f36f81522e0 con 0x7f36f8074100 2024-04-23T10:13:33.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f77fe640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 0x7f36f81f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36f6ffd640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36f000ce40 tx=0x7f36f000a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0003ba0 con 0x7f36f8074100 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36f0003d40 con 0x7f36f8074100 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f36f81f38d0 con 0x7f36f8074100 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f36f0004240 con 0x7f36f8074100 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.957+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f36f81f3e90 con 0x7f36f8074100 2024-04-23T10:13:33.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f36f8075df0 con 0x7f36f8074100 2024-04-23T10:13:33.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f36f00043e0 con 0x7f36f8074100 2024-04-23T10:13:33.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36effff640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 0x7f36d806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:33.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f36f00878c0 con 0x7f36f8074100 2024-04-23T10:13:33.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36f67fc640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 0x7f36d806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:33.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.961+0000 7f36f67fc640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 0x7f36d806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f36e00ae000 tx=0x7f36e0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:33.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:33.965+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f36f0057af0 con 0x7f36f8074100 2024-04-23T10:13:34.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.117+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f36f8149c50 con 0x7f36d8068380 2024-04-23T10:13:34.143 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.141+0000 7f36effff640 1 -- 172.21.15.26:0/3971623762 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332694 (secure 0 0 0) 0x7f36f8149c50 con 0x7f36d8068380 2024-04-23T10:13:34.145 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:34.148 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 msgr2=0x7f36d806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 0x7f36d806a840 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7f36e00ae000 tx=0x7f36e0008040 comp rx=0 tx=0).stop 2024-04-23T10:13:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 msgr2=0x7f36f8153060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7f36f000ce40 tx=0x7f36f000a660 comp rx=0 tx=0).stop 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 shutdown_connections 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f36d8068380 0x7f36d806a840 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f36f814ffa0 0x7f36f81f4bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f36f814fbc0 0x7f36f81f4690 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 --2- 172.21.15.26:0/3971623762 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f36f8074100 0x7f36f8153060 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.145+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 >> 172.21.15.26:0/3971623762 conn(0x7f36f806b9d0 msgr2=0x7f36f814d170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.149+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 shutdown_connections 2024-04-23T10:13:34.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.149+0000 7f36fd905640 1 -- 172.21.15.26:0/3971623762 wait complete. 2024-04-23T10:13:34.164 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-23T10:13:32.935395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004516"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046610+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:13:20.046610+0000","last_peered":"2024-04-23T10:13:20.046610+0000","last_clean":"2024-04-23T10:13:20.046610+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:13:20.046610+0000","last_undegraded":"2024-04-23T10:13:20.046610+0000","last_fullsized":"2024-04-23T10:13:20.046610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019065+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:13:16.019065+0000","last_peered":"2024-04-23T10:13:16.019065+0000","last_clean":"2024-04-23T10:13:16.019065+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:13:16.019065+0000","last_undegraded":"2024-04-23T10:13:16.019065+0000","last_fullsized":"2024-04-23T10:13:16.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017119+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:13:16.017119+0000","last_peered":"2024-04-23T10:13:16.017119+0000","last_clean":"2024-04-23T10:13:16.017119+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:13:16.017119+0000","last_undegraded":"2024-04-23T10:13:16.017119+0000","last_fullsized":"2024-04-23T10:13:16.017119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019233+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:13:16.019233+0000","last_peered":"2024-04-23T10:13:16.019233+0000","last_clean":"2024-04-23T10:13:16.019233+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:13:16.019233+0000","last_undegraded":"2024-04-23T10:13:16.019233+0000","last_fullsized":"2024-04-23T10:13:16.019233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024766+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:13:16.024766+0000","last_peered":"2024-04-23T10:13:16.024766+0000","last_clean":"2024-04-23T10:13:16.024766+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:13:16.024766+0000","last_undegraded":"2024-04-23T10:13:16.024766+0000","last_fullsized":"2024-04-23T10:13:16.024766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020029+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:13:16.020029+0000","last_peered":"2024-04-23T10:13:16.020029+0000","last_clean":"2024-04-23T10:13:16.020029+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:13:16.020029+0000","last_undegraded":"2024-04-23T10:13:16.020029+0000","last_fullsized":"2024-04-23T10:13:16.020029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.045304+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:13:20.045304+0000","last_peered":"2024-04-23T10:13:20.045304+0000","last_clean":"2024-04-23T10:13:20.045304+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:13:20.045304+0000","last_undegraded":"2024-04-23T10:13:20.045304+0000","last_fullsized":"2024-04-23T10:13:20.045304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021916+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:13:16.021916+0000","last_peered":"2024-04-23T10:13:16.021916+0000","last_clean":"2024-04-23T10:13:16.021916+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:13:16.021916+0000","last_undegraded":"2024-04-23T10:13:16.021916+0000","last_fullsized":"2024-04-23T10:13:16.021916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025938+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:13:16.025938+0000","last_peered":"2024-04-23T10:13:16.025938+0000","last_clean":"2024-04-23T10:13:16.025938+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:13:16.025938+0000","last_undegraded":"2024-04-23T10:13:16.025938+0000","last_fullsized":"2024-04-23T10:13:16.025938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.048154+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:13:20.048154+0000","last_peered":"2024-04-23T10:13:20.048154+0000","last_clean":"2024-04-23T10:13:20.048154+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:13:20.048154+0000","last_undegraded":"2024-04-23T10:13:20.048154+0000","last_fullsized":"2024-04-23T10:13:20.048154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021936+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:13:16.021936+0000","last_peered":"2024-04-23T10:13:16.021936+0000","last_clean":"2024-04-23T10:13:16.021936+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:13:16.021936+0000","last_undegraded":"2024-04-23T10:13:16.021936+0000","last_fullsized":"2024-04-23T10:13:16.021936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022781+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:13:16.022781+0000","last_peered":"2024-04-23T10:13:16.022781+0000","last_clean":"2024-04-23T10:13:16.022781+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:13:16.022781+0000","last_undegraded":"2024-04-23T10:13:16.022781+0000","last_fullsized":"2024-04-23T10:13:16.022781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931819+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:13:16.931819+0000","last_peered":"2024-04-23T10:13:16.931819+0000","last_clean":"2024-04-23T10:13:16.931819+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:13:16.931819+0000","last_undegraded":"2024-04-23T10:13:16.931819+0000","last_fullsized":"2024-04-23T10:13:16.931819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569675+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:13:16.569675+0000","last_peered":"2024-04-23T10:13:16.569675+0000","last_clean":"2024-04-23T10:13:16.569675+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:13:16.569675+0000","last_undegraded":"2024-04-23T10:13:16.569675+0000","last_fullsized":"2024-04-23T10:13:16.569675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029363+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:13:16.029363+0000","last_peered":"2024-04-23T10:13:16.029363+0000","last_clean":"2024-04-23T10:13:16.029363+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:13:16.029363+0000","last_undegraded":"2024-04-23T10:13:16.029363+0000","last_fullsized":"2024-04-23T10:13:16.029363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018319+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:13:16.018319+0000","last_peered":"2024-04-23T10:13:16.018319+0000","last_clean":"2024-04-23T10:13:16.018319+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:13:16.018319+0000","last_undegraded":"2024-04-23T10:13:16.018319+0000","last_fullsized":"2024-04-23T10:13:16.018319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887576+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:13:16.887576+0000","last_peered":"2024-04-23T10:13:16.887576+0000","last_clean":"2024-04-23T10:13:16.887576+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:13:16.887576+0000","last_undegraded":"2024-04-23T10:13:16.887576+0000","last_fullsized":"2024-04-23T10:13:16.887576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024348+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:13:16.024348+0000","last_peered":"2024-04-23T10:13:16.024348+0000","last_clean":"2024-04-23T10:13:16.024348+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:13:16.024348+0000","last_undegraded":"2024-04-23T10:13:16.024348+0000","last_fullsized":"2024-04-23T10:13:16.024348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017388+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:13:16.017388+0000","last_peered":"2024-04-23T10:13:16.017388+0000","last_clean":"2024-04-23T10:13:16.017388+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:13:16.017388+0000","last_undegraded":"2024-04-23T10:13:16.017388+0000","last_fullsized":"2024-04-23T10:13:16.017388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047434+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:13:20.047434+0000","last_peered":"2024-04-23T10:13:20.047434+0000","last_clean":"2024-04-23T10:13:20.047434+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:13:20.047434+0000","last_undegraded":"2024-04-23T10:13:20.047434+0000","last_fullsized":"2024-04-23T10:13:20.047434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889029+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:13:16.889029+0000","last_peered":"2024-04-23T10:13:16.889029+0000","last_clean":"2024-04-23T10:13:16.889029+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:13:16.889029+0000","last_undegraded":"2024-04-23T10:13:16.889029+0000","last_fullsized":"2024-04-23T10:13:16.889029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023383+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:13:16.023383+0000","last_peered":"2024-04-23T10:13:16.023383+0000","last_clean":"2024-04-23T10:13:16.023383+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:13:16.023383+0000","last_undegraded":"2024-04-23T10:13:16.023383+0000","last_fullsized":"2024-04-23T10:13:16.023383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569061+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:13:16.569061+0000","last_peered":"2024-04-23T10:13:16.569061+0000","last_clean":"2024-04-23T10:13:16.569061+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:13:16.569061+0000","last_undegraded":"2024-04-23T10:13:16.569061+0000","last_fullsized":"2024-04-23T10:13:16.569061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024366+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:13:16.024366+0000","last_peered":"2024-04-23T10:13:16.024366+0000","last_clean":"2024-04-23T10:13:16.024366+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:13:16.024366+0000","last_undegraded":"2024-04-23T10:13:16.024366+0000","last_fullsized":"2024-04-23T10:13:16.024366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025541+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:13:16.025541+0000","last_peered":"2024-04-23T10:13:16.025541+0000","last_clean":"2024-04-23T10:13:16.025541+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:13:16.025541+0000","last_undegraded":"2024-04-23T10:13:16.025541+0000","last_fullsized":"2024-04-23T10:13:16.025541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047236+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:13:20.047236+0000","last_peered":"2024-04-23T10:13:20.047236+0000","last_clean":"2024-04-23T10:13:20.047236+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:13:20.047236+0000","last_undegraded":"2024-04-23T10:13:20.047236+0000","last_fullsized":"2024-04-23T10:13:20.047236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023004+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:13:16.023004+0000","last_peered":"2024-04-23T10:13:16.023004+0000","last_clean":"2024-04-23T10:13:16.023004+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:13:16.023004+0000","last_undegraded":"2024-04-23T10:13:16.023004+0000","last_fullsized":"2024-04-23T10:13:16.023004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.572546+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:13:16.572546+0000","last_peered":"2024-04-23T10:13:16.572546+0000","last_clean":"2024-04-23T10:13:16.572546+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:13:16.572546+0000","last_undegraded":"2024-04-23T10:13:16.572546+0000","last_fullsized":"2024-04-23T10:13:16.572546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889277+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:13:16.889277+0000","last_peered":"2024-04-23T10:13:16.889277+0000","last_clean":"2024-04-23T10:13:16.889277+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:13:16.889277+0000","last_undegraded":"2024-04-23T10:13:16.889277+0000","last_fullsized":"2024-04-23T10:13:16.889277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891510+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:13:16.891510+0000","last_peered":"2024-04-23T10:13:16.891510+0000","last_clean":"2024-04-23T10:13:16.891510+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:13:16.891510+0000","last_undegraded":"2024-04-23T10:13:16.891510+0000","last_fullsized":"2024-04-23T10:13:16.891510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889028+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:13:16.889028+0000","last_peered":"2024-04-23T10:13:16.889028+0000","last_clean":"2024-04-23T10:13:16.889028+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:13:16.889028+0000","last_undegraded":"2024-04-23T10:13:16.889028+0000","last_fullsized":"2024-04-23T10:13:16.889028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570186+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:13:16.570186+0000","last_peered":"2024-04-23T10:13:16.570186+0000","last_clean":"2024-04-23T10:13:16.570186+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:13:16.570186+0000","last_undegraded":"2024-04-23T10:13:16.570186+0000","last_fullsized":"2024-04-23T10:13:16.570186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024412+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:13:16.024412+0000","last_peered":"2024-04-23T10:13:16.024412+0000","last_clean":"2024-04-23T10:13:16.024412+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:13:16.024412+0000","last_undegraded":"2024-04-23T10:13:16.024412+0000","last_fullsized":"2024-04-23T10:13:16.024412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021967+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:13:16.021967+0000","last_peered":"2024-04-23T10:13:16.021967+0000","last_clean":"2024-04-23T10:13:16.021967+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:13:16.021967+0000","last_undegraded":"2024-04-23T10:13:16.021967+0000","last_fullsized":"2024-04-23T10:13:16.021967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889344+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:13:16.889344+0000","last_peered":"2024-04-23T10:13:16.889344+0000","last_clean":"2024-04-23T10:13:16.889344+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:13:16.889344+0000","last_undegraded":"2024-04-23T10:13:16.889344+0000","last_fullsized":"2024-04-23T10:13:16.889344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886856+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:13:16.886856+0000","last_peered":"2024-04-23T10:13:16.886856+0000","last_clean":"2024-04-23T10:13:16.886856+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:13:16.886856+0000","last_undegraded":"2024-04-23T10:13:16.886856+0000","last_fullsized":"2024-04-23T10:13:16.886856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024771+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:13:16.024771+0000","last_peered":"2024-04-23T10:13:16.024771+0000","last_clean":"2024-04-23T10:13:16.024771+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:13:16.024771+0000","last_undegraded":"2024-04-23T10:13:16.024771+0000","last_fullsized":"2024-04-23T10:13:16.024771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043830+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:13:20.043830+0000","last_peered":"2024-04-23T10:13:20.043830+0000","last_clean":"2024-04-23T10:13:20.043830+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:13:20.043830+0000","last_undegraded":"2024-04-23T10:13:20.043830+0000","last_fullsized":"2024-04-23T10:13:20.043830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888499+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:13:16.888499+0000","last_peered":"2024-04-23T10:13:16.888499+0000","last_clean":"2024-04-23T10:13:16.888499+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:13:16.888499+0000","last_undegraded":"2024-04-23T10:13:16.888499+0000","last_fullsized":"2024-04-23T10:13:16.888499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887022+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:13:16.887022+0000","last_peered":"2024-04-23T10:13:16.887022+0000","last_clean":"2024-04-23T10:13:16.887022+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:13:16.887022+0000","last_undegraded":"2024-04-23T10:13:16.887022+0000","last_fullsized":"2024-04-23T10:13:16.887022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.040904+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:13:20.040904+0000","last_peered":"2024-04-23T10:13:20.040904+0000","last_clean":"2024-04-23T10:13:20.040904+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:13:20.040904+0000","last_undegraded":"2024-04-23T10:13:20.040904+0000","last_fullsized":"2024-04-23T10:13:20.040904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889168+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:13:16.889168+0000","last_peered":"2024-04-23T10:13:16.889168+0000","last_clean":"2024-04-23T10:13:16.889168+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:13:16.889168+0000","last_undegraded":"2024-04-23T10:13:16.889168+0000","last_fullsized":"2024-04-23T10:13:16.889168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024139+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:13:16.024139+0000","last_peered":"2024-04-23T10:13:16.024139+0000","last_clean":"2024-04-23T10:13:16.024139+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:13:16.024139+0000","last_undegraded":"2024-04-23T10:13:16.024139+0000","last_fullsized":"2024-04-23T10:13:16.024139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569577+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:13:16.569577+0000","last_peered":"2024-04-23T10:13:16.569577+0000","last_clean":"2024-04-23T10:13:16.569577+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:13:16.569577+0000","last_undegraded":"2024-04-23T10:13:16.569577+0000","last_fullsized":"2024-04-23T10:13:16.569577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.574008+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:13:16.574008+0000","last_peered":"2024-04-23T10:13:16.574008+0000","last_clean":"2024-04-23T10:13:16.574008+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:13:16.574008+0000","last_undegraded":"2024-04-23T10:13:16.574008+0000","last_fullsized":"2024-04-23T10:13:16.574008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017537+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:13:16.017537+0000","last_peered":"2024-04-23T10:13:16.017537+0000","last_clean":"2024-04-23T10:13:16.017537+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:13:16.017537+0000","last_undegraded":"2024-04-23T10:13:16.017537+0000","last_fullsized":"2024-04-23T10:13:16.017537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021779+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:13:16.021779+0000","last_peered":"2024-04-23T10:13:16.021779+0000","last_clean":"2024-04-23T10:13:16.021779+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:13:16.021779+0000","last_undegraded":"2024-04-23T10:13:16.021779+0000","last_fullsized":"2024-04-23T10:13:16.021779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569733+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:13:16.569733+0000","last_peered":"2024-04-23T10:13:16.569733+0000","last_clean":"2024-04-23T10:13:16.569733+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:13:16.569733+0000","last_undegraded":"2024-04-23T10:13:16.569733+0000","last_fullsized":"2024-04-23T10:13:16.569733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932370+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:13:16.932370+0000","last_peered":"2024-04-23T10:13:16.932370+0000","last_clean":"2024-04-23T10:13:16.932370+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:13:16.932370+0000","last_undegraded":"2024-04-23T10:13:16.932370+0000","last_fullsized":"2024-04-23T10:13:16.932370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569024+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:13:16.569024+0000","last_peered":"2024-04-23T10:13:16.569024+0000","last_clean":"2024-04-23T10:13:16.569024+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:13:16.569024+0000","last_undegraded":"2024-04-23T10:13:16.569024+0000","last_fullsized":"2024-04-23T10:13:16.569024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021712+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:13:16.021712+0000","last_peered":"2024-04-23T10:13:16.021712+0000","last_clean":"2024-04-23T10:13:16.021712+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:13:16.021712+0000","last_undegraded":"2024-04-23T10:13:16.021712+0000","last_fullsized":"2024-04-23T10:13:16.021712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931725+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:13:16.931725+0000","last_peered":"2024-04-23T10:13:16.931725+0000","last_clean":"2024-04-23T10:13:16.931725+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:13:16.931725+0000","last_undegraded":"2024-04-23T10:13:16.931725+0000","last_fullsized":"2024-04-23T10:13:16.931725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022224+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:13:16.022224+0000","last_peered":"2024-04-23T10:13:16.022224+0000","last_clean":"2024-04-23T10:13:16.022224+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:13:16.022224+0000","last_undegraded":"2024-04-23T10:13:16.022224+0000","last_fullsized":"2024-04-23T10:13:16.022224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888952+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:13:16.888952+0000","last_peered":"2024-04-23T10:13:16.888952+0000","last_clean":"2024-04-23T10:13:16.888952+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:13:16.888952+0000","last_undegraded":"2024-04-23T10:13:16.888952+0000","last_fullsized":"2024-04-23T10:13:16.888952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024715+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:13:16.024715+0000","last_peered":"2024-04-23T10:13:16.024715+0000","last_clean":"2024-04-23T10:13:16.024715+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:13:16.024715+0000","last_undegraded":"2024-04-23T10:13:16.024715+0000","last_fullsized":"2024-04-23T10:13:16.024715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570090+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:13:16.570090+0000","last_peered":"2024-04-23T10:13:16.570090+0000","last_clean":"2024-04-23T10:13:16.570090+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:13:16.570090+0000","last_undegraded":"2024-04-23T10:13:16.570090+0000","last_fullsized":"2024-04-23T10:13:16.570090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.041591+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:13:20.041591+0000","last_peered":"2024-04-23T10:13:20.041591+0000","last_clean":"2024-04-23T10:13:20.041591+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:13:20.041591+0000","last_undegraded":"2024-04-23T10:13:20.041591+0000","last_fullsized":"2024-04-23T10:13:20.041591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020888+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:13:16.020888+0000","last_peered":"2024-04-23T10:13:16.020888+0000","last_clean":"2024-04-23T10:13:16.020888+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:13:16.020888+0000","last_undegraded":"2024-04-23T10:13:16.020888+0000","last_fullsized":"2024-04-23T10:13:16.020888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569592+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:13:16.569592+0000","last_peered":"2024-04-23T10:13:16.569592+0000","last_clean":"2024-04-23T10:13:16.569592+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:13:16.569592+0000","last_undegraded":"2024-04-23T10:13:16.569592+0000","last_fullsized":"2024-04-23T10:13:16.569592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024919+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:13:16.024919+0000","last_peered":"2024-04-23T10:13:16.024919+0000","last_clean":"2024-04-23T10:13:16.024919+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:13:16.024919+0000","last_undegraded":"2024-04-23T10:13:16.024919+0000","last_fullsized":"2024-04-23T10:13:16.024919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019854+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:13:16.019854+0000","last_peered":"2024-04-23T10:13:16.019854+0000","last_clean":"2024-04-23T10:13:16.019854+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:13:16.019854+0000","last_undegraded":"2024-04-23T10:13:16.019854+0000","last_fullsized":"2024-04-23T10:13:16.019854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569940+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:13:16.569940+0000","last_peered":"2024-04-23T10:13:16.569940+0000","last_clean":"2024-04-23T10:13:16.569940+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:13:16.569940+0000","last_undegraded":"2024-04-23T10:13:16.569940+0000","last_fullsized":"2024-04-23T10:13:16.569940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021026+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:13:16.021026+0000","last_peered":"2024-04-23T10:13:16.021026+0000","last_clean":"2024-04-23T10:13:16.021026+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:13:16.021026+0000","last_undegraded":"2024-04-23T10:13:16.021026+0000","last_fullsized":"2024-04-23T10:13:16.021026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024747+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:13:16.024747+0000","last_peered":"2024-04-23T10:13:16.024747+0000","last_clean":"2024-04-23T10:13:16.024747+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:13:16.024747+0000","last_undegraded":"2024-04-23T10:13:16.024747+0000","last_fullsized":"2024-04-23T10:13:16.024747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932091+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:13:16.932091+0000","last_peered":"2024-04-23T10:13:16.932091+0000","last_clean":"2024-04-23T10:13:16.932091+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:13:16.932091+0000","last_undegraded":"2024-04-23T10:13:16.932091+0000","last_fullsized":"2024-04-23T10:13:16.932091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932214+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:13:16.932214+0000","last_peered":"2024-04-23T10:13:16.932214+0000","last_clean":"2024-04-23T10:13:16.932214+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:13:16.932214+0000","last_undegraded":"2024-04-23T10:13:16.932214+0000","last_fullsized":"2024-04-23T10:13:16.932214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019066+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:13:16.019066+0000","last_peered":"2024-04-23T10:13:16.019066+0000","last_clean":"2024-04-23T10:13:16.019066+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:13:16.019066+0000","last_undegraded":"2024-04-23T10:13:16.019066+0000","last_fullsized":"2024-04-23T10:13:16.019066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569434+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:13:16.569434+0000","last_peered":"2024-04-23T10:13:16.569434+0000","last_clean":"2024-04-23T10:13:16.569434+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:13:16.569434+0000","last_undegraded":"2024-04-23T10:13:16.569434+0000","last_fullsized":"2024-04-23T10:13:16.569434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021371+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:13:16.021371+0000","last_peered":"2024-04-23T10:13:16.021371+0000","last_clean":"2024-04-23T10:13:16.021371+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:13:16.021371+0000","last_undegraded":"2024-04-23T10:13:16.021371+0000","last_fullsized":"2024-04-23T10:13:16.021371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018636+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:13:16.018636+0000","last_peered":"2024-04-23T10:13:16.018636+0000","last_clean":"2024-04-23T10:13:16.018636+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:13:16.018636+0000","last_undegraded":"2024-04-23T10:13:16.018636+0000","last_fullsized":"2024-04-23T10:13:16.018636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024461+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:13:16.024461+0000","last_peered":"2024-04-23T10:13:16.024461+0000","last_clean":"2024-04-23T10:13:16.024461+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:13:16.024461+0000","last_undegraded":"2024-04-23T10:13:16.024461+0000","last_fullsized":"2024-04-23T10:13:16.024461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043352+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:13:20.043352+0000","last_peered":"2024-04-23T10:13:20.043352+0000","last_clean":"2024-04-23T10:13:20.043352+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:13:20.043352+0000","last_undegraded":"2024-04-23T10:13:20.043352+0000","last_fullsized":"2024-04-23T10:13:20.043352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021878+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:13:16.021878+0000","last_peered":"2024-04-23T10:13:16.021878+0000","last_clean":"2024-04-23T10:13:16.021878+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:13:16.021878+0000","last_undegraded":"2024-04-23T10:13:16.021878+0000","last_fullsized":"2024-04-23T10:13:16.021878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570096+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:13:16.570096+0000","last_peered":"2024-04-23T10:13:16.570096+0000","last_clean":"2024-04-23T10:13:16.570096+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:13:16.570096+0000","last_undegraded":"2024-04-23T10:13:16.570096+0000","last_fullsized":"2024-04-23T10:13:16.570096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:28.628833+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:13:28.628833+0000","last_peered":"2024-04-23T10:13:28.628833+0000","last_clean":"2024-04-23T10:13:28.628833+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:13:28.628833+0000","last_undegraded":"2024-04-23T10:13:28.628833+0000","last_fullsized":"2024-04-23T10:13:28.628833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887133+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:13:16.887133+0000","last_peered":"2024-04-23T10:13:16.887133+0000","last_clean":"2024-04-23T10:13:16.887133+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:13:16.887133+0000","last_undegraded":"2024-04-23T10:13:16.887133+0000","last_fullsized":"2024-04-23T10:13:16.887133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025287+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:13:16.025287+0000","last_peered":"2024-04-23T10:13:16.025287+0000","last_clean":"2024-04-23T10:13:16.025287+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:13:16.025287+0000","last_undegraded":"2024-04-23T10:13:16.025287+0000","last_fullsized":"2024-04-23T10:13:16.025287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888751+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:13:16.888751+0000","last_peered":"2024-04-23T10:13:16.888751+0000","last_clean":"2024-04-23T10:13:16.888751+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:13:16.888751+0000","last_undegraded":"2024-04-23T10:13:16.888751+0000","last_fullsized":"2024-04-23T10:13:16.888751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023945+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:13:16.023945+0000","last_peered":"2024-04-23T10:13:16.023945+0000","last_clean":"2024-04-23T10:13:16.023945+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:13:16.023945+0000","last_undegraded":"2024-04-23T10:13:16.023945+0000","last_fullsized":"2024-04-23T10:13:16.023945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891269+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:13:16.891269+0000","last_peered":"2024-04-23T10:13:16.891269+0000","last_clean":"2024-04-23T10:13:16.891269+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:13:16.891269+0000","last_undegraded":"2024-04-23T10:13:16.891269+0000","last_fullsized":"2024-04-23T10:13:16.891269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046189+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:13:20.046189+0000","last_peered":"2024-04-23T10:13:20.046189+0000","last_clean":"2024-04-23T10:13:20.046189+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:13:20.046189+0000","last_undegraded":"2024-04-23T10:13:20.046189+0000","last_fullsized":"2024-04-23T10:13:20.046189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017213+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:13:16.017213+0000","last_peered":"2024-04-23T10:13:16.017213+0000","last_clean":"2024-04-23T10:13:16.017213+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:13:16.017213+0000","last_undegraded":"2024-04-23T10:13:16.017213+0000","last_fullsized":"2024-04-23T10:13:16.017213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022505+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:13:16.022505+0000","last_peered":"2024-04-23T10:13:16.022505+0000","last_clean":"2024-04-23T10:13:16.022505+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:13:16.022505+0000","last_undegraded":"2024-04-23T10:13:16.022505+0000","last_fullsized":"2024-04-23T10:13:16.022505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.933003+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:13:16.933003+0000","last_peered":"2024-04-23T10:13:16.933003+0000","last_clean":"2024-04-23T10:13:16.933003+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:13:16.933003+0000","last_undegraded":"2024-04-23T10:13:16.933003+0000","last_fullsized":"2024-04-23T10:13:16.933003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017176+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:13:16.017176+0000","last_peered":"2024-04-23T10:13:16.017176+0000","last_clean":"2024-04-23T10:13:16.017176+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:13:16.017176+0000","last_undegraded":"2024-04-23T10:13:16.017176+0000","last_fullsized":"2024-04-23T10:13:16.017176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024581+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:13:16.024581+0000","last_peered":"2024-04-23T10:13:16.024581+0000","last_clean":"2024-04-23T10:13:16.024581+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:13:16.024581+0000","last_undegraded":"2024-04-23T10:13:16.024581+0000","last_fullsized":"2024-04-23T10:13:16.024581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886778+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:13:16.886778+0000","last_peered":"2024-04-23T10:13:16.886778+0000","last_clean":"2024-04-23T10:13:16.886778+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:13:16.886778+0000","last_undegraded":"2024-04-23T10:13:16.886778+0000","last_fullsized":"2024-04-23T10:13:16.886778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022144+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:13:16.022144+0000","last_peered":"2024-04-23T10:13:16.022144+0000","last_clean":"2024-04-23T10:13:16.022144+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:13:16.022144+0000","last_undegraded":"2024-04-23T10:13:16.022144+0000","last_fullsized":"2024-04-23T10:13:16.022144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932630+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:13:16.932630+0000","last_peered":"2024-04-23T10:13:16.932630+0000","last_clean":"2024-04-23T10:13:16.932630+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:13:16.932630+0000","last_undegraded":"2024-04-23T10:13:16.932630+0000","last_fullsized":"2024-04-23T10:13:16.932630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029183+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:13:16.029183+0000","last_peered":"2024-04-23T10:13:16.029183+0000","last_clean":"2024-04-23T10:13:16.029183+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:13:16.029183+0000","last_undegraded":"2024-04-23T10:13:16.029183+0000","last_fullsized":"2024-04-23T10:13:16.029183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:13:16.017565+0000","last_peered":"2024-04-23T10:13:16.017565+0000","last_clean":"2024-04-23T10:13:16.017565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:13:16.017565+0000","last_undegraded":"2024-04-23T10:13:16.017565+0000","last_fullsized":"2024-04-23T10:13:16.017565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931915+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:13:16.931915+0000","last_peered":"2024-04-23T10:13:16.931915+0000","last_clean":"2024-04-23T10:13:16.931915+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:13:16.931915+0000","last_undegraded":"2024-04-23T10:13:16.931915+0000","last_fullsized":"2024-04-23T10:13:16.931915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024846+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:13:16.024846+0000","last_peered":"2024-04-23T10:13:16.024846+0000","last_clean":"2024-04-23T10:13:16.024846+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:13:16.024846+0000","last_undegraded":"2024-04-23T10:13:16.024846+0000","last_fullsized":"2024-04-23T10:13:16.024846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021473+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:13:16.021473+0000","last_peered":"2024-04-23T10:13:16.021473+0000","last_clean":"2024-04-23T10:13:16.021473+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:13:16.021473+0000","last_undegraded":"2024-04-23T10:13:16.021473+0000","last_fullsized":"2024-04-23T10:13:16.021473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018439+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:13:16.018439+0000","last_peered":"2024-04-23T10:13:16.018439+0000","last_clean":"2024-04-23T10:13:16.018439+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:13:16.018439+0000","last_undegraded":"2024-04-23T10:13:16.018439+0000","last_fullsized":"2024-04-23T10:13:16.018439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023744+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:13:16.023744+0000","last_peered":"2024-04-23T10:13:16.023744+0000","last_clean":"2024-04-23T10:13:16.023744+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:13:16.023744+0000","last_undegraded":"2024-04-23T10:13:16.023744+0000","last_fullsized":"2024-04-23T10:13:16.023744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.027505+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:13:16.027505+0000","last_peered":"2024-04-23T10:13:16.027505+0000","last_clean":"2024-04-23T10:13:16.027505+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:13:16.027505+0000","last_undegraded":"2024-04-23T10:13:16.027505+0000","last_fullsized":"2024-04-23T10:13:16.027505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931744+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:13:16.931744+0000","last_peered":"2024-04-23T10:13:16.931744+0000","last_clean":"2024-04-23T10:13:16.931744+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:13:16.931744+0000","last_undegraded":"2024-04-23T10:13:16.931744+0000","last_fullsized":"2024-04-23T10:13:16.931744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021237+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:13:16.021237+0000","last_peered":"2024-04-23T10:13:16.021237+0000","last_clean":"2024-04-23T10:13:16.021237+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:13:16.021237+0000","last_undegraded":"2024-04-23T10:13:16.021237+0000","last_fullsized":"2024-04-23T10:13:16.021237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021239+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:13:16.021239+0000","last_peered":"2024-04-23T10:13:16.021239+0000","last_clean":"2024-04-23T10:13:16.021239+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:13:16.021239+0000","last_undegraded":"2024-04-23T10:13:16.021239+0000","last_fullsized":"2024-04-23T10:13:16.021239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024751+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:13:16.024751+0000","last_peered":"2024-04-23T10:13:16.024751+0000","last_clean":"2024-04-23T10:13:16.024751+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:13:16.024751+0000","last_undegraded":"2024-04-23T10:13:16.024751+0000","last_fullsized":"2024-04-23T10:13:16.024751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018890+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:13:16.018890+0000","last_peered":"2024-04-23T10:13:16.018890+0000","last_clean":"2024-04-23T10:13:16.018890+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:13:16.018890+0000","last_undegraded":"2024-04-23T10:13:16.018890+0000","last_fullsized":"2024-04-23T10:13:16.018890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888505+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:13:16.888505+0000","last_peered":"2024-04-23T10:13:16.888505+0000","last_clean":"2024-04-23T10:13:16.888505+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:13:16.888505+0000","last_undegraded":"2024-04-23T10:13:16.888505+0000","last_fullsized":"2024-04-23T10:13:16.888505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932655+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:13:16.932655+0000","last_peered":"2024-04-23T10:13:16.932655+0000","last_clean":"2024-04-23T10:13:16.932655+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:13:16.932655+0000","last_undegraded":"2024-04-23T10:13:16.932655+0000","last_fullsized":"2024-04-23T10:13:16.932655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019178+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:13:16.019178+0000","last_peered":"2024-04-23T10:13:16.019178+0000","last_clean":"2024-04-23T10:13:16.019178+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:13:16.019178+0000","last_undegraded":"2024-04-23T10:13:16.019178+0000","last_fullsized":"2024-04-23T10:13:16.019178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021724+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:13:16.021724+0000","last_peered":"2024-04-23T10:13:16.021724+0000","last_clean":"2024-04-23T10:13:16.021724+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:13:16.021724+0000","last_undegraded":"2024-04-23T10:13:16.021724+0000","last_fullsized":"2024-04-23T10:13:16.021724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017320+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:13:16.017320+0000","last_peered":"2024-04-23T10:13:16.017320+0000","last_clean":"2024-04-23T10:13:16.017320+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:13:16.017320+0000","last_undegraded":"2024-04-23T10:13:16.017320+0000","last_fullsized":"2024-04-23T10:13:16.017320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021273+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:13:16.021273+0000","last_peered":"2024-04-23T10:13:16.021273+0000","last_clean":"2024-04-23T10:13:16.021273+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:13:16.021273+0000","last_undegraded":"2024-04-23T10:13:16.021273+0000","last_fullsized":"2024-04-23T10:13:16.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024565+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:13:16.024565+0000","last_peered":"2024-04-23T10:13:16.024565+0000","last_clean":"2024-04-23T10:13:16.024565+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:13:16.024565+0000","last_undegraded":"2024-04-23T10:13:16.024565+0000","last_fullsized":"2024-04-23T10:13:16.024565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932257+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:13:16.932257+0000","last_peered":"2024-04-23T10:13:16.932257+0000","last_clean":"2024-04-23T10:13:16.932257+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:13:16.932257+0000","last_undegraded":"2024-04-23T10:13:16.932257+0000","last_fullsized":"2024-04-23T10:13:16.932257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569748+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:13:16.569748+0000","last_peered":"2024-04-23T10:13:16.569748+0000","last_clean":"2024-04-23T10:13:16.569748+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:13:16.569748+0000","last_undegraded":"2024-04-23T10:13:16.569748+0000","last_fullsized":"2024-04-23T10:13:16.569748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021598+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:13:16.021598+0000","last_peered":"2024-04-23T10:13:16.021598+0000","last_clean":"2024-04-23T10:13:16.021598+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:13:16.021598+0000","last_undegraded":"2024-04-23T10:13:16.021598+0000","last_fullsized":"2024-04-23T10:13:16.021598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022975+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:13:16.022975+0000","last_peered":"2024-04-23T10:13:16.022975+0000","last_clean":"2024-04-23T10:13:16.022975+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:13:16.022975+0000","last_undegraded":"2024-04-23T10:13:16.022975+0000","last_fullsized":"2024-04-23T10:13:16.022975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.028684+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:13:16.028684+0000","last_peered":"2024-04-23T10:13:16.028684+0000","last_clean":"2024-04-23T10:13:16.028684+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:13:16.028684+0000","last_undegraded":"2024-04-23T10:13:16.028684+0000","last_fullsized":"2024-04-23T10:13:16.028684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887057+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:13:16.887057+0000","last_peered":"2024-04-23T10:13:16.887057+0000","last_clean":"2024-04-23T10:13:16.887057+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:13:16.887057+0000","last_undegraded":"2024-04-23T10:13:16.887057+0000","last_fullsized":"2024-04-23T10:13:16.887057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024410+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:13:16.024410+0000","last_peered":"2024-04-23T10:13:16.024410+0000","last_clean":"2024-04-23T10:13:16.024410+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:13:16.024410+0000","last_undegraded":"2024-04-23T10:13:16.024410+0000","last_fullsized":"2024-04-23T10:13:16.024410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018218+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:13:16.018218+0000","last_peered":"2024-04-23T10:13:16.018218+0000","last_clean":"2024-04-23T10:13:16.018218+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:13:16.018218+0000","last_undegraded":"2024-04-23T10:13:16.018218+0000","last_fullsized":"2024-04-23T10:13:16.018218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025006+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:13:16.025006+0000","last_peered":"2024-04-23T10:13:16.025006+0000","last_clean":"2024-04-23T10:13:16.025006+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:13:16.025006+0000","last_undegraded":"2024-04-23T10:13:16.025006+0000","last_fullsized":"2024-04-23T10:13:16.025006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932289+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:13:16.932289+0000","last_peered":"2024-04-23T10:13:16.932289+0000","last_clean":"2024-04-23T10:13:16.932289+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:13:16.932289+0000","last_undegraded":"2024-04-23T10:13:16.932289+0000","last_fullsized":"2024-04-23T10:13:16.932289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932585+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:13:16.932585+0000","last_peered":"2024-04-23T10:13:16.932585+0000","last_clean":"2024-04-23T10:13:16.932585+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:13:16.932585+0000","last_undegraded":"2024-04-23T10:13:16.932585+0000","last_fullsized":"2024-04-23T10:13:16.932585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570022+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:13:16.570022+0000","last_peered":"2024-04-23T10:13:16.570022+0000","last_clean":"2024-04-23T10:13:16.570022+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:13:16.570022+0000","last_undegraded":"2024-04-23T10:13:16.570022+0000","last_fullsized":"2024-04-23T10:13:16.570022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017199+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:13:16.017199+0000","last_peered":"2024-04-23T10:13:16.017199+0000","last_clean":"2024-04-23T10:13:16.017199+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:13:16.017199+0000","last_undegraded":"2024-04-23T10:13:16.017199+0000","last_fullsized":"2024-04-23T10:13:16.017199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569870+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:13:16.569870+0000","last_peered":"2024-04-23T10:13:16.569870+0000","last_clean":"2024-04-23T10:13:16.569870+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:13:16.569870+0000","last_undegraded":"2024-04-23T10:13:16.569870+0000","last_fullsized":"2024-04-23T10:13:16.569870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021154+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:13:16.021154+0000","last_peered":"2024-04-23T10:13:16.021154+0000","last_clean":"2024-04-23T10:13:16.021154+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:13:16.021154+0000","last_undegraded":"2024-04-23T10:13:16.021154+0000","last_fullsized":"2024-04-23T10:13:16.021154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.568995+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:13:16.568995+0000","last_peered":"2024-04-23T10:13:16.568995+0000","last_clean":"2024-04-23T10:13:16.568995+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:13:16.568995+0000","last_undegraded":"2024-04-23T10:13:16.568995+0000","last_fullsized":"2024-04-23T10:13:16.568995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021733+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:13:16.021733+0000","last_peered":"2024-04-23T10:13:16.021733+0000","last_clean":"2024-04-23T10:13:16.021733+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:13:16.021733+0000","last_undegraded":"2024-04-23T10:13:16.021733+0000","last_fullsized":"2024-04-23T10:13:16.021733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024566+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:13:16.024566+0000","last_peered":"2024-04-23T10:13:16.024566+0000","last_clean":"2024-04-23T10:13:16.024566+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:13:16.024566+0000","last_undegraded":"2024-04-23T10:13:16.024566+0000","last_fullsized":"2024-04-23T10:13:16.024566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889699+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:13:16.889699+0000","last_peered":"2024-04-23T10:13:16.889699+0000","last_clean":"2024-04-23T10:13:16.889699+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:13:16.889699+0000","last_undegraded":"2024-04-23T10:13:16.889699+0000","last_fullsized":"2024-04-23T10:13:16.889699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569674+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:13:16.569674+0000","last_peered":"2024-04-23T10:13:16.569674+0000","last_clean":"2024-04-23T10:13:16.569674+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:13:16.569674+0000","last_undegraded":"2024-04-23T10:13:16.569674+0000","last_fullsized":"2024-04-23T10:13:16.569674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:34.168 INFO:tasks.quiescer.ceph_manager:clean! 2024-04-23T10:13:34.169 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:13:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.329+0000 7f9b263d2640 1 Processor -- start 2024-04-23T10:13:34.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.329+0000 7f9b263d2640 1 -- start start 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b263d2640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9b2014ffa0 0x7f9b2006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b263d2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b200c5d70 con 0x7f9b2014fbc0 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b263d2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9b200c6050 con 0x7f9b20074100 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b263d2640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9b200c6330 con 0x7f9b2014ffa0 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9b2014fbc0 0x7f9b200c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49748/0 (socket says 172.21.15.26:49748) 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1ffff640 1 -- 172.21.15.26:0/2941354824 learned_addr learned my addr 172.21.15.26:0/2941354824 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:34.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/2941354824 >> v2:172.21.15.190:3300/0 conn(0x7f9b2014ffa0 0x7f9b2006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1581350349 0 0) 0x7f9b200c5d70 con 0x7f9b2014fbc0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9b08003530 con 0x7f9b2014fbc0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1387492195 0 0) 0x7f9b08003530 con 0x7f9b2014fbc0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 >> v2:172.21.15.190:3300/0 conn(0x7f9b2014ffa0 msgr2=0x7f9b2006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 --2- 172.21.15.26:0/2941354824 >> v2:172.21.15.190:3300/0 conn(0x7f9b2014ffa0 0x7f9b2006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 >> v1:172.21.15.190:6789/0 conn(0x7f9b20074100 legacy=0x7f9b200c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b200c6610 con 0x7f9b2014fbc0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f9b18001680 con 0x7f9b2014fbc0 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 >> v1:172.21.15.26:6789/0 conn(0x7f9b2014fbc0 legacy=0x7f9b200c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b080039c0 0x7f9b08003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 0x7f9b08004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b080051d0 0x7f9b0800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200c6330 con 0x7f9b08004810 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b0800c070 con 0x7f9b080051d0 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b0800c270 con 0x7f9b080039c0 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 0x7f9b08004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b080039c0 msgr2=0x7f9b08003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b2496f640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b080051d0 0x7f9b0800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1ffff640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b080039c0 0x7f9b08003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b080039c0 0x7f9b08003de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b080051d0 msgr2=0x7f9b0800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b080051d0 0x7f9b0800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/2941354824 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b08003530 con 0x7f9b08004810 2024-04-23T10:13:34.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b2496f640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b080051d0 0x7f9b0800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:34.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.333+0000 7f9b2496f640 1 -- 172.21.15.26:0/2941354824 reap_dead start 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 0x7f9b08004c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009ae0 tx=0x7f9b1401ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d1ed9f4a473692dc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140b2070 con 0x7f9b08004810 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b140a5660 con 0x7f9b08004810 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1effd640 1 -- 172.21.15.26:0/2941354824 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140096b0 con 0x7f9b08004810 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 msgr2=0x7f9b08004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 0x7f9b08004c90 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f9b14009ae0 tx=0x7f9b1401ca70 comp rx=0 tx=0).stop 2024-04-23T10:13:34.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/2941354824 shutdown_connections 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 --2- 172.21.15.26:0/2941354824 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b08004810 0x7f9b08004c90 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/2941354824 >> 172.21.15.26:0/2941354824 conn(0x7f9b2006b9d0 msgr2=0x7f9b2006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/2941354824 shutdown_connections 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/2941354824 wait complete. 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 Processor -- start 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- start start 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b08004810 0x7f9b20152060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20149a30 0x7f9b20149eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9b20068350 con 0x7f9b201ef6d0 2024-04-23T10:13:34.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9b200681d0 con 0x7f9b20149a30 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9b2006f700 con 0x7f9b08004810 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49634/0 (socket says 172.21.15.26:49634) 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/4080134633 learned_addr learned my addr 172.21.15.26:0/4080134633 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b08004810 msgr2=0x7f9b20152060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b08004810 0x7f9b20152060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20149a30 msgr2=0x7f9b20149eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20149a30 0x7f9b20149eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 -- 172.21.15.26:0/4080134633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9b2014a3f0 con 0x7f9b201ef6d0 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1f7fe640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b0040 tx=0x7f9b14019810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140b2040 con 0x7f9b201ef6d0 2024-04-23T10:13:34.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9b14004020 con 0x7f9b201ef6d0 2024-04-23T10:13:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9b20152780 con 0x7f9b201ef6d0 2024-04-23T10:13:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9b140096b0 con 0x7f9b201ef6d0 2024-04-23T10:13:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.337+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9b201503c0 con 0x7f9b201ef6d0 2024-04-23T10:13:34.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9b20075df0 con 0x7f9b201ef6d0 2024-04-23T10:13:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9b140bf060 con 0x7f9b201ef6d0 2024-04-23T10:13:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b1cff9640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 0x7f9b0c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9b14120940 con 0x7f9b201ef6d0 2024-04-23T10:13:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b1ffff640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 0x7f9b0c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.341+0000 7f9b1ffff640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 0x7f9b0c06a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b180017f0 tx=0x7f9b180011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.345+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9b14016780 con 0x7f9b201ef6d0 2024-04-23T10:13:34.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.497+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9b2014a5e0 con 0x7f9b0c0683b0 2024-04-23T10:13:34.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.521+0000 7f9b1cff9640 1 -- 172.21.15.26:0/4080134633 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+332694 (secure 0 0 0) 0x7f9b2014a5e0 con 0x7f9b0c0683b0 2024-04-23T10:13:34.525 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:34.527 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:13:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 msgr2=0x7f9b0c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 0x7f9b0c06a870 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f9b180017f0 tx=0x7f9b180011a0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 msgr2=0x7f9b201e5af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7f9b140b0040 tx=0x7f9b14019810 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 shutdown_connections 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9b0c0683b0 0x7f9b0c06a870 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9b20149a30 0x7f9b20149eb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9b201ef6d0 0x7f9b201e5af0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 --2- 172.21.15.26:0/4080134633 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9b08004810 0x7f9b20152060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 >> 172.21.15.26:0/4080134633 conn(0x7f9b2006b9d0 msgr2=0x7f9b2014dc20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 shutdown_connections 2024-04-23T10:13:34.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.525+0000 7f9b263d2640 1 -- 172.21.15.26:0/4080134633 wait complete. 2024-04-23T10:13:34.542 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":55,"stamp":"2024-04-23T10:13:32.935395+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":602396,"num_objects":100,"num_object_clones":0,"num_object_copies":200,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":100,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":374,"num_write_kb":2489,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":306,"ondisk_log_size":306,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":236360,"kb_used_data":3592,"kb_used_omap":12,"kb_used_meta":232691,"kb_avail":754738360,"statfs":{"total":773094113280,"available":772852080640,"internally_reserved":0,"allocated":3678208,"data_stored":2120376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":238276144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3170,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":48,"num_write_kb":19,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":14,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.004516"},"pg_stats":[{"pgid":"2.1f","version":"26'13","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046610+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:13:20.046610+0000","last_peered":"2024-04-23T10:13:20.046610+0000","last_clean":"2024-04-23T10:13:20.046610+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:13:20.046610+0000","last_undegraded":"2024-04-23T10:13:20.046610+0000","last_fullsized":"2024-04-23T10:13:20.046610+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019065+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:13:16.019065+0000","last_peered":"2024-04-23T10:13:16.019065+0000","last_clean":"2024-04-23T10:13:16.019065+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:13:16.019065+0000","last_undegraded":"2024-04-23T10:13:16.019065+0000","last_fullsized":"2024-04-23T10:13:16.019065+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017119+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:13:16.017119+0000","last_peered":"2024-04-23T10:13:16.017119+0000","last_clean":"2024-04-23T10:13:16.017119+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:13:16.017119+0000","last_undegraded":"2024-04-23T10:13:16.017119+0000","last_fullsized":"2024-04-23T10:13:16.017119+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"24'2","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019233+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:13:16.019233+0000","last_peered":"2024-04-23T10:13:16.019233+0000","last_clean":"2024-04-23T10:13:16.019233+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:13:16.019233+0000","last_undegraded":"2024-04-23T10:13:16.019233+0000","last_fullsized":"2024-04-23T10:13:16.019233+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024766+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:13:16.024766+0000","last_peered":"2024-04-23T10:13:16.024766+0000","last_clean":"2024-04-23T10:13:16.024766+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:13:16.024766+0000","last_undegraded":"2024-04-23T10:13:16.024766+0000","last_fullsized":"2024-04-23T10:13:16.024766+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020029+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:13:16.020029+0000","last_peered":"2024-04-23T10:13:16.020029+0000","last_clean":"2024-04-23T10:13:16.020029+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:13:16.020029+0000","last_undegraded":"2024-04-23T10:13:16.020029+0000","last_fullsized":"2024-04-23T10:13:16.020029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'12","reported_seq":38,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.045304+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:13:20.045304+0000","last_peered":"2024-04-23T10:13:20.045304+0000","last_clean":"2024-04-23T10:13:20.045304+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:13:20.045304+0000","last_undegraded":"2024-04-23T10:13:20.045304+0000","last_fullsized":"2024-04-23T10:13:20.045304+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021916+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:13:16.021916+0000","last_peered":"2024-04-23T10:13:16.021916+0000","last_clean":"2024-04-23T10:13:16.021916+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:13:16.021916+0000","last_undegraded":"2024-04-23T10:13:16.021916+0000","last_fullsized":"2024-04-23T10:13:16.021916+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025938+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:13:16.025938+0000","last_peered":"2024-04-23T10:13:16.025938+0000","last_clean":"2024-04-23T10:13:16.025938+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:13:16.025938+0000","last_undegraded":"2024-04-23T10:13:16.025938+0000","last_fullsized":"2024-04-23T10:13:16.025938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.048154+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:13:20.048154+0000","last_peered":"2024-04-23T10:13:20.048154+0000","last_clean":"2024-04-23T10:13:20.048154+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:13:20.048154+0000","last_undegraded":"2024-04-23T10:13:20.048154+0000","last_fullsized":"2024-04-23T10:13:20.048154+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021936+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:13:16.021936+0000","last_peered":"2024-04-23T10:13:16.021936+0000","last_clean":"2024-04-23T10:13:16.021936+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:13:16.021936+0000","last_undegraded":"2024-04-23T10:13:16.021936+0000","last_fullsized":"2024-04-23T10:13:16.021936+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022781+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:13:16.022781+0000","last_peered":"2024-04-23T10:13:16.022781+0000","last_clean":"2024-04-23T10:13:16.022781+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:13:16.022781+0000","last_undegraded":"2024-04-23T10:13:16.022781+0000","last_fullsized":"2024-04-23T10:13:16.022781+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931819+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:13:16.931819+0000","last_peered":"2024-04-23T10:13:16.931819+0000","last_clean":"2024-04-23T10:13:16.931819+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:13:16.931819+0000","last_undegraded":"2024-04-23T10:13:16.931819+0000","last_fullsized":"2024-04-23T10:13:16.931819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"24'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569675+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:13:16.569675+0000","last_peered":"2024-04-23T10:13:16.569675+0000","last_clean":"2024-04-23T10:13:16.569675+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:13:16.569675+0000","last_undegraded":"2024-04-23T10:13:16.569675+0000","last_fullsized":"2024-04-23T10:13:16.569675+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029363+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:13:16.029363+0000","last_peered":"2024-04-23T10:13:16.029363+0000","last_clean":"2024-04-23T10:13:16.029363+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:13:16.029363+0000","last_undegraded":"2024-04-23T10:13:16.029363+0000","last_fullsized":"2024-04-23T10:13:16.029363+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018319+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:13:16.018319+0000","last_peered":"2024-04-23T10:13:16.018319+0000","last_clean":"2024-04-23T10:13:16.018319+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:13:16.018319+0000","last_undegraded":"2024-04-23T10:13:16.018319+0000","last_fullsized":"2024-04-23T10:13:16.018319+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887576+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:13:16.887576+0000","last_peered":"2024-04-23T10:13:16.887576+0000","last_clean":"2024-04-23T10:13:16.887576+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:13:16.887576+0000","last_undegraded":"2024-04-23T10:13:16.887576+0000","last_fullsized":"2024-04-23T10:13:16.887576+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024348+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:13:16.024348+0000","last_peered":"2024-04-23T10:13:16.024348+0000","last_clean":"2024-04-23T10:13:16.024348+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:13:16.024348+0000","last_undegraded":"2024-04-23T10:13:16.024348+0000","last_fullsized":"2024-04-23T10:13:16.024348+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017388+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:13:16.017388+0000","last_peered":"2024-04-23T10:13:16.017388+0000","last_clean":"2024-04-23T10:13:16.017388+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:13:16.017388+0000","last_undegraded":"2024-04-23T10:13:16.017388+0000","last_fullsized":"2024-04-23T10:13:16.017388+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047434+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:13:20.047434+0000","last_peered":"2024-04-23T10:13:20.047434+0000","last_clean":"2024-04-23T10:13:20.047434+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:13:20.047434+0000","last_undegraded":"2024-04-23T10:13:20.047434+0000","last_fullsized":"2024-04-23T10:13:20.047434+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889029+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:13:16.889029+0000","last_peered":"2024-04-23T10:13:16.889029+0000","last_clean":"2024-04-23T10:13:16.889029+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:13:16.889029+0000","last_undegraded":"2024-04-23T10:13:16.889029+0000","last_fullsized":"2024-04-23T10:13:16.889029+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023383+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:13:16.023383+0000","last_peered":"2024-04-23T10:13:16.023383+0000","last_clean":"2024-04-23T10:13:16.023383+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:13:16.023383+0000","last_undegraded":"2024-04-23T10:13:16.023383+0000","last_fullsized":"2024-04-23T10:13:16.023383+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569061+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:13:16.569061+0000","last_peered":"2024-04-23T10:13:16.569061+0000","last_clean":"2024-04-23T10:13:16.569061+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:13:16.569061+0000","last_undegraded":"2024-04-23T10:13:16.569061+0000","last_fullsized":"2024-04-23T10:13:16.569061+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024366+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:13:16.024366+0000","last_peered":"2024-04-23T10:13:16.024366+0000","last_clean":"2024-04-23T10:13:16.024366+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:13:16.024366+0000","last_undegraded":"2024-04-23T10:13:16.024366+0000","last_fullsized":"2024-04-23T10:13:16.024366+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025541+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:13:16.025541+0000","last_peered":"2024-04-23T10:13:16.025541+0000","last_clean":"2024-04-23T10:13:16.025541+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:13:16.025541+0000","last_undegraded":"2024-04-23T10:13:16.025541+0000","last_fullsized":"2024-04-23T10:13:16.025541+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.047236+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:13:20.047236+0000","last_peered":"2024-04-23T10:13:20.047236+0000","last_clean":"2024-04-23T10:13:20.047236+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:13:20.047236+0000","last_undegraded":"2024-04-23T10:13:20.047236+0000","last_fullsized":"2024-04-23T10:13:20.047236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023004+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:13:16.023004+0000","last_peered":"2024-04-23T10:13:16.023004+0000","last_clean":"2024-04-23T10:13:16.023004+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:13:16.023004+0000","last_undegraded":"2024-04-23T10:13:16.023004+0000","last_fullsized":"2024-04-23T10:13:16.023004+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.572546+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:13:16.572546+0000","last_peered":"2024-04-23T10:13:16.572546+0000","last_clean":"2024-04-23T10:13:16.572546+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:13:16.572546+0000","last_undegraded":"2024-04-23T10:13:16.572546+0000","last_fullsized":"2024-04-23T10:13:16.572546+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889277+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:13:16.889277+0000","last_peered":"2024-04-23T10:13:16.889277+0000","last_clean":"2024-04-23T10:13:16.889277+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:13:16.889277+0000","last_undegraded":"2024-04-23T10:13:16.889277+0000","last_fullsized":"2024-04-23T10:13:16.889277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":12,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891510+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:13:16.891510+0000","last_peered":"2024-04-23T10:13:16.891510+0000","last_clean":"2024-04-23T10:13:16.891510+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:13:16.891510+0000","last_undegraded":"2024-04-23T10:13:16.891510+0000","last_fullsized":"2024-04-23T10:13:16.891510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889028+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:13:16.889028+0000","last_peered":"2024-04-23T10:13:16.889028+0000","last_clean":"2024-04-23T10:13:16.889028+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:13:16.889028+0000","last_undegraded":"2024-04-23T10:13:16.889028+0000","last_fullsized":"2024-04-23T10:13:16.889028+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570186+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:13:16.570186+0000","last_peered":"2024-04-23T10:13:16.570186+0000","last_clean":"2024-04-23T10:13:16.570186+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:13:16.570186+0000","last_undegraded":"2024-04-23T10:13:16.570186+0000","last_fullsized":"2024-04-23T10:13:16.570186+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024412+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:13:16.024412+0000","last_peered":"2024-04-23T10:13:16.024412+0000","last_clean":"2024-04-23T10:13:16.024412+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:13:16.024412+0000","last_undegraded":"2024-04-23T10:13:16.024412+0000","last_fullsized":"2024-04-23T10:13:16.024412+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021967+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:13:16.021967+0000","last_peered":"2024-04-23T10:13:16.021967+0000","last_clean":"2024-04-23T10:13:16.021967+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:13:16.021967+0000","last_undegraded":"2024-04-23T10:13:16.021967+0000","last_fullsized":"2024-04-23T10:13:16.021967+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"24'1","reported_seq":27,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889344+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:13:16.889344+0000","last_peered":"2024-04-23T10:13:16.889344+0000","last_clean":"2024-04-23T10:13:16.889344+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:13:16.889344+0000","last_undegraded":"2024-04-23T10:13:16.889344+0000","last_fullsized":"2024-04-23T10:13:16.889344+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886856+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:13:16.886856+0000","last_peered":"2024-04-23T10:13:16.886856+0000","last_clean":"2024-04-23T10:13:16.886856+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:13:16.886856+0000","last_undegraded":"2024-04-23T10:13:16.886856+0000","last_fullsized":"2024-04-23T10:13:16.886856+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024771+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:13:16.024771+0000","last_peered":"2024-04-23T10:13:16.024771+0000","last_clean":"2024-04-23T10:13:16.024771+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:13:16.024771+0000","last_undegraded":"2024-04-23T10:13:16.024771+0000","last_fullsized":"2024-04-23T10:13:16.024771+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043830+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:13:20.043830+0000","last_peered":"2024-04-23T10:13:20.043830+0000","last_clean":"2024-04-23T10:13:20.043830+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:13:20.043830+0000","last_undegraded":"2024-04-23T10:13:20.043830+0000","last_fullsized":"2024-04-23T10:13:20.043830+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":588,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888499+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:13:16.888499+0000","last_peered":"2024-04-23T10:13:16.888499+0000","last_clean":"2024-04-23T10:13:16.888499+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:13:16.888499+0000","last_undegraded":"2024-04-23T10:13:16.888499+0000","last_fullsized":"2024-04-23T10:13:16.888499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887022+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:13:16.887022+0000","last_peered":"2024-04-23T10:13:16.887022+0000","last_clean":"2024-04-23T10:13:16.887022+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:13:16.887022+0000","last_undegraded":"2024-04-23T10:13:16.887022+0000","last_fullsized":"2024-04-23T10:13:16.887022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.040904+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:13:20.040904+0000","last_peered":"2024-04-23T10:13:20.040904+0000","last_clean":"2024-04-23T10:13:20.040904+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:13:20.040904+0000","last_undegraded":"2024-04-23T10:13:20.040904+0000","last_fullsized":"2024-04-23T10:13:20.040904+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889168+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:13:16.889168+0000","last_peered":"2024-04-23T10:13:16.889168+0000","last_clean":"2024-04-23T10:13:16.889168+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:13:16.889168+0000","last_undegraded":"2024-04-23T10:13:16.889168+0000","last_fullsized":"2024-04-23T10:13:16.889168+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024139+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:13:16.024139+0000","last_peered":"2024-04-23T10:13:16.024139+0000","last_clean":"2024-04-23T10:13:16.024139+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:13:16.024139+0000","last_undegraded":"2024-04-23T10:13:16.024139+0000","last_fullsized":"2024-04-23T10:13:16.024139+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569577+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:13:16.569577+0000","last_peered":"2024-04-23T10:13:16.569577+0000","last_clean":"2024-04-23T10:13:16.569577+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:13:16.569577+0000","last_undegraded":"2024-04-23T10:13:16.569577+0000","last_fullsized":"2024-04-23T10:13:16.569577+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.574008+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:13:16.574008+0000","last_peered":"2024-04-23T10:13:16.574008+0000","last_clean":"2024-04-23T10:13:16.574008+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:13:16.574008+0000","last_undegraded":"2024-04-23T10:13:16.574008+0000","last_fullsized":"2024-04-23T10:13:16.574008+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017537+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:13:16.017537+0000","last_peered":"2024-04-23T10:13:16.017537+0000","last_clean":"2024-04-23T10:13:16.017537+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:13:16.017537+0000","last_undegraded":"2024-04-23T10:13:16.017537+0000","last_fullsized":"2024-04-23T10:13:16.017537+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021779+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:13:16.021779+0000","last_peered":"2024-04-23T10:13:16.021779+0000","last_clean":"2024-04-23T10:13:16.021779+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:13:16.021779+0000","last_undegraded":"2024-04-23T10:13:16.021779+0000","last_fullsized":"2024-04-23T10:13:16.021779+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569733+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:13:16.569733+0000","last_peered":"2024-04-23T10:13:16.569733+0000","last_clean":"2024-04-23T10:13:16.569733+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:13:16.569733+0000","last_undegraded":"2024-04-23T10:13:16.569733+0000","last_fullsized":"2024-04-23T10:13:16.569733+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932370+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:13:16.932370+0000","last_peered":"2024-04-23T10:13:16.932370+0000","last_clean":"2024-04-23T10:13:16.932370+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:13:16.932370+0000","last_undegraded":"2024-04-23T10:13:16.932370+0000","last_fullsized":"2024-04-23T10:13:16.932370+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569024+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:13:16.569024+0000","last_peered":"2024-04-23T10:13:16.569024+0000","last_clean":"2024-04-23T10:13:16.569024+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:13:16.569024+0000","last_undegraded":"2024-04-23T10:13:16.569024+0000","last_fullsized":"2024-04-23T10:13:16.569024+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021712+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:13:16.021712+0000","last_peered":"2024-04-23T10:13:16.021712+0000","last_clean":"2024-04-23T10:13:16.021712+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:13:16.021712+0000","last_undegraded":"2024-04-23T10:13:16.021712+0000","last_fullsized":"2024-04-23T10:13:16.021712+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1611,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931725+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:13:16.931725+0000","last_peered":"2024-04-23T10:13:16.931725+0000","last_clean":"2024-04-23T10:13:16.931725+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:13:16.931725+0000","last_undegraded":"2024-04-23T10:13:16.931725+0000","last_fullsized":"2024-04-23T10:13:16.931725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022224+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:13:16.022224+0000","last_peered":"2024-04-23T10:13:16.022224+0000","last_clean":"2024-04-23T10:13:16.022224+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:13:16.022224+0000","last_undegraded":"2024-04-23T10:13:16.022224+0000","last_fullsized":"2024-04-23T10:13:16.022224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888952+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:13:16.888952+0000","last_peered":"2024-04-23T10:13:16.888952+0000","last_clean":"2024-04-23T10:13:16.888952+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:13:16.888952+0000","last_undegraded":"2024-04-23T10:13:16.888952+0000","last_fullsized":"2024-04-23T10:13:16.888952+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":70,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024715+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:13:16.024715+0000","last_peered":"2024-04-23T10:13:16.024715+0000","last_clean":"2024-04-23T10:13:16.024715+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:13:16.024715+0000","last_undegraded":"2024-04-23T10:13:16.024715+0000","last_fullsized":"2024-04-23T10:13:16.024715+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570090+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:13:16.570090+0000","last_peered":"2024-04-23T10:13:16.570090+0000","last_clean":"2024-04-23T10:13:16.570090+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:13:16.570090+0000","last_undegraded":"2024-04-23T10:13:16.570090+0000","last_fullsized":"2024-04-23T10:13:16.570090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'5","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.041591+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:13:20.041591+0000","last_peered":"2024-04-23T10:13:20.041591+0000","last_clean":"2024-04-23T10:13:20.041591+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:13:20.041591+0000","last_undegraded":"2024-04-23T10:13:20.041591+0000","last_fullsized":"2024-04-23T10:13:20.041591+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.020888+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:13:16.020888+0000","last_peered":"2024-04-23T10:13:16.020888+0000","last_clean":"2024-04-23T10:13:16.020888+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:13:16.020888+0000","last_undegraded":"2024-04-23T10:13:16.020888+0000","last_fullsized":"2024-04-23T10:13:16.020888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569592+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:13:16.569592+0000","last_peered":"2024-04-23T10:13:16.569592+0000","last_clean":"2024-04-23T10:13:16.569592+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:13:16.569592+0000","last_undegraded":"2024-04-23T10:13:16.569592+0000","last_fullsized":"2024-04-23T10:13:16.569592+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"24'2","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024919+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:13:16.024919+0000","last_peered":"2024-04-23T10:13:16.024919+0000","last_clean":"2024-04-23T10:13:16.024919+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:13:16.024919+0000","last_undegraded":"2024-04-23T10:13:16.024919+0000","last_fullsized":"2024-04-23T10:13:16.024919+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019854+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:13:16.019854+0000","last_peered":"2024-04-23T10:13:16.019854+0000","last_clean":"2024-04-23T10:13:16.019854+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:13:16.019854+0000","last_undegraded":"2024-04-23T10:13:16.019854+0000","last_fullsized":"2024-04-23T10:13:16.019854+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569940+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:13:16.569940+0000","last_peered":"2024-04-23T10:13:16.569940+0000","last_clean":"2024-04-23T10:13:16.569940+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:13:16.569940+0000","last_undegraded":"2024-04-23T10:13:16.569940+0000","last_fullsized":"2024-04-23T10:13:16.569940+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'17","reported_seq":42,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021026+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:13:16.021026+0000","last_peered":"2024-04-23T10:13:16.021026+0000","last_clean":"2024-04-23T10:13:16.021026+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:13:16.021026+0000","last_undegraded":"2024-04-23T10:13:16.021026+0000","last_fullsized":"2024-04-23T10:13:16.021026+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":112,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024747+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:13:16.024747+0000","last_peered":"2024-04-23T10:13:16.024747+0000","last_clean":"2024-04-23T10:13:16.024747+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:13:16.024747+0000","last_undegraded":"2024-04-23T10:13:16.024747+0000","last_fullsized":"2024-04-23T10:13:16.024747+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932091+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:13:16.932091+0000","last_peered":"2024-04-23T10:13:16.932091+0000","last_clean":"2024-04-23T10:13:16.932091+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:13:16.932091+0000","last_undegraded":"2024-04-23T10:13:16.932091+0000","last_fullsized":"2024-04-23T10:13:16.932091+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'6","reported_seq":32,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932214+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:13:16.932214+0000","last_peered":"2024-04-23T10:13:16.932214+0000","last_clean":"2024-04-23T10:13:16.932214+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:13:16.932214+0000","last_undegraded":"2024-04-23T10:13:16.932214+0000","last_fullsized":"2024-04-23T10:13:16.932214+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1029,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019066+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:13:16.019066+0000","last_peered":"2024-04-23T10:13:16.019066+0000","last_clean":"2024-04-23T10:13:16.019066+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:13:16.019066+0000","last_undegraded":"2024-04-23T10:13:16.019066+0000","last_fullsized":"2024-04-23T10:13:16.019066+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569434+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:13:16.569434+0000","last_peered":"2024-04-23T10:13:16.569434+0000","last_clean":"2024-04-23T10:13:16.569434+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:13:16.569434+0000","last_undegraded":"2024-04-23T10:13:16.569434+0000","last_fullsized":"2024-04-23T10:13:16.569434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021371+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:13:16.021371+0000","last_peered":"2024-04-23T10:13:16.021371+0000","last_clean":"2024-04-23T10:13:16.021371+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:13:16.021371+0000","last_undegraded":"2024-04-23T10:13:16.021371+0000","last_fullsized":"2024-04-23T10:13:16.021371+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018636+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:13:16.018636+0000","last_peered":"2024-04-23T10:13:16.018636+0000","last_clean":"2024-04-23T10:13:16.018636+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:13:16.018636+0000","last_undegraded":"2024-04-23T10:13:16.018636+0000","last_fullsized":"2024-04-23T10:13:16.018636+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024461+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:13:16.024461+0000","last_peered":"2024-04-23T10:13:16.024461+0000","last_clean":"2024-04-23T10:13:16.024461+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:13:16.024461+0000","last_undegraded":"2024-04-23T10:13:16.024461+0000","last_fullsized":"2024-04-23T10:13:16.024461+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'9","reported_seq":34,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.043352+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:13:20.043352+0000","last_peered":"2024-04-23T10:13:20.043352+0000","last_clean":"2024-04-23T10:13:20.043352+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:13:20.043352+0000","last_undegraded":"2024-04-23T10:13:20.043352+0000","last_fullsized":"2024-04-23T10:13:20.043352+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021878+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:13:16.021878+0000","last_peered":"2024-04-23T10:13:16.021878+0000","last_clean":"2024-04-23T10:13:16.021878+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:13:16.021878+0000","last_undegraded":"2024-04-23T10:13:16.021878+0000","last_fullsized":"2024-04-23T10:13:16.021878+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570096+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:13:16.570096+0000","last_peered":"2024-04-23T10:13:16.570096+0000","last_clean":"2024-04-23T10:13:16.570096+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:13:16.570096+0000","last_undegraded":"2024-04-23T10:13:16.570096+0000","last_fullsized":"2024-04-23T10:13:16.570096+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'15","reported_seq":41,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:28.628833+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:13:28.628833+0000","last_peered":"2024-04-23T10:13:28.628833+0000","last_clean":"2024-04-23T10:13:28.628833+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:13:28.628833+0000","last_undegraded":"2024-04-23T10:13:28.628833+0000","last_fullsized":"2024-04-23T10:13:28.628833+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4283,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887133+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:13:16.887133+0000","last_peered":"2024-04-23T10:13:16.887133+0000","last_clean":"2024-04-23T10:13:16.887133+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:13:16.887133+0000","last_undegraded":"2024-04-23T10:13:16.887133+0000","last_fullsized":"2024-04-23T10:13:16.887133+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025287+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:13:16.025287+0000","last_peered":"2024-04-23T10:13:16.025287+0000","last_clean":"2024-04-23T10:13:16.025287+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:13:16.025287+0000","last_undegraded":"2024-04-23T10:13:16.025287+0000","last_fullsized":"2024-04-23T10:13:16.025287+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"24'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888751+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:13:16.888751+0000","last_peered":"2024-04-23T10:13:16.888751+0000","last_clean":"2024-04-23T10:13:16.888751+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:13:16.888751+0000","last_undegraded":"2024-04-23T10:13:16.888751+0000","last_fullsized":"2024-04-23T10:13:16.888751+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023945+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:13:16.023945+0000","last_peered":"2024-04-23T10:13:16.023945+0000","last_clean":"2024-04-23T10:13:16.023945+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:13:16.023945+0000","last_undegraded":"2024-04-23T10:13:16.023945+0000","last_fullsized":"2024-04-23T10:13:16.023945+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.891269+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:13:16.891269+0000","last_peered":"2024-04-23T10:13:16.891269+0000","last_clean":"2024-04-23T10:13:16.891269+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:13:16.891269+0000","last_undegraded":"2024-04-23T10:13:16.891269+0000","last_fullsized":"2024-04-23T10:13:16.891269+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'4","reported_seq":30,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:20.046189+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:13:20.046189+0000","last_peered":"2024-04-23T10:13:20.046189+0000","last_clean":"2024-04-23T10:13:20.046189+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:13:20.046189+0000","last_undegraded":"2024-04-23T10:13:20.046189+0000","last_fullsized":"2024-04-23T10:13:20.046189+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017213+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:13:16.017213+0000","last_peered":"2024-04-23T10:13:16.017213+0000","last_clean":"2024-04-23T10:13:16.017213+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:13:16.017213+0000","last_undegraded":"2024-04-23T10:13:16.017213+0000","last_fullsized":"2024-04-23T10:13:16.017213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022505+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:13:16.022505+0000","last_peered":"2024-04-23T10:13:16.022505+0000","last_clean":"2024-04-23T10:13:16.022505+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:13:16.022505+0000","last_undegraded":"2024-04-23T10:13:16.022505+0000","last_fullsized":"2024-04-23T10:13:16.022505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'5","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.933003+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:13:16.933003+0000","last_peered":"2024-04-23T10:13:16.933003+0000","last_clean":"2024-04-23T10:13:16.933003+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:13:16.933003+0000","last_undegraded":"2024-04-23T10:13:16.933003+0000","last_fullsized":"2024-04-23T10:13:16.933003+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017176+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:13:16.017176+0000","last_peered":"2024-04-23T10:13:16.017176+0000","last_clean":"2024-04-23T10:13:16.017176+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:13:16.017176+0000","last_undegraded":"2024-04-23T10:13:16.017176+0000","last_fullsized":"2024-04-23T10:13:16.017176+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024581+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:13:16.024581+0000","last_peered":"2024-04-23T10:13:16.024581+0000","last_clean":"2024-04-23T10:13:16.024581+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:13:16.024581+0000","last_undegraded":"2024-04-23T10:13:16.024581+0000","last_fullsized":"2024-04-23T10:13:16.024581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.886778+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:13:16.886778+0000","last_peered":"2024-04-23T10:13:16.886778+0000","last_clean":"2024-04-23T10:13:16.886778+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:13:16.886778+0000","last_undegraded":"2024-04-23T10:13:16.886778+0000","last_fullsized":"2024-04-23T10:13:16.886778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'3","reported_seq":29,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022144+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:13:16.022144+0000","last_peered":"2024-04-23T10:13:16.022144+0000","last_clean":"2024-04-23T10:13:16.022144+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:13:16.022144+0000","last_undegraded":"2024-04-23T10:13:16.022144+0000","last_fullsized":"2024-04-23T10:13:16.022144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":582,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932630+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:13:16.932630+0000","last_peered":"2024-04-23T10:13:16.932630+0000","last_clean":"2024-04-23T10:13:16.932630+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:13:16.932630+0000","last_undegraded":"2024-04-23T10:13:16.932630+0000","last_fullsized":"2024-04-23T10:13:16.932630+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.029183+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:13:16.029183+0000","last_peered":"2024-04-23T10:13:16.029183+0000","last_clean":"2024-04-23T10:13:16.029183+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:13:16.029183+0000","last_undegraded":"2024-04-23T10:13:16.029183+0000","last_fullsized":"2024-04-23T10:13:16.029183+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'3","reported_seq":28,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017565+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:13:16.017565+0000","last_peered":"2024-04-23T10:13:16.017565+0000","last_clean":"2024-04-23T10:13:16.017565+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:13:16.017565+0000","last_undegraded":"2024-04-23T10:13:16.017565+0000","last_fullsized":"2024-04-23T10:13:16.017565+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"24'7","reported_seq":33,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931915+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:13:16.931915+0000","last_peered":"2024-04-23T10:13:16.931915+0000","last_clean":"2024-04-23T10:13:16.931915+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:13:16.931915+0000","last_undegraded":"2024-04-23T10:13:16.931915+0000","last_fullsized":"2024-04-23T10:13:16.931915+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024846+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:13:16.024846+0000","last_peered":"2024-04-23T10:13:16.024846+0000","last_clean":"2024-04-23T10:13:16.024846+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:13:16.024846+0000","last_undegraded":"2024-04-23T10:13:16.024846+0000","last_fullsized":"2024-04-23T10:13:16.024846+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":18,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021473+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:13:16.021473+0000","last_peered":"2024-04-23T10:13:16.021473+0000","last_clean":"2024-04-23T10:13:16.021473+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:13:16.021473+0000","last_undegraded":"2024-04-23T10:13:16.021473+0000","last_fullsized":"2024-04-23T10:13:16.021473+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'6","reported_seq":31,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018439+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:13:16.018439+0000","last_peered":"2024-04-23T10:13:16.018439+0000","last_clean":"2024-04-23T10:13:16.018439+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:13:16.018439+0000","last_undegraded":"2024-04-23T10:13:16.018439+0000","last_fullsized":"2024-04-23T10:13:16.018439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1063,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.023744+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:13:16.023744+0000","last_peered":"2024-04-23T10:13:16.023744+0000","last_clean":"2024-04-23T10:13:16.023744+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:13:16.023744+0000","last_undegraded":"2024-04-23T10:13:16.023744+0000","last_fullsized":"2024-04-23T10:13:16.023744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":25,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.027505+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:13:16.027505+0000","last_peered":"2024-04-23T10:13:16.027505+0000","last_clean":"2024-04-23T10:13:16.027505+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:13:16.027505+0000","last_undegraded":"2024-04-23T10:13:16.027505+0000","last_fullsized":"2024-04-23T10:13:16.027505+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.931744+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:13:16.931744+0000","last_peered":"2024-04-23T10:13:16.931744+0000","last_clean":"2024-04-23T10:13:16.931744+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:13:16.931744+0000","last_undegraded":"2024-04-23T10:13:16.931744+0000","last_fullsized":"2024-04-23T10:13:16.931744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021237+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:13:16.021237+0000","last_peered":"2024-04-23T10:13:16.021237+0000","last_clean":"2024-04-23T10:13:16.021237+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:13:16.021237+0000","last_undegraded":"2024-04-23T10:13:16.021237+0000","last_fullsized":"2024-04-23T10:13:16.021237+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021239+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:13:16.021239+0000","last_peered":"2024-04-23T10:13:16.021239+0000","last_clean":"2024-04-23T10:13:16.021239+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:13:16.021239+0000","last_undegraded":"2024-04-23T10:13:16.021239+0000","last_fullsized":"2024-04-23T10:13:16.021239+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024751+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:13:16.024751+0000","last_peered":"2024-04-23T10:13:16.024751+0000","last_clean":"2024-04-23T10:13:16.024751+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:13:16.024751+0000","last_undegraded":"2024-04-23T10:13:16.024751+0000","last_fullsized":"2024-04-23T10:13:16.024751+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018890+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:13:16.018890+0000","last_peered":"2024-04-23T10:13:16.018890+0000","last_clean":"2024-04-23T10:13:16.018890+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:13:16.018890+0000","last_undegraded":"2024-04-23T10:13:16.018890+0000","last_fullsized":"2024-04-23T10:13:16.018890+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.888505+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:13:16.888505+0000","last_peered":"2024-04-23T10:13:16.888505+0000","last_clean":"2024-04-23T10:13:16.888505+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:13:16.888505+0000","last_undegraded":"2024-04-23T10:13:16.888505+0000","last_fullsized":"2024-04-23T10:13:16.888505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932655+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:13:16.932655+0000","last_peered":"2024-04-23T10:13:16.932655+0000","last_clean":"2024-04-23T10:13:16.932655+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:13:16.932655+0000","last_undegraded":"2024-04-23T10:13:16.932655+0000","last_fullsized":"2024-04-23T10:13:16.932655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.019178+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:13:16.019178+0000","last_peered":"2024-04-23T10:13:16.019178+0000","last_clean":"2024-04-23T10:13:16.019178+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:13:16.019178+0000","last_undegraded":"2024-04-23T10:13:16.019178+0000","last_fullsized":"2024-04-23T10:13:16.019178+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021724+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:13:16.021724+0000","last_peered":"2024-04-23T10:13:16.021724+0000","last_clean":"2024-04-23T10:13:16.021724+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:13:16.021724+0000","last_undegraded":"2024-04-23T10:13:16.021724+0000","last_fullsized":"2024-04-23T10:13:16.021724+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017320+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:13:16.017320+0000","last_peered":"2024-04-23T10:13:16.017320+0000","last_clean":"2024-04-23T10:13:16.017320+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:13:16.017320+0000","last_undegraded":"2024-04-23T10:13:16.017320+0000","last_fullsized":"2024-04-23T10:13:16.017320+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021273+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:13:16.021273+0000","last_peered":"2024-04-23T10:13:16.021273+0000","last_clean":"2024-04-23T10:13:16.021273+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:13:16.021273+0000","last_undegraded":"2024-04-23T10:13:16.021273+0000","last_fullsized":"2024-04-23T10:13:16.021273+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024565+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:13:16.024565+0000","last_peered":"2024-04-23T10:13:16.024565+0000","last_clean":"2024-04-23T10:13:16.024565+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:13:16.024565+0000","last_undegraded":"2024-04-23T10:13:16.024565+0000","last_fullsized":"2024-04-23T10:13:16.024565+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932257+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:13:16.932257+0000","last_peered":"2024-04-23T10:13:16.932257+0000","last_clean":"2024-04-23T10:13:16.932257+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:13:16.932257+0000","last_undegraded":"2024-04-23T10:13:16.932257+0000","last_fullsized":"2024-04-23T10:13:16.932257+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569748+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:13:16.569748+0000","last_peered":"2024-04-23T10:13:16.569748+0000","last_clean":"2024-04-23T10:13:16.569748+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:13:16.569748+0000","last_undegraded":"2024-04-23T10:13:16.569748+0000","last_fullsized":"2024-04-23T10:13:16.569748+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021598+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:13:16.021598+0000","last_peered":"2024-04-23T10:13:16.021598+0000","last_clean":"2024-04-23T10:13:16.021598+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:13:16.021598+0000","last_undegraded":"2024-04-23T10:13:16.021598+0000","last_fullsized":"2024-04-23T10:13:16.021598+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.022975+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:13:16.022975+0000","last_peered":"2024-04-23T10:13:16.022975+0000","last_clean":"2024-04-23T10:13:16.022975+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:13:16.022975+0000","last_undegraded":"2024-04-23T10:13:16.022975+0000","last_fullsized":"2024-04-23T10:13:16.022975+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":10,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.028684+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:13:16.028684+0000","last_peered":"2024-04-23T10:13:16.028684+0000","last_clean":"2024-04-23T10:13:16.028684+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:13:16.028684+0000","last_undegraded":"2024-04-23T10:13:16.028684+0000","last_fullsized":"2024-04-23T10:13:16.028684+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.887057+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:13:16.887057+0000","last_peered":"2024-04-23T10:13:16.887057+0000","last_clean":"2024-04-23T10:13:16.887057+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:13:16.887057+0000","last_undegraded":"2024-04-23T10:13:16.887057+0000","last_fullsized":"2024-04-23T10:13:16.887057+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024410+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:13:16.024410+0000","last_peered":"2024-04-23T10:13:16.024410+0000","last_clean":"2024-04-23T10:13:16.024410+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:13:16.024410+0000","last_undegraded":"2024-04-23T10:13:16.024410+0000","last_fullsized":"2024-04-23T10:13:16.024410+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.018218+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:13:16.018218+0000","last_peered":"2024-04-23T10:13:16.018218+0000","last_clean":"2024-04-23T10:13:16.018218+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:13:16.018218+0000","last_undegraded":"2024-04-23T10:13:16.018218+0000","last_fullsized":"2024-04-23T10:13:16.018218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.025006+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:13:16.025006+0000","last_peered":"2024-04-23T10:13:16.025006+0000","last_clean":"2024-04-23T10:13:16.025006+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:13:16.025006+0000","last_undegraded":"2024-04-23T10:13:16.025006+0000","last_fullsized":"2024-04-23T10:13:16.025006+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932289+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:13:16.932289+0000","last_peered":"2024-04-23T10:13:16.932289+0000","last_clean":"2024-04-23T10:13:16.932289+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:13:16.932289+0000","last_undegraded":"2024-04-23T10:13:16.932289+0000","last_fullsized":"2024-04-23T10:13:16.932289+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.932585+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:13:16.932585+0000","last_peered":"2024-04-23T10:13:16.932585+0000","last_clean":"2024-04-23T10:13:16.932585+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:13:16.932585+0000","last_undegraded":"2024-04-23T10:13:16.932585+0000","last_fullsized":"2024-04-23T10:13:16.932585+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.570022+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:13:16.570022+0000","last_peered":"2024-04-23T10:13:16.570022+0000","last_clean":"2024-04-23T10:13:16.570022+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:13:16.570022+0000","last_undegraded":"2024-04-23T10:13:16.570022+0000","last_fullsized":"2024-04-23T10:13:16.570022+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.017199+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:13:16.017199+0000","last_peered":"2024-04-23T10:13:16.017199+0000","last_clean":"2024-04-23T10:13:16.017199+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:13:16.017199+0000","last_undegraded":"2024-04-23T10:13:16.017199+0000","last_fullsized":"2024-04-23T10:13:16.017199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569870+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:13:16.569870+0000","last_peered":"2024-04-23T10:13:16.569870+0000","last_clean":"2024-04-23T10:13:16.569870+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:13:16.569870+0000","last_undegraded":"2024-04-23T10:13:16.569870+0000","last_fullsized":"2024-04-23T10:13:16.569870+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021154+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:13:16.021154+0000","last_peered":"2024-04-23T10:13:16.021154+0000","last_clean":"2024-04-23T10:13:16.021154+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:13:16.021154+0000","last_undegraded":"2024-04-23T10:13:16.021154+0000","last_fullsized":"2024-04-23T10:13:16.021154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.568995+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:13:16.568995+0000","last_peered":"2024-04-23T10:13:16.568995+0000","last_clean":"2024-04-23T10:13:16.568995+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:13:16.568995+0000","last_undegraded":"2024-04-23T10:13:16.568995+0000","last_fullsized":"2024-04-23T10:13:16.568995+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.021733+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:13:16.021733+0000","last_peered":"2024-04-23T10:13:16.021733+0000","last_clean":"2024-04-23T10:13:16.021733+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:13:16.021733+0000","last_undegraded":"2024-04-23T10:13:16.021733+0000","last_fullsized":"2024-04-23T10:13:16.021733+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":23,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.024566+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:13:16.024566+0000","last_peered":"2024-04-23T10:13:16.024566+0000","last_clean":"2024-04-23T10:13:16.024566+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:13:16.024566+0000","last_undegraded":"2024-04-23T10:13:16.024566+0000","last_fullsized":"2024-04-23T10:13:16.024566+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.889699+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:13:16.889699+0000","last_peered":"2024-04-23T10:13:16.889699+0000","last_clean":"2024-04-23T10:13:16.889699+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:13:16.889699+0000","last_undegraded":"2024-04-23T10:13:16.889699+0000","last_fullsized":"2024-04-23T10:13:16.889699+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"0'0","reported_seq":24,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:13:16.569674+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:13:16.569674+0000","last_peered":"2024-04-23T10:13:16.569674+0000","last_clean":"2024-04-23T10:13:16.569674+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:13:16.569674+0000","last_undegraded":"2024-04-23T10:13:16.569674+0000","last_fullsized":"2024-04-23T10:13:16.569674+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":12028,"num_objects":98,"num_object_clones":0,"num_object_copies":196,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":98,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":215,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":262144,"data_stored":24056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":189,"ondisk_log_size":189,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574865,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27904,"kb_used_data":888,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343936,"statfs":{"total":96636764160,"available":96608190464,"internally_reserved":0,"allocated":909312,"data_stored":707357,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574864,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27316,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344524,"statfs":{"total":96636764160,"available":96608792576,"internally_reserved":0,"allocated":307200,"data_stored":119962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574864,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27336,"kb_used_data":320,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344504,"statfs":{"total":96636764160,"available":96608772096,"internally_reserved":0,"allocated":327680,"data_stored":118821,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574866,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27312,"kb_used_data":296,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344528,"statfs":{"total":96636764160,"available":96608796672,"internally_reserved":0,"allocated":303104,"data_stored":116219,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574866,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":119996,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574866,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31480,"kb_used_data":304,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340360,"statfs":{"total":96636764160,"available":96604528640,"internally_reserved":0,"allocated":311296,"data_stored":116351,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":31476,"kb_used_data":300,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94340364,"statfs":{"total":96636764160,"available":96604532736,"internally_reserved":0,"allocated":307200,"data_stored":115980,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574865,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32056,"kb_used_data":880,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339784,"statfs":{"total":96636764160,"available":96603938816,"internally_reserved":0,"allocated":901120,"data_stored":705690,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":1532,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1903,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":5548,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1771,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":4373,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":5514,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":2541,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:13:34.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:34.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 Processor -- start 2024-04-23T10:13:34.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 -- start start 2024-04-23T10:13:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f101814fbc0 0x7f101806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1018074100 0x7f10180c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f10180c5d70 con 0x7f101814ffa0 2024-04-23T10:13:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f10180c6050 con 0x7f101814fbc0 2024-04-23T10:13:34.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f1020619640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f10180c6330 con 0x7f1018074100 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101dbb4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f101814ffa0 0x7f10180c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49756/0 (socket says 172.21.15.26:49756) 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101dbb4640 1 -- 172.21.15.26:0/3093494158 learned_addr learned my addr 172.21.15.26:0/3093494158 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101e3b5640 1 --2- 172.21.15.26:0/3093494158 >> v2:172.21.15.190:3300/0 conn(0x7f101814fbc0 0x7f101806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101ebb6640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1018074100 0x7f10180c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1225730095 0 0) 0x7f10180c5d70 con 0x7f101814ffa0 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1004003530 con 0x7f101814ffa0 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2859016385 0 0) 0x7f1004003530 con 0x7f101814ffa0 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101e3b5640 1 -- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1018074100 msgr2=0x7f10180c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101e3b5640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1018074100 0x7f10180c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101e3b5640 1 -- 172.21.15.26:0/3093494158 >> v1:172.21.15.26:6789/0 conn(0x7f101814ffa0 legacy=0x7f10180c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.709+0000 7f101e3b5640 1 -- 172.21.15.26:0/3093494158 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10180c6610 con 0x7f101814fbc0 2024-04-23T10:13:34.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f101e3b5640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f101814fbc0 0x7f101806f700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10140097c0 tx=0x7f101401c3c0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=dc4964c03bc91398 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10140b0070 con 0x7f101814fbc0 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f10140ab400 con 0x7f101814fbc0 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f101d3b3640 1 -- 172.21.15.26:0/3093494158 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008001680 con 0x7f101814fbc0 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f101814fbc0 msgr2=0x7f101806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f101814fbc0 0x7f101806f700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7f10140097c0 tx=0x7f101401c3c0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- 172.21.15.26:0/3093494158 shutdown_connections 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1018074100 0x7f10180c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 --2- 172.21.15.26:0/3093494158 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f101814fbc0 0x7f101806f700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- 172.21.15.26:0/3093494158 >> 172.21.15.26:0/3093494158 conn(0x7f101806b9d0 msgr2=0x7f101806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:34.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- 172.21.15.26:0/3093494158 shutdown_connections 2024-04-23T10:13:34.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- 172.21.15.26:0/3093494158 wait complete. 2024-04-23T10:13:34.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 Processor -- start 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.713+0000 7f1020619640 1 -- start start 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1018074100 0x7f10180cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f101814ffa0 0x7f10181530e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f10180c8ab0 con 0x7f101814fbc0 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f10180c8930 con 0x7f1018074100 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1018166090 con 0x7f101814ffa0 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49638/0 (socket says 172.21.15.26:49638) 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 -- 172.21.15.26:0/4169600938 learned_addr learned my addr 172.21.15.26:0/4169600938 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:34.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101ebb6640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f101814ffa0 0x7f10181530e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101e3b5640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1018074100 0x7f10180cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 -- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f101814ffa0 msgr2=0x7f10181530e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f101814ffa0 0x7f10181530e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 -- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1018074100 msgr2=0x7f10180cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1018074100 0x7f10180cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 -- 172.21.15.26:0/4169600938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f10181536c0 con 0x7f101814fbc0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101dbb4640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f10080017f0 tx=0x7f100800cbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1008005ae0 con 0x7f101814fbc0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1008005ca0 con 0x7f101814fbc0 2024-04-23T10:13:34.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f10181f4370 con 0x7f101814fbc0 2024-04-23T10:13:34.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f10080072b0 con 0x7f101814fbc0 2024-04-23T10:13:34.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f10181f4930 con 0x7f101814fbc0 2024-04-23T10:13:34.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1018075df0 con 0x7f101814fbc0 2024-04-23T10:13:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1008007450 con 0x7f101814fbc0 2024-04-23T10:13:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 0x7f0ffc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1008086b70 con 0x7f101814fbc0 2024-04-23T10:13:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.717+0000 7f101e3b5640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 0x7f0ffc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:34.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.721+0000 7f101e3b5640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 0x7f0ffc06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10140ad000 tx=0x7f10140a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:34.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.721+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1008010300 con 0x7f101814fbc0 2024-04-23T10:13:34.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.913+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f10180c7df0 con 0x7f101814fbc0 2024-04-23T10:13:34.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.913+0000 7f100effd640 1 -- 172.21.15.26:0/4169600938 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f1008056d10 con 0x7f101814fbc0 2024-04-23T10:13:34.916 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:34.916 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:13:34.916 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:13:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 msgr2=0x7f0ffc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 0x7f0ffc06a840 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f10140ad000 tx=0x7f10140a6000 comp rx=0 tx=0).stop 2024-04-23T10:13:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 msgr2=0x7f1018152ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f10080017f0 tx=0x7f100800cbe0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 shutdown_connections 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0ffc068380 0x7f0ffc06a840 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f101814ffa0 0x7f10181530e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f101814fbc0 0x7f1018152ba0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 --2- 172.21.15.26:0/4169600938 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1018074100 0x7f10180cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 >> 172.21.15.26:0/4169600938 conn(0x7f101806b9d0 msgr2=0x7f101814a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 shutdown_connections 2024-04-23T10:13:34.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:34.917+0000 7f1020619640 1 -- 172.21.15.26:0/4169600938 wait complete. 2024-04-23T10:13:34.934 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 Processor -- start 2024-04-23T10:13:35.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 -- start start 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a58152ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8a58153220 0x7f8a5806ddd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8a58153650 con 0x7f8a580723d0 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8a580742d0 con 0x7f8a58153220 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5d003640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a58074550 con 0x7f8a58067b00 2024-04-23T10:13:35.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a56d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8a580723d0 0x7f8a580727b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49772/0 (socket says 172.21.15.26:49772) 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a56d9d640 1 -- 172.21.15.26:0/482072687 learned_addr learned my addr 172.21.15.26:0/482072687 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a58152ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5759e640 1 --2- 172.21.15.26:0/482072687 >> v2:172.21.15.190:3300/0 conn(0x7f8a58153220 0x7f8a5806ddd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3921223164 0 0) 0x7f8a58153650 con 0x7f8a580723d0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8a44003530 con 0x7f8a580723d0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2532756884 0 0) 0x7f8a44003530 con 0x7f8a580723d0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 msgr2=0x7f8a58152ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a58152ce0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 >> v2:172.21.15.190:3300/0 conn(0x7f8a58153220 msgr2=0x7f8a5806ddd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 --2- 172.21.15.26:0/482072687 >> v2:172.21.15.190:3300/0 conn(0x7f8a58153220 0x7f8a5806ddd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a58159a60 con 0x7f8a580723d0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f8a48001a00 con 0x7f8a580723d0 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 >> v1:172.21.15.26:6789/0 conn(0x7f8a580723d0 legacy=0x7f8a580727b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a44004810 0x7f8a44004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a440051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580742d0 con 0x7f8a44004810 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58074550 con 0x7f8a440039c0 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a4400b9d0 con 0x7f8a58067b00 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a44004810 0x7f8a44004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a56d9d640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5759e640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a440051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 -- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 msgr2=0x7f8a440051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a58067b00 0x7f8a440051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 -- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a440039c0 msgr2=0x7f8a44003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a440039c0 0x7f8a44003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.045+0000 7f8a5659c640 1 -- 172.21.15.26:0/482072687 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a44003530 con 0x7f8a44004810 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5659c640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a44004810 0x7f8a44004c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009ab0 tx=0x7f8a4001ca50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=26c321ec8ec47eec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400b2070 con 0x7f8a44004810 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a400a5560 con 0x7f8a44004810 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a55d9b640 1 -- 172.21.15.26:0/482072687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a400096b0 con 0x7f8a44004810 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- 172.21.15.26:0/482072687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a44004810 msgr2=0x7f8a44004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 --2- 172.21.15.26:0/482072687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a44004810 0x7f8a44004c90 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f8a40009ab0 tx=0x7f8a4001ca50 comp rx=0 tx=0).stop 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5759e640 1 -- 172.21.15.26:0/482072687 reap_dead start 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- 172.21.15.26:0/482072687 shutdown_connections 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- 172.21.15.26:0/482072687 >> 172.21.15.26:0/482072687 conn(0x7f8a580c9a70 msgr2=0x7f8a580c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- 172.21.15.26:0/482072687 shutdown_connections 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- 172.21.15.26:0/482072687 wait complete. 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 Processor -- start 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- start start 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a44004810 0x7f8a581f0d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a58152510 0x7f8a5814cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8a58159d40 con 0x7f8a58155fd0 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8a580c9650 con 0x7f8a58152510 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5d003640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8a580676a0 con 0x7f8a44004810 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5759e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49664/0 (socket says 172.21.15.26:49664) 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.049+0000 7f8a5759e640 1 -- 172.21.15.26:0/3062327122 learned_addr learned my addr 172.21.15.26:0/3062327122 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a56d9d640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a44004810 0x7f8a581f0d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5659c640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a58152510 0x7f8a5814cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 -- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a44004810 msgr2=0x7f8a581f0d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a44004810 0x7f8a581f0d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 -- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a58152510 msgr2=0x7f8a5814cb50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a58152510 0x7f8a5814cb50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 -- 172.21.15.26:0/3062327122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8a581f45e0 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5759e640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8a58156ae0 tx=0x7f8a50010b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000f040 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8a5001c070 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8a581f48a0 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8a5000eab0 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8a581f4e60 con 0x7f8a58155fd0 2024-04-23T10:13:35.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8a58145450 con 0x7f8a58155fd0 2024-04-23T10:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8a5000ec50 con 0x7f8a58155fd0 2024-04-23T10:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 0x7f8a3806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8a500869d0 con 0x7f8a58155fd0 2024-04-23T10:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a56d9d640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 0x7f8a3806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.053+0000 7f8a56d9d640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 0x7f8a3806a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a480013e0 tx=0x7f8a48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.057+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8a58145450 con 0x7f8a58155fd0 2024-04-23T10:13:35.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.221+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f8a58075df0 con 0x7f8a58155fd0 2024-04-23T10:13:35.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a4f7fe640 1 -- 172.21.15.26:0/3062327122 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7f8a50026020 con 0x7f8a58155fd0 2024-04-23T10:13:35.225 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:35.225 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 msgr2=0x7f8a3806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 0x7f8a3806a870 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f8a480013e0 tx=0x7f8a48009040 comp rx=0 tx=0).stop 2024-04-23T10:13:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 msgr2=0x7f8a58156480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f8a58156ae0 tx=0x7f8a50010b70 comp rx=0 tx=0).stop 2024-04-23T10:13:35.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 shutdown_connections 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8a380683b0 0x7f8a3806a870 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8a58155fd0 0x7f8a58156480 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8a58152510 0x7f8a5814cb50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 --2- 172.21.15.26:0/3062327122 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8a44004810 0x7f8a581f0d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 >> 172.21.15.26:0/3062327122 conn(0x7f8a580c9a70 msgr2=0x7f8a58074e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 shutdown_connections 2024-04-23T10:13:35.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.225+0000 7f8a5d003640 1 -- 172.21.15.26:0/3062327122 wait complete. 2024-04-23T10:13:35.243 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:13:35.244 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:13:35.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 Processor -- start 2024-04-23T10:13:35.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 -- start start 2024-04-23T10:13:35.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c14ffa0 0x7fbb8c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbb8c074100 0x7fbb8c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbb8c0c5d70 con 0x7fbb8c14fbc0 2024-04-23T10:13:35.371 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbb8c0c6050 con 0x7fbb8c074100 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb930f9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c0c6330 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb90e95640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbb8c14fbc0 0x7fbb8c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49784/0 (socket says 172.21.15.26:49784) 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb90e95640 1 -- 172.21.15.26:0/2206387363 learned_addr learned my addr 172.21.15.26:0/2206387363 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb91696640 1 --2- 172.21.15.26:0/2206387363 >> v2:172.21.15.26:3300/0 conn(0x7fbb8c074100 0x7fbb8c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb8bfff640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c14ffa0 0x7fbb8c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb91696640 1 -- 172.21.15.26:0/2206387363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c14ffa0 msgr2=0x7fbb8c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb91696640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c14ffa0 0x7fbb8c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb91696640 1 -- 172.21.15.26:0/2206387363 >> v1:172.21.15.26:6789/0 conn(0x7fbb8c14fbc0 legacy=0x7fbb8c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb91696640 1 -- 172.21.15.26:0/2206387363 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c0c6610 con 0x7fbb8c074100 2024-04-23T10:13:35.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.369+0000 7fbb8b7fe640 1 -- 172.21.15.26:0/2206387363 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4110863922 0 0) 0x7fbb8c0c5d70 con 0x7fbb8c14fbc0 2024-04-23T10:13:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb91696640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c074100 0x7fbb8c0c7250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb840097c0 tx=0x7fbb8401c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b555dd4f5b3377 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb8b7fe640 1 -- 172.21.15.26:0/2206387363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840aa620 con 0x7fbb8c074100 2024-04-23T10:13:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb8b7fe640 1 -- 172.21.15.26:0/2206387363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb840af070 con 0x7fbb8c074100 2024-04-23T10:13:35.374 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb8b7fe640 1 -- 172.21.15.26:0/2206387363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840aa9e0 con 0x7fbb8c074100 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- 172.21.15.26:0/2206387363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c074100 msgr2=0x7fbb8c0c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c074100 0x7fbb8c0c7250 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7fbb840097c0 tx=0x7fbb8401c4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- 172.21.15.26:0/2206387363 shutdown_connections 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c074100 0x7fbb8c0c7250 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 --2- 172.21.15.26:0/2206387363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c14ffa0 0x7fbb8c06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- 172.21.15.26:0/2206387363 >> 172.21.15.26:0/2206387363 conn(0x7fbb8c06b9d0 msgr2=0x7fbb8c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- 172.21.15.26:0/2206387363 shutdown_connections 2024-04-23T10:13:35.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- 172.21.15.26:0/2206387363 wait complete. 2024-04-23T10:13:35.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 Processor -- start 2024-04-23T10:13:35.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.373+0000 7fbb930f9640 1 -- start start 2024-04-23T10:13:35.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 0x7fbb8c0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8c14fbc0 0x7fbb8c1627e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0c8ab0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbb8c0c8930 con 0x7fbb8c14fbc0 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbb8c166090 con 0x7fbb8c074100 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49678/0 (socket says 172.21.15.26:49678) 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 -- 172.21.15.26:0/4284243183 learned_addr learned my addr 172.21.15.26:0/4284243183 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb90e95640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 0x7fbb8c0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 -- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 msgr2=0x7fbb8c0c4240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 0x7fbb8c0c4240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 -- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8c14fbc0 msgr2=0x7fbb8c1627e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8c14fbc0 0x7fbb8c1627e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 -- 172.21.15.26:0/4284243183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbb8c1f7bf0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb90e95640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 0x7fbb8c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb91696640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb8401a0d0 tx=0x7fbb8401ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840aabe0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbb840aad80 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbb8c161a40 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbb840be630 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbb8c161d00 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbb8c075df0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbb840bc020 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 0x7fbb6c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.377+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbb841213b0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.381+0000 7fbb90e95640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 0x7fbb6c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.381+0000 7fbb90e95640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 0x7fbb6c06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb74007fd0 tx=0x7fbb74009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.381+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbb840c3060 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.546 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:13:35.547 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.545+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fbb8c0c7df0 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.545+0000 7fbb897fa640 1 -- 172.21.15.26:0/4284243183 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fbb84016090 con 0x7fbb8c14ffa0 2024-04-23T10:13:35.548 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:13:35.549 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:13:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 msgr2=0x7fbb6c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 0x7fbb6c06a840 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fbb74007fd0 tx=0x7fbb74009040 comp rx=0 tx=0).stop 2024-04-23T10:13:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 msgr2=0x7fbb8c162d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7fbb8401a0d0 tx=0x7fbb8401ace0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 shutdown_connections 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbb6c068380 0x7fbb6c06a840 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbb8c14ffa0 0x7fbb8c162d20 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbb8c14fbc0 0x7fbb8c1627e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 --2- 172.21.15.26:0/4284243183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbb8c074100 0x7fbb8c0c4240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 >> 172.21.15.26:0/4284243183 conn(0x7fbb8c06b9d0 msgr2=0x7fbb8c14e560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 shutdown_connections 2024-04-23T10:13:35.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.549+0000 7fbb930f9640 1 -- 172.21.15.26:0/4284243183 wait complete. 2024-04-23T10:13:35.568 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:13:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 Processor -- start 2024-04-23T10:13:35.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 -- start start 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d4814ffa0 0x7f1d4806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 0x7f1d480c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1d480c5d70 con 0x7f1d4814fbc0 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1d480c6050 con 0x7f1d4814ffa0 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4fec2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d480c6330 con 0x7f1d48074100 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4d45d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1d4814ffa0 0x7f1d4806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4dc5e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1d4814fbc0 0x7f1d480c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49792/0 (socket says 172.21.15.26:49792) 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4dc5e640 1 -- 172.21.15.26:0/91613110 learned_addr learned my addr 172.21.15.26:0/91613110 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:35.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4e45f640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 0x7f1d480c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4d45d640 1 -- 172.21.15.26:0/91613110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 msgr2=0x7f1d480c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4d45d640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 0x7f1d480c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4d45d640 1 -- 172.21.15.26:0/91613110 >> v1:172.21.15.26:6789/0 conn(0x7f1d4814fbc0 legacy=0x7f1d480c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4cc5c640 1 -- 172.21.15.26:0/91613110 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1068499222 0 0) 0x7f1d480c5d70 con 0x7f1d4814fbc0 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4d45d640 1 -- 172.21.15.26:0/91613110 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d480c6610 con 0x7f1d4814ffa0 2024-04-23T10:13:35.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.753+0000 7f1d4e45f640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 0x7f1d480c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:35.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4d45d640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d4806f700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097c0 tx=0x7f1d3801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b2afc84b9a6e48 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4cc5c640 1 -- 172.21.15.26:0/91613110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380aa620 con 0x7f1d4814ffa0 2024-04-23T10:13:35.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4cc5c640 1 -- 172.21.15.26:0/91613110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d380af070 con 0x7f1d4814ffa0 2024-04-23T10:13:35.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4cc5c640 1 -- 172.21.15.26:0/91613110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d380aa9e0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- 172.21.15.26:0/91613110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 msgr2=0x7f1d4806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d4806f700 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f1d380097c0 tx=0x7f1d3801c4a0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- 172.21.15.26:0/91613110 shutdown_connections 2024-04-23T10:13:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d48074100 0x7f1d480c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.758 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/91613110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d4806f700 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- 172.21.15.26:0/91613110 >> 172.21.15.26:0/91613110 conn(0x7f1d4806b9d0 msgr2=0x7f1d4806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- 172.21.15.26:0/91613110 shutdown_connections 2024-04-23T10:13:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- 172.21.15.26:0/91613110 wait complete. 2024-04-23T10:13:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 Processor -- start 2024-04-23T10:13:35.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- start start 2024-04-23T10:13:35.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d48074100 0x7f1d481517d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4814fbc0 0x7f1d4814bdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1d480c8ab0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1d480c8930 con 0x7f1d48074100 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4fec2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1d48166090 con 0x7f1d4814fbc0 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49700/0 (socket says 172.21.15.26:49700) 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 -- 172.21.15.26:0/3599117810 learned_addr learned my addr 172.21.15.26:0/3599117810 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4d45d640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4814fbc0 0x7f1d4814bdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4dc5e640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d48074100 0x7f1d481517d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 -- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4814fbc0 msgr2=0x7f1d4814bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4814fbc0 0x7f1d4814bdd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 -- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d48074100 msgr2=0x7f1d481517d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d48074100 0x7f1d481517d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.757+0000 7f1d4e45f640 1 -- 172.21.15.26:0/3599117810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1d481f3a00 con 0x7f1d4814ffa0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4e45f640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cea0 tx=0x7f1d4000cf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d40003ba0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1d40003d60 con 0x7f1d4814ffa0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1d481f3ce0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1d4000d880 con 0x7f1d4814ffa0 2024-04-23T10:13:35.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1d481f42a0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1d48075df0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1d4000da20 con 0x7f1d4814ffa0 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 0x7f1d3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1d40087720 con 0x7f1d4814ffa0 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4dc5e640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 0x7f1d3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:35.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.761+0000 7f1d4dc5e640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 0x7f1d3406a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000f70 tx=0x7f1d44007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:35.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.765+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1d400578c0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f1d480c7df0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d3e7fc640 1 -- 172.21.15.26:0/3599117810 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1d400571c0 con 0x7f1d4814ffa0 2024-04-23T10:13:35.930 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 msgr2=0x7f1d3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 0x7f1d3406a870 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f1d44000f70 tx=0x7f1d44007b60 comp rx=0 tx=0).stop 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 msgr2=0x7f1d481525e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.929+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f1d4000cea0 tx=0x7f1d4000cf90 comp rx=0 tx=0).stop 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 shutdown_connections 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1d340683b0 0x7f1d3406a870 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1d4814ffa0 0x7f1d481525e0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1d4814fbc0 0x7f1d4814bdd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 --2- 172.21.15.26:0/3599117810 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1d48074100 0x7f1d481517d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:35.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 >> 172.21.15.26:0/3599117810 conn(0x7f1d4806b9d0 msgr2=0x7f1d48145ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:35.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 shutdown_connections 2024-04-23T10:13:35.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:35.933+0000 7f1d4fec2640 1 -- 172.21.15.26:0/3599117810 wait complete. 2024-04-23T10:13:35.949 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:13:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 Processor -- start 2024-04-23T10:13:36.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 -- start start 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f806814fbc0 0x7f806806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80680c5d70 con 0x7f806814ffa0 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f80680c6050 con 0x7f8068074100 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f8070438640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f80680c6330 con 0x7f806814fbc0 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d9d3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f806814ffa0 0x7f80680c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49800/0 (socket says 172.21.15.26:49800) 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d9d3640 1 -- 172.21.15.26:0/2141791045 learned_addr learned my addr 172.21.15.26:0/2141791045 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:36.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e1d4640 1 --2- 172.21.15.26:0/2141791045 >> v2:172.21.15.190:3300/0 conn(0x7f806814fbc0 0x7f806806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1506686388 0 0) 0x7f80680c5d70 con 0x7f806814ffa0 2024-04-23T10:13:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8054003530 con 0x7f806814ffa0 2024-04-23T10:13:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 671426553 0 0) 0x7f8054003530 con 0x7f806814ffa0 2024-04-23T10:13:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 >> v2:172.21.15.190:3300/0 conn(0x7f806814fbc0 msgr2=0x7f806806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:36.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 --2- 172.21.15.26:0/2141791045 >> v2:172.21.15.190:3300/0 conn(0x7f806814fbc0 0x7f806806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 >> v1:172.21.15.190:6789/0 conn(0x7f8068074100 legacy=0x7f80680c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680c6610 con 0x7f806814ffa0 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f8058001680 con 0x7f806814ffa0 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 >> v1:172.21.15.26:6789/0 conn(0x7f806814ffa0 legacy=0x7f80680c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80540039c0 0x7f8054003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8054004810 0x7f8054004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f805400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f80680c6330 con 0x7f80540051d0 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f805400c070 con 0x7f8054004810 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f805400c270 con 0x7f80540039c0 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f805400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e1d4640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80540039c0 0x7f8054003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806d9d3640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8054004810 0x7f8054004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 -- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80540039c0 msgr2=0x7f8054003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80540039c0 0x7f8054003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 -- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8054004810 msgr2=0x7f8054004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8054004810 0x7f8054004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.077+0000 7f806e9d5640 1 -- 172.21.15.26:0/2141791045 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8054003530 con 0x7f80540051d0 2024-04-23T10:13:36.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806e9d5640 1 -- 172.21.15.26:0/2141791045 reap_dead start 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f805400b9d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f806815a080 tx=0x7f806401c720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0ef883dd7f830ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064001a90 con 0x7f80540051d0 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8064003b80 con 0x7f80540051d0 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806d1d2640 1 -- 172.21.15.26:0/2141791045 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8064005020 con 0x7f80540051d0 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 msgr2=0x7f805400b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f805400b9d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f806815a080 tx=0x7f806401c720 comp rx=0 tx=0).stop 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- 172.21.15.26:0/2141791045 shutdown_connections 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 --2- 172.21.15.26:0/2141791045 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f805400b9d0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- 172.21.15.26:0/2141791045 >> 172.21.15.26:0/2141791045 conn(0x7f806806b9d0 msgr2=0x7f806806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- 172.21.15.26:0/2141791045 shutdown_connections 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- 172.21.15.26:0/2141791045 wait complete. 2024-04-23T10:13:36.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 Processor -- start 2024-04-23T10:13:36.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- start start 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80680c1560 0x7f806814cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 0x7f806814b960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8068074530 con 0x7f80540051d0 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f80680c5bf0 con 0x7f806814b500 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f8070438640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f80680681d0 con 0x7f80680c1560 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806e1d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806e1d4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49730/0 (socket says 172.21.15.26:49730) 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.081+0000 7f806e1d4640 1 -- 172.21.15.26:0/2930984354 learned_addr learned my addr 172.21.15.26:0/2930984354 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 0x7f806814b960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806d9d3640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80680c1560 0x7f806814cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 -- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80680c1560 msgr2=0x7f806814cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80680c1560 0x7f806814cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 -- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 msgr2=0x7f806814b960 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 0x7f806814b960 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 -- 172.21.15.26:0/2930984354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f80680bedb0 con 0x7f80540051d0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e9d5640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 0x7f806814b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806e1d4640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8060011560 tx=0x7f8060011a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8060015930 con 0x7f80540051d0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8060015ad0 con 0x7f80540051d0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f80681ee710 con 0x7f80540051d0 2024-04-23T10:13:36.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f806001d400 con 0x7f80540051d0 2024-04-23T10:13:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f80681eecd0 con 0x7f80540051d0 2024-04-23T10:13:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8068075df0 con 0x7f80540051d0 2024-04-23T10:13:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f806001d5a0 con 0x7f80540051d0 2024-04-23T10:13:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 0x7f804c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8060087580 con 0x7f80540051d0 2024-04-23T10:13:36.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.085+0000 7f806d9d3640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 0x7f804c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.089+0000 7f806d9d3640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 0x7f804c06a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8058001ec0 tx=0x7f8058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.089+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8060019030 con 0x7f80540051d0 2024-04-23T10:13:36.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.257+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7f80680c7df0 con 0x7f80540051d0 2024-04-23T10:13:36.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.257+0000 7f805effd640 1 -- 172.21.15.26:0/2930984354 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7f80600577b0 con 0x7f80540051d0 2024-04-23T10:13:36.260 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 msgr2=0x7f804c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 0x7f804c06a870 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f8058001ec0 tx=0x7f8058009040 comp rx=0 tx=0).stop 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 msgr2=0x7f80680be870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f8060011560 tx=0x7f8060011a20 comp rx=0 tx=0).stop 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 shutdown_connections 2024-04-23T10:13:36.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f804c0683b0 0x7f804c06a870 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f806814b500 0x7f806814b960 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f80680c1560 0x7f806814cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 --2- 172.21.15.26:0/2930984354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f80540051d0 0x7f80680be870 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 >> 172.21.15.26:0/2930984354 conn(0x7f806806b9d0 msgr2=0x7f80680cad90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 shutdown_connections 2024-04-23T10:13:36.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.261+0000 7f8070438640 1 -- 172.21.15.26:0/2930984354 wait complete. 2024-04-23T10:13:36.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:13:36.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 Processor -- start 2024-04-23T10:13:36.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 -- start start 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d00c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa1d006f700 0x7fa1d015e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa1d00c4e80 con 0x7fa1d015ec50 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa1d00c4230 con 0x7fa1d006f700 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1d6191640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d015f0e0 con 0x7fa1d0155300 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fa1d015ec50 0x7fa1d00c6f70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49806/0 (socket says 172.21.15.26:49806) 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cffff640 1 -- 172.21.15.26:0/1943346810 learned_addr learned my addr 172.21.15.26:0/1943346810 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/1943346810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d00c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1ceffd640 1 --2- 172.21.15.26:0/1943346810 >> v2:172.21.15.190:3300/0 conn(0x7fa1d006f700 0x7fa1d015e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1ce7fc640 1 -- 172.21.15.26:0/1943346810 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2110610588 0 0) 0x7fa1d00c4e80 con 0x7fa1d015ec50 2024-04-23T10:13:36.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1ce7fc640 1 -- 172.21.15.26:0/1943346810 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa1b8003530 con 0x7fa1d015ec50 2024-04-23T10:13:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cf7fe640 1 -- 172.21.15.26:0/1943346810 >> v2:172.21.15.190:3300/0 conn(0x7fa1d006f700 msgr2=0x7fa1d015e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/1943346810 >> v2:172.21.15.190:3300/0 conn(0x7fa1d006f700 0x7fa1d015e710 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cf7fe640 1 -- 172.21.15.26:0/1943346810 >> v1:172.21.15.26:6789/0 conn(0x7fa1d015ec50 legacy=0x7fa1d00c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.401+0000 7fa1cf7fe640 1 -- 172.21.15.26:0/1943346810 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d015f320 con 0x7fa1d0155300 2024-04-23T10:13:36.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/1943346810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d00c3cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00097c0 tx=0x7fa1c001c4c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=d42a72c68d042aff server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1ce7fc640 1 -- 172.21.15.26:0/1943346810 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00b0070 con 0x7fa1d0155300 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1ce7fc640 1 -- 172.21.15.26:0/1943346810 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c00ab600 con 0x7fa1d0155300 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1ce7fc640 1 -- 172.21.15.26:0/1943346810 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c00ab9d0 con 0x7fa1d0155300 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- 172.21.15.26:0/1943346810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 msgr2=0x7fa1d00c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 --2- 172.21.15.26:0/1943346810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d00c3cf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00097c0 tx=0x7fa1c001c4c0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- 172.21.15.26:0/1943346810 shutdown_connections 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 --2- 172.21.15.26:0/1943346810 >> v2:172.21.15.190:3300/0 conn(0x7fa1d006f700 0x7fa1d015e710 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 --2- 172.21.15.26:0/1943346810 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d00c3cf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- 172.21.15.26:0/1943346810 >> 172.21.15.26:0/1943346810 conn(0x7fa1d006b9d0 msgr2=0x7fa1d006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- 172.21.15.26:0/1943346810 shutdown_connections 2024-04-23T10:13:36.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- 172.21.15.26:0/1943346810 wait complete. 2024-04-23T10:13:36.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 Processor -- start 2024-04-23T10:13:36.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.405+0000 7fa1d6191640 1 -- start start 2024-04-23T10:13:36.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 0x7fa1d00cb520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d0144010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00681d0 con 0x7fa1d015ec50 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa1d00c5770 con 0x7fa1d006f700 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa1d0068350 con 0x7fa1d0155300 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49742/0 (socket says 172.21.15.26:49742) 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 -- 172.21.15.26:0/3261562902 learned_addr learned my addr 172.21.15.26:0/3261562902 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1ceffd640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d0144010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 0x7fa1d00cb520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 -- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 msgr2=0x7fa1d0144010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d0144010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 -- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 msgr2=0x7fa1d00cb520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 0x7fa1d00cb520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 -- 172.21.15.26:0/3261562902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa1d00cadb0 con 0x7fa1d015ec50 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 0x7fa1d00cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cffff640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800caa0 tx=0x7fa1c800cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8017070 con 0x7fa1d015ec50 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1c800ac00 con 0x7fa1d015ec50 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa1d00cbe80 con 0x7fa1d015ec50 2024-04-23T10:13:36.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1c8012400 con 0x7fa1d015ec50 2024-04-23T10:13:36.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa1d015dcd0 con 0x7fa1d015ec50 2024-04-23T10:13:36.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa1d0075df0 con 0x7fa1d015ec50 2024-04-23T10:13:36.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa1c801a070 con 0x7fa1d015ec50 2024-04-23T10:13:36.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1c8086c30 con 0x7fa1d015ec50 2024-04-23T10:13:36.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.409+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.413+0000 7fa1cf7fe640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ad000 tx=0x7fa1c0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.413+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa1c8056d40 con 0x7fa1d015ec50 2024-04-23T10:13:36.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.577+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7fa1d01526a0 con 0x7fa1d015ec50 2024-04-23T10:13:36.578 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.577+0000 7fa1b7fff640 1 -- 172.21.15.26:0/3261562902 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7fa1c8056640 con 0x7fa1d015ec50 2024-04-23T10:13:36.579 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.577+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 msgr2=0x7fa1bc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 0x7fa1bc06a840 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7fa1c00ad000 tx=0x7fa1c0008040 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 msgr2=0x7fa1d0144550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7fa1c800caa0 tx=0x7fa1c800cf60 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 shutdown_connections 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa1bc068380 0x7fa1bc06a840 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa1d015ec50 0x7fa1d0144550 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa1d0155300 0x7fa1d0144010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 --2- 172.21.15.26:0/3261562902 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa1d006f700 0x7fa1d00cb520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.581 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 >> 172.21.15.26:0/3261562902 conn(0x7fa1d006b9d0 msgr2=0x7fa1d006bdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 shutdown_connections 2024-04-23T10:13:36.582 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.581+0000 7fa1d6191640 1 -- 172.21.15.26:0/3261562902 wait complete. 2024-04-23T10:13:36.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:36.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 Processor -- start 2024-04-23T10:13:36.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 -- start start 2024-04-23T10:13:36.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a840c78c0 0x7f2a84159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a840c4c50 con 0x7f2a8414f810 2024-04-23T10:13:36.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2a840c4f30 con 0x7f2a8414fbf0 2024-04-23T10:13:36.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a89992640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2a84158fe0 con 0x7f2a840c78c0 2024-04-23T10:13:36.720 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a837fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a840c78c0 0x7f2a84159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a82ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2a8414f810 0x7f2a840c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49820/0 (socket says 172.21.15.26:49820) 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a82ffd640 1 -- 172.21.15.26:0/2518082278 learned_addr learned my addr 172.21.15.26:0/2518082278 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a837fe640 1 -- 172.21.15.26:0/2518082278 >> v1:172.21.15.190:6789/0 conn(0x7f2a8414fbf0 legacy=0x7f2a840cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a827fc640 1 -- 172.21.15.26:0/2518082278 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196443817 0 0) 0x7f2a840c4c50 con 0x7f2a8414f810 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a837fe640 1 -- 172.21.15.26:0/2518082278 >> v1:172.21.15.26:6789/0 conn(0x7f2a8414f810 legacy=0x7f2a840c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.717+0000 7f2a837fe640 1 -- 172.21.15.26:0/2518082278 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a840c5210 con 0x7f2a840c78c0 2024-04-23T10:13:36.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a837fe640 1 --2- 172.21.15.26:0/2518082278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a84159470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2a84159160 tx=0x7f2a7c01f130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68800e263c433c6b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a827fc640 1 -- 172.21.15.26:0/2518082278 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0b4070 con 0x7f2a840c78c0 2024-04-23T10:13:36.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a827fc640 1 -- 172.21.15.26:0/2518082278 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a7c0af600 con 0x7f2a840c78c0 2024-04-23T10:13:36.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a827fc640 1 -- 172.21.15.26:0/2518082278 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a7c0af9d0 con 0x7f2a840c78c0 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 -- 172.21.15.26:0/2518082278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 msgr2=0x7f2a84159470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 --2- 172.21.15.26:0/2518082278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a84159470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f2a84159160 tx=0x7f2a7c01f130 comp rx=0 tx=0).stop 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 -- 172.21.15.26:0/2518082278 shutdown_connections 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 --2- 172.21.15.26:0/2518082278 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a84159470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 -- 172.21.15.26:0/2518082278 >> 172.21.15.26:0/2518082278 conn(0x7f2a8406fca0 msgr2=0x7f2a840700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 -- 172.21.15.26:0/2518082278 shutdown_connections 2024-04-23T10:13:36.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.721+0000 7f2a89992640 1 -- 172.21.15.26:0/2518082278 wait complete. 2024-04-23T10:13:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 Processor -- start 2024-04-23T10:13:36.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- start start 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 0x7f2a84144780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8414fbf0 0x7f2a8414db50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2a8406bb90 con 0x7f2a840c78c0 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2a840c57d0 con 0x7f2a8414f810 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2a840cdd50 con 0x7f2a8414fbf0 2024-04-23T10:13:36.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49756/0 (socket says 172.21.15.26:49756) 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 -- 172.21.15.26:0/3586586928 learned_addr learned my addr 172.21.15.26:0/3586586928 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a7bfff640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 0x7f2a84144780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 -- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8414fbf0 msgr2=0x7f2a8414db50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8414fbf0 0x7f2a8414db50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 -- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 msgr2=0x7f2a84144780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 0x7f2a84144780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 -- 172.21.15.26:0/3586586928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a841f08f0 con 0x7f2a840c78c0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a7bfff640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 0x7f2a84144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a82ffd640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c4a0 tx=0x7f2a7400c960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74018070 con 0x7f2a840c78c0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a740074e0 con 0x7f2a840c78c0 2024-04-23T10:13:36.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a841f4bb0 con 0x7f2a840c78c0 2024-04-23T10:13:36.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a74004a30 con 0x7f2a840c78c0 2024-04-23T10:13:36.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a841f1170 con 0x7f2a840c78c0 2024-04-23T10:13:36.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a84075df0 con 0x7f2a840c78c0 2024-04-23T10:13:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.725+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a7401b070 con 0x7f2a840c78c0 2024-04-23T10:13:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.729+0000 7f2a80ff9640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 0x7f2a6406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.729+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2a74085fd0 con 0x7f2a840c78c0 2024-04-23T10:13:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.729+0000 7f2a7bfff640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 0x7f2a6406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:36.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.729+0000 7f2a7bfff640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 0x7f2a6406a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a84159e60 tx=0x7f2a6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:36.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.733+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a74056200 con 0x7f2a840c78c0 2024-04-23T10:13:36.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.933+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a840c7670 con 0x7f2a840c78c0 2024-04-23T10:13:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.933+0000 7f2a80ff9640 1 -- 172.21.15.26:0/3586586928 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f2a74055b00 con 0x7f2a840c78c0 2024-04-23T10:13:36.936 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:36.936 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:13:36.936 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 msgr2=0x7f2a6406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 0x7f2a6406a870 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f2a84159e60 tx=0x7f2a6c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 msgr2=0x7f2a8414cdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x7f2a7400c4a0 tx=0x7f2a7400c960 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 shutdown_connections 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a640683b0 0x7f2a6406a870 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a8414fbf0 0x7f2a8414db50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a8414f810 0x7f2a84144780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 --2- 172.21.15.26:0/3586586928 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a840c78c0 0x7f2a8414cdf0 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:36.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 >> 172.21.15.26:0/3586586928 conn(0x7f2a8406fca0 msgr2=0x7f2a840c8a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 shutdown_connections 2024-04-23T10:13:36.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:36.937+0000 7f2a89992640 1 -- 172.21.15.26:0/3586586928 wait complete. 2024-04-23T10:13:36.954 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:13:37.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.061+0000 7f432e88b640 1 Processor -- start 2024-04-23T10:13:37.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.061+0000 7f432e88b640 1 -- start start 2024-04-23T10:13:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432e88b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4328159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432e88b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43280c4c50 con 0x7f432814f810 2024-04-23T10:13:37.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432e88b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43280c4f30 con 0x7f432814fbf0 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432e88b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4328158fe0 con 0x7f43280c78c0 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f432814f810 0x7f43280c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49830/0 (socket says 172.21.15.26:49830) 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 -- 172.21.15.26:0/2663320096 learned_addr learned my addr 172.21.15.26:0/2663320096 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432ce28640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4328159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 349098003 0 0) 0x7f43280c4c50 con 0x7f432814f810 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4310003530 con 0x7f432814f810 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2179408542 0 0) 0x7f4310003530 con 0x7f432814f810 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 msgr2=0x7f4328159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4328159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 >> v1:172.21.15.190:6789/0 conn(0x7f432814fbf0 legacy=0x7f43280cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43280c5210 con 0x7f432814f810 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4318001680 con 0x7f432814f810 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 >> v1:172.21.15.26:6789/0 conn(0x7f432814f810 legacy=0x7f43280c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43100039f0 0x7f4310003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4310004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4310004d50 0x7f43100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4328158fe0 con 0x7f43100039f0 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f431000bb10 con 0x7f4310004d50 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f431000bd10 con 0x7f43280c78c0 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43100039f0 0x7f4310003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f43277fe640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4310004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f432ce28640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4310004d50 0x7f43100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 -- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 msgr2=0x7f4310004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43280c78c0 0x7f4310004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 -- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4310004d50 msgr2=0x7f43100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4310004d50 0x7f43100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.065+0000 7f4327fff640 1 -- 172.21.15.26:0/2663320096 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4310003530 con 0x7f43100039f0 2024-04-23T10:13:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f4327fff640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43100039f0 0x7f4310003e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f431800c190 tx=0x7f431801f390 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73d1fa30edbb2436 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318007d00 con 0x7f43100039f0 2024-04-23T10:13:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4318005b00 con 0x7f43100039f0 2024-04-23T10:13:37.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f4326ffd640 1 -- 172.21.15.26:0/2663320096 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4318007070 con 0x7f43100039f0 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- 172.21.15.26:0/2663320096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43100039f0 msgr2=0x7f4310003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 --2- 172.21.15.26:0/2663320096 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43100039f0 0x7f4310003e30 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f431800c190 tx=0x7f431801f390 comp rx=0 tx=0).stop 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432ce28640 1 -- 172.21.15.26:0/2663320096 reap_dead start 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- 172.21.15.26:0/2663320096 shutdown_connections 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- 172.21.15.26:0/2663320096 >> 172.21.15.26:0/2663320096 conn(0x7f432806fca0 msgr2=0x7f43280700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- 172.21.15.26:0/2663320096 shutdown_connections 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- 172.21.15.26:0/2663320096 wait complete. 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 Processor -- start 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- start start 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43281441a0 0x7f43281e2d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43281e4780 0x7f43281e66c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f432806bb90 con 0x7f4328158b90 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43280c57d0 con 0x7f43281441a0 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432e88b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43280cdd50 con 0x7f43281e4780 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49764/0 (socket says 172.21.15.26:49764) 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 -- 172.21.15.26:0/1579208338 learned_addr learned my addr 172.21.15.26:0/1579208338 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f4327fff640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43281441a0 0x7f43281e2d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f432ce28640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43281e4780 0x7f43281e66c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 -- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43281e4780 msgr2=0x7f43281e66c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43281e4780 0x7f43281e66c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 -- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43281441a0 msgr2=0x7f43281e2d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43281441a0 0x7f43281e2d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 -- 172.21.15.26:0/1579208338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43281e4d00 con 0x7f4328158b90 2024-04-23T10:13:37.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.069+0000 7f43277fe640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e4d0 tx=0x7f431c00e990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c0053a0 con 0x7f4328158b90 2024-04-23T10:13:37.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f431c018070 con 0x7f4328158b90 2024-04-23T10:13:37.075 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f431c003820 con 0x7f4328158b90 2024-04-23T10:13:37.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43281e4fe0 con 0x7f4328158b90 2024-04-23T10:13:37.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4328158390 con 0x7f4328158b90 2024-04-23T10:13:37.076 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4328075df0 con 0x7f4328158b90 2024-04-23T10:13:37.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f431c0039c0 con 0x7f4328158b90 2024-04-23T10:13:37.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 0x7f431406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f431c086680 con 0x7f4328158b90 2024-04-23T10:13:37.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4327fff640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 0x7f431406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.073+0000 7f4327fff640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 0x7f431406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43180ae000 tx=0x7f4318007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.077+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f431c056800 con 0x7f4328158b90 2024-04-23T10:13:37.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.237+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f432806bd10 con 0x7f4328158b90 2024-04-23T10:13:37.239 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.237+0000 7f4324ff9640 1 -- 172.21.15.26:0/1579208338 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7f431c056100 con 0x7f4328158b90 2024-04-23T10:13:37.241 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:37.241 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:13:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 msgr2=0x7f431406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 0x7f431406a870 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f43180ae000 tx=0x7f4318007040 comp rx=0 tx=0).stop 2024-04-23T10:13:37.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 msgr2=0x7f43281f44f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7f431c00e4d0 tx=0x7f431c00e990 comp rx=0 tx=0).stop 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 shutdown_connections 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43140683b0 0x7f431406a870 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43281e4780 0x7f43281e66c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4328158b90 0x7f43281f44f0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 --2- 172.21.15.26:0/1579208338 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43281441a0 0x7f43281e2d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 >> 172.21.15.26:0/1579208338 conn(0x7f432806fca0 msgr2=0x7f4328159470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 shutdown_connections 2024-04-23T10:13:37.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.241+0000 7f432e88b640 1 -- 172.21.15.26:0/1579208338 wait complete. 2024-04-23T10:13:37.257 INFO:tasks.quiescer.fs.[cephfs]:Initializing Quiescer with random seed 993729 2024-04-23T10:13:37.257 DEBUG:tasks.quiescer:Yielding 2024-04-23T10:13:37.257 INFO:teuthology.run_tasks:Running task workunit... 2024-04-23T10:13:37.270 INFO:tasks.workunit:Pulling workunits from ref 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:13:37.270 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-23T10:13:37.270 INFO:tasks.workunit:timeout=6h 2024-04-23T10:13:37.270 INFO:tasks.workunit:cleanup=True 2024-04-23T10:13:37.271 DEBUG:teuthology.orchestra.run.smithi026:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:37.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:37.276 INFO:teuthology.orchestra.run.smithi026.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:37.276 INFO:teuthology.orchestra.run.smithi026.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout:Device: 2dh/45d Inode: 1 Links: 2 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout:Modify: 2024-04-23 10:12:40.008744516 +0000 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout:Change: 2024-04-23 10:12:50.520446474 +0000 2024-04-23T10:13:37.277 INFO:teuthology.orchestra.run.smithi026.stdout: Birth: - 2024-04-23T10:13:37.277 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-04-23T10:13:37.277 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-04-23T10:13:37.340 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 0a6c3ed699031b80a2b419e7e795368719871394 2024-04-23T10:13:37.378 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 Processor -- start 2024-04-23T10:13:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 -- start start 2024-04-23T10:13:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f59e00c6300 0x7f59e0152c70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e00ca960 con 0x7f59e00c5f20 2024-04-23T10:13:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f59e00c7f30 con 0x7f59e00c9c10 2024-04-23T10:13:37.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e7b38640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f59e00ca0c0 con 0x7f59e00c6300 2024-04-23T10:13:37.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e58d4640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f59e00c5f20 0x7f59e00c86f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49846/0 (socket says 172.21.15.26:49846) 2024-04-23T10:13:37.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e58d4640 1 -- 172.21.15.26:0/3364912792 learned_addr learned my addr 172.21.15.26:0/3364912792 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:37.381 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2893555374 0 0) 0x7f59e00ca960 con 0x7f59e00c5f20 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f59cc003530 con 0x7f59e00c5f20 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e60d5640 1 --2- 172.21.15.26:0/3364912792 >> v2:172.21.15.190:3300/0 conn(0x7f59e00c6300 0x7f59e0152c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3125963393 0 0) 0x7f59cc003530 con 0x7f59e00c5f20 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 >> v2:172.21.15.190:3300/0 conn(0x7f59e00c6300 msgr2=0x7f59e0152c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 --2- 172.21.15.26:0/3364912792 >> v2:172.21.15.190:3300/0 conn(0x7f59e00c6300 0x7f59e0152c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 >> v1:172.21.15.190:6789/0 conn(0x7f59e00c9c10 legacy=0x7f59e00c91c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e00ca3a0 con 0x7f59e00c5f20 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f59dc001680 con 0x7f59e00c5f20 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 >> v1:172.21.15.26:6789/0 conn(0x7f59e00c5f20 legacy=0x7f59e00c86f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59cc0039c0 0x7f59cc003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 0x7f59cc004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc0051d0 0x7f59cc00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f59e00ca0c0 con 0x7f59cc004810 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59cc00c100 con 0x7f59cc0051d0 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.377+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59cc00c300 con 0x7f59cc0039c0 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 0x7f59cc004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e60d5640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc0051d0 0x7f59cc00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 -- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59cc0039c0 msgr2=0x7f59cc003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59cc0039c0 0x7f59cc003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 -- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc0051d0 msgr2=0x7f59cc00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc0051d0 0x7f59cc00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e60d5640 1 -- 172.21.15.26:0/3364912792 reap_dead start 2024-04-23T10:13:37.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 -- 172.21.15.26:0/3364912792 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59cc003530 con 0x7f59cc004810 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e50d3640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 0x7f59cc004c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59d0001780 tx=0x7f59d001c400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3652319843241a9a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d00013a0 con 0x7f59cc004810 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d00052f0 con 0x7f59cc004810 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e48d2640 1 -- 172.21.15.26:0/3364912792 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d0003840 con 0x7f59cc004810 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 -- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 msgr2=0x7f59cc004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 0x7f59cc004c90 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f59d0001780 tx=0x7f59d001c400 comp rx=0 tx=0).stop 2024-04-23T10:13:37.385 INFO:tasks.workunit.client.0.smithi026.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-23T10:13:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 -- 172.21.15.26:0/3364912792 shutdown_connections 2024-04-23T10:13:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 --2- 172.21.15.26:0/3364912792 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59cc004810 0x7f59cc004c90 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 -- 172.21.15.26:0/3364912792 >> 172.21.15.26:0/3364912792 conn(0x7f59e00676a0 msgr2=0x7f59e0067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:37.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 -- 172.21.15.26:0/3364912792 shutdown_connections 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.381+0000 7f59e7b38640 1 -- 172.21.15.26:0/3364912792 wait complete. 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 Processor -- start 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- start start 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc004810 0x7f59e01e2c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e01e48c0 0x7f59e01f1e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f59e00c5830 con 0x7f59e01e3960 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f59e00c81d0 con 0x7f59cc004810 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f59e00c59b0 con 0x7f59e01e48c0 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49788/0 (socket says 172.21.15.26:49788) 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 -- 172.21.15.26:0/146268488 learned_addr learned my addr 172.21.15.26:0/146268488 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:37.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e58d4640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc004810 0x7f59e01e2c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e50d3640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e01e48c0 0x7f59e01f1e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 -- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e01e48c0 msgr2=0x7f59e01f1e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e01e48c0 0x7f59e01f1e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 -- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc004810 msgr2=0x7f59e01e2c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc004810 0x7f59e01e2c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 -- 172.21.15.26:0/146268488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f59e01e31d0 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e60d5640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f59e0070690 tx=0x7f59d8009dc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8019070 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59d8007d90 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f59d8014640 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f59e01f2740 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f59e01f2a00 con 0x7f59e01e3960 2024-04-23T10:13:37.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f59e0075df0 con 0x7f59e01e3960 2024-04-23T10:13:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.385+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f59d801c070 con 0x7f59e01e3960 2024-04-23T10:13:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.389+0000 7f59d67fc640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.389+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f59d8086920 con 0x7f59e01e3960 2024-04-23T10:13:37.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.389+0000 7f59e58d4640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:37.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.389+0000 7f59e58d4640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 0x7f59c406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001870 tx=0x7f59dc001640 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:37.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.393+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f59d8056500 con 0x7f59e01e3960 2024-04-23T10:13:37.583 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.581+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f59e00cc610 con 0x7f59e01e3960 2024-04-23T10:13:37.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.581+0000 7f59d67fc640 1 -- 172.21.15.26:0/146268488 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f59d805a800 con 0x7f59e01e3960 2024-04-23T10:13:37.584 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:37.584 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:13:37.584 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 msgr2=0x7f59c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 0x7f59c406a840 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f59dc001870 tx=0x7f59dc001640 comp rx=0 tx=0).stop 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 msgr2=0x7f59e014c0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f59e0070690 tx=0x7f59d8009dc0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 shutdown_connections 2024-04-23T10:13:37.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f59c4068380 0x7f59c406a840 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f59e01e3960 0x7f59e014c0d0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f59e01e48c0 0x7f59e01f1e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 --2- 172.21.15.26:0/146268488 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f59cc004810 0x7f59e01e2c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 >> 172.21.15.26:0/146268488 conn(0x7f59e00676a0 msgr2=0x7f59e01565a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 shutdown_connections 2024-04-23T10:13:37.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:37.585+0000 7f59e7b38640 1 -- 172.21.15.26:0/146268488 wait complete. 2024-04-23T10:13:38.205 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: mds map: {'epoch': 19, 'flags': 18, 'flags_state': {'joinable': True, 'allow_snaps': True, 'allow_multimds_snaps': True, 'allow_standby_replay': False, 'refuse_client_session': False, 'refuse_standby_for_another_fs': False, 'balance_automate': False}, 'ever_allowed_features': 0, 'explicitly_allowed_features': 0, 'created': '2024-04-23T10:12:34.380485+0000', 'modified': '2024-04-23T10:13:21.048533+0000', 'tableserver': 0, 'root': 0, 'session_timeout': 300, 'session_autoclose': 300, 'required_client_features': {}, 'max_file_size': 1099511627776, 'max_xattr_size': 65536, 'last_failure': 0, 'last_failure_osd_epoch': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}, 'max_mds': 5, 'in': [0, 1, 2, 3, 4], 'up': {'mds_0': 4287, 'mds_1': 4284, 'mds_2': 4282, 'mds_3': 4275, 'mds_4': 4260}, 'failed': [], 'damaged': [], 'stopped': [], 'info': {'gid_4260': {'gid': 4260, 'name': 'c', 'rank': 4, 'incarnation': 18, 'state': 'up:active', 'state_seq': 15, 'addr': '172.21.15.26:6833/3926029460', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6832', 'nonce': 3926029460}, {'type': 'v1', 'addr': '172.21.15.26:6833', 'nonce': 3926029460}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4275': {'gid': 4275, 'name': 'e', 'rank': 3, 'incarnation': 16, 'state': 'up:active', 'state_seq': 13, 'addr': '172.21.15.26:6836/2066596634', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6834', 'nonce': 2066596634}, {'type': 'v1', 'addr': '172.21.15.26:6836', 'nonce': 2066596634}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4282': {'gid': 4282, 'name': 'd', 'rank': 2, 'incarnation': 14, 'state': 'up:active', 'state_seq': 12, 'addr': '172.21.15.190:6837/1581526507', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6835', 'nonce': 1581526507}, {'type': 'v1', 'addr': '172.21.15.190:6837', 'nonce': 1581526507}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4284': {'gid': 4284, 'name': 'a', 'rank': 1, 'incarnation': 10, 'state': 'up:active', 'state_seq': 10, 'addr': '172.21.15.26:6837/1290255157', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.26:6835', 'nonce': 1290255157}, {'type': 'v1', 'addr': '172.21.15.26:6837', 'nonce': 1290255157}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}, 'gid_4287': {'gid': 4287, 'name': 'f', 'rank': 0, 'incarnation': 4, 'state': 'up:active', 'state_seq': 5, 'addr': '172.21.15.190:6838/585421961', 'addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.190:6834', 'nonce': 585421961}, {'type': 'v1', 'addr': '172.21.15.190:6838', 'nonce': 585421961}]}, 'join_fscid': -1, 'export_targets': [], 'features': 4540701547738038271, 'flags': 0, 'compat': {'compat': {}, 'ro_compat': {}, 'incompat': {'feature_1': 'base v0.20', 'feature_2': 'client writeable ranges', 'feature_3': 'default file layouts on dirs', 'feature_4': 'dir inode in separate object', 'feature_5': 'mds uses versioned encoding', 'feature_6': 'dirfrag is stored in omap', 'feature_7': 'mds uses inline data', 'feature_8': 'no anchor table', 'feature_9': 'file layout v2', 'feature_10': 'snaprealm v2', 'feature_11': 'minor log segments', 'feature_12': 'quiesce subvolumes'}}}}, 'data_pools': [3, 4], 'metadata_pool': 2, 'enabled': True, 'fs_name': 'cephfs', 'balancer': '', 'bal_rank_mask': '-1', 'standby_count_wanted': 0, 'qdb_leader': 4287, 'qdb_cluster': [4260, 4275, 4282, 4284, 4287]} 2024-04-23T10:13:38.205 DEBUG:tasks.cephfs.filesystem:are_daemons_healthy: 5/5 2024-04-23T10:13:38.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.c status 2024-04-23T10:13:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 Processor -- start 2024-04-23T10:13:38.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 -- start start 2024-04-23T10:13:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 0x7eff280c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 0x7eff280c6380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7eff280cada0 con 0x7eff280ca550 2024-04-23T10:13:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7eff280cb080 con 0x7eff280c7eb0 2024-04-23T10:13:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff2d999640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff280c9360 con 0x7eff28152ff0 2024-04-23T10:13:38.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 0x7eff280c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff267fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 0x7eff280c6380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff267fc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 0x7eff280c6380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:51028/0 (socket says 172.21.15.26:51028) 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff267fc640 1 -- 172.21.15.26:0/618487074 learned_addr learned my addr 172.21.15.26:0/618487074 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff277fe640 1 --1- 172.21.15.26:0/618487074 >> v1:172.21.15.190:6789/0 conn(0x7eff280ca550 0x7eff280cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:60404/0 (socket says 172.21.15.26:60404) 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff26ffd640 1 -- 172.21.15.26:0/618487074 >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 msgr2=0x7eff280c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff26ffd640 1 --2- 172.21.15.26:0/618487074 >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 0x7eff280c6380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff26ffd640 1 -- 172.21.15.26:0/618487074 >> v1:172.21.15.190:6789/0 conn(0x7eff280ca550 legacy=0x7eff280cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.345+0000 7eff26ffd640 1 -- 172.21.15.26:0/618487074 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff280c9640 con 0x7eff28152ff0 2024-04-23T10:13:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff26ffd640 1 --2- 172.21.15.26:0/618487074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 0x7eff280c5730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff180097c0 tx=0x7eff1801ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=4effe5504851d267 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff25ffb640 1 -- 172.21.15.26:0/618487074 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180b5070 con 0x7eff28152ff0 2024-04-23T10:13:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff25ffb640 1 -- 172.21.15.26:0/618487074 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff180a8990 con 0x7eff28152ff0 2024-04-23T10:13:38.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff25ffb640 1 -- 172.21.15.26:0/618487074 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180a8d60 con 0x7eff28152ff0 2024-04-23T10:13:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- 172.21.15.26:0/618487074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 msgr2=0x7eff280c5730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 --2- 172.21.15.26:0/618487074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 0x7eff280c5730 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7eff180097c0 tx=0x7eff1801ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- 172.21.15.26:0/618487074 shutdown_connections 2024-04-23T10:13:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 --2- 172.21.15.26:0/618487074 >> v2:172.21.15.190:3300/0 conn(0x7eff280c7eb0 0x7eff280c6380 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 --2- 172.21.15.26:0/618487074 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff28152ff0 0x7eff280c5730 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- 172.21.15.26:0/618487074 >> 172.21.15.26:0/618487074 conn(0x7eff280676a0 msgr2=0x7eff28067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- 172.21.15.26:0/618487074 shutdown_connections 2024-04-23T10:13:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- 172.21.15.26:0/618487074 wait complete. 2024-04-23T10:13:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 Processor -- start 2024-04-23T10:13:38.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.349+0000 7eff2d999640 1 -- start start 2024-04-23T10:13:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff280c7eb0 0x7eff2815b6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff28152ff0 0x7eff281f10d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7eff280caaa0 con 0x7eff280ca550 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7eff280c5e60 con 0x7eff28152ff0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff280c68c0 con 0x7eff280c7eb0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49794/0 (socket says 172.21.15.26:49794) 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 -- 172.21.15.26:0/525615635 learned_addr learned my addr 172.21.15.26:0/525615635 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff26ffd640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff280c7eb0 0x7eff2815b6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff277fe640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff28152ff0 0x7eff281f10d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 -- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff280c7eb0 msgr2=0x7eff2815b6c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff280c7eb0 0x7eff2815b6c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 -- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff28152ff0 msgr2=0x7eff281f10d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff28152ff0 0x7eff281f10d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 -- 172.21.15.26:0/525615635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff2806e4e0 con 0x7eff280ca550 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff267fc640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e910 tx=0x7eff1c00edd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff0ffff640 1 -- 172.21.15.26:0/525615635 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c017070 con 0x7eff280ca550 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff0ffff640 1 -- 172.21.15.26:0/525615635 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1c00ca00 con 0x7eff280ca550 2024-04-23T10:13:38.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff2806e7a0 con 0x7eff280ca550 2024-04-23T10:13:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff0ffff640 1 -- 172.21.15.26:0/525615635 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c00cdd0 con 0x7eff280ca550 2024-04-23T10:13:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff28147b80 con 0x7eff280ca550 2024-04-23T10:13:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.353+0000 7eff0ffff640 1 -- 172.21.15.26:0/525615635 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff1c013470 con 0x7eff280ca550 2024-04-23T10:13:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff0ffff640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 0x7eff1406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff0ffff640 1 -- 172.21.15.26:0/525615635 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff1c086e20 con 0x7eff280ca550 2024-04-23T10:13:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff26ffd640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 0x7eff1406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 Processor -- start 2024-04-23T10:13:38.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- start start 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff26ffd640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 0x7eff1406a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff180b2000 tx=0x7eff180aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa5a570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa95080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5629ba8a3420 con 0x5629baa955c0 2024-04-23T10:13:38.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5629ba83dbf0 con 0x5629baa5a190 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5629ba89f3e0 con 0x5629baa5aab0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49804/0 (socket says 172.21.15.26:49804) 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 -- 172.21.15.26:0/1690514610 learned_addr learned my addr 172.21.15.26:0/1690514610 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff267fc640 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa95080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff26ffd640 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa5a570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 -- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 msgr2=0x5629baa95080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa95080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 -- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 msgr2=0x5629baa5a570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa5a570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 -- 172.21.15.26:0/1690514610 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ba94b450 con 0x5629baa955c0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff277fe640 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff200078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2b824cee4135559 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff0d7fa640 1 -- 172.21.15.26:0/1690514610 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20019070 con 0x5629baa955c0 2024-04-23T10:13:38.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff0d7fa640 1 -- 172.21.15.26:0/1690514610 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20001d10 con 0x5629baa955c0 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff0d7fa640 1 -- 172.21.15.26:0/1690514610 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20014480 con 0x5629baa955c0 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- 172.21.15.26:0/1690514610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 msgr2=0x5629baa959a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7eff20007fd0 tx=0x7eff200078a0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- 172.21.15.26:0/1690514610 shutdown_connections 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa959a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa95080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1690514610 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa5a570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- 172.21.15.26:0/1690514610 >> 172.21.15.26:0/1690514610 conn(0x5629baa91e40 msgr2=0x5629baa94260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- 172.21.15.26:0/1690514610 shutdown_connections 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- 172.21.15.26:0/1690514610 wait complete. 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 -- start start 2024-04-23T10:13:38.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.357+0000 7eff30b1b000 1 Processor -- start 2024-04-23T10:13:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa56c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa57160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.366 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5629ba843ec0 con 0x5629baa955c0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5629ba924120 con 0x5629baa5a190 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5629ba8ae350 con 0x5629baa5aab0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 10 client.0 _ll_register_callbacks cb 0x5629ba8804d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49810/0 (socket says 172.21.15.26:49810) 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 -- 172.21.15.26:0/2786671363 learned_addr learned my addr 172.21.15.26:0/2786671363 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff267fc640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa57160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff26ffd640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa56c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 -- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 msgr2=0x5629baa57160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa57160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 -- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 msgr2=0x5629baa56c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa56c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 -- 172.21.15.26:0/2786671363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ba8e8f80 con 0x5629baa955c0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff26ffd640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa56c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff277fe640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7eff200012f0 tx=0x7eff20001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=874c4cfca775ccd0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff20019070 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff20004d80 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff20001d10 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7eff2002d050 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 10 client.5127 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5629ba87cf00 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff20001d10 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7eff20030020 con 0x5629baa955c0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 10 client.5127 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 10 client.5127 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 20 client.5127 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629baaa9d90 0x5629baaac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 4 client.5127 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 --> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5629ba83cbc0 con 0x5629baaa9d90 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff26ffd640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629baaa9d90 0x5629baaac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 10 client.5127 ms_handle_connect on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff26ffd640 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629baaa9d90 0x5629baaac180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=c3c18e6aa1d70392 server_cookie=1a816bc4638f1124 in_seq=0 out_seq=0 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 1 -- 172.21.15.26:0/2786671363 <== mds.4 v2:172.21.15.26:6832/3926029460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5629ba83cbc0 con 0x5629baaa9d90 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 10 client.5127 handle_command_reply: tid=0 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 client.5127 shutdown 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 msgr2=0x5629baa576a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7eff200012f0 tx=0x7eff20001260 comp rx=0 tx=0).stop 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 shutdown_connections 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629baaa9d90 0x5629baaac180 crc :-1 s=READY pgs=16 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa955c0 0x5629baa576a0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5aab0 0x5629baa57160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 --2- 172.21.15.26:0/2786671363 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5a190 0x5629baa56c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff067fc640 0 client.5127 ms_handle_reset on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 >> 172.21.15.26:0/2786671363 conn(0x5629baa91e40 msgr2=0x5629baa931c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 shutdown_connections 2024-04-23T10:13:38.369 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 1 -- 172.21.15.26:0/2786671363 wait complete. 2024-04-23T10:13:38.370 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.361+0000 7eff30b1b000 20 client.5127 trim_cache size 0 max 16384 2024-04-23T10:13:38.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 Processor -- start 2024-04-23T10:13:38.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- start start 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5a190 0x5629baa8fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 0x5629baaac180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7eff281fe740 con 0x5629baa5aab0 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7eff281fee10 con 0x5629baa955c0 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff281f50d0 con 0x5629baa5a190 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49816/0 (socket says 172.21.15.26:49816) 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 -- 172.21.15.26:0/1770538911 learned_addr learned my addr 172.21.15.26:0/1770538911 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff277fe640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 0x5629baaac180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff26ffd640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5a190 0x5629baa8fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 -- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5a190 msgr2=0x5629baa8fe90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5a190 0x5629baa8fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 -- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 msgr2=0x5629baaac180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 0x5629baaac180 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 -- 172.21.15.26:0/1770538911 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629ba829e80 con 0x5629baa5aab0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff277fe640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 0x5629baaac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff267fc640 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e8e0 tx=0x7eff1c056f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa14f8e805727db8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff0cff9640 1 -- 172.21.15.26:0/1770538911 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c082030 con 0x5629baa5aab0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff0cff9640 1 -- 172.21.15.26:0/1770538911 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1c05f4a0 con 0x5629baa5aab0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff0cff9640 1 -- 172.21.15.26:0/1770538911 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff1c020040 con 0x5629baa5aab0 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- 172.21.15.26:0/1770538911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 msgr2=0x5629baa903d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e8e0 tx=0x7eff1c056f30 comp rx=0 tx=0).stop 2024-04-23T10:13:38.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- 172.21.15.26:0/1770538911 shutdown_connections 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa955c0 0x5629baaac180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5aab0 0x5629baa903d0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1770538911 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa5a190 0x5629baa8fe90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.381+0000 7eff30b1b000 1 -- 172.21.15.26:0/1770538911 >> 172.21.15.26:0/1770538911 conn(0x5629baa91e40 msgr2=0x5629baa53ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1770538911 shutdown_connections 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1770538911 wait complete. 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- start start 2024-04-23T10:13:38.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 Processor -- start 2024-04-23T10:13:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5aab0 0x5629bab04610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa955c0 0x5629bab04f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5629ba8a2730 con 0x5629baa5a190 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5629ba86f9e0 con 0x5629baa5aab0 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5629ba8a7a50 con 0x5629baa955c0 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 10 client.0 _ll_register_callbacks cb 0x7eff20017070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49820/0 (socket says 172.21.15.26:49820) 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 -- 172.21.15.26:0/1179812358 learned_addr learned my addr 172.21.15.26:0/1179812358 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 -- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa955c0 msgr2=0x5629bab04f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa955c0 0x5629bab04f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 -- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5aab0 msgr2=0x5629bab04610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5aab0 0x5629bab04610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 -- 172.21.15.26:0/1179812358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629ba86bb30 con 0x5629baa5a190 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff26ffd640 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7eff1801ecd0 tx=0x7eff180046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=75fc0ceb9579ffd7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff180b5040 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff18004040 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff1c05f4a0 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7eff180d8050 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 10 client.5133 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5629ba9245b0 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff1c05f4a0 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7eff180db020 con 0x5629baa5a190 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 10 client.5133 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 10 client.5133 resolve_mds: resolved name 'c' to daemon mds.c 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 20 client.5133 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629bab05740 0x5629bab05b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 4 client.5133 mds_command: new command op to 4260 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:38.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 --> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] -- command(tid 0: {"prefix": "status"}) -- 0x5629ba8b0e40 con 0x5629bab05740 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff267fc640 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629bab05740 0x5629bab05b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff267fc640 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629bab05740 0x5629bab05b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.4 client_cookie=3d49f5e790378f3b server_cookie=e9f6cf9c6d98dadd in_seq=0 out_seq=0 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 10 client.5133 ms_handle_connect on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 1 -- 172.21.15.26:0/1179812358 <== mds.4 v2:172.21.15.26:6832/3926029460 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x5629ba8b0e40 con 0x5629bab05740 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 10 client.5133 handle_command_reply: tid=0 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 client.5133 shutdown 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 msgr2=0x5629bab040d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7eff1801ecd0 tx=0x7eff180046d0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 shutdown_connections 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:6832/3926029460,v1:172.21.15.26:6833/3926029460] conn(0x5629bab05740 0x5629bab05b20 crc :-1 s=READY pgs=17 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5629baa955c0 0x5629bab04f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5629baa5aab0 0x5629bab04610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 --2- 172.21.15.26:0/1179812358 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5629baa5a190 0x5629bab040d0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff067fc640 0 client.5133 ms_handle_reset on v2:172.21.15.26:6832/3926029460 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 >> 172.21.15.26:0/1179812358 conn(0x5629baa91e40 msgr2=0x5629baa53110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 shutdown_connections 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 1 -- 172.21.15.26:0/1179812358 wait complete. 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.385+0000 7eff30b1b000 20 client.5133 trim_cache size 0 max 16384 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 4, 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4260, 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:38.394 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 23.357374202999999, 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 70.430456366000001 2024-04-23T10:13:38.395 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 msgr2=0x7eff1406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 0x7eff1406a870 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7eff180b2000 tx=0x7eff180aa070 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 msgr2=0x7eff2814c420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7eff1c00e910 tx=0x7eff1c00edd0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 shutdown_connections 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff140683b0 0x7eff1406a870 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff28152ff0 0x7eff281f10d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff280ca550 0x7eff2814c420 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 --2- 172.21.15.26:0/525615635 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff280c7eb0 0x7eff2815b6c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 >> 172.21.15.26:0/525615635 conn(0x7eff280676a0 msgr2=0x7eff28150820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 shutdown_connections 2024-04-23T10:13:38.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.389+0000 7eff2d999640 1 -- 172.21.15.26:0/525615635 wait complete. 2024-04-23T10:13:38.405 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.e status 2024-04-23T10:13:38.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 Processor -- start 2024-04-23T10:13:38.522 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 -- start start 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4db414fbc0 0x7f4db406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 0x7f4db40c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4db40c5d70 con 0x7f4db4074100 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4db40c6050 con 0x7f4db414fbc0 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db9a5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4db40c6330 con 0x7f4db414ffa0 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db37fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4db4074100 0x7f4db40c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49862/0 (socket says 172.21.15.26:49862) 2024-04-23T10:13:38.523 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db37fe640 1 -- 172.21.15.26:0/2734341328 learned_addr learned my addr 172.21.15.26:0/2734341328 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db27fc640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 0x7f4db40c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2734341328 >> v2:172.21.15.190:3300/0 conn(0x7f4db414fbc0 0x7f4db406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2088013332 0 0) 0x7f4db40c5d70 con 0x7f4db4074100 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d9c003530 con 0x7f4db4074100 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4270362833 0 0) 0x7f4d9c003530 con 0x7f4db4074100 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 msgr2=0x7f4db40c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 0x7f4db40c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 >> v2:172.21.15.190:3300/0 conn(0x7f4db414fbc0 msgr2=0x7f4db406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 --2- 172.21.15.26:0/2734341328 >> v2:172.21.15.190:3300/0 conn(0x7f4db414fbc0 0x7f4db406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db40c6610 con 0x7f4db4074100 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4dac001a00 con 0x7f4db4074100 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 >> v1:172.21.15.26:6789/0 conn(0x7f4db4074100 legacy=0x7f4db40c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c0039c0 0x7f4d9c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 0x7f4d9c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40c6050 con 0x7f4d9c0039c0 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40c6330 con 0x7f4d9c004810 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d9c00b9d0 con 0x7f4db414ffa0 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c0039c0 0x7f4d9c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 -- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 msgr2=0x7f4d9c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4db414ffa0 0x7f4d9c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 -- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c004810 msgr2=0x7f4d9c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db27fc640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d9c004810 0x7f4d9c004c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.521+0000 7f4db2ffd640 1 -- 172.21.15.26:0/2734341328 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d9c003530 con 0x7f4d9c0039c0 2024-04-23T10:13:38.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c0039c0 0x7f4d9c003de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009ae0 tx=0x7f4da401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee5709966f148f9e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.527 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da40b2070 con 0x7f4d9c0039c0 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da40a55c0 con 0x7f4d9c0039c0 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db1ffb640 1 -- 172.21.15.26:0/2734341328 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da40096b0 con 0x7f4d9c0039c0 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 -- 172.21.15.26:0/2734341328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c0039c0 msgr2=0x7f4d9c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/2734341328 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d9c0039c0 0x7f4d9c003de0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7f4da4009ae0 tx=0x7f4da401cab0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db37fe640 1 -- 172.21.15.26:0/2734341328 reap_dead start 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 -- 172.21.15.26:0/2734341328 shutdown_connections 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 -- 172.21.15.26:0/2734341328 >> 172.21.15.26:0/2734341328 conn(0x7f4db406b9d0 msgr2=0x7f4db406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 -- 172.21.15.26:0/2734341328 shutdown_connections 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 -- 172.21.15.26:0/2734341328 wait complete. 2024-04-23T10:13:38.528 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.525+0000 7f4db9a5f640 1 Processor -- start 2024-04-23T10:13:38.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- start start 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d9c0039c0 0x7f4db4150ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4db4159e30 0x7f4db41f2380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4163c00 con 0x7f4db414b100 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4db4163a80 con 0x7f4db4159e30 2024-04-23T10:13:38.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4db4163d80 con 0x7f4d9c0039c0 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49840/0 (socket says 172.21.15.26:49840) 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 -- 172.21.15.26:0/566675082 learned_addr learned my addr 172.21.15.26:0/566675082 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d9c0039c0 0x7f4db4150ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db27fc640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4db4159e30 0x7f4db41f2380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 -- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d9c0039c0 msgr2=0x7f4db4150ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d9c0039c0 0x7f4db4150ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 -- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4db4159e30 msgr2=0x7f4db41f2380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4db4159e30 0x7f4db41f2380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 -- 172.21.15.26:0/566675082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4db4162b00 con 0x7f4db414b100 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db37fe640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ca3b0 tx=0x7f4dac00cf00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4d9bfff640 1 -- 172.21.15.26:0/566675082 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00a5e0 con 0x7f4db414b100 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4d9bfff640 1 -- 172.21.15.26:0/566675082 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dac00a780 con 0x7f4db414b100 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4db41f2c10 con 0x7f4db414b100 2024-04-23T10:13:38.531 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4d9bfff640 1 -- 172.21.15.26:0/566675082 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac00ab30 con 0x7f4db414b100 2024-04-23T10:13:38.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4db41f31d0 con 0x7f4db414b100 2024-04-23T10:13:38.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4d9bfff640 1 -- 172.21.15.26:0/566675082 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4dac00acd0 con 0x7f4db414b100 2024-04-23T10:13:38.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.529+0000 7f4d9bfff640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 0x7f4da006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.532 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4d9bfff640 1 -- 172.21.15.26:0/566675082 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4dac0866f0 con 0x7f4db414b100 2024-04-23T10:13:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 0x7f4da006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 Processor -- start 2024-04-23T10:13:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- start start 2024-04-23T10:13:38.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 0x7f4da006a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4da40af000 tx=0x7f4da40046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416f63b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fad80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562a41508420 con 0x562a416fa080 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a414a2bf0 con 0x562a416fa9a0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562a415043e0 con 0x562a416f5fd0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49846/0 (socket says 172.21.15.26:49846) 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 -- 172.21.15.26:0/2672671702 learned_addr learned my addr 172.21.15.26:0/2672671702 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416f63b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db37fe640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fad80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 -- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 msgr2=0x562a416f63b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416f63b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 -- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 msgr2=0x562a416fad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fad80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 -- 172.21.15.26:0/2672671702 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a415b0450 con 0x562a416fa080 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db37fe640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4db27fc640 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009b00 tx=0x7f4da8009190 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5705dda928237e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4d997fa640 1 -- 172.21.15.26:0/2672671702 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8019030 con 0x562a416fa080 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4d997fa640 1 -- 172.21.15.26:0/2672671702 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8012a30 con 0x562a416fa080 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4d997fa640 1 -- 172.21.15.26:0/2672671702 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da800f040 con 0x562a416fa080 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2672671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 msgr2=0x562a416fa460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f4da8009b00 tx=0x7f4da8009190 comp rx=0 tx=0).stop 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2672671702 shutdown_connections 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fad80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fa460 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2672671702 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416f63b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2672671702 >> 172.21.15.26:0/2672671702 conn(0x562a416f6e40 msgr2=0x562a416f9260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2672671702 shutdown_connections 2024-04-23T10:13:38.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2672671702 wait complete. 2024-04-23T10:13:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 -- start start 2024-04-23T10:13:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.533+0000 7f4dbcbe1000 1 Processor -- start 2024-04-23T10:13:38.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416fd2d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fdd50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562a414a8ec0 con 0x562a416fa080 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a41589120 con 0x562a416fa9a0 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562a41513350 con 0x562a416f5fd0 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 10 client.0 _ll_register_callbacks cb 0x562a414e54d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49854/0 (socket says 172.21.15.26:49854) 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 -- 172.21.15.26:0/3405734424 learned_addr learned my addr 172.21.15.26:0/3405734424 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 -- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 msgr2=0x562a416fd2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416fd2d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 -- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 msgr2=0x562a416fdd50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fdd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 -- 172.21.15.26:0/3405734424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a4154df80 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db27fc640 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4da8008010 tx=0x7f4da80046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a3620cc8e6e5003c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da8005e30 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4da8006040 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4da8012a30 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4da8030050 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 10 client.5145 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562a414e1f00 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4da8012a30 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4da8033020 con 0x562a416fa080 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 10 client.5145 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 10 client.5145 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 20 client.5145 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a416fe760 0x562a417155e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 4 client.5145 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 --> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x562a414a1bc0 con 0x562a416fe760 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a416fe760 0x562a417155e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a416fe760 0x562a417155e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=4407117247f9ad54 server_cookie=a9a4ff67f866c744 in_seq=0 out_seq=0 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 10 client.5145 ms_handle_connect on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 1 -- 172.21.15.26:0/3405734424 <== mds.3 v2:172.21.15.26:6834/2066596634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x562a414a1bc0 con 0x562a416fe760 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 10 client.5145 handle_command_reply: tid=0 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 client.5145 shutdown 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 msgr2=0x562a416fd810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f4da8008010 tx=0x7f4da80046d0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 shutdown_connections 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a416fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a416fe760 0x562a417155e0 crc :-1 s=READY pgs=23 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa080 0x562a416fd810 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/3405734424 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416fd2d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.544 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 >> 172.21.15.26:0/3405734424 conn(0x562a416f6e40 msgr2=0x562a416f9230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4d927fc640 0 client.5145 ms_handle_reset on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:38.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 shutdown_connections 2024-04-23T10:13:38.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/3405734424 wait complete. 2024-04-23T10:13:38.545 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.537+0000 7f4dbcbe1000 20 client.5145 trim_cache size 0 max 16384 2024-04-23T10:13:38.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 Processor -- start 2024-04-23T10:13:38.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- start start 2024-04-23T10:13:38.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416df980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa080 0x562a416de550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4db41fe6b0 con 0x562a416fa9a0 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4db40c5790 con 0x562a416fa080 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562a414d49e0 con 0x562a416f5fd0 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49862/0 (socket says 172.21.15.26:49862) 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 -- 172.21.15.26:0/2627669532 learned_addr learned my addr 172.21.15.26:0/2627669532 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 -- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 msgr2=0x562a416df980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416df980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 -- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa080 msgr2=0x562a416de550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa080 0x562a416de550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 -- 172.21.15.26:0/2627669532 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562a4148ee80 con 0x562a416fa9a0 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4db37fe640 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4dac055d60 tx=0x7f4dac01a3c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e666b41127d87e62 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4d98ff9640 1 -- 172.21.15.26:0/2627669532 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac081070 con 0x562a416fa9a0 2024-04-23T10:13:38.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4d98ff9640 1 -- 172.21.15.26:0/2627669532 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dac05a410 con 0x562a416fa9a0 2024-04-23T10:13:38.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4d98ff9640 1 -- 172.21.15.26:0/2627669532 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4dac05ecd0 con 0x562a416fa9a0 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2627669532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 msgr2=0x562a416dea90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f4dac055d60 tx=0x7f4dac01a3c0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2627669532 shutdown_connections 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416fa9a0 0x562a416dea90 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa080 0x562a416de550 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/2627669532 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416f5fd0 0x562a416df980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2627669532 >> 172.21.15.26:0/2627669532 conn(0x562a416f6e40 msgr2=0x562a416f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2627669532 shutdown_connections 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.557+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/2627669532 wait complete. 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- start start 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 Processor -- start 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.565 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416fa080 0x562a41716980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a41716ec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x562a4150ca50 con 0x562a416f5fd0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x562a41507730 con 0x562a416fa9a0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x562a41515630 con 0x562a416fa080 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 10 client.0 _ll_register_callbacks cb 0x7f4da8009950 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49866/0 (socket says 172.21.15.26:49866) 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 -- 172.21.15.26:0/31895171 learned_addr learned my addr 172.21.15.26:0/31895171 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db37fe640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a41716ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db27fc640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416fa080 0x562a41716980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 -- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416fa080 msgr2=0x562a41716980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416fa080 0x562a41716980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 -- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 msgr2=0x562a41716ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.566 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a41716ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 -- 172.21.15.26:0/31895171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562a414d0b30 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db37fe640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a41716ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db2ffd640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4da401caf0 tx=0x7f4da4019850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91ff9b08003a499d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4da40cc060 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4da4003820 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4dac05a410 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4da40d2050 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 10 client.5151 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x562a415895b0 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4dac05a410 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4da40d5020 con 0x562a416f5fd0 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 10 client.5151 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 10 client.5151 resolve_mds: resolved name 'e' to daemon mds.e 2024-04-23T10:13:38.567 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 20 client.5151 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a41717400 0x562a4177b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 4 client.5151 mds_command: new command op to 4275 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 --> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] -- command(tid 0: {"prefix": "status"}) -- 0x562a41515e40 con 0x562a41717400 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db27fc640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a41717400 0x562a4177b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 10 client.5151 ms_handle_connect on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4db27fc640 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a41717400 0x562a4177b5c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.3 client_cookie=7059bbbe65047c0e server_cookie=fedc4110e0fa5979 in_seq=0 out_seq=0 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 1 -- 172.21.15.26:0/31895171 <== mds.3 v2:172.21.15.26:6834/2066596634 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x562a41515e40 con 0x562a41717400 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 10 client.5151 handle_command_reply: tid=0 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 client.5151 shutdown 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 msgr2=0x562a41716440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f4da401caf0 tx=0x7f4da4019850 comp rx=0 tx=0).stop 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 shutdown_connections 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x562a416fa9a0 0x562a41716ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x562a416fa080 0x562a41716980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.568 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:6834/2066596634,v1:172.21.15.26:6836/2066596634] conn(0x562a41717400 0x562a4177b5c0 crc :-1 s=READY pgs=24 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 --2- 172.21.15.26:0/31895171 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x562a416f5fd0 0x562a41716440 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4d927fc640 0 client.5151 ms_handle_reset on v2:172.21.15.26:6834/2066596634 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 >> 172.21.15.26:0/31895171 conn(0x562a416f6e40 msgr2=0x562a416fcb30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 shutdown_connections 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 1 -- 172.21.15.26:0/31895171 wait complete. 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.561+0000 7f4dbcbe1000 20 client.5151 trim_cache size 0 max 16384 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 3, 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4275, 2024-04-23T10:13:38.569 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 29.565968513000001, 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 70.596892972000006 2024-04-23T10:13:38.570 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 msgr2=0x7f4da006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 0x7f4da006a840 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f4da40af000 tx=0x7f4da40046d0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 msgr2=0x7f4db414b580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f4db40ca3b0 tx=0x7f4dac00cf00 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 shutdown_connections 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4da0068380 0x7f4da006a840 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4db414b100 0x7f4db414b580 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4db4159e30 0x7f4db41f2380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 --2- 172.21.15.26:0/566675082 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d9c0039c0 0x7f4db4150ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 >> 172.21.15.26:0/566675082 conn(0x7f4db406b9d0 msgr2=0x7f4db4073660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 shutdown_connections 2024-04-23T10:13:38.571 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.565+0000 7f4db9a5f640 1 -- 172.21.15.26:0/566675082 wait complete. 2024-04-23T10:13:38.581 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.d status 2024-04-23T10:13:38.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.693+0000 7f87bc060640 1 Processor -- start 2024-04-23T10:13:38.696 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.693+0000 7f87bc060640 1 -- start start 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8630 0x7f87b4151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f87b40c8a70 0x7f87b4152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f87b415b740 con 0x7f87b40c8250 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f87b40c6490 con 0x7f87b40c8a70 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f87b41525c0 con 0x7f87b40c8630 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b9dfc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f87b40c8250 0x7f87b40c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49872/0 (socket says 172.21.15.26:49872) 2024-04-23T10:13:38.697 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b9dfc640 1 -- 172.21.15.26:0/3371155764 learned_addr learned my addr 172.21.15.26:0/3371155764 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/3371155764 >> v2:172.21.15.26:3300/0 conn(0x7f87b40c8a70 0x7f87b4152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b95fb640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8630 0x7f87b4151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b8dfa640 1 -- 172.21.15.26:0/3371155764 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 781691823 0 0) 0x7f87b415b740 con 0x7f87b40c8250 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b8dfa640 1 -- 172.21.15.26:0/3371155764 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f87a0003530 con 0x7f87b40c8250 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 -- 172.21.15.26:0/3371155764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8630 msgr2=0x7f87b4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8630 0x7f87b4151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 -- 172.21.15.26:0/3371155764 >> v1:172.21.15.26:6789/0 conn(0x7f87b40c8250 legacy=0x7f87b40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.698 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 -- 172.21.15.26:0/3371155764 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b40c40f0 con 0x7f87b40c8a70 2024-04-23T10:13:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8a70 0x7f87b4152080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009dc0 tx=0x7f87ac01c8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7c7174ec87a299c1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b8dfa640 1 -- 172.21.15.26:0/3371155764 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0b2070 con 0x7f87b40c8a70 2024-04-23T10:13:38.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b8dfa640 1 -- 172.21.15.26:0/3371155764 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac0a5780 con 0x7f87b40c8a70 2024-04-23T10:13:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87b8dfa640 1 -- 172.21.15.26:0/3371155764 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0a5b50 con 0x7f87b40c8a70 2024-04-23T10:13:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- 172.21.15.26:0/3371155764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8a70 msgr2=0x7f87b4152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8a70 0x7f87b4152080 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f87ac009dc0 tx=0x7f87ac01c8c0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- 172.21.15.26:0/3371155764 shutdown_connections 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8a70 0x7f87b4152080 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 --2- 172.21.15.26:0/3371155764 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8630 0x7f87b4151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- 172.21.15.26:0/3371155764 >> 172.21.15.26:0/3371155764 conn(0x7f87b406b9d0 msgr2=0x7f87b406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- 172.21.15.26:0/3371155764 shutdown_connections 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.697+0000 7f87bc060640 1 -- 172.21.15.26:0/3371155764 wait complete. 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 Processor -- start 2024-04-23T10:13:38.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- start start 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8250 0x7f87b41f7f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b40c8a70 0x7f87b40ca2e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f87b415b400 con 0x7f87b40c8630 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87b40721a0 con 0x7f87b40c8a70 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f87b40c6900 con 0x7f87b40c8250 2024-04-23T10:13:38.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49884/0 (socket says 172.21.15.26:49884) 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 -- 172.21.15.26:0/1392404539 learned_addr learned my addr 172.21.15.26:0/1392404539 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8250 0x7f87b41f7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b40c8a70 0x7f87b40ca2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 -- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8250 msgr2=0x7f87b41f7f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8250 0x7f87b41f7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 -- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b40c8a70 msgr2=0x7f87b40ca2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b40c8a70 0x7f87b40ca2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 -- 172.21.15.26:0/1392404539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f87b40c54f0 con 0x7f87b40c8630 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87a400d800 tx=0x7f87a400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87aa7fc640 1 -- 172.21.15.26:0/1392404539 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a400b6c0 con 0x7f87b40c8630 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87aa7fc640 1 -- 172.21.15.26:0/1392404539 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a4019070 con 0x7f87b40c8630 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f87b41f4eb0 con 0x7f87b40c8630 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87aa7fc640 1 -- 172.21.15.26:0/1392404539 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a400ba60 con 0x7f87b40c8630 2024-04-23T10:13:38.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f87b41f40f0 con 0x7f87b40c8630 2024-04-23T10:13:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.701+0000 7f87aa7fc640 1 -- 172.21.15.26:0/1392404539 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f87a400bc00 con 0x7f87b40c8630 2024-04-23T10:13:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87aa7fc640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 0x7f879806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87aa7fc640 1 -- 172.21.15.26:0/1392404539 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f87a4087300 con 0x7f87b40c8630 2024-04-23T10:13:38.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 0x7f879806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 Processor -- start 2024-04-23T10:13:38.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- start start 2024-04-23T10:13:38.706 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 0x7f879806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87b0007fd0 tx=0x7f87b0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545afa0570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545afdb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.708 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56545ade9420 con 0x56545afdb5c0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56545ad83bf0 con 0x56545afa0190 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56545ade53e0 con 0x56545afa0ab0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49900/0 (socket says 172.21.15.26:49900) 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1186961330 learned_addr learned my addr 172.21.15.26:0/1186961330 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 msgr2=0x56545afdb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545afa0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545afdb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545afdb080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 msgr2=0x56545afa0570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545afa0570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1186961330 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545ae91450 con 0x56545afdb5c0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545afa0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f87ac01a4f0 tx=0x7f87ac004ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3105c4ae1f877ab server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87977fe640 1 -- 172.21.15.26:0/1186961330 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0b2040 con 0x56545afdb5c0 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87977fe640 1 -- 172.21.15.26:0/1186961330 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac0be070 con 0x56545afdb5c0 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87977fe640 1 -- 172.21.15.26:0/1186961330 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0a59c0 con 0x56545afdb5c0 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1186961330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 msgr2=0x56545afdb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f87ac01a4f0 tx=0x7f87ac004ac0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1186961330 shutdown_connections 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545afdb9a0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545afdb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1186961330 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545afa0570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1186961330 >> 172.21.15.26:0/1186961330 conn(0x56545afd7e40 msgr2=0x56545afda260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1186961330 shutdown_connections 2024-04-23T10:13:38.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.705+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1186961330 wait complete. 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- start start 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 Processor -- start 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af9cbc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545af9d100 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56545ad89ec0 con 0x56545afdb5c0 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56545ae6a120 con 0x56545afa0190 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56545adf4350 con 0x56545afa0ab0 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 10 client.0 _ll_register_callbacks cb 0x56545adc64d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49914/0 (socket says 172.21.15.26:49914) 2024-04-23T10:13:38.713 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1941902904 learned_addr learned my addr 172.21.15.26:0/1941902904 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545af9d100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af9cbc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 msgr2=0x56545af9d100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545af9d100 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 msgr2=0x56545af9cbc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af9cbc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 -- 172.21.15.26:0/1941902904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545ae2ef80 con 0x56545afdb5c0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f90 tx=0x7f87ac01b100 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8053112199c9675b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87ac0b2040 con 0x56545afdb5c0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87ac0be070 con 0x56545afdb5c0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f87ac004240 con 0x56545afdb5c0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f87ac0d2050 con 0x56545afdb5c0 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 10 client.5166 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56545adc2f00 con 0x56545afdb5c0 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87ac0be070 con 0x56545afdb5c0 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f87ac0d5020 con 0x56545afdb5c0 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 10 client.5166 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 10 client.5166 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 20 client.5166 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545afefd90 0x56545aff2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 4 client.5166 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 --> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56545ad82bc0 con 0x56545afefd90 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545afefd90 0x56545aff2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f8794ff9640 10 client.5166 ms_handle_connect on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:38.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.709+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545afefd90 0x56545aff2180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=b447b4324df2b436 server_cookie=90eafebca44a782e in_seq=0 out_seq=0 2024-04-23T10:13:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f8794ff9640 1 -- 172.21.15.26:0/1941902904 <== mds.2 v2:172.21.15.190:6835/1581526507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56545ad82bc0 con 0x56545afefd90 2024-04-23T10:13:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f8794ff9640 10 client.5166 handle_command_reply: tid=0 2024-04-23T10:13:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 client.5166 shutdown 2024-04-23T10:13:38.716 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 msgr2=0x56545af9d640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f87ac000f90 tx=0x7f87ac01b100 comp rx=0 tx=0).stop 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 shutdown_connections 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afdb5c0 0x56545af9d640 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afa0ab0 0x56545af9d100 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545afefd90 0x56545aff2180 crc :-1 s=READY pgs=18 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1941902904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af9cbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f8794ff9640 0 client.5166 ms_handle_reset on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 >> 172.21.15.26:0/1941902904 conn(0x56545afd7e40 msgr2=0x56545afd91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 shutdown_connections 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1941902904 wait complete. 2024-04-23T10:13:38.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.713+0000 7f87bf1e2000 20 client.5166 trim_cache size 0 max 16384 2024-04-23T10:13:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.729+0000 7f87bf1e2000 1 Processor -- start 2024-04-23T10:13:38.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.729+0000 7f87bf1e2000 1 -- start start 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af99890 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545aff2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f87b4201b60 con 0x56545afa0ab0 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f87b415aa10 con 0x56545afa0190 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56545adb59e0 con 0x56545afdb5c0 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49924/0 (socket says 172.21.15.26:49924) 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/245480681 learned_addr learned my addr 172.21.15.26:0/245480681 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545aff2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af99890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 msgr2=0x56545aff2180 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545aff2180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 msgr2=0x56545af99890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af99890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/245480681 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545ad6fe80 con 0x56545afa0ab0 2024-04-23T10:13:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87a4004780 tx=0x7f87a4056660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec45d4b4880b9e2b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f8796ffd640 1 -- 172.21.15.26:0/245480681 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a405b0b0 con 0x56545afa0ab0 2024-04-23T10:13:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f8796ffd640 1 -- 172.21.15.26:0/245480681 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a405f8e0 con 0x56545afa0ab0 2024-04-23T10:13:38.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f8796ffd640 1 -- 172.21.15.26:0/245480681 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a40870b0 con 0x56545afa0ab0 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- 172.21.15.26:0/245480681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 msgr2=0x56545af99dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f87a4004780 tx=0x7f87a4056660 comp rx=0 tx=0).stop 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- 172.21.15.26:0/245480681 shutdown_connections 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545aff2180 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545af99dd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/245480681 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545af99890 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- 172.21.15.26:0/245480681 >> 172.21.15.26:0/245480681 conn(0x56545afd7e40 msgr2=0x56545afd5e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- 172.21.15.26:0/245480681 shutdown_connections 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- 172.21.15.26:0/245480681 wait complete. 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- start start 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 Processor -- start 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545b04ffa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545b00fd30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56545adeda50 con 0x56545afa0ab0 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56545ade8730 con 0x56545afa0190 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56545adf6630 con 0x56545afdb5c0 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87bf1e2000 10 client.0 _ll_register_callbacks cb 0x7f87a0003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49936/0 (socket says 172.21.15.26:49936) 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/1081489849 learned_addr learned my addr 172.21.15.26:0/1081489849 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545b04ffa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87ba5fd640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545b00fd30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 msgr2=0x56545b00fd30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545b00fd30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 msgr2=0x56545b04ffa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545b04ffa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 -- 172.21.15.26:0/1081489849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545adb1b30 con 0x56545afa0ab0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545b04ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f87b95fb640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b4b0 tx=0x7f87a4085240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=15cc82f6742256c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f8794ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.733+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87a407a060 con 0x56545afa0ab0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f87a4053370 con 0x56545afa0ab0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f87a405f8e0 con 0x56545afa0ab0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f87a405f450 con 0x56545afa0ab0 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 10 client.5172 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.741 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56545ae6a5b0 con 0x56545afa0ab0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87a405f8e0 con 0x56545afa0ab0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f87a4013070 con 0x56545afa0ab0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 10 client.5172 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 10 client.5172 resolve_mds: resolved name 'd' to daemon mds.d 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 20 client.5172 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545b0106c0 0x56545b010aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 4 client.5172 mds_command: new command op to 4282 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 --> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] -- command(tid 0: {"prefix": "status"}) -- 0x56545adf6e40 con 0x56545b0106c0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545b0106c0 0x56545b010aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 10 client.5172 ms_handle_connect on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87b9dfc640 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545b0106c0 0x56545b010aa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.2 client_cookie=890a594d68b2d104 server_cookie=c31b237448fff426 in_seq=0 out_seq=0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 1 -- 172.21.15.26:0/1081489849 <== mds.2 v2:172.21.15.190:6835/1581526507 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x56545adf6e40 con 0x56545b0106c0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 10 client.5172 handle_command_reply: tid=0 2024-04-23T10:13:38.742 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 client.5172 shutdown 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 msgr2=0x56545b0504e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f87a400b4b0 tx=0x7f87a4085240 comp rx=0 tx=0).stop 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 shutdown_connections 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56545afdb5c0 0x56545b00fd30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56545afa0ab0 0x56545b0504e0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:6835/1581526507,v1:172.21.15.190:6837/1581526507] conn(0x56545b0106c0 0x56545b010aa0 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 --2- 172.21.15.26:0/1081489849 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56545afa0190 0x56545b04ffa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f8794ff9640 0 client.5172 ms_handle_reset on v2:172.21.15.190:6835/1581526507 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 >> 172.21.15.26:0/1081489849 conn(0x56545afd7e40 msgr2=0x56545af99ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 shutdown_connections 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 1 -- 172.21.15.26:0/1081489849 wait complete. 2024-04-23T10:13:38.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bf1e2000 20 client.5172 trim_cache size 0 max 16384 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 2, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4282, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 35.513167367999998, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 70.765341669999998 2024-04-23T10:13:38.744 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 msgr2=0x7f879806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 0x7f879806a840 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f87b0007fd0 tx=0x7f87b0009040 comp rx=0 tx=0).stop 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 msgr2=0x7f87b4147400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f87a400d800 tx=0x7f87a400dcc0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 shutdown_connections 2024-04-23T10:13:38.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8798068380 0x7f879806a840 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f87b40c8a70 0x7f87b40ca2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f87b40c8630 0x7f87b4147400 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 --2- 172.21.15.26:0/1392404539 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f87b40c8250 0x7f87b41f7f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 >> 172.21.15.26:0/1392404539 conn(0x7f87b406b9d0 msgr2=0x7f87b41460c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 shutdown_connections 2024-04-23T10:13:38.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.737+0000 7f87bc060640 1 -- 172.21.15.26:0/1392404539 wait complete. 2024-04-23T10:13:38.755 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.a status 2024-04-23T10:13:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.885+0000 7fb369ab3640 1 Processor -- start 2024-04-23T10:13:38.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.885+0000 7fb369ab3640 1 -- start start 2024-04-23T10:13:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb369ab3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3640cda50 0x7fb3640c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb369ab3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36415bc10 con 0x7fb364155350 2024-04-23T10:13:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb369ab3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb36415beb0 con 0x7fb36415b0b0 2024-04-23T10:13:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb369ab3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb3640cca40 con 0x7fb3640cda50 2024-04-23T10:13:38.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3637fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb364155350 0x7fb3640cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49884/0 (socket says 172.21.15.26:49884) 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3637fe640 1 -- 172.21.15.26:0/28522725 learned_addr learned my addr 172.21.15.26:0/28522725 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb362ffd640 1 --2- 172.21.15.26:0/28522725 >> v2:172.21.15.190:3300/0 conn(0x7fb3640cda50 0x7fb3640c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3627fc640 1 -- 172.21.15.26:0/28522725 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4034694752 0 0) 0x7fb36415bc10 con 0x7fb364155350 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3627fc640 1 -- 172.21.15.26:0/28522725 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb34c003530 con 0x7fb364155350 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb362ffd640 1 -- 172.21.15.26:0/28522725 >> v1:172.21.15.190:6789/0 conn(0x7fb36415b0b0 legacy=0x7fb36415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb362ffd640 1 -- 172.21.15.26:0/28522725 >> v1:172.21.15.26:6789/0 conn(0x7fb364155350 legacy=0x7fb3640cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb362ffd640 1 -- 172.21.15.26:0/28522725 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3640ccc90 con 0x7fb3640cda50 2024-04-23T10:13:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb362ffd640 1 --2- 172.21.15.26:0/28522725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3640cda50 0x7fb3640c59c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097c0 tx=0x7fb35801ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=f645a9acd5fa61c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3627fc640 1 -- 172.21.15.26:0/28522725 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580b5070 con 0x7fb3640cda50 2024-04-23T10:13:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3627fc640 1 -- 172.21.15.26:0/28522725 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3580a8990 con 0x7fb3640cda50 2024-04-23T10:13:38.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.889+0000 7fb3627fc640 1 -- 172.21.15.26:0/28522725 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a8d40 con 0x7fb3640cda50 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/28522725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3640cda50 msgr2=0x7fb3640c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 --2- 172.21.15.26:0/28522725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3640cda50 0x7fb3640c59c0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7fb3580097c0 tx=0x7fb35801ec90 comp rx=0 tx=0).stop 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/28522725 shutdown_connections 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 --2- 172.21.15.26:0/28522725 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3640cda50 0x7fb3640c59c0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/28522725 >> 172.21.15.26:0/28522725 conn(0x7fb36406cc30 msgr2=0x7fb36406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/28522725 shutdown_connections 2024-04-23T10:13:38.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/28522725 wait complete. 2024-04-23T10:13:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 Processor -- start 2024-04-23T10:13:38.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- start start 2024-04-23T10:13:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb364155350 0x7fb3640b5420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb36415b0b0 0x7fb3641f43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640cd530 con 0x7fb3640cda50 2024-04-23T10:13:38.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3640cd250 con 0x7fb36415b0b0 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb364155730 con 0x7fb364155350 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49938/0 (socket says 172.21.15.26:49938) 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 -- 172.21.15.26:0/2796656546 learned_addr learned my addr 172.21.15.26:0/2796656546 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb362ffd640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb364155350 0x7fb3640b5420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 -- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb364155350 msgr2=0x7fb3640b5420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb363fff640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb36415b0b0 0x7fb3641f43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb364155350 0x7fb3640b5420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 -- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb36415b0b0 msgr2=0x7fb3641f43f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb36415b0b0 0x7fb3641f43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 -- 172.21.15.26:0/2796656546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb364153f60 con 0x7fb3640cda50 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb3637fe640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb35400c4d0 tx=0x7fb35400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb34bfff640 1 -- 172.21.15.26:0/2796656546 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354017070 con 0x7fb3640cda50 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb34bfff640 1 -- 172.21.15.26:0/2796656546 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb354005cf0 con 0x7fb3640cda50 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3641e4180 con 0x7fb3640cda50 2024-04-23T10:13:38.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb34bfff640 1 -- 172.21.15.26:0/2796656546 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354007270 con 0x7fb3640cda50 2024-04-23T10:13:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.893+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb364154200 con 0x7fb3640cda50 2024-04-23T10:13:38.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb34bfff640 1 -- 172.21.15.26:0/2796656546 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb35401a070 con 0x7fb3640cda50 2024-04-23T10:13:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb34bfff640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 0x7fb35006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb34bfff640 1 -- 172.21.15.26:0/2796656546 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb354086100 con 0x7fb3640cda50 2024-04-23T10:13:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 Processor -- start 2024-04-23T10:13:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb362ffd640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 0x7fb35006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 -- start start 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b02ea570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb362ffd640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 0x7fb35006a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b2000 tx=0x7fb358008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02eaab0 0x55d5b0325080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d5b0133420 con 0x55d5b03255c0 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d5b00cdbf0 con 0x55d5b02eaab0 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d5b012f3e0 con 0x55d5b02ea190 2024-04-23T10:13:38.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb363fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb363fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49944/0 (socket says 172.21.15.26:49944) 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.897+0000 7fb363fff640 1 -- 172.21.15.26:0/86691617 learned_addr learned my addr 172.21.15.26:0/86691617 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3637fe640 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b02ea570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02eaab0 0x55d5b0325080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 -- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 msgr2=0x55d5b02ea570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b02ea570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 -- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02eaab0 msgr2=0x55d5b0325080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02eaab0 0x55d5b0325080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 -- 172.21.15.26:0/86691617 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b01db450 con 0x55d5b03255c0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb35c001cb0 tx=0x7fb35c002170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=310c02c752e599c7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3497fa640 1 -- 172.21.15.26:0/86691617 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c016020 con 0x55d5b03255c0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3497fa640 1 -- 172.21.15.26:0/86691617 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35c00dcc0 con 0x55d5b03255c0 2024-04-23T10:13:38.902 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3497fa640 1 -- 172.21.15.26:0/86691617 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35c012610 con 0x55d5b03255c0 2024-04-23T10:13:38.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/86691617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 msgr2=0x55d5b03259a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7fb35c001cb0 tx=0x7fb35c002170 comp rx=0 tx=0).stop 2024-04-23T10:13:38.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/86691617 shutdown_connections 2024-04-23T10:13:38.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b03255c0 0x55d5b03259a0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02eaab0 0x55d5b0325080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- 172.21.15.26:0/86691617 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b02ea570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/86691617 >> 172.21.15.26:0/86691617 conn(0x55d5b0321e40 msgr2=0x55d5b0324260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/86691617 shutdown_connections 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/86691617 wait complete. 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- start start 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 Processor -- start 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02ea190 0x55d5b02e6b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b03255c0 0x55d5b02e75e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d5b00d3ec0 con 0x55d5b02eaab0 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d5b01b4120 con 0x55d5b02ea190 2024-04-23T10:13:38.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d5b013e350 con 0x55d5b03255c0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 10 client.0 _ll_register_callbacks cb 0x55d5b01104d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49960/0 (socket says 172.21.15.26:49960) 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 -- 172.21.15.26:0/1371898892 learned_addr learned my addr 172.21.15.26:0/1371898892 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02ea190 0x55d5b02e6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb363fff640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b03255c0 0x55d5b02e75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 -- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b03255c0 msgr2=0x55d5b02e75e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b03255c0 0x55d5b02e75e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 -- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02ea190 msgr2=0x55d5b02e6b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02ea190 0x55d5b02e6b60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 -- 172.21.15.26:0/1371898892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b0178f80 con 0x55d5b02eaab0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb362ffd640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb35801b8a0 tx=0x7fb3580046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0a01c5b7cd4723 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3427fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580a8da0 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb35c00dcc0 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb358003620 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.901+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb358003820 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 10 client.5184 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d5b010cf00 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb35c00dcc0 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb3580039c0 con 0x55d5b02eaab0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 10 client.5184 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 10 client.5184 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 20 client.5184 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0339d90 0x55d5b033c180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 4 client.5184 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 --> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d5b00ccbc0 con 0x55d5b0339d90 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0339d90 0x55d5b033c180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 10 client.5184 ms_handle_connect on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0339d90 0x55d5b033c180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=58dd97de14c5e1ec server_cookie=dbef0cd066abd7db in_seq=0 out_seq=0 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 1 -- 172.21.15.26:0/1371898892 <== mds.1 v2:172.21.15.26:6835/1290255157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d5b00ccbc0 con 0x55d5b0339d90 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 10 client.5184 handle_command_reply: tid=0 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 client.5184 shutdown 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 msgr2=0x55d5b02e70a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7fb35801b8a0 tx=0x7fb3580046d0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 shutdown_connections 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0339d90 0x55d5b033c180 crc :-1 s=READY pgs=19 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b03255c0 0x55d5b02e75e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b02e70a0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb3427fc640 0 client.5184 ms_handle_reset on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1371898892 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b02ea190 0x55d5b02e6b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 >> 172.21.15.26:0/1371898892 conn(0x55d5b0321e40 msgr2=0x55d5b03231c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 shutdown_connections 2024-04-23T10:13:38.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 1 -- 172.21.15.26:0/1371898892 wait complete. 2024-04-23T10:13:38.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.905+0000 7fb36cc35000 20 client.5184 trim_cache size 0 max 16384 2024-04-23T10:13:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.921+0000 7fb36cc35000 1 Processor -- start 2024-04-23T10:13:38.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.921+0000 7fb36cc35000 1 -- start start 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02eaab0 0x55d5b03203d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0396510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641fe5f0 con 0x55d5b02ea190 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3641fecc0 con 0x55d5b03255c0 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb36414b6c0 con 0x55d5b02eaab0 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49976/0 (socket says 172.21.15.26:49976) 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 -- 172.21.15.26:0/1568080932 learned_addr learned my addr 172.21.15.26:0/1568080932 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02eaab0 0x55d5b03203d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.926 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb363fff640 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0396510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 -- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02eaab0 msgr2=0x55d5b03203d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02eaab0 0x55d5b03203d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 -- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 msgr2=0x55d5b0396510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0396510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 -- 172.21.15.26:0/1568080932 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b02e9940 con 0x55d5b02ea190 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb3540520e0 tx=0x7fb3540840e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=328a28034e6bde4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb348ff9640 1 -- 172.21.15.26:0/1568080932 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb354054040 con 0x55d5b02ea190 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb348ff9640 1 -- 172.21.15.26:0/1568080932 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3540522f0 con 0x55d5b02ea190 2024-04-23T10:13:38.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb348ff9640 1 -- 172.21.15.26:0/1568080932 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb35405e5b0 con 0x55d5b02ea190 2024-04-23T10:13:38.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- 172.21.15.26:0/1568080932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 msgr2=0x55d5b031fe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7fb3540520e0 tx=0x7fb3540840e0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- 172.21.15.26:0/1568080932 shutdown_connections 2024-04-23T10:13:38.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0396510 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02eaab0 0x55d5b03203d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- 172.21.15.26:0/1568080932 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02ea190 0x55d5b031fe90 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- 172.21.15.26:0/1568080932 >> 172.21.15.26:0/1568080932 conn(0x55d5b0321e40 msgr2=0x55d5b02e3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- 172.21.15.26:0/1568080932 shutdown_connections 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- 172.21.15.26:0/1568080932 wait complete. 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- start start 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 Processor -- start 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b03932a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0394820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d5b0132730 con 0x55d5b02eaab0 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d5b00ff9e0 con 0x55d5b03255c0 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d5b0137a50 con 0x55d5b02ea190 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb36cc35000 10 client.0 _ll_register_callbacks cb 0x7fb3580b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:38.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49990/0 (socket says 172.21.15.26:49990) 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 -- 172.21.15.26:0/827714169 learned_addr learned my addr 172.21.15.26:0/827714169 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb3637fe640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b03932a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb363fff640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0394820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 -- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 msgr2=0x55d5b03932a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b03932a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 -- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 msgr2=0x55d5b0394820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0394820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.925+0000 7fb362ffd640 1 -- 172.21.15.26:0/827714169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b00b9e80 con 0x55d5b02eaab0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb362ffd640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb35801ecd0 tx=0x7fb35801d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a2ab36bd22833dae server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3580e0060 con 0x55d5b02eaab0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb358003620 con 0x55d5b02eaab0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3540522f0 con 0x55d5b02eaab0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3580039c0 con 0x55d5b02eaab0 2024-04-23T10:13:38.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 10 client.5190 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d5b00fbb30 con 0x55d5b02eaab0 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3540522f0 con 0x55d5b02eaab0 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb3580e6740 con 0x55d5b02eaab0 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 10 client.5190 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 10 client.5190 resolve_mds: resolved name 'a' to daemon mds.a 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 20 client.5190 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0394d60 0x55d5b0395140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 4 client.5190 mds_command: new command op to 4284 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 --> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] -- command(tid 0: {"prefix": "status"}) -- 0x55d5b0140e40 con 0x55d5b0394d60 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3637fe640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0394d60 0x55d5b0395140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3637fe640 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0394d60 0x55d5b0395140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.1 client_cookie=56de972683b1c455 server_cookie=ad0eb5580d0f3224 in_seq=0 out_seq=0 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 10 client.5190 ms_handle_connect on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 1 -- 172.21.15.26:0/827714169 <== mds.1 v2:172.21.15.26:6835/1290255157 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x55d5b0140e40 con 0x55d5b0394d60 2024-04-23T10:13:38.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 10 client.5190 handle_command_reply: tid=0 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 client.5190 shutdown 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 msgr2=0x55d5b03942e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x7fb35801ecd0 tx=0x7fb35801d4d0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 shutdown_connections 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:6835/1290255157,v1:172.21.15.26:6837/1290255157] conn(0x55d5b0394d60 0x55d5b0395140 crc :-1 s=READY pgs=20 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d5b03255c0 0x55d5b0394820 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d5b02eaab0 0x55d5b03942e0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 --2- 172.21.15.26:0/827714169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d5b02ea190 0x55d5b03932a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 >> 172.21.15.26:0/827714169 conn(0x55d5b0321e40 msgr2=0x55d5b02e2880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb3427fc640 0 client.5190 ms_handle_reset on v2:172.21.15.26:6835/1290255157 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 shutdown_connections 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 1 -- 172.21.15.26:0/827714169 wait complete. 2024-04-23T10:13:38.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb36cc35000 20 client.5190 trim_cache size 0 max 16384 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 1, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4284, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 41.752682534999998, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 70.963140326000001 2024-04-23T10:13:38.936 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 msgr2=0x7fb35006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 0x7fb35006a840 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7fb3580b2000 tx=0x7fb358008040 comp rx=0 tx=0).stop 2024-04-23T10:13:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 msgr2=0x7fb36415dbe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7fb35400c4d0 tx=0x7fb35400c990 comp rx=0 tx=0).stop 2024-04-23T10:13:38.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 shutdown_connections 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb350068380 0x7fb35006a840 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb36415b0b0 0x7fb3641f43f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb364155350 0x7fb3640b5420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 --2- 172.21.15.26:0/2796656546 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb3640cda50 0x7fb36415dbe0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 >> 172.21.15.26:0/2796656546 conn(0x7fb36406cc30 msgr2=0x7fb364151ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 shutdown_connections 2024-04-23T10:13:38.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:38.929+0000 7fb369ab3640 1 -- 172.21.15.26:0/2796656546 wait complete. 2024-04-23T10:13:38.947 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.f status 2024-04-23T10:13:39.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 Processor -- start 2024-04-23T10:13:39.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 -- start start 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c70158950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c70152620 con 0x7f5c700c8640 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c700c8ae0 con 0x7f5c70152240 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c75abc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c70158e90 con 0x7f5c700c6740 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c6effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5c700c8640 0x7f5c700c6030 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49894/0 (socket says 172.21.15.26:49894) 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c6effd640 1 -- 172.21.15.26:0/696234544 learned_addr learned my addr 172.21.15.26:0/696234544 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.057+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c70158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1745924233 0 0) 0x7f5c70152620 con 0x7f5c700c8640 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5c58003530 con 0x7f5c700c8640 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3745345802 0 0) 0x7f5c58003530 con 0x7f5c700c8640 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 msgr2=0x7f5c70158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c70158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 >> v1:172.21.15.190:6789/0 conn(0x7f5c70152240 legacy=0x7f5c700cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7015b480 con 0x7f5c700c8640 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f5c64001680 con 0x7f5c700c8640 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 >> v1:172.21.15.26:6789/0 conn(0x7f5c700c8640 legacy=0x7f5c700c6030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c580039f0 0x7f5c58003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c58004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c58004d50 0x7f5c580051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5c70158e90 con 0x7f5c58004d50 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5c5800bb10 con 0x7f5c580039f0 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c5800bd10 con 0x7f5c700c6740 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c58004d50 0x7f5c580051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c580039f0 0x7f5c58003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6effd640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c58004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.063 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 -- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 msgr2=0x7f5c58004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c58004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 -- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c580039f0 msgr2=0x7f5c58003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c580039f0 0x7f5c58003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 -- 172.21.15.26:0/696234544 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c58003530 con 0x7f5c58004d50 2024-04-23T10:13:39.064 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6effd640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c700c6740 0x7f5c58004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c58004d50 0x7f5c580051d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009f70 tx=0x7f5c6801cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=953399a08889ee7b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680b2070 con 0x7f5c58004d50 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680a5cf0 con 0x7f5c58004d50 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6e7fc640 1 -- 172.21.15.26:0/696234544 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68009bf0 con 0x7f5c58004d50 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 -- 172.21.15.26:0/696234544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c58004d50 msgr2=0x7f5c580051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 --2- 172.21.15.26:0/696234544 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c58004d50 0x7f5c580051d0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f5c68009f70 tx=0x7f5c6801cc20 comp rx=0 tx=0).stop 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c6ffff640 1 -- 172.21.15.26:0/696234544 reap_dead start 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 -- 172.21.15.26:0/696234544 shutdown_connections 2024-04-23T10:13:39.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 -- 172.21.15.26:0/696234544 >> 172.21.15.26:0/696234544 conn(0x7f5c7006fca0 msgr2=0x7f5c700700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 -- 172.21.15.26:0/696234544 shutdown_connections 2024-04-23T10:13:39.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.061+0000 7f5c75abc640 1 -- 172.21.15.26:0/696234544 wait complete. 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 Processor -- start 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- start start 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 0x7f5c7014fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c7014d240 0x7f5c70147f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7015bd20 con 0x7f5c7014c4f0 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5c7015ba40 con 0x7f5c7014d240 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c7015c000 con 0x7f5c7014ce60 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50002/0 (socket says 172.21.15.26:50002) 2024-04-23T10:13:39.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 -- 172.21.15.26:0/353057968 learned_addr learned my addr 172.21.15.26:0/353057968 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 0x7f5c7014fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c7014d240 0x7f5c70147f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 -- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 msgr2=0x7f5c7014fe60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 0x7f5c7014fe60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 -- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c7014d240 msgr2=0x7f5c70147f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c7014d240 0x7f5c70147f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 -- 172.21.15.26:0/353057968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c7015a390 con 0x7f5c7014c4f0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 0x7f5c7014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c6effd640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400db40 tx=0x7f5c64001670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c57fff640 1 -- 172.21.15.26:0/353057968 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64019070 con 0x7f5c7014c4f0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c57fff640 1 -- 172.21.15.26:0/353057968 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c64004cc0 con 0x7f5c7014c4f0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c7015a670 con 0x7f5c7014c4f0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c57fff640 1 -- 172.21.15.26:0/353057968 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c64007310 con 0x7f5c7014c4f0 2024-04-23T10:13:39.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.065+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c7014f660 con 0x7f5c7014c4f0 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c57fff640 1 -- 172.21.15.26:0/353057968 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c640074b0 con 0x7f5c7014c4f0 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c57fff640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 0x7f5c5c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c57fff640 1 -- 172.21.15.26:0/353057968 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c64086850 con 0x7f5c7014c4f0 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 0x7f5c5c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 Processor -- start 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 -- start start 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 0x7f5c5c06a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005630 tx=0x7f5c60009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa90570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5facb080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.072 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564c5f8d9420 con 0x564c5facb5c0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c5f873bf0 con 0x564c5fa90ab0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564c5f8d53e0 con 0x564c5fa90190 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50004/0 (socket says 172.21.15.26:50004) 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 -- 172.21.15.26:0/1540774965 learned_addr learned my addr 172.21.15.26:0/1540774965 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6effd640 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5facb080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa90570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 -- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 msgr2=0x564c5fa90570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa90570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 -- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 msgr2=0x564c5facb080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5facb080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 -- 172.21.15.26:0/1540774965 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c5f981450 con 0x564c5facb5c0 2024-04-23T10:13:39.073 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5c68002240 tx=0x7f5c6801b460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eba8f7251553238f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c557fa640 1 -- 172.21.15.26:0/1540774965 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680b2070 con 0x564c5facb5c0 2024-04-23T10:13:39.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c557fa640 1 -- 172.21.15.26:0/1540774965 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b3040 con 0x564c5facb5c0 2024-04-23T10:13:39.074 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c557fa640 1 -- 172.21.15.26:0/1540774965 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c68009bf0 con 0x564c5facb5c0 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 -- 172.21.15.26:0/1540774965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 msgr2=0x564c5facb9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.069+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 crypto rx=0x7f5c68002240 tx=0x7f5c6801b460 comp rx=0 tx=0).stop 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/1540774965 shutdown_connections 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5facb9a0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5facb080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/1540774965 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa90570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/1540774965 >> 172.21.15.26:0/1540774965 conn(0x564c5fac7e40 msgr2=0x564c5faca260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/1540774965 shutdown_connections 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/1540774965 wait complete. 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- start start 2024-04-23T10:13:39.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 Processor -- start 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa8cbf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5fa8d130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564c5f879ec0 con 0x564c5facb5c0 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c5f95a120 con 0x564c5fa90ab0 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564c5f8e4350 con 0x564c5fa90190 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 10 client.0 _ll_register_callbacks cb 0x564c5f8b64d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50008/0 (socket says 172.21.15.26:50008) 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 -- 172.21.15.26:0/2101484573 learned_addr learned my addr 172.21.15.26:0/2101484573 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6effd640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5fa8d130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa8cbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 -- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 msgr2=0x564c5fa8cbf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa8cbf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 -- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 msgr2=0x564c5fa8d130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5fa8d130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 -- 172.21.15.26:0/2101484573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c5f91ef80 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa8cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6effd640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5fa8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801cc60 tx=0x7f5c58005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2313defc4eda101f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680b2040 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c680b3040 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c68002040 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5c68009cb0 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 10 client.5202 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564c5f8b2f00 con 0x564c5facb5c0 2024-04-23T10:13:39.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c680b3040 con 0x564c5facb5c0 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5c680b7650 con 0x564c5facb5c0 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 10 client.5202 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 10 client.5202 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 20 client.5202 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fadfd90 0x564c5fae2180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 4 client.5202 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564c5f872bc0 con 0x564c5fadfd90 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fadfd90 0x564c5fae2180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c4e7fc640 10 client.5202 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:39.080 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.073+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fadfd90 0x564c5fae2180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=8406ae85953f160f server_cookie=d6ffeb0d1b4505c8 in_seq=0 out_seq=0 2024-04-23T10:13:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/2101484573 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564c5f872bc0 con 0x564c5fadfd90 2024-04-23T10:13:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c4e7fc640 10 client.5202 handle_command_reply: tid=0 2024-04-23T10:13:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 client.5202 shutdown 2024-04-23T10:13:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 msgr2=0x564c5fa8d670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7f5c6801cc60 tx=0x7f5c58005840 comp rx=0 tx=0).stop 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 shutdown_connections 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fadfd90 0x564c5fae2180 crc :-1 s=READY pgs=29 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fa8d670 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90ab0 0x564c5fa8d130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2101484573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90190 0x564c5fa8cbf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c4e7fc640 0 client.5202 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 >> 172.21.15.26:0/2101484573 conn(0x564c5fac7e40 msgr2=0x564c5fac91c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 shutdown_connections 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2101484573 wait complete. 2024-04-23T10:13:39.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.077+0000 7f5c78c3e000 20 client.5202 trim_cache size 0 max 16384 2024-04-23T10:13:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.093+0000 7f5c78c3e000 1 Processor -- start 2024-04-23T10:13:39.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.093+0000 7f5c78c3e000 1 -- start start 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fac5e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5facb5c0 0x564c5fb394e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5c701f53a0 con 0x564c5fa90ab0 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c5f8a59e0 con 0x564c5fa90190 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564c5f8d8730 con 0x564c5facb5c0 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50022/0 (socket says 172.21.15.26:50022) 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 -- 172.21.15.26:0/2868876868 learned_addr learned my addr 172.21.15.26:0/2868876868 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 -- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5facb5c0 msgr2=0x564c5fb394e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5facb5c0 0x564c5fb394e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 -- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 msgr2=0x564c5fac5e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fac5e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 -- 172.21.15.26:0/2868876868 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564c5f85fe80 con 0x564c5fa90ab0 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400db10 tx=0x7f5c64052570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3911a9a488eaf4e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c54ff9640 1 -- 172.21.15.26:0/2868876868 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6405a570 con 0x564c5fa90ab0 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c54ff9640 1 -- 172.21.15.26:0/2868876868 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6406e070 con 0x564c5fa90ab0 2024-04-23T10:13:39.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c54ff9640 1 -- 172.21.15.26:0/2868876868 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c6405ee30 con 0x564c5fa90ab0 2024-04-23T10:13:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2868876868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 msgr2=0x564c5fac63d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400db10 tx=0x7f5c64052570 comp rx=0 tx=0).stop 2024-04-23T10:13:39.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2868876868 shutdown_connections 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5facb5c0 0x564c5fb394e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5fa90ab0 0x564c5fac63d0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/2868876868 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fac5e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2868876868 >> 172.21.15.26:0/2868876868 conn(0x564c5fac7e40 msgr2=0x564c5fa89ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2868876868 shutdown_connections 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- 172.21.15.26:0/2868876868 wait complete. 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- start start 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 Processor -- start 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fae4d60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90ab0 0x564c5fb3b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564c5f8e6630 con 0x564c5facb5c0 2024-04-23T10:13:39.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564c5f8dda50 con 0x564c5fa90190 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564c5f95a120 con 0x564c5fa90ab0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c78c3e000 10 client.0 _ll_register_callbacks cb 0x7f5c58003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:50036/0 (socket says 172.21.15.26:50036) 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6ffff640 1 -- 172.21.15.26:0/4018713437 learned_addr learned my addr 172.21.15.26:0/4018713437 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fae4d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.097+0000 7f5c6effd640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90ab0 0x564c5fb3b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 -- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90ab0 msgr2=0x564c5fb3b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90ab0 0x564c5fb3b540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 -- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 msgr2=0x564c5fae4d60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fae4d60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 -- 172.21.15.26:0/4018713437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564c5f8a1b30 con 0x564c5facb5c0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6ffff640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c68000f90 tx=0x7f5c68009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ceaf421b6d8092f2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:39.104 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c680d2060 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c680b7650 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f5c6406e070 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f5c680d8050 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 10 client.5208 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564c5f95a5b0 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c6406e070 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f5c680db020 con 0x564c5facb5c0 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 10 client.5208 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 10 client.5208 resolve_mds: resolved name 'f' to daemon mds.f 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 20 client.5208 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fb3a110 0x564c5fb3a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 4 client.5208 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "status"}] 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "status"}) -- 0x564c5f8e6e40 con 0x564c5fb3a110 2024-04-23T10:13:39.105 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fb3a110 0x564c5fb3a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c6f7fe640 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fb3a110 0x564c5fb3a4f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6e9f74db92e5d3aa server_cookie=9d30cec269ebb881 in_seq=0 out_seq=0 2024-04-23T10:13:39.106 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 10 client.5208 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 1 -- 172.21.15.26:0/4018713437 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+331 (crc 0 0 0) 0x564c5f8e6e40 con 0x564c5fb3a110 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 10 client.5208 handle_command_reply: tid=0 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 client.5208 shutdown 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 msgr2=0x564c5fb3ba80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x7f5c68000f90 tx=0x7f5c68009750 comp rx=0 tx=0).stop 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 shutdown_connections 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564c5fb3a110 0x564c5fb3a4f0 crc :-1 s=READY pgs=30 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.107 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564c5facb5c0 0x564c5fb3ba80 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564c5fa90ab0 0x564c5fb3b540 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 --2- 172.21.15.26:0/4018713437 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564c5fa90190 0x564c5fae4d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 >> 172.21.15.26:0/4018713437 conn(0x564c5fac7e40 msgr2=0x564c5fa89110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c4e7fc640 0 client.5208 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 shutdown_connections 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 1 -- 172.21.15.26:0/4018713437 wait complete. 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c78c3e000 20 client.5208 trim_cache size 0 max 16384 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stdout: "cluster_fsid": "8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8", 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stdout: "whoami": 0, 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stdout: "id": 4287, 2024-04-23T10:13:39.108 INFO:teuthology.orchestra.run.smithi026.stdout: "want_state": "up:active", 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "state": "up:active", 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "fs_name": "cephfs", 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "rank_uptime": 64.098471054000001, 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "mdsmap_epoch": 19, 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch": 26, 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "osdmap_epoch_barrier": 26, 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout: "uptime": 71.129724757000005 2024-04-23T10:13:39.109 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 msgr2=0x7f5c5c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 0x7f5c5c06a870 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5c60005630 tx=0x7f5c60009040 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 msgr2=0x7f5c701503a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f5c6400db40 tx=0x7f5c64001670 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 shutdown_connections 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c5c0683b0 0x7f5c5c06a870 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c7014d240 0x7f5c70147f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c7014c4f0 0x7f5c701503a0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 --2- 172.21.15.26:0/353057968 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c7014ce60 0x7f5c7014fe60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:39.110 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 >> 172.21.15.26:0/353057968 conn(0x7f5c7006fca0 msgr2=0x7f5c700ca850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 shutdown_connections 2024-04-23T10:13:39.111 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:39.101+0000 7f5c75abc640 1 -- 172.21.15.26:0/353057968 wait complete. 2024-04-23T10:13:39.125 INFO:tasks.quiescer:Ready to start quiesce thrashing; initial delay: 15 sec 2024-04-23T10:13:54.126 INFO:tasks.quiescer.fs.[cephfs]:Total duration (36.7) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:13:54.127 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.35 2024-04-23T10:13:54.127 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:13:54.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.240+0000 7f14ab8ba640 1 Processor -- start 2024-04-23T10:13:54.244 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.240+0000 7f14ab8ba640 1 -- start start 2024-04-23T10:13:54.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.240+0000 7f14ab8ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a4159cf0 0x7f14a4071530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.240+0000 7f14ab8ba640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f14a40c6210 0x7f14a40c6630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14ab8ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14a40c9370 0x7f14a40c9820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14ab8ba640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f14a40c5d80 con 0x7f14a40c9370 2024-04-23T10:13:54.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14ab8ba640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f14a40c8080 con 0x7f14a40c6210 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14ab8ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14a40c8360 con 0x7f14a4159cf0 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14a40c9370 0x7f14a40c9820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f14a40c9370 0x7f14a40c9820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58038/0 (socket says 172.21.15.26:58038) 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 -- 172.21.15.26:0/673196588 learned_addr learned my addr 172.21.15.26:0/673196588 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9656640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a4159cf0 0x7f14a4071530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a8e55640 1 --2- 172.21.15.26:0/673196588 >> v2:172.21.15.190:3300/0 conn(0x7f14a40c6210 0x7f14a40c6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 -- 172.21.15.26:0/673196588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a4159cf0 msgr2=0x7f14a4071530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a4159cf0 0x7f14a4071530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 -- 172.21.15.26:0/673196588 >> v2:172.21.15.190:3300/0 conn(0x7f14a40c6210 msgr2=0x7f14a40c6630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 --2- 172.21.15.26:0/673196588 >> v2:172.21.15.190:3300/0 conn(0x7f14a40c6210 0x7f14a40c6630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 -- 172.21.15.26:0/673196588 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a40c8640 con 0x7f14a40c9370 2024-04-23T10:13:54.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.244+0000 7f14a9e57640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c9370 0x7f14a40c9820 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f14a4071ea0 tx=0x7f149c01f200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fac6b490abda3849 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f149bfff640 1 -- 172.21.15.26:0/673196588 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0b4070 con 0x7f14a40c9370 2024-04-23T10:13:54.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f149bfff640 1 -- 172.21.15.26:0/673196588 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f149c0af400 con 0x7f14a40c9370 2024-04-23T10:13:54.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f149bfff640 1 -- 172.21.15.26:0/673196588 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f149c0af7d0 con 0x7f14a40c9370 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- 172.21.15.26:0/673196588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c9370 msgr2=0x7f14a40c9820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c9370 0x7f14a40c9820 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7f14a4071ea0 tx=0x7f149c01f200 comp rx=0 tx=0).stop 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- 172.21.15.26:0/673196588 shutdown_connections 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c9370 0x7f14a40c9820 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/673196588 >> v2:172.21.15.190:3300/0 conn(0x7f14a40c6210 0x7f14a40c6630 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/673196588 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a4159cf0 0x7f14a4071530 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- 172.21.15.26:0/673196588 >> 172.21.15.26:0/673196588 conn(0x7f14a40676a0 msgr2=0x7f14a4067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- 172.21.15.26:0/673196588 shutdown_connections 2024-04-23T10:13:54.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- 172.21.15.26:0/673196588 wait complete. 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 Processor -- start 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.248+0000 7f14ab8ba640 1 -- start start 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a40c9370 0x7f14a4158430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 0x7f14a413f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f14a4158f80 con 0x7f14a40c6210 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f14a40c8c00 con 0x7f14a4159cf0 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f14a40cb1e0 con 0x7f14a40c9370 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58044/0 (socket says 172.21.15.26:58044) 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 -- 172.21.15.26:0/2635939213 learned_addr learned my addr 172.21.15.26:0/2635939213 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a8e55640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a40c9370 0x7f14a4158430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9e57640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 0x7f14a413f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 -- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a40c9370 msgr2=0x7f14a4158430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a40c9370 0x7f14a4158430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 -- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 msgr2=0x7f14a413f4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 0x7f14a413f4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 -- 172.21.15.26:0/2635939213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f14a413d0e0 con 0x7f14a40c6210 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9e57640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 0x7f14a413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14a9656640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e870 tx=0x7f14a000ed30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a0017070 con 0x7f14a40c6210 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14a000c940 con 0x7f14a40c6210 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f14a4140900 con 0x7f14a40c6210 2024-04-23T10:13:54.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f14a413c0c0 con 0x7f14a40c6210 2024-04-23T10:13:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14a000cd10 con 0x7f14a40c6210 2024-04-23T10:13:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.252+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f14a4075df0 con 0x7f14a40c6210 2024-04-23T10:13:54.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.256+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f14a001a070 con 0x7f14a40c6210 2024-04-23T10:13:54.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.256+0000 7f1499ffb640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 0x7f148806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.256+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f14a0086d40 con 0x7f14a40c6210 2024-04-23T10:13:54.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.256+0000 7f14a8e55640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 0x7f148806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.256+0000 7f14a8e55640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 0x7f148806a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14a40710f0 tx=0x7f1494008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.264+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f14a0056780 con 0x7f14a40c6210 2024-04-23T10:13:54.665 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f14a40c9150 con 0x7f14a40c6210 2024-04-23T10:13:54.666 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f1499ffb640 1 -- 172.21.15.26:0/2635939213 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f14a005aa80 con 0x7f14a40c6210 2024-04-23T10:13:54.666 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:13:54.666 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:13:54.667 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 msgr2=0x7f148806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 0x7f148806a840 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f14a40710f0 tx=0x7f1494008040 comp rx=0 tx=0).stop 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 msgr2=0x7f14a413df90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.664+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7f14a000e870 tx=0x7f14a000ed30 comp rx=0 tx=0).stop 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 shutdown_connections 2024-04-23T10:13:54.669 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1488068380 0x7f148806a840 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f14a4159cf0 0x7f14a413f4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f14a40c9370 0x7f14a4158430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 --2- 172.21.15.26:0/2635939213 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f14a40c6210 0x7f14a413df90 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 >> 172.21.15.26:0/2635939213 conn(0x7f14a40676a0 msgr2=0x7f14a40ca8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 shutdown_connections 2024-04-23T10:13:54.670 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.668+0000 7f14ab8ba640 1 -- 172.21.15.26:0/2635939213 wait complete. 2024-04-23T10:13:54.690 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 78.35 --await-for 42.0' 2024-04-23T10:13:54.691 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 78.35 --await-for 42.0 2024-04-23T10:13:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 Processor -- start 2024-04-23T10:13:54.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 -- start start 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f399c152180 0x7f399c158880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c073090 0x7f399c072090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f399c0734a0 con 0x7f399c0ccba0 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f399c06dc60 con 0x7f399c152180 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f39a19d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f399c0727d0 con 0x7f399c073090 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f399c152180 0x7f399c158880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399b7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c073090 0x7f399c072090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f399c152180 0x7f399c158880 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:37614/0 (socket says 172.21.15.26:37614) 2024-04-23T10:13:54.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 -- 172.21.15.26:0/3102253573 learned_addr learned my addr 172.21.15.26:0/3102253573 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 -- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c073090 msgr2=0x7f399c072090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 --2- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c073090 0x7f399c072090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 -- 172.21.15.26:0/3102253573 >> v1:172.21.15.190:6789/0 conn(0x7f399c0ccba0 legacy=0x7f399c0cbe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.864+0000 7f399affd640 1 -- 172.21.15.26:0/3102253573 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c072a70 con 0x7f399c152180 2024-04-23T10:13:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.868+0000 7f399affd640 1 --2- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c152180 0x7f399c158880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f398c009870 tx=0x7f398c01ed50 comp rx=0 tx=0).ready entity=mon.1 client_cookie=40beb0fc4bb26c8 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.868+0000 7f3999ffb640 1 -- 172.21.15.26:0/3102253573 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c0b5070 con 0x7f399c152180 2024-04-23T10:13:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.868+0000 7f3999ffb640 1 -- 172.21.15.26:0/3102253573 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c0a8a50 con 0x7f399c152180 2024-04-23T10:13:54.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.868+0000 7f3999ffb640 1 -- 172.21.15.26:0/3102253573 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c0a8e20 con 0x7f399c152180 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c152180 msgr2=0x7f399c158880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c152180 0x7f399c158880 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f398c009870 tx=0x7f398c01ed50 comp rx=0 tx=0).stop 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- 172.21.15.26:0/3102253573 shutdown_connections 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c073090 0x7f399c072090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- 172.21.15.26:0/3102253573 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c152180 0x7f399c158880 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- 172.21.15.26:0/3102253573 >> 172.21.15.26:0/3102253573 conn(0x7f399c06fe50 msgr2=0x7f399c070260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- 172.21.15.26:0/3102253573 shutdown_connections 2024-04-23T10:13:54.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- 172.21.15.26:0/3102253573 wait complete. 2024-04-23T10:13:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 Processor -- start 2024-04-23T10:13:54.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- start start 2024-04-23T10:13:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c073090 0x7f399c147bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c0ccba0 0x7f399c1e4680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f399c158360 con 0x7f399c152180 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f399c158080 con 0x7f399c073090 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f39a19d3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f399c157d30 con 0x7f399c0ccba0 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f399b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f399b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58058/0 (socket says 172.21.15.26:58058) 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f399b7fe640 1 -- 172.21.15.26:0/2198435062 learned_addr learned my addr 172.21.15.26:0/2198435062 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f399affd640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c073090 0x7f399c147bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.872+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c0ccba0 0x7f399c1e4680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 -- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c0ccba0 msgr2=0x7f399c1e4680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c0ccba0 0x7f399c1e4680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 -- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c073090 msgr2=0x7f399c147bd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c073090 0x7f399c147bd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 -- 172.21.15.26:0/2198435062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f399c151810 con 0x7f399c152180 2024-04-23T10:13:54.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3994009dd0 tx=0x7f399400c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 -- 172.21.15.26:0/2198435062 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994018020 con 0x7f399c152180 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 -- 172.21.15.26:0/2198435062 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3994014480 con 0x7f399c152180 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f39a19d3640 1 -- 172.21.15.26:0/2198435062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f399c0c8100 con 0x7f399c152180 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 -- 172.21.15.26:0/2198435062 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994014870 con 0x7f399c152180 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f39a19d3640 1 -- 172.21.15.26:0/2198435062 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f399c0c86c0 con 0x7f399c152180 2024-04-23T10:13:54.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 -- 172.21.15.26:0/2198435062 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f399401b020 con 0x7f399c152180 2024-04-23T10:13:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 0x7f398806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.876+0000 7f3983fff640 1 -- 172.21.15.26:0/2198435062 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3994087a10 con 0x7f399c152180 2024-04-23T10:13:54.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399affd640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 0x7f398806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 Processor -- start 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 -- start start 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399affd640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 0x7f398806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b2000 tx=0x7f398c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef819e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef873c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef819e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58072/0 (socket says 172.21.15.26:58072) 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 -- 172.21.15.26:0/1190059960 learned_addr learned my addr 172.21.15.26:0/1190059960 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56051ee2d2a0 con 0x56051ef866c0 2024-04-23T10:13:54.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56051ed935f0 con 0x56051ef86fe0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56051ed2e820 con 0x56051ef81600 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399b7fe640 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef873c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 -- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 msgr2=0x56051ef819e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef819e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 -- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 msgr2=0x56051ef873c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef873c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 -- 172.21.15.26:0/1190059960 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051edd9c00 con 0x56051ef866c0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f399a7fc640 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3990001860 tx=0x7f3990007de0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=548812b390e89fb1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a19d3640 1 -- 172.21.15.26:0/1190059960 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f39900052e0 con 0x56051ef866c0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a19d3640 1 -- 172.21.15.26:0/1190059960 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3990018070 con 0x56051ef866c0 2024-04-23T10:13:54.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.880+0000 7f39a19d3640 1 -- 172.21.15.26:0/1190059960 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f399000fa70 con 0x56051ef866c0 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 msgr2=0x56051ef86aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 crypto rx=0x7f3990001860 tx=0x7f3990007de0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 shutdown_connections 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef873c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef86aa0 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- 172.21.15.26:0/1190059960 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef819e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 >> 172.21.15.26:0/1190059960 conn(0x56051ef82470 msgr2=0x56051ef84890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 shutdown_connections 2024-04-23T10:13:54.887 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- 172.21.15.26:0/1190059960 wait complete. 2024-04-23T10:13:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 -- start start 2024-04-23T10:13:54.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 Processor -- start 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef80e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.884+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58080/0 (socket says 172.21.15.26:58080) 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef8cb60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef80e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef80e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:51844/0 (socket says 172.21.15.26:51844) 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 -- 172.21.15.26:0/2042590103 learned_addr learned my addr 172.21.15.26:0/2042590103 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56051ed3ec60 con 0x56051ef866c0 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56051ee15bf0 con 0x56051ef86fe0 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56051ee50560 con 0x56051ef81600 2024-04-23T10:13:54.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef8cb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 -- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 msgr2=0x56051ef80e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef80e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 -- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 msgr2=0x56051ef8cb60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef8cb60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56051edce630 con 0x56051ef866c0 2024-04-23T10:13:54.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x56051ed99ac0 tx=0x7f3990000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c70077ba436a2661 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f397a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 10 client.0 _ll_register_callbacks cb 0x56051ed6a570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f397a7fc640 1 -- 172.21.15.26:0/2042590103 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3990003600 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f397a7fc640 1 -- 172.21.15.26:0/2042590103 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f39900037a0 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3990018070 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f397a7fc640 1 -- 172.21.15.26:0/2042590103 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f399002c050 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 10 client.5223 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({fsmap=19}) -- 0x56051ed33490 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f397a7fc640 1 -- 172.21.15.26:0/2042590103 <== mon.0 v2:172.21.15.26:3300/0 4 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f39900039a0 con 0x56051ef866c0 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 10 client.5223 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 10 client.5223 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 20 client.5223 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef8d570 0x56051ef8d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 4 client.5223 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:13:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x7f3990018070 con 0x56051ef8d570 2024-04-23T10:13:54.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.888+0000 7f399affd640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef8d570 0x56051ef8d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f397a7fc640 10 client.5223 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:54.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f399affd640 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef8d570 0x56051ef8d980 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=6f8004773d4bea03 server_cookie=fc73a979a92c405b in_seq=0 out_seq=0 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f397a7fc640 1 -- 172.21.15.26:0/2042590103 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x7f3990018070 con 0x56051ef8d570 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f397a7fc640 10 client.5223 handle_command_reply: tid=0 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 client.5223 shutdown 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 msgr2=0x56051ef8c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x56051ed99ac0 tx=0x7f3990000ee0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 shutdown_connections 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef8d570 0x56051ef8d980 crc :-1 s=READY pgs=31 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef86fe0 0x56051ef8cb60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f397a7fc640 0 client.5223 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051ef8c620 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2042590103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef80e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 >> 172.21.15.26:0/2042590103 conn(0x56051ef82470 msgr2=0x56051ef856b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 shutdown_connections 2024-04-23T10:13:54.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 1 -- 172.21.15.26:0/2042590103 wait complete. 2024-04-23T10:13:54.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.892+0000 7f39a4b55000 20 client.5223 trim_cache size 0 max 16384 2024-04-23T10:13:54.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.924+0000 7f39a4b55000 1 Processor -- start 2024-04-23T10:13:54.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.924+0000 7f39a4b55000 1 -- start start 2024-04-23T10:13:54.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef8c940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef866c0 0x56051ef8d980 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58096/0 (socket says 172.21.15.26:58096) 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 -- 172.21.15.26:0/2175563733 learned_addr learned my addr 172.21.15.26:0/2175563733 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1fa320 con 0x56051ef82470 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f399c1fa9f0 con 0x56051ef866c0 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f399c0c7550 con 0x56051ef81600 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef8c940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef866c0 0x56051ef8d980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 -- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 msgr2=0x56051ef8c940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef8c940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 -- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef866c0 msgr2=0x56051ef8d980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef866c0 0x56051ef8d980 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 -- 172.21.15.26:0/2175563733 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56051ed2ea70 con 0x56051ef82470 2024-04-23T10:13:54.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f399affd640 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f398c000c10 tx=0x7f398c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e8dbcc99c94b3db server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f3980ff9640 1 -- 172.21.15.26:0/2175563733 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c0b5040 con 0x56051ef82470 2024-04-23T10:13:54.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f3980ff9640 1 -- 172.21.15.26:0/2175563733 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c0d1030 con 0x56051ef82470 2024-04-23T10:13:54.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f3980ff9640 1 -- 172.21.15.26:0/2175563733 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f398c0cd450 con 0x56051ef82470 2024-04-23T10:13:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 msgr2=0x56051ef8c400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7f398c000c10 tx=0x7f398c004740 comp rx=0 tx=0).stop 2024-04-23T10:13:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 shutdown_connections 2024-04-23T10:13:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef866c0 0x56051ef8d980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.928+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051ef8c940 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2175563733 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef82470 0x56051ef8c400 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 >> 172.21.15.26:0/2175563733 conn(0x56051ef43ac0 msgr2=0x56051ef97ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 shutdown_connections 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- 172.21.15.26:0/2175563733 wait complete. 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- start start 2024-04-23T10:13:54.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 Processor -- start 2024-04-23T10:13:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051efbc460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef82470 0x56051efbc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56051ed92900 con 0x56051ef866c0 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56051ed5de60 con 0x56051ef82470 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58102/0 (socket says 172.21.15.26:58102) 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399b7fe640 1 -- 172.21.15.26:0/2496403093 learned_addr learned my addr 172.21.15.26:0/2496403093 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399affd640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051efbc460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399a7fc640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef82470 0x56051efbc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56051ed97c20 con 0x56051ef81600 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f39a4b55000 10 client.0 _ll_register_callbacks cb 0x7f3990007f50 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399b7fe640 1 -- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 msgr2=0x56051efbc460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.932+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051efbc460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399b7fe640 1 -- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef82470 msgr2=0x56051efbc9a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef82470 0x56051efbc9a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399b7fe640 1 -- 172.21.15.26:0/2496403093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56051ee16080 con 0x56051ef866c0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399b7fe640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3994057260 tx=0x7f399405b860 comp rx=0 tx=0).ready entity=mon.0 client_cookie=783fd9aa6ed8ee60 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3994055920 con 0x56051ef866c0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f399405fe10 con 0x56051ef866c0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f398c0d1030 con 0x56051ef866c0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f39940569b0 con 0x56051ef866c0 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 10 client.5229 fetch_fsmap learned FSMap version 19 2024-04-23T10:13:54.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56051ed393e0 con 0x56051ef866c0 2024-04-23T10:13:54.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398c0d1030 con 0x56051ef866c0 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f3994056b50 con 0x56051ef866c0 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 10 client.5229 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 10 client.5229 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 20 client.5229 populate_metadata read hostname 'smithi026' 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef86fe0 0x56051ef8bec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 4 client.5229 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.35, "await_for": 42.0}] 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.35, "await_for": 42.0}) -- 0x56051ed2d7f0 con 0x56051ef86fe0 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399affd640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef86fe0 0x56051ef8bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f397a7fc640 10 client.5229 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:54.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.936+0000 7f399affd640 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef86fe0 0x56051ef8bec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3ff4b772b69da525 server_cookie=ecd1d870d66e28b8 in_seq=0 out_seq=0 2024-04-23T10:13:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f397a7fc640 1 -- 172.21.15.26:0/2496403093 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x56051ed2d7f0 con 0x56051ef86fe0 2024-04-23T10:13:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f397a7fc640 10 client.5229 handle_command_reply: tid=0 2024-04-23T10:13:54.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 client.5229 shutdown 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 msgr2=0x56051efbcee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7f3994057260 tx=0x7f399405b860 comp rx=0 tx=0).stop 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 shutdown_connections 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56051ef86fe0 0x56051ef8bec0 crc :-1 s=READY pgs=32 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56051ef866c0 0x56051efbcee0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f397a7fc640 0 client.5229 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56051ef82470 0x56051efbc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 --2- 172.21.15.26:0/2496403093 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56051ef81600 0x56051efbc460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 >> 172.21.15.26:0/2496403093 conn(0x56051ef43ac0 msgr2=0x56051ef97630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 shutdown_connections 2024-04-23T10:13:54.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 1 -- 172.21.15.26:0/2496403093 wait complete. 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f39a4b55000 20 client.5229 trim_cache size 0 max 16384 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 2, 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "a485b75c": { 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 2, 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:13:54.949 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 78.3, 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:54.950 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 msgr2=0x7f398806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 0x7f398806a840 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f398c0b2000 tx=0x7f398c009040 comp rx=0 tx=0).stop 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 msgr2=0x7f399c1502e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7f3994009dd0 tx=0x7f399400c490 comp rx=0 tx=0).stop 2024-04-23T10:13:54.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 shutdown_connections 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3988068380 0x7f398806a840 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f399c152180 0x7f399c1502e0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f399c0ccba0 0x7f399c1e4680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 --2- 172.21.15.26:0/2198435062 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f399c073090 0x7f399c147bd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.944+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 >> 172.21.15.26:0/2198435062 conn(0x7f399c06fe50 msgr2=0x7f399c14efb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.948+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 shutdown_connections 2024-04-23T10:13:54.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:13:54.948+0000 7f3981ffb640 1 -- 172.21.15.26:0/2198435062 wait complete. 2024-04-23T10:13:54.969 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'a485b75c', quiesce took 0.8 seconds. Will release after: 18.35 2024-04-23T10:14:05.593 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:14:05.596 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:14:13.320 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:14:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 Processor -- start 2024-04-23T10:14:13.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 -- start start 2024-04-23T10:14:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f33c8144580 0x7f33c815b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33c806cee0 0x7f33c806d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f33c80c8570 con 0x7f33c80703c0 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f33c815f420 con 0x7f33c806cee0 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cf3cf640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f33c80c8040 con 0x7f33c8144580 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33c806cee0 0x7f33c806d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f33c806cee0 0x7f33c806d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41278/0 (socket says 172.21.15.26:41278) 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 -- 172.21.15.26:0/3032143775 learned_addr learned my addr 172.21.15.26:0/3032143775 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd16b640 1 --2- 172.21.15.26:0/3032143775 >> v2:172.21.15.190:3300/0 conn(0x7f33c8144580 0x7f33c815b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 -- 172.21.15.26:0/3032143775 >> v2:172.21.15.190:3300/0 conn(0x7f33c8144580 msgr2=0x7f33c815b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 --2- 172.21.15.26:0/3032143775 >> v2:172.21.15.190:3300/0 conn(0x7f33c8144580 0x7f33c815b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 -- 172.21.15.26:0/3032143775 >> v1:172.21.15.190:6789/0 conn(0x7f33c80703c0 legacy=0x7f33c80c9010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 -- 172.21.15.26:0/3032143775 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c80c8290 con 0x7f33c806cee0 2024-04-23T10:14:13.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.440+0000 7f33cd96c640 1 --2- 172.21.15.26:0/3032143775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c806d310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33c806ca00 tx=0x7f33c001c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4fa0f62d6281c9ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33bffff640 1 -- 172.21.15.26:0/3032143775 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c00a5890 con 0x7f33c806cee0 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33bffff640 1 -- 172.21.15.26:0/3032143775 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c00a5a30 con 0x7f33c806cee0 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33bffff640 1 -- 172.21.15.26:0/3032143775 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c00a5e00 con 0x7f33c806cee0 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/3032143775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 msgr2=0x7f33c806d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/3032143775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c806d310 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7f33c806ca00 tx=0x7f33c001c9b0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/3032143775 shutdown_connections 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/3032143775 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c806d310 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/3032143775 >> v2:172.21.15.190:3300/0 conn(0x7f33c8144580 0x7f33c815b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/3032143775 >> 172.21.15.26:0/3032143775 conn(0x7f33c80ca540 msgr2=0x7f33c80ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/3032143775 shutdown_connections 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/3032143775 wait complete. 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 Processor -- start 2024-04-23T10:14:13.446 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- start start 2024-04-23T10:14:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33c80703c0 0x7f33c8157f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 0x7f33c815dad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f33c80c8cb0 con 0x7f33c806cee0 2024-04-23T10:14:13.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f33c815ef00 con 0x7f33c80703c0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f33c80c9720 con 0x7f33c8144580 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41284/0 (socket says 172.21.15.26:41284) 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 -- 172.21.15.26:0/1683033133 learned_addr learned my addr 172.21.15.26:0/1683033133 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cc96a640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33c80703c0 0x7f33c8157f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 -- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 msgr2=0x7f33c815dad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd96c640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 0x7f33c815dad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 0x7f33c815dad0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 -- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33c80703c0 msgr2=0x7f33c8157f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33c80703c0 0x7f33c8157f00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 -- 172.21.15.26:0/1683033133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f33c8158440 con 0x7f33c806cee0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd96c640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 0x7f33c815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cd16b640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d800 tx=0x7f33c400dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c400b6c0 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f33c4019070 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.444+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f33c8155970 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f33c400ba60 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f33c8155f30 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33c8156650 con 0x7f33c806cee0 2024-04-23T10:14:13.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f33c400bc00 con 0x7f33c806cee0 2024-04-23T10:14:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33bdffb640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 0x7f33ac06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f33c4087260 con 0x7f33c806cee0 2024-04-23T10:14:13.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33cc96a640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 0x7f33ac06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.448+0000 7f33cc96a640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 0x7f33ac06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f33c813d900 tx=0x7f33b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.456+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f33c4057400 con 0x7f33c806cee0 2024-04-23T10:14:13.700 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f33c8075df0 con 0x7f33c806cee0 2024-04-23T10:14:13.701 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33bdffb640 1 -- 172.21.15.26:0/1683033133 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f33c4056d00 con 0x7f33c806cee0 2024-04-23T10:14:13.702 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:14:13.702 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:14:13.702 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 msgr2=0x7f33ac06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 0x7f33ac06a840 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7f33c813d900 tx=0x7f33b8008040 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 msgr2=0x7f33c8140530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7f33c400d800 tx=0x7f33c400dcc0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 shutdown_connections 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f33ac068380 0x7f33ac06a840 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f33c8144580 0x7f33c815dad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f33c80703c0 0x7f33c8157f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 --2- 172.21.15.26:0/1683033133 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f33c806cee0 0x7f33c8140530 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.704 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 >> 172.21.15.26:0/1683033133 conn(0x7f33c80ca540 msgr2=0x7f33c8142260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 shutdown_connections 2024-04-23T10:14:13.705 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.700+0000 7f33cf3cf640 1 -- 172.21.15.26:0/1683033133 wait complete. 2024-04-23T10:14:13.723 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id a485b75c --release --await' 2024-04-23T10:14:13.724 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id a485b75c --release --await 2024-04-23T10:14:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 Processor -- start 2024-04-23T10:14:13.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 -- start start 2024-04-23T10:14:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc98153100 0x7fbc9806c5e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.846 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc9806e4b0 0x7fbc98073a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbc980677b0 con 0x7fbc980c0a20 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbc9806cb20 con 0x7fbc9806e4b0 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc9dcf4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbc98067d70 con 0x7fbc98153100 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc9806e4b0 0x7fbc98073a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbc9806e4b0 0x7fbc98073a80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41300/0 (socket says 172.21.15.26:41300) 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 -- 172.21.15.26:0/1743831141 learned_addr learned my addr 172.21.15.26:0/1743831141 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc977fe640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc98153100 0x7fbc9806c5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 -- 172.21.15.26:0/1743831141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc98153100 msgr2=0x7fbc9806c5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc98153100 0x7fbc9806c5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 -- 172.21.15.26:0/1743831141 >> v1:172.21.15.190:6789/0 conn(0x7fbc980c0a20 legacy=0x7fbc98159970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.844+0000 7fbc97fff640 1 -- 172.21.15.26:0/1743831141 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc98067a90 con 0x7fbc9806e4b0 2024-04-23T10:14:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc9806e4b0 0x7fbc98073a80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009e80 tx=0x7fbc9001c9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=437faee7d96a5140 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc967fc640 1 -- 172.21.15.26:0/1743831141 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a5820 con 0x7fbc9806e4b0 2024-04-23T10:14:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc967fc640 1 -- 172.21.15.26:0/1743831141 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc900a59c0 con 0x7fbc9806e4b0 2024-04-23T10:14:13.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc967fc640 1 -- 172.21.15.26:0/1743831141 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc900a5d90 con 0x7fbc9806e4b0 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/1743831141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc9806e4b0 msgr2=0x7fbc98073a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc9806e4b0 0x7fbc98073a80 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7fbc90009e80 tx=0x7fbc9001c9a0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/1743831141 shutdown_connections 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc9806e4b0 0x7fbc98073a80 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/1743831141 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc98153100 0x7fbc9806c5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/1743831141 >> 172.21.15.26:0/1743831141 conn(0x7fbc9806f280 msgr2=0x7fbc9806f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/1743831141 shutdown_connections 2024-04-23T10:14:13.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/1743831141 wait complete. 2024-04-23T10:14:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 Processor -- start 2024-04-23T10:14:13.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- start start 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc9806e4b0 0x7fbc980cbfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 0x7fbc98162c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98153660 con 0x7fbc98153100 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbc981534e0 con 0x7fbc980c0a20 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbc981660e0 con 0x7fbc9806e4b0 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41312/0 (socket says 172.21.15.26:41312) 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 -- 172.21.15.26:0/3372758169 learned_addr learned my addr 172.21.15.26:0/3372758169 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 0x7fbc98162c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc977fe640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc9806e4b0 0x7fbc980cbfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 -- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc9806e4b0 msgr2=0x7fbc980cbfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc9806e4b0 0x7fbc980cbfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 -- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 msgr2=0x7fbc98162c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 0x7fbc98162c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 -- 172.21.15.26:0/3372758169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbc98152610 con 0x7fbc98153100 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 0x7fbc98162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc97fff640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc9001b050 tx=0x7fbc90019740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc7ffff640 1 -- 172.21.15.26:0/3372758169 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc900bc020 con 0x7fbc98153100 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc7ffff640 1 -- 172.21.15.26:0/3372758169 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc900b8670 con 0x7fbc98153100 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbc981f4560 con 0x7fbc98153100 2024-04-23T10:14:13.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc7ffff640 1 -- 172.21.15.26:0/3372758169 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc900b8a60 con 0x7fbc98153100 2024-04-23T10:14:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.848+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbc981f4b20 con 0x7fbc98153100 2024-04-23T10:14:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbc7ffff640 1 -- 172.21.15.26:0/3372758169 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbc900bf020 con 0x7fbc98153100 2024-04-23T10:14:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbc7ffff640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 0x7fbc8406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbc7ffff640 1 -- 172.21.15.26:0/3372758169 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbc90121ff0 con 0x7fbc98153100 2024-04-23T10:14:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbc977fe640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 0x7fbc8406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbc977fe640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 0x7fbc8406a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b930 tx=0x7fbc88008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbca0e76000 1 Processor -- start 2024-04-23T10:14:13.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.852+0000 7fbca0e76000 1 -- start start 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964a629c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a9e120 0x55d964a9e500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d9648aa660 con 0x55d964a62f00 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d96484f5d0 con 0x55d964a998a0 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d9648a6620 con 0x55d964a9e120 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41318/0 (socket says 172.21.15.26:41318) 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 -- 172.21.15.26:0/451714692 learned_addr learned my addr 172.21.15.26:0/451714692 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc97fff640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a9e120 0x55d964a9e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc977fe640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964a629c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 -- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a9e120 msgr2=0x55d964a9e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a9e120 0x55d964a9e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 -- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 msgr2=0x55d964a629c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964a629c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 -- 172.21.15.26:0/451714692 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d964883bd0 con 0x55d964a62f00 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc977fe640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964a629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c003db0 tx=0x7fbc8c004270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2afffc37ec103f98 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc7d7fa640 1 -- 172.21.15.26:0/451714692 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c019070 con 0x55d964a62f00 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc7d7fa640 1 -- 172.21.15.26:0/451714692 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc8c005070 con 0x55d964a62f00 2024-04-23T10:14:13.860 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbc7d7fa640 1 -- 172.21.15.26:0/451714692 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c005420 con 0x55d964a62f00 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- 172.21.15.26:0/451714692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 msgr2=0x55d964a632e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c003db0 tx=0x7fbc8c004270 comp rx=0 tx=0).stop 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- 172.21.15.26:0/451714692 shutdown_connections 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a9e120 0x55d964a9e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a632e0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 --2- 172.21.15.26:0/451714692 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964a629c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- 172.21.15.26:0/451714692 >> 172.21.15.26:0/451714692 conn(0x55d964944b00 msgr2=0x55d964a9bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- 172.21.15.26:0/451714692 shutdown_connections 2024-04-23T10:14:13.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- 172.21.15.26:0/451714692 wait complete. 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 -- start start 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.856+0000 7fbca0e76000 1 Processor -- start 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a983c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a9e120 0x55d964a5d870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d964967d40 con 0x55d964a62f00 2024-04-23T10:14:13.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d964864eb0 con 0x55d964a9e120 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d9648a52a0 con 0x55d964a998a0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41320/0 (socket says 172.21.15.26:41320) 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 -- 172.21.15.26:0/1311819570 learned_addr learned my addr 172.21.15.26:0/1311819570 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 10 client.0 _ll_register_callbacks cb 0x55d964a48a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a983c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc97fff640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a9e120 0x55d964a5d870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 -- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 msgr2=0x55d964a983c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a983c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 -- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a9e120 msgr2=0x55d964a5d870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a9e120 0x55d964a5d870 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 -- 172.21.15.26:0/1311819570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d9648f0b30 con 0x55d964a62f00 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc977fe640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b570 tx=0x7fbc88004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dec4aa2f07f4c0d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88015820 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55d964844060 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbc880159c0 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbc8802e050 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 10 client.5247 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d964849b70 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55d964844060 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fbc88031020 con 0x55d964a62f00 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 10 client.5247 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 10 client.5247 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 20 client.5247 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a5e610 0x55d964a5ea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 4 client.5247 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:14:13.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55d964882e30 con 0x55d964a5e610 2024-04-23T10:14:13.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a5e610 0x55d964a5ea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc767fc640 10 client.5247 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:13.867 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.860+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a5e610 0x55d964a5ea20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=fdafc97fc8f0955b server_cookie=2b2698853934d501 in_seq=0 out_seq=0 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbc767fc640 1 -- 172.21.15.26:0/1311819570 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55d964882e30 con 0x55d964a5e610 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbc767fc640 10 client.5247 handle_command_reply: tid=0 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 client.5247 shutdown 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 msgr2=0x55d964a97e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b570 tx=0x7fbc88004740 comp rx=0 tx=0).stop 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 shutdown_connections 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a5e610 0x55d964a5ea20 crc :-1 s=READY pgs=33 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a9e120 0x55d964a5d870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbc767fc640 0 client.5247 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a983c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 --2- 172.21.15.26:0/1311819570 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a97e80 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 >> 172.21.15.26:0/1311819570 conn(0x55d964944b00 msgr2=0x55d964a9d9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 shutdown_connections 2024-04-23T10:14:13.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 1 -- 172.21.15.26:0/1311819570 wait complete. 2024-04-23T10:14:13.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.864+0000 7fbca0e76000 20 client.5247 trim_cache size 0 max 16384 2024-04-23T10:14:13.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 Processor -- start 2024-04-23T10:14:13.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- start start 2024-04-23T10:14:13.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a62f00 0x55d964a5caf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a5d030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98201c70 con 0x55d964a5e610 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbc98202340 con 0x55d964a62f00 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbc981f85e0 con 0x55d964a998a0 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41322/0 (socket says 172.21.15.26:41322) 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 -- 172.21.15.26:0/682831110 learned_addr learned my addr 172.21.15.26:0/682831110 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc97fff640 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a5d030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 -- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 msgr2=0x55d964a5d030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a5d030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 -- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a62f00 msgr2=0x55d964a5caf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a62f00 0x55d964a5caf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 -- 172.21.15.26:0/682831110 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d96492c5e0 con 0x55d964a5e610 2024-04-23T10:14:13.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc977fe640 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c010 tx=0x7fbc8801f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99c6f9adc54a9f94 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc7cff9640 1 -- 172.21.15.26:0/682831110 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8800fc00 con 0x55d964a5e610 2024-04-23T10:14:13.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc7cff9640 1 -- 172.21.15.26:0/682831110 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88026070 con 0x55d964a5e610 2024-04-23T10:14:13.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbc7cff9640 1 -- 172.21.15.26:0/682831110 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc88015620 con 0x55d964a5e610 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- 172.21.15.26:0/682831110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 msgr2=0x55d964a972f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800c010 tx=0x7fbc8801f000 comp rx=0 tx=0).stop 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- 172.21.15.26:0/682831110 shutdown_connections 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a998a0 0x55d964a5d030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a62f00 0x55d964a5caf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 --2- 172.21.15.26:0/682831110 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a5e610 0x55d964a972f0 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- 172.21.15.26:0/682831110 >> 172.21.15.26:0/682831110 conn(0x55d964944b00 msgr2=0x55d964a5c3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.880+0000 7fbca0e76000 1 -- 172.21.15.26:0/682831110 shutdown_connections 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- 172.21.15.26:0/682831110 wait complete. 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- start start 2024-04-23T10:14:13.886 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 Processor -- start 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 0x55d964a98bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964ab5b60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55d9648a9970 con 0x55d964a62f00 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55d96485f8f0 con 0x55d964a998a0 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55d9648aec90 con 0x55d964a5e610 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 10 client.0 _ll_register_callbacks cb 0x7fbc8800beb0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41328/0 (socket says 172.21.15.26:41328) 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 -- 172.21.15.26:0/2883448290 learned_addr learned my addr 172.21.15.26:0/2883448290 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:13.889 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc977fe640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 0x55d964a98bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 -- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 msgr2=0x55d964a98bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 0x55d964a98bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 -- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 msgr2=0x55d964ab5b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964ab5b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 -- 172.21.15.26:0/2883448290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d96483cae0 con 0x55d964a62f00 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc977fe640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 0x55d964a98bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc96ffd640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c017040 tx=0x7fbc8c003770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d9e29399ed10936 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbc8c019040 con 0x55d964a62f00 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbc8c010040 con 0x55d964a62f00 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fbc88026070 con 0x55d964a62f00 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fbc8c034050 con 0x55d964a62f00 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 10 client.5253 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:13.890 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55d96483fd80 con 0x55d964a62f00 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbc88026070 con 0x55d964a62f00 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fbc8c037020 con 0x55d964a62f00 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 10 client.5253 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 10 client.5253 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 20 client.5253 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a9e120 0x55d964b1a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 4 client.5253 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "a485b75c", "release": true, "await": true}] 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "a485b75c", "release": true, "await": true}) -- 0x55d9648480d0 con 0x55d964a9e120 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.884+0000 7fbc977fe640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a9e120 0x55d964b1a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbc977fe640 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a9e120 0x55d964b1a5a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=566f9de99a138141 server_cookie=2a962f6ca9aee9d8 in_seq=0 out_seq=0 2024-04-23T10:14:13.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbc767fc640 10 client.5253 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:13.892 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbc767fc640 1 -- 172.21.15.26:0/2883448290 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55d9648480d0 con 0x55d964a9e120 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbc767fc640 10 client.5253 handle_command_reply: tid=0 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 client.5253 shutdown 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 msgr2=0x55d964a99130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fbc8c017040 tx=0x7fbc8c003770 comp rx=0 tx=0).stop 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 shutdown_connections 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55d964a9e120 0x55d964b1a5a0 crc :-1 s=READY pgs=34 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55d964a998a0 0x55d964ab5b60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55d964a62f00 0x55d964a99130 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 --2- 172.21.15.26:0/2883448290 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55d964a5e610 0x55d964a98bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 >> 172.21.15.26:0/2883448290 conn(0x55d964944b00 msgr2=0x55d964a960d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbc767fc640 0 client.5253 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 shutdown_connections 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 1 -- 172.21.15.26:0/2883448290 wait complete. 2024-04-23T10:14:13.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.888+0000 7fbca0e76000 20 client.5253 trim_cache size 0 max 16384 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 4, 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "a485b75c": { 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 4, 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:14:13.894 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 78.3, 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:13.895 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 msgr2=0x7fbc8406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 0x7fbc8406a840 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbc8800b930 tx=0x7fbc88008040 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 msgr2=0x7fbc98163180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 crypto rx=0x7fbc9001b050 tx=0x7fbc90019740 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 shutdown_connections 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbc84068380 0x7fbc8406a840 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbc98153100 0x7fbc98163180 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbc980c0a20 0x7fbc98162c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 --2- 172.21.15.26:0/3372758169 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbc9806e4b0 0x7fbc980cbfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:13.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 >> 172.21.15.26:0/3372758169 conn(0x7fbc9806f280 msgr2=0x7fbc98158390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:13.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 shutdown_connections 2024-04-23T10:14:13.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:13.892+0000 7fbc9dcf4640 1 -- 172.21.15.26:0/3372758169 wait complete. 2024-04-23T10:14:13.908 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'a485b75c', seconds elapsed: 19.8 2024-04-23T10:14:13.908 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 18.35 2024-04-23T10:14:13.908 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 Processor -- start 2024-04-23T10:14:14.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 -- start start 2024-04-23T10:14:14.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8d600ca550 0x7f8d600c5730 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d600cada0 con 0x7f8d600c7eb0 2024-04-23T10:14:14.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8d600cb080 con 0x7f8d60152ff0 2024-04-23T10:14:14.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d65cbc640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8d600c9360 con 0x7f8d600ca550 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8d600c7eb0 0x7f8d600cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49888/0 (socket says 172.21.15.26:49888) 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5effd640 1 -- 172.21.15.26:0/158353299 learned_addr learned my addr 172.21.15.26:0/158353299 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5ffff640 1 --2- 172.21.15.26:0/158353299 >> v2:172.21.15.190:3300/0 conn(0x7f8d600ca550 0x7f8d600c5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 832040677 0 0) 0x7f8d600cada0 con 0x7f8d600c7eb0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8d48003530 con 0x7f8d600c7eb0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3347540002 0 0) 0x7f8d48003530 con 0x7f8d600c7eb0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 >> v2:172.21.15.190:3300/0 conn(0x7f8d600ca550 msgr2=0x7f8d600c5730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 --2- 172.21.15.26:0/158353299 >> v2:172.21.15.190:3300/0 conn(0x7f8d600ca550 0x7f8d600c5730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 >> v1:172.21.15.190:6789/0 conn(0x7f8d60152ff0 legacy=0x7f8d600c6380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600c9640 con 0x7f8d600c7eb0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f8d54001680 con 0x7f8d600c7eb0 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 >> v1:172.21.15.26:6789/0 conn(0x7f8d600c7eb0 legacy=0x7f8d600cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 0x7f8d48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d48004810 0x7f8d48004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480051d0 0x7f8d4800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600c9360 con 0x7f8d480039c0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d4800c020 con 0x7f8d480051d0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8d4800c220 con 0x7f8d48004810 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 0x7f8d48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5effd640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d48004810 0x7f8d48004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5ffff640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480051d0 0x7f8d4800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 -- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d48004810 msgr2=0x7f8d48004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d48004810 0x7f8d48004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 -- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480051d0 msgr2=0x7f8d4800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480051d0 0x7f8d4800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5f7fe640 1 -- 172.21.15.26:0/158353299 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d600c9640 con 0x7f8d480039c0 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5ffff640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480051d0 0x7f8d4800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:14:14.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.012+0000 7f8d5ffff640 1 -- 172.21.15.26:0/158353299 reap_dead start 2024-04-23T10:14:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 0x7f8d48003de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001760 tx=0x7f8d5001c320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=85fe7efb768dbc30 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50001380 con 0x7f8d480039c0 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d500052f0 con 0x7f8d480039c0 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5e7fc640 1 -- 172.21.15.26:0/158353299 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d50003840 con 0x7f8d480039c0 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 msgr2=0x7f8d48003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 0x7f8d48003de0 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001760 tx=0x7f8d5001c320 comp rx=0 tx=0).stop 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/158353299 shutdown_connections 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/158353299 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d480039c0 0x7f8d48003de0 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/158353299 >> 172.21.15.26:0/158353299 conn(0x7f8d600676a0 msgr2=0x7f8d60067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/158353299 shutdown_connections 2024-04-23T10:14:14.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/158353299 wait complete. 2024-04-23T10:14:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 Processor -- start 2024-04-23T10:14:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- start start 2024-04-23T10:14:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480039c0 0x7f8d60146090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d6015af40 0x7f8d6015b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41344/0 (socket says 172.21.15.26:41344) 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5effd640 1 -- 172.21.15.26:0/1623360447 learned_addr learned my addr 172.21.15.26:0/1623360447 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600caaa0 con 0x7f8d6015a5e0 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8d600c5e60 con 0x7f8d480039c0 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8d601533d0 con 0x7f8d6015af40 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.016+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480039c0 0x7f8d60146090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5ffff640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d6015af40 0x7f8d6015b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 -- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d6015af40 msgr2=0x7f8d6015b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d6015af40 0x7f8d6015b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 -- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480039c0 msgr2=0x7f8d60146090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480039c0 0x7f8d60146090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8d6015b900 con 0x7f8d6015a5e0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5effd640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d540124c0 tx=0x7f8d54012980 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54014810 con 0x7f8d6015a5e0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8d5401b070 con 0x7f8d6015a5e0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8d60159f40 con 0x7f8d6015a5e0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8d54014c10 con 0x7f8d6015a5e0 2024-04-23T10:14:14.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8d601ef6d0 con 0x7f8d6015a5e0 2024-04-23T10:14:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8d60075df0 con 0x7f8d6015a5e0 2024-04-23T10:14:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8d54016480 con 0x7f8d6015a5e0 2024-04-23T10:14:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8d5408abf0 con 0x7f8d6015a5e0 2024-04-23T10:14:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.020+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.024+0000 7f8d5f7fe640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 0x7f8d4c06a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001730 tx=0x7f8d500011a0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.024+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8d6015b900 con 0x7f8d6015a5e0 2024-04-23T10:14:14.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.296+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8d600ca000 con 0x7f8d6015a5e0 2024-04-23T10:14:14.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.296+0000 7f8d47fff640 1 -- 172.21.15.26:0/1623360447 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f8d5405af30 con 0x7f8d6015a5e0 2024-04-23T10:14:14.300 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:14:14.300 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:14:14.300 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 msgr2=0x7f8d4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 0x7f8d4c06a870 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7f8d50001730 tx=0x7f8d500011a0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 msgr2=0x7f8d6014f750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d540124c0 tx=0x7f8d54012980 comp rx=0 tx=0).stop 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 shutdown_connections 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8d4c0683b0 0x7f8d4c06a870 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8d6015af40 0x7f8d6015b3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8d6015a5e0 0x7f8d6014f750 secure :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 crypto rx=0x7f8d540124c0 tx=0x7f8d54012980 comp rx=0 tx=0).stop 2024-04-23T10:14:14.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 --2- 172.21.15.26:0/1623360447 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8d480039c0 0x7f8d60146090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 >> 172.21.15.26:0/1623360447 conn(0x7f8d600676a0 msgr2=0x7f8d60073b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 shutdown_connections 2024-04-23T10:14:14.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.300+0000 7f8d65cbc640 1 -- 172.21.15.26:0/1623360447 wait complete. 2024-04-23T10:14:14.317 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 78.35 --await-for 42.0' 2024-04-23T10:14:14.317 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 78.35 --await-for 42.0 2024-04-23T10:14:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 Processor -- start 2024-04-23T10:14:14.445 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 -- start start 2024-04-23T10:14:14.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1a280cdc40 0x7f1a28158a70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a280722f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1a2815baf0 con 0x7f1a280cd860 2024-04-23T10:14:14.447 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f1a2815c350 con 0x7f1a280cdc40 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2c812640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a281585e0 con 0x7f1a280c9970 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f1a280cd860 0x7f1a2815b3e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:49904/0 (socket says 172.21.15.26:49904) 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 -- 172.21.15.26:0/2940586553 learned_addr learned my addr 172.21.15.26:0/2940586553 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a280722f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2940586553 >> v2:172.21.15.190:3300/0 conn(0x7f1a280cdc40 0x7f1a28158a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1196412212 0 0) 0x7f1a2815baf0 con 0x7f1a280cd860 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1a10003530 con 0x7f1a280cd860 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4087341205 0 0) 0x7f1a10003530 con 0x7f1a280cd860 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 msgr2=0x7f1a280722f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a280722f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 >> v2:172.21.15.190:3300/0 conn(0x7f1a280cdc40 msgr2=0x7f1a28158a70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 --2- 172.21.15.26:0/2940586553 >> v2:172.21.15.190:3300/0 conn(0x7f1a280cdc40 0x7f1a28158a70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a2815bd90 con 0x7f1a280cd860 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f1a18001680 con 0x7f1a280cd860 2024-04-23T10:14:14.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 >> v1:172.21.15.26:6789/0 conn(0x7f1a280cd860 legacy=0x7f1a2815b3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a100039c0 0x7f1a10003e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a10004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a10004d50 0x7f1a100051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1a2815c350 con 0x7f1a100039c0 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281585e0 con 0x7f1a10004d50 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a1000ba00 con 0x7f1a280c9970 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a100039c0 0x7f1a10003e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a10004d50 0x7f1a100051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a10004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 -- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 msgr2=0x7f1a10004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c9970 0x7f1a10004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 -- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a10004d50 msgr2=0x7f1a100051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a10004d50 0x7f1a100051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.444+0000 7f1a2659c640 1 -- 172.21.15.26:0/2940586553 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a10003530 con 0x7f1a100039c0 2024-04-23T10:14:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a100039c0 0x7f1a10003e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c210 tx=0x7f1a1801f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee1842703d064abc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007d60 con 0x7f1a100039c0 2024-04-23T10:14:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a18005ae0 con 0x7f1a100039c0 2024-04-23T10:14:14.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2559a640 1 -- 172.21.15.26:0/2940586553 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007070 con 0x7f1a100039c0 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- 172.21.15.26:0/2940586553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a100039c0 msgr2=0x7f1a10003e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 --2- 172.21.15.26:0/2940586553 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a100039c0 0x7f1a10003e00 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c210 tx=0x7f1a1801f3f0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a26d9d640 1 -- 172.21.15.26:0/2940586553 reap_dead start 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- 172.21.15.26:0/2940586553 shutdown_connections 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- 172.21.15.26:0/2940586553 >> 172.21.15.26:0/2940586553 conn(0x7f1a28067d30 msgr2=0x7f1a2806fca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- 172.21.15.26:0/2940586553 shutdown_connections 2024-04-23T10:14:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- 172.21.15.26:0/2940586553 wait complete. 2024-04-23T10:14:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 Processor -- start 2024-04-23T10:14:14.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.448+0000 7f1a2c812640 1 -- start start 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 0x7f1a281ef970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c7da0 0x7f1a28143a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28158270 con 0x7f1a2815a980 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1a28157f90 con 0x7f1a2815a5a0 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a280c90c0 con 0x7f1a280c7da0 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41360/0 (socket says 172.21.15.26:41360) 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 -- 172.21.15.26:0/1901620300 learned_addr learned my addr 172.21.15.26:0/1901620300 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c7da0 0x7f1a28143a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2659c640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 0x7f1a281ef970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 -- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c7da0 msgr2=0x7f1a28143a60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c7da0 0x7f1a28143a60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 -- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 msgr2=0x7f1a281ef970 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 0x7f1a281ef970 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 -- 172.21.15.26:0/1901620300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1a28155a00 con 0x7f1a2815a980 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2659c640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 0x7f1a281ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c011600 tx=0x7f1a1c011ac0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a16ffd640 1 -- 172.21.15.26:0/1901620300 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c00f920 con 0x7f1a2815a980 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a16ffd640 1 -- 172.21.15.26:0/1901620300 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c00fac0 con 0x7f1a2815a980 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1a28155ca0 con 0x7f1a2815a980 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a16ffd640 1 -- 172.21.15.26:0/1901620300 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c015460 con 0x7f1a2815a980 2024-04-23T10:14:14.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.452+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1a280c5e70 con 0x7f1a2815a980 2024-04-23T10:14:14.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a16ffd640 1 -- 172.21.15.26:0/1901620300 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1a1c015600 con 0x7f1a2815a980 2024-04-23T10:14:14.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a16ffd640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 0x7f1a0806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a16ffd640 1 -- 172.21.15.26:0/1901620300 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1a1c0875a0 con 0x7f1a2815a980 2024-04-23T10:14:14.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2659c640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 0x7f1a0806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 Processor -- start 2024-04-23T10:14:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2659c640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 0x7f1a0806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c210 tx=0x7f1a18007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 -- start start 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e609e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e663c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564d37d0c2a0 con 0x564d37e656c0 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564d37c725f0 con 0x564d37e65fe0 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564d37c0d820 con 0x564d37e60600 2024-04-23T10:14:14.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41368/0 (socket says 172.21.15.26:41368) 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2333598888 learned_addr learned my addr 172.21.15.26:0/2333598888 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 msgr2=0x564d37e609e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e609e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 msgr2=0x564d37e663c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e663c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e663c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2333598888 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d37cb8c00 con 0x564d37e656c0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c05f780 tx=0x7f1a1c056b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=22d1051186041292 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a07fff640 1 -- 172.21.15.26:0/2333598888 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c06f070 con 0x564d37e656c0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a07fff640 1 -- 172.21.15.26:0/2333598888 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c05fcb0 con 0x564d37e656c0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.456+0000 7f1a07fff640 1 -- 172.21.15.26:0/2333598888 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c05b170 con 0x564d37e656c0 2024-04-23T10:14:14.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2333598888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 msgr2=0x564d37e65aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c05f780 tx=0x7f1a1c056b60 comp rx=0 tx=0).stop 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2333598888 shutdown_connections 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e663c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e65aa0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2333598888 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e609e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2333598888 >> 172.21.15.26:0/2333598888 conn(0x564d37e61470 msgr2=0x564d37e63890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2333598888 shutdown_connections 2024-04-23T10:14:14.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2333598888 wait complete. 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- start start 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 Processor -- start 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e5f9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e6b620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564d37c1dc60 con 0x564d37e656c0 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41374/0 (socket says 172.21.15.26:41374) 2024-04-23T10:14:14.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2330359151 learned_addr learned my addr 172.21.15.26:0/2330359151 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564d37cf4bf0 con 0x564d37e65fe0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564d37d2f560 con 0x564d37e60600 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 10 client.0 _ll_register_callbacks cb 0x564d37c49570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e5f9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e6b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 msgr2=0x564d37e5f9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e5f9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 msgr2=0x564d37e6b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e6b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d37cad630 con 0x564d37e656c0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f4e0 tx=0x7f1a1c014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5dac4ddbbfa77c47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a057fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:14.467 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a1c074060 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1a1c01cc10 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.460+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a1c05fcb0 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a1c06f040 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 10 client.5271 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564d37c12490 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a1c05fcb0 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1a1c025030 con 0x564d37e656c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 10 client.5271 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 10 client.5271 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 20 client.5271 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e6c3c0 0x564d37e6c7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 4 client.5271 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x564d37c0c7f0 con 0x564d37e6c3c0 2024-04-23T10:14:14.468 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e6c3c0 0x564d37e6c7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 10 client.5271 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:14.469 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2659c640 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e6c3c0 0x564d37e6c7d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e51da19f6448d21c server_cookie=98a0059901215153 in_seq=0 out_seq=0 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 1 -- 172.21.15.26:0/2330359151 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x564d37c0c7f0 con 0x564d37e6c3c0 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 10 client.5271 handle_command_reply: tid=0 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 client.5271 shutdown 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 msgr2=0x564d37e5ff20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c00f4e0 tx=0x7f1a1c014000 comp rx=0 tx=0).stop 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 shutdown_connections 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e6c3c0 0x564d37e6c7d0 crc :-1 s=READY pgs=35 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e6b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e656c0 0x564d37e5ff20 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 --2- 172.21.15.26:0/2330359151 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e60600 0x564d37e5f9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 >> 172.21.15.26:0/2330359151 conn(0x564d37e61470 msgr2=0x564d37e646b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a057fa640 0 client.5271 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 shutdown_connections 2024-04-23T10:14:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 1 -- 172.21.15.26:0/2330359151 wait complete. 2024-04-23T10:14:14.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.464+0000 7f1a2f994000 20 client.5271 trim_cache size 0 max 16384 2024-04-23T10:14:14.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 Processor -- start 2024-04-23T10:14:14.485 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- start start 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e656c0 0x564d37e6dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e80010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281fb010 con 0x564d37e60600 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1a281fb6e0 con 0x564d37e65fe0 2024-04-23T10:14:14.486 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1a281f97b0 con 0x564d37e656c0 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41380/0 (socket says 172.21.15.26:41380) 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 -- 172.21.15.26:0/3313620049 learned_addr learned my addr 172.21.15.26:0/3313620049 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 -- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e656c0 msgr2=0x564d37e6dcf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e656c0 0x564d37e6dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 -- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 msgr2=0x564d37e80010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e80010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 -- 172.21.15.26:0/3313620049 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d37c0da70 con 0x564d37e60600 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1a18001e30 tx=0x7f1a1801dc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4d21ddaca0678f9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a077fe640 1 -- 172.21.15.26:0/3313620049 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007500 con 0x564d37e60600 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a077fe640 1 -- 172.21.15.26:0/3313620049 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a180076a0 con 0x564d37e60600 2024-04-23T10:14:14.487 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a077fe640 1 -- 172.21.15.26:0/3313620049 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007850 con 0x564d37e60600 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- 172.21.15.26:0/3313620049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 msgr2=0x564d37e6d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7f1a18001e30 tx=0x7f1a1801dc30 comp rx=0 tx=0).stop 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- 172.21.15.26:0/3313620049 shutdown_connections 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e65fe0 0x564d37e80010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e656c0 0x564d37e6dcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3313620049 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37e6d7b0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.489 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- 172.21.15.26:0/3313620049 >> 172.21.15.26:0/3313620049 conn(0x564d37e61470 msgr2=0x564d37e76ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- 172.21.15.26:0/3313620049 shutdown_connections 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- 172.21.15.26:0/3313620049 wait complete. 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 -- start start 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.484+0000 7f1a2f994000 1 Processor -- start 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e656c0 0x564d37eda160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e65fe0 0x564d37e25e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x564d37c71900 con 0x564d37e60600 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x564d37c3ce60 con 0x564d37e656c0 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x564d37c76c20 con 0x564d37e65fe0 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:41394/0 (socket says 172.21.15.26:41394) 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 -- 172.21.15.26:0/3738779971 learned_addr learned my addr 172.21.15.26:0/3738779971 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:14.490 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 10 client.0 _ll_register_callbacks cb 0x7f1a1c056a30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e656c0 0x564d37eda160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.491 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a26d9d640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e65fe0 0x564d37e25e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.492 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 -- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e65fe0 msgr2=0x564d37e25e70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e65fe0 0x564d37e25e70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 -- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e656c0 msgr2=0x564d37eda160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e656c0 0x564d37eda160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 -- 172.21.15.26:0/3738779971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d37cf5080 con 0x564d37e60600 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2659c640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007010 tx=0x7f1a1c01f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b068e1a5a9cbac7b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1a18007500 con 0x564d37e60600 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1a180048b0 con 0x564d37e60600 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f1a180076a0 con 0x564d37e60600 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f1a18004ab0 con 0x564d37e60600 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 10 client.5277 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:14.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x564d37c183e0 con 0x564d37e60600 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1a180076a0 con 0x564d37e60600 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f1a18004c50 con 0x564d37e60600 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 10 client.5277 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 10 client.5277 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 20 client.5277 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e263b0 0x564d37e26790 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 4 client.5277 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.35, "await_for": 42.0}] 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 78.35, "await_for": 42.0}) -- 0x564d37c1b940 con 0x564d37e263b0 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e263b0 0x564d37e26790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a057fa640 10 client.5277 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:14.494 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.488+0000 7f1a25d9b640 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e263b0 0x564d37e26790 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=5a50fc380c7af36d server_cookie=985e2bddbbadb002 in_seq=0 out_seq=0 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.496+0000 7f1a057fa640 1 -- 172.21.15.26:0/3738779971 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x564d37c1b940 con 0x564d37e263b0 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.496+0000 7f1a057fa640 10 client.5277 handle_command_reply: tid=0 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.496+0000 7f1a2f994000 1 client.5277 shutdown 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.496+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 msgr2=0x564d37ed9c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.496+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 crypto rx=0x7f1a18007010 tx=0x7f1a1c01f000 comp rx=0 tx=0).stop 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 shutdown_connections 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x564d37e263b0 0x564d37e26790 crc :-1 s=READY pgs=36 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x564d37e65fe0 0x564d37e25e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x564d37e656c0 0x564d37eda160 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 --2- 172.21.15.26:0/3738779971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x564d37e60600 0x564d37ed9c20 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 >> 172.21.15.26:0/3738779971 conn(0x564d37e61470 msgr2=0x564d37e81230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a057fa640 0 client.5277 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 shutdown_connections 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 1 -- 172.21.15.26:0/3738779971 wait complete. 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2f994000 20 client.5277 trim_cache size 0 max 16384 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 6, 2024-04-23T10:14:14.502 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "e9cdfd92": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 6, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 78.3, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:14.503 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:14.504 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 msgr2=0x7f1a0806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 0x7f1a0806a870 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1a1800c210 tx=0x7f1a18007040 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 msgr2=0x7f1a281efeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7f1a1c011600 tx=0x7f1a1c011ac0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 shutdown_connections 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1a080683b0 0x7f1a0806a870 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1a280c7da0 0x7f1a28143a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1a2815a980 0x7f1a281efeb0 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 --2- 172.21.15.26:0/1901620300 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1a2815a5a0 0x7f1a281ef970 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 >> 172.21.15.26:0/1901620300 conn(0x7f1a28067d30 msgr2=0x7f1a2814fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 shutdown_connections 2024-04-23T10:14:14.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:14.500+0000 7f1a2c812640 1 -- 172.21.15.26:0/1901620300 wait complete. 2024-04-23T10:14:14.519 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'e9cdfd92', quiesce took 0.6 seconds. Will release after: 18.35 2024-04-23T10:14:19.178 INFO:tasks.workunit.client.0.smithi026.stderr:Note: switching to '0a6c3ed699031b80a2b419e7e795368719871394'. 2024-04-23T10:14:19.178 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.178 INFO:tasks.workunit.client.0.smithi026.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-23T10:14:19.178 INFO:tasks.workunit.client.0.smithi026.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-23T10:14:19.178 INFO:tasks.workunit.client.0.smithi026.stderr:state without impacting any branches by switching back to a branch. 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: git switch -c 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr:Or undo this operation with: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: git switch - 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-23T10:14:19.179 INFO:tasks.workunit.client.0.smithi026.stderr: 2024-04-23T10:14:19.180 INFO:tasks.workunit.client.0.smithi026.stderr:HEAD is now at 0a6c3ed6990 qa/suites/fs: add quiescer to the fs suite 2024-04-23T10:14:19.181 DEBUG:teuthology.orchestra.run.smithi026:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-23T10:14:19.187 INFO:tasks.workunit.client.0.smithi026.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-23T10:14:19.191 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:14:19.191 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-23T10:14:19.990 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-23T10:14:20.076 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-23T10:14:20.132 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-23T10:14:20.134 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:14:20.134 INFO:tasks.workunit.client.0.smithi026.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-23T10:14:20.185 INFO:tasks.workunit.client.0.smithi026.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-23T10:14:20.190 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:14:20.190 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-23T10:14:20.238 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-04-23T10:14:20.239 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-04-23T10:14:20.240 DEBUG:teuthology.orchestra.run.smithi026:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=0a6c3ed699031b80a2b419e7e795368719871394 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 6h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-04-23T10:14:32.870 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:14:33.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 Processor -- start 2024-04-23T10:14:33.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 -- start start 2024-04-23T10:14:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 0x7ff98406e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9840cd450 0x7ff9840cd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff984157fa0 con 0x7ff9840c79e0 2024-04-23T10:14:33.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ff9840c2230 con 0x7ff9840cd450 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98be6b640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ff984158520 con 0x7ff984151910 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff989406640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff9840c79e0 0x7ff98415b240 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41632/0 (socket says 172.21.15.26:41632) 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff989406640 1 -- 172.21.15.26:0/2898365 learned_addr learned my addr 172.21.15.26:0/2898365 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98a408640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ff9840cd450 0x7ff9840cd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff989c07640 1 --2- 172.21.15.26:0/2898365 >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 0x7ff98406e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98a408640 1 -- 172.21.15.26:0/2898365 >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 msgr2=0x7ff98406e7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98a408640 1 --2- 172.21.15.26:0/2898365 >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 0x7ff98406e7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98a408640 1 -- 172.21.15.26:0/2898365 >> v1:172.21.15.26:6789/0 conn(0x7ff9840c79e0 legacy=0x7ff98415b240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff98a408640 1 -- 172.21.15.26:0/2898365 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff984158240 con 0x7ff9840cd450 2024-04-23T10:14:33.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.004+0000 7ff989c07640 1 --2- 172.21.15.26:0/2898365 >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 0x7ff98406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98a408640 1 --2- 172.21.15.26:0/2898365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff9840cd850 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff98406deb0 tx=0x7ff97c01c730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d024736e519e4f6f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff988c05640 1 -- 172.21.15.26:0/2898365 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0ad070 con 0x7ff9840cd450 2024-04-23T10:14:33.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff988c05640 1 -- 172.21.15.26:0/2898365 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff97c0a9680 con 0x7ff9840cd450 2024-04-23T10:14:33.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff988c05640 1 -- 172.21.15.26:0/2898365 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff97c0a9a50 con 0x7ff9840cd450 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- 172.21.15.26:0/2898365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 msgr2=0x7ff9840cd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- 172.21.15.26:0/2898365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff9840cd850 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7ff98406deb0 tx=0x7ff97c01c730 comp rx=0 tx=0).stop 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- 172.21.15.26:0/2898365 shutdown_connections 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- 172.21.15.26:0/2898365 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff9840cd850 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- 172.21.15.26:0/2898365 >> v2:172.21.15.190:3300/0 conn(0x7ff984151910 0x7ff98406e7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- 172.21.15.26:0/2898365 >> 172.21.15.26:0/2898365 conn(0x7ff98406bdd0 msgr2=0x7ff98406c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- 172.21.15.26:0/2898365 shutdown_connections 2024-04-23T10:14:33.011 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- 172.21.15.26:0/2898365 wait complete. 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 Processor -- start 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- start start 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9840c79e0 0x7ff9841561d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff984151910 0x7ff98414d1d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840ca730 con 0x7ff9840cd450 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff9840c7e10 con 0x7ff984151910 2024-04-23T10:14:33.014 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98be6b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff98415b950 con 0x7ff9840c79e0 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37294/0 (socket says 172.21.15.26:37294) 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 -- 172.21.15.26:0/977793982 learned_addr learned my addr 172.21.15.26:0/977793982 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989c07640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9840c79e0 0x7ff9841561d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff98a408640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff984151910 0x7ff98414d1d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 -- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9840c79e0 msgr2=0x7ff9841561d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9840c79e0 0x7ff9841561d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 -- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff984151910 msgr2=0x7ff98414d1d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff984151910 0x7ff98414d1d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.008+0000 7ff989406640 1 -- 172.21.15.26:0/977793982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff984158ee0 con 0x7ff9840cd450 2024-04-23T10:14:33.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff989406640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c7b0 tx=0x7ff98000cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff980018070 con 0x7ff9840cd450 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9800072d0 con 0x7ff9840cd450 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff984159180 con 0x7ff9840cd450 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff9800047f0 con 0x7ff9840cd450 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9841556d0 con 0x7ff9840cd450 2024-04-23T10:14:33.016 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff984075df0 con 0x7ff9840cd450 2024-04-23T10:14:33.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff98001b070 con 0x7ff9840cd450 2024-04-23T10:14:33.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 0x7ff96806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff980086410 con 0x7ff9840cd450 2024-04-23T10:14:33.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff989c07640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 0x7ff96806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.012+0000 7ff989c07640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 0x7ff96806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff974006fd0 tx=0x7ff974008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.016+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ff980056750 con 0x7ff9840cd450 2024-04-23T10:14:33.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.216+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7ff9840c7fc0 con 0x7ff9840cd450 2024-04-23T10:14:33.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff97a7fc640 1 -- 172.21.15.26:0/977793982 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7ff980056050 con 0x7ff9840cd450 2024-04-23T10:14:33.222 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:14:33.222 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:14:33.222 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:14:33.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 msgr2=0x7ff96806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 0x7ff96806a870 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7ff974006fd0 tx=0x7ff974008040 comp rx=0 tx=0).stop 2024-04-23T10:14:33.224 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 msgr2=0x7ff98414cc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7ff98000c7b0 tx=0x7ff98000cc70 comp rx=0 tx=0).stop 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 shutdown_connections 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff9680683b0 0x7ff96806a870 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff984151910 0x7ff98414d1d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff9840cd450 0x7ff98414cc90 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 --2- 172.21.15.26:0/977793982 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff9840c79e0 0x7ff9841561d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 >> 172.21.15.26:0/977793982 conn(0x7ff98406bdd0 msgr2=0x7ff98415b240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 shutdown_connections 2024-04-23T10:14:33.225 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.220+0000 7ff98be6b640 1 -- 172.21.15.26:0/977793982 wait complete. 2024-04-23T10:14:33.242 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id e9cdfd92 --release --await' 2024-04-23T10:14:33.243 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id e9cdfd92 --release --await 2024-04-23T10:14:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.368+0000 7fe35446f640 1 Processor -- start 2024-04-23T10:14:33.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.368+0000 7fe35446f640 1 -- start start 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35446f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe34c0c8630 0x7fe34c151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35446f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34c15b740 con 0x7fe34c0c8250 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35446f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe34c0c40f0 con 0x7fe34c0c8a70 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35446f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe34c0c6490 con 0x7fe34c0c8630 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35220b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe34c0c8250 0x7fe34c0c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:41636/0 (socket says 172.21.15.26:41636) 2024-04-23T10:14:33.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35220b640 1 -- 172.21.15.26:0/540285917 learned_addr learned my addr 172.21.15.26:0/540285917 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 --2- 172.21.15.26:0/540285917 >> v2:172.21.15.190:3300/0 conn(0x7fe34c0c8630 0x7fe34c151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3632111493 0 0) 0x7fe34c15b740 con 0x7fe34c0c8250 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe338003530 con 0x7fe34c0c8250 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2511277762 0 0) 0x7fe338003530 con 0x7fe34c0c8250 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 >> v2:172.21.15.190:3300/0 conn(0x7fe34c0c8630 msgr2=0x7fe34c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 --2- 172.21.15.26:0/540285917 >> v2:172.21.15.190:3300/0 conn(0x7fe34c0c8630 0x7fe34c151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 >> v1:172.21.15.190:6789/0 conn(0x7fe34c0c8a70 legacy=0x7fe34c152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c0c58c0 con 0x7fe34c0c8250 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fe348001680 con 0x7fe34c0c8250 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 >> v1:172.21.15.26:6789/0 conn(0x7fe34c0c8250 legacy=0x7fe34c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3380039c0 0x7fe338003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0c6490 con 0x7fe338004810 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe33800c170 con 0x7fe3380039c0 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe33800c370 con 0x7fe3380051d0 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe35220b640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3380039c0 0x7fe338003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe352a0c640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 -- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3380051d0 msgr2=0x7fe33800b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 -- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3380039c0 msgr2=0x7fe338003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe3380039c0 0x7fe338003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 -- 172.21.15.26:0/540285917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe338003530 con 0x7fe338004810 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe352a0c640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe3380051d0 0x7fe33800b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:33.377 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe352a0c640 1 -- 172.21.15.26:0/540285917 reap_dead start 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351a0a640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 0x7fe338004c90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009ae0 tx=0x7fe33c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce1c450f0b86073e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0b2070 con 0x7fe338004810 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c0a5530 con 0x7fe338004810 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.372+0000 7fe351209640 1 -- 172.21.15.26:0/540285917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0096b0 con 0x7fe338004810 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 msgr2=0x7fe338004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 0x7fe338004c90 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7fe33c009ae0 tx=0x7fe33c01ca70 comp rx=0 tx=0).stop 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/540285917 shutdown_connections 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 --2- 172.21.15.26:0/540285917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe338004810 0x7fe338004c90 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/540285917 >> 172.21.15.26:0/540285917 conn(0x7fe34c06b9d0 msgr2=0x7fe34c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/540285917 shutdown_connections 2024-04-23T10:14:33.379 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/540285917 wait complete. 2024-04-23T10:14:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 Processor -- start 2024-04-23T10:14:33.380 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- start start 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe338004810 0x7fe34c073e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 0x7fe34c146300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c15b400 con 0x7fe34c14dc00 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c0721a0 con 0x7fe338004810 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c0c6900 con 0x7fe34c14c050 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37310/0 (socket says 172.21.15.26:37310) 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 -- 172.21.15.26:0/3894997337 learned_addr learned my addr 172.21.15.26:0/3894997337 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35220b640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe338004810 0x7fe34c073e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.382 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe352a0c640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 0x7fe34c146300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 -- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 msgr2=0x7fe34c146300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 0x7fe34c146300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 -- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe338004810 msgr2=0x7fe34c073e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe338004810 0x7fe34c073e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 -- 172.21.15.26:0/3894997337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe34c0cb5b0 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe352a0c640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 0x7fe34c146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe351a0a640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe33c01c8a0 tx=0x7fe338005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe342ffd640 1 -- 172.21.15.26:0/3894997337 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0b2040 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe342ffd640 1 -- 172.21.15.26:0/3894997337 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe33c0bb070 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe34c0cb890 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe342ffd640 1 -- 172.21.15.26:0/3894997337 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0ad440 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.376+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe34c0cbe50 con 0x7fe34c14dc00 2024-04-23T10:14:33.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe342ffd640 1 -- 172.21.15.26:0/3894997337 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe33c0ad5e0 con 0x7fe34c14dc00 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe342ffd640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 0x7fe33006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe342ffd640 1 -- 172.21.15.26:0/3894997337 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe33c120670 con 0x7fe34c14dc00 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 0x7fe33006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 Processor -- start 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 -- start start 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 0x7fe33006a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c10 tx=0x7fe348009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb84142e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb844f500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fcb825b660 con 0x55fcb844a8a0 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fcb82005d0 con 0x55fcb844f120 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55fcb8257620 con 0x55fcb8413f00 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37316/0 (socket says 172.21.15.26:37316) 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 -- 172.21.15.26:0/1060648800 learned_addr learned my addr 172.21.15.26:0/1060648800 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe351a0a640 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb84142e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe352a0c640 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb844f500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 -- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 msgr2=0x55fcb84142e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb84142e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 -- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 msgr2=0x55fcb844f500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb844f500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 -- 172.21.15.26:0/1060648800 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb8234bd0 con 0x55fcb844a8a0 2024-04-23T10:14:33.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe35220b640 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe348010b90 tx=0x7fe34800e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=acf096989a9e502a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe32ffff640 1 -- 172.21.15.26:0/1060648800 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348027070 con 0x55fcb844a8a0 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe32ffff640 1 -- 172.21.15.26:0/1060648800 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348005250 con 0x55fcb844a8a0 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.380+0000 7fe32ffff640 1 -- 172.21.15.26:0/1060648800 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348005600 con 0x55fcb844a8a0 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1060648800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 msgr2=0x55fcb84139c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 crypto rx=0x7fe348010b90 tx=0x7fe34800e000 comp rx=0 tx=0).stop 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1060648800 shutdown_connections 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb844f500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb84142e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1060648800 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb84139c0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1060648800 >> 172.21.15.26:0/1060648800 conn(0x55fcb82f5b00 msgr2=0x55fcb844cee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1060648800 shutdown_connections 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1060648800 wait complete. 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- start start 2024-04-23T10:14:33.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 Processor -- start 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb8413f00 0x55fcb8449650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844f120 0x55fcb840e900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fcb8318d40 con 0x55fcb844a8a0 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fcb8215eb0 con 0x55fcb8413f00 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55fcb82562a0 con 0x55fcb844f120 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 10 client.0 _ll_register_callbacks cb 0x55fcb83f9a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37324/0 (socket says 172.21.15.26:37324) 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 -- 172.21.15.26:0/1511231786 learned_addr learned my addr 172.21.15.26:0/1511231786 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe35220b640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb8413f00 0x55fcb8449650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe352a0c640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844f120 0x55fcb840e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 -- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844f120 msgr2=0x55fcb840e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844f120 0x55fcb840e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 -- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb8413f00 msgr2=0x55fcb8449650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb8413f00 0x55fcb8449650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 -- 172.21.15.26:0/1511231786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb82a1b30 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe351a0a640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0efea0 tx=0x7fe33c0f08a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7813546899c9a31e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe33c0f8d80 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe33c0f4160 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55fcb81f5060 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe33c0f88f0 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 10 client.5298 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55fcb81fab70 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55fcb81f5060 con 0x55fcb844a8a0 2024-04-23T10:14:33.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fe33c0b5070 con 0x55fcb844a8a0 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 10 client.5298 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 10 client.5298 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 20 client.5298 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb840f670 0x55fcb840fa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 4 client.5298 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55fcb8233e30 con 0x55fcb840f670 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.384+0000 7fe35220b640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb840f670 0x55fcb840fa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe35220b640 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb840f670 0x55fcb840fa50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=59aceb1be84cacad server_cookie=8ea2796e5f1d034b in_seq=0 out_seq=0 2024-04-23T10:14:33.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe32d7fa640 10 client.5298 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe32d7fa640 1 -- 172.21.15.26:0/1511231786 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55fcb8233e30 con 0x55fcb840f670 2024-04-23T10:14:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe32d7fa640 10 client.5298 handle_command_reply: tid=0 2024-04-23T10:14:33.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 client.5298 shutdown 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 msgr2=0x55fcb8449b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7fe33c0efea0 tx=0x7fe33c0f08a0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 shutdown_connections 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb840f670 0x55fcb840fa50 crc :-1 s=READY pgs=37 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844f120 0x55fcb840e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844a8a0 0x55fcb8449b90 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 --2- 172.21.15.26:0/1511231786 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb8413f00 0x55fcb8449650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe32d7fa640 0 client.5298 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 >> 172.21.15.26:0/1511231786 conn(0x55fcb82f5b00 msgr2=0x55fcb844e9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 shutdown_connections 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 1 -- 172.21.15.26:0/1511231786 wait complete. 2024-04-23T10:14:33.396 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.388+0000 7fe3575f1000 20 client.5298 trim_cache size 0 max 16384 2024-04-23T10:14:33.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 Processor -- start 2024-04-23T10:14:33.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 -- start start 2024-04-23T10:14:33.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844a8a0 0x55fcb84b9240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb84b9780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c202150 con 0x55fcb8413f00 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe34c202820 con 0x55fcb844f120 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.404+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe34c1f8180 con 0x55fcb844a8a0 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37338/0 (socket says 172.21.15.26:37338) 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 -- 172.21.15.26:0/82191882 learned_addr learned my addr 172.21.15.26:0/82191882 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 -- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844a8a0 msgr2=0x55fcb84b9240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844a8a0 0x55fcb84b9240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 -- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 msgr2=0x55fcb84b9780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb84b9780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 -- 172.21.15.26:0/82191882 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fcb82dd5e0 con 0x55fcb8413f00 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe348010b90 tx=0x7fe348015000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6da5dc3d11a69959 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32f7fe640 1 -- 172.21.15.26:0/82191882 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348032e60 con 0x55fcb8413f00 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32f7fe640 1 -- 172.21.15.26:0/82191882 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348005430 con 0x55fcb8413f00 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32f7fe640 1 -- 172.21.15.26:0/82191882 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe348027040 con 0x55fcb8413f00 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/82191882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 msgr2=0x55fcb84b8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7fe348010b90 tx=0x7fe348015000 comp rx=0 tx=0).stop 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/82191882 shutdown_connections 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844f120 0x55fcb84b9780 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb844a8a0 0x55fcb84b9240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- 172.21.15.26:0/82191882 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb8413f00 0x55fcb84b8d00 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/82191882 >> 172.21.15.26:0/82191882 conn(0x55fcb82f5b00 msgr2=0x55fcb8411a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/82191882 shutdown_connections 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/82191882 wait complete. 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- start start 2024-04-23T10:14:33.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 Processor -- start 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb8469130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844a8a0 0x55fcb8469670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55fcb825a970 con 0x55fcb844f120 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55fcb82108f0 con 0x55fcb844a8a0 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55fcb825fc90 con 0x55fcb8413f00 2024-04-23T10:14:33.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 10 client.0 _ll_register_callbacks cb 0x7fe33c0a5f20 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37354/0 (socket says 172.21.15.26:37354) 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 -- 172.21.15.26:0/4084410051 learned_addr learned my addr 172.21.15.26:0/4084410051 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe35220b640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb8469130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe351a0a640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844a8a0 0x55fcb8469670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 -- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 msgr2=0x55fcb8469130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb8469130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 -- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844a8a0 msgr2=0x55fcb8469670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844a8a0 0x55fcb8469670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 -- 172.21.15.26:0/4084410051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fcb81edae0 con 0x55fcb844f120 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe352a0c640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe344007fd0 tx=0x7fe344003f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e86158b2fc8afd3e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32d7fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe344015850 con 0x55fcb844f120 2024-04-23T10:14:33.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe3440159f0 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fe348005430 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fe344023050 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 10 client.5304 fetch_fsmap learned FSMap version 19 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55fcb81f0d80 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.408+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe348005430 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fe344026020 con 0x55fcb844f120 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 10 client.5304 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 10 client.5304 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 20 client.5304 populate_metadata read hostname 'smithi026' 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb84c95a0 0x55fcb84cb990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 4 client.5304 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "e9cdfd92", "release": true, "await": true}] 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "e9cdfd92", "release": true, "await": true}) -- 0x55fcb81f90d0 con 0x55fcb84c95a0 2024-04-23T10:14:33.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe35220b640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb84c95a0 0x55fcb84cb990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:14:33.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe32d7fa640 10 client.5304 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:33.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe35220b640 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb84c95a0 0x55fcb84cb990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f5d0982dcc2f5594 server_cookie=4d96119bb864ffa1 in_seq=0 out_seq=0 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe32d7fa640 1 -- 172.21.15.26:0/4084410051 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+587 (crc 0 0 0) 0x55fcb81f90d0 con 0x55fcb84c95a0 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe32d7fa640 10 client.5304 handle_command_reply: tid=0 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.412+0000 7fe3575f1000 1 client.5304 shutdown 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 msgr2=0x55fcb8469bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x7fe344007fd0 tx=0x7fe344003f90 comp rx=0 tx=0).stop 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 shutdown_connections 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55fcb84c95a0 0x55fcb84cb990 crc :-1 s=READY pgs=38 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55fcb844f120 0x55fcb8469bb0 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55fcb844a8a0 0x55fcb8469670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 --2- 172.21.15.26:0/4084410051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55fcb8413f00 0x55fcb8469130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe32d7fa640 0 client.5304 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 >> 172.21.15.26:0/4084410051 conn(0x55fcb82f5b00 msgr2=0x55fcb84122f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 shutdown_connections 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 1 -- 172.21.15.26:0/4084410051 wait complete. 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe3575f1000 20 client.5304 trim_cache size 0 max 16384 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 8, 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:14:33.420 INFO:teuthology.orchestra.run.smithi026.stdout: "e9cdfd92": { 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 8, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 78.3, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:14:33.421 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:14:33.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 msgr2=0x7fe33006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 0x7fe33006a840 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fe348000c10 tx=0x7fe348009040 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 msgr2=0x7fe34c145dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7fe33c01c8a0 tx=0x7fe338005840 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 shutdown_connections 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe330068380 0x7fe33006a840 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe34c14c050 0x7fe34c146300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe34c14dc00 0x7fe34c145dc0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 --2- 172.21.15.26:0/3894997337 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe338004810 0x7fe34c073e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 >> 172.21.15.26:0/3894997337 conn(0x7fe34c06b9d0 msgr2=0x7fe34c150bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 shutdown_connections 2024-04-23T10:14:33.423 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:14:33.416+0000 7fe35446f640 1 -- 172.21.15.26:0/3894997337 wait complete. 2024-04-23T10:14:33.430 INFO:tasks.workunit.client.0.smithi026.stderr:+ mkdir -p fsstress 2024-04-23T10:14:33.434 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd fsstress 2024-04-23T10:14:33.435 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:14:33.435 INFO:tasks.workunit.client.0.smithi026.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-04-23T10:14:33.435 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'e9cdfd92', seconds elapsed: 19.5 2024-04-23T10:14:34.851 INFO:tasks.workunit.client.0.smithi026.stderr:+ tar xzf ltp-full.tgz 2024-04-23T10:14:35.642 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:14:35.644 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:05.721 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:05.724 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:35.771 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:35.774 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:15:41.594 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 32.4 2024-04-23T10:15:41.594 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:15:41.743 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 Processor -- start 2024-04-23T10:15:41.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 -- start start 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a3815bf40 0x7f3a38163660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3806d550 con 0x7f3a38151f40 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3a3806d830 con 0x7f3a3806cff0 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3ec5e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3a3815bab0 con 0x7f3a3815bf40 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3d1fb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a3815bf40 0x7f3a38163660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3c9fa640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3a38151f40 0x7f3a38157cd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53822/0 (socket says 172.21.15.26:53822) 2024-04-23T10:15:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3d1fb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3a3815bf40 0x7f3a38163660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54314/0 (socket says 172.21.15.26:54314) 2024-04-23T10:15:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3d1fb640 1 -- 172.21.15.26:0/3456009405 learned_addr learned my addr 172.21.15.26:0/3456009405 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.739+0000 7f3a3d1fb640 1 -- 172.21.15.26:0/3456009405 >> v1:172.21.15.190:6789/0 conn(0x7f3a3806cff0 legacy=0x7f3a380c8870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3d1fb640 1 -- 172.21.15.26:0/3456009405 >> v1:172.21.15.26:6789/0 conn(0x7f3a38151f40 legacy=0x7f3a38157cd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.746 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3d1fb640 1 -- 172.21.15.26:0/3456009405 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a3815b460 con 0x7f3a3815bf40 2024-04-23T10:15:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3d1fb640 1 --2- 172.21.15.26:0/3456009405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3815bf40 0x7f3a38163660 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3a3815bc30 tx=0x7f3a3001c930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=875da33a0b9a3329 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.747 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a2f7fe640 1 -- 172.21.15.26:0/3456009405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a300a5790 con 0x7f3a3815bf40 2024-04-23T10:15:41.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a2f7fe640 1 -- 172.21.15.26:0/3456009405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a300a5930 con 0x7f3a3815bf40 2024-04-23T10:15:41.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a2f7fe640 1 -- 172.21.15.26:0/3456009405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a300a5d00 con 0x7f3a3815bf40 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3456009405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3815bf40 msgr2=0x7f3a38163660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3456009405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3815bf40 0x7f3a38163660 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f3a3815bc30 tx=0x7f3a3001c930 comp rx=0 tx=0).stop 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3456009405 shutdown_connections 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3456009405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3815bf40 0x7f3a38163660 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3456009405 >> 172.21.15.26:0/3456009405 conn(0x7f3a380ca540 msgr2=0x7f3a380ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3456009405 shutdown_connections 2024-04-23T10:15:41.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.743+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3456009405 wait complete. 2024-04-23T10:15:41.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 Processor -- start 2024-04-23T10:15:41.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- start start 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 0x7f3a380c6fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 0x7f3a3814ccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a3815bf40 0x7f3a3814d210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3a380c4670 con 0x7f3a3806cff0 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3a38152320 con 0x7f3a38151f40 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3a380c8f80 con 0x7f3a3815bf40 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 0x7f3a3814ccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2ffff640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 0x7f3a3814ccd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:46104/0 (socket says 172.21.15.26:46104) 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2ffff640 1 -- 172.21.15.26:0/3521895191 learned_addr learned my addr 172.21.15.26:0/3521895191 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:41.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3d1fb640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a3815bf40 0x7f3a3814d210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 0x7f3a380c6fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 -- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a3815bf40 msgr2=0x7f3a3814d210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a3815bf40 0x7f3a3814d210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 -- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 msgr2=0x7f3a3814ccd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 0x7f3a3814ccd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 -- 172.21.15.26:0/3521895191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3a381570e0 con 0x7f3a3806cff0 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3c9fa640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 0x7f3a380c6fc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009e20 tx=0x7f3a3400c430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34019070 con 0x7f3a3806cff0 2024-04-23T10:15:41.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a34007a30 con 0x7f3a3806cff0 2024-04-23T10:15:41.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3a38156800 con 0x7f3a3806cff0 2024-04-23T10:15:41.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a34007e00 con 0x7f3a3806cff0 2024-04-23T10:15:41.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.747+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3a3814c1f0 con 0x7f3a3806cff0 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3a3814c910 con 0x7f3a3806cff0 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a3401c070 con 0x7f3a3806cff0 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a2d7fa640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 0x7f3a2406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3a34088a90 con 0x7f3a3806cff0 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a2ffff640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 0x7f3a2406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:41.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.751+0000 7f3a2ffff640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 0x7f3a2406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a380c4170 tx=0x7f3a28009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:41.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:41.755+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a340585e0 con 0x7f3a3806cff0 2024-04-23T10:15:42.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.031+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3a38075df0 con 0x7f3a3806cff0 2024-04-23T10:15:42.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.031+0000 7f3a2d7fa640 1 -- 172.21.15.26:0/3521895191 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f3a3405c8e0 con 0x7f3a3806cff0 2024-04-23T10:15:42.034 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:15:42.034 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:15:42.034 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:15:42.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 msgr2=0x7f3a2406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 0x7f3a2406a840 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7f3a380c4170 tx=0x7f3a28009040 comp rx=0 tx=0).stop 2024-04-23T10:15:42.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 msgr2=0x7f3a380c6fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 0x7f3a380c6fc0 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f3a34009e20 tx=0x7f3a3400c430 comp rx=0 tx=0).stop 2024-04-23T10:15:42.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 shutdown_connections 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a24068380 0x7f3a2406a840 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3a3815bf40 0x7f3a3814d210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3a38151f40 0x7f3a3814ccd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 --2- 172.21.15.26:0/3521895191 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3a3806cff0 0x7f3a380c6fc0 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 >> 172.21.15.26:0/3521895191 conn(0x7f3a380ca540 msgr2=0x7f3a380ca920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 shutdown_connections 2024-04-23T10:15:42.038 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.035+0000 7f3a3ec5e640 1 -- 172.21.15.26:0/3521895191 wait complete. 2024-04-23T10:15:42.059 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 92.4 --await-for 42.0' 2024-04-23T10:15:42.060 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 92.4 --await-for 42.0 2024-04-23T10:15:42.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 Processor -- start 2024-04-23T10:15:42.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 -- start start 2024-04-23T10:15:42.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7970073360 0x7f79700c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f79700cc9d0 con 0x7f79700cd490 2024-04-23T10:15:42.206 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7970073e30 con 0x7f7970073740 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f7976439640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f797015ba20 con 0x7f7970073360 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f79749d6640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f79700cd490 0x7f7970154fd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53834/0 (socket says 172.21.15.26:53834) 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f796ffff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f7970073360 0x7f79700c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f79749d6640 1 -- 172.21.15.26:0/674211430 learned_addr learned my addr 172.21.15.26:0/674211430 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f796effd640 1 -- 172.21.15.26:0/674211430 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2774564050 0 0) 0x7f79700cc9d0 con 0x7f79700cd490 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f796ffff640 1 -- 172.21.15.26:0/674211430 >> v1:172.21.15.190:6789/0 conn(0x7f7970073740 legacy=0x7f797015b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f796ffff640 1 -- 172.21.15.26:0/674211430 >> v1:172.21.15.26:6789/0 conn(0x7f79700cd490 legacy=0x7f7970154fd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.207 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.203+0000 7f796ffff640 1 -- 172.21.15.26:0/674211430 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797015bd00 con 0x7f7970073360 2024-04-23T10:15:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f796ffff640 1 --2- 172.21.15.26:0/674211430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7970073360 0x7f79700c58a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79600097c0 tx=0x7f796001ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=ebf13ceda5ece94e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f796effd640 1 -- 172.21.15.26:0/674211430 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600b5070 con 0x7f7970073360 2024-04-23T10:15:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f796effd640 1 -- 172.21.15.26:0/674211430 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600a8990 con 0x7f7970073360 2024-04-23T10:15:42.210 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f796effd640 1 -- 172.21.15.26:0/674211430 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600a8d60 con 0x7f7970073360 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- 172.21.15.26:0/674211430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7970073360 msgr2=0x7f79700c58a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 --2- 172.21.15.26:0/674211430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7970073360 0x7f79700c58a0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x7f79600097c0 tx=0x7f796001ec90 comp rx=0 tx=0).stop 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- 172.21.15.26:0/674211430 shutdown_connections 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 --2- 172.21.15.26:0/674211430 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f7970073360 0x7f79700c58a0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- 172.21.15.26:0/674211430 >> 172.21.15.26:0/674211430 conn(0x7f797006cc30 msgr2=0x7f797006d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- 172.21.15.26:0/674211430 shutdown_connections 2024-04-23T10:15:42.211 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- 172.21.15.26:0/674211430 wait complete. 2024-04-23T10:15:42.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 Processor -- start 2024-04-23T10:15:42.213 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.207+0000 7f7976439640 1 -- start start 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7970073360 0x7f79700d0390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79700cd490 0x7f79701f11e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f79700ccf70 con 0x7f7970073740 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f79700ccc90 con 0x7f79700cd490 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f79701556e0 con 0x7f7970073360 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54334/0 (socket says 172.21.15.26:54334) 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 -- 172.21.15.26:0/2703879822 learned_addr learned my addr 172.21.15.26:0/2703879822 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f79749d6640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79700cd490 0x7f79701f11e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796ffff640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7970073360 0x7f79700d0390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 -- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7970073360 msgr2=0x7f79700d0390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7970073360 0x7f79700d0390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 -- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79700cd490 msgr2=0x7f79701f11e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79700cd490 0x7f79701f11e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 -- 172.21.15.26:0/2703879822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f797015b060 con 0x7f7970073740 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f796400c500 tx=0x7f796400c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796cff9640 1 -- 172.21.15.26:0/2703879822 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964016020 con 0x7f7970073740 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796cff9640 1 -- 172.21.15.26:0/2703879822 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7964005220 con 0x7f7970073740 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f79701f41b0 con 0x7f7970073740 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796cff9640 1 -- 172.21.15.26:0/2703879822 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7964007030 con 0x7f7970073740 2024-04-23T10:15:42.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f79701f4470 con 0x7f7970073740 2024-04-23T10:15:42.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.211+0000 7f796cff9640 1 -- 172.21.15.26:0/2703879822 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f79640071d0 con 0x7f7970073740 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796cff9640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 0x7f795c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796cff9640 1 -- 172.21.15.26:0/2703879822 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f79640866a0 con 0x7f7970073740 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 0x7f795c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 Processor -- start 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- start start 2024-04-23T10:15:42.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 0x7f795c06a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79600b2000 tx=0x7f79600aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f97633aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f97633fe0 0x557f976343c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557f974da2a0 con 0x557f9762e600 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557f974405f0 con 0x557f976336c0 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557f973db820 con 0x557f97633fe0 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54338/0 (socket says 172.21.15.26:54338) 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 -- 172.21.15.26:0/2777073522 learned_addr learned my addr 172.21.15.26:0/2777073522 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79749d6640 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f97633fe0 0x557f976343c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f97633aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 -- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f97633fe0 msgr2=0x557f976343c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f97633fe0 0x557f976343c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 -- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 msgr2=0x557f97633aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f97633aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 -- 172.21.15.26:0/2777073522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f97486c00 con 0x557f9762e600 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f796ffff640 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f796009b4b0 tx=0x7f7960004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=adca7855581d48ac server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f7955ffb640 1 -- 172.21.15.26:0/2777073522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600cb070 con 0x557f9762e600 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f7955ffb640 1 -- 172.21.15.26:0/2777073522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600a8ca0 con 0x557f9762e600 2024-04-23T10:15:42.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f7955ffb640 1 -- 172.21.15.26:0/2777073522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600b5040 con 0x557f9762e600 2024-04-23T10:15:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- 172.21.15.26:0/2777073522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 msgr2=0x557f9762e9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f796009b4b0 tx=0x7f7960004740 comp rx=0 tx=0).stop 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- 172.21.15.26:0/2777073522 shutdown_connections 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f97633fe0 0x557f976343c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f97633aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 --2- 172.21.15.26:0/2777073522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762e9e0 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- 172.21.15.26:0/2777073522 >> 172.21.15.26:0/2777073522 conn(0x557f9762f470 msgr2=0x557f97631890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- 172.21.15.26:0/2777073522 shutdown_connections 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.215+0000 7f79795bb000 1 -- 172.21.15.26:0/2777073522 wait complete. 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- start start 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 Processor -- start 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.227 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9762df20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97633fe0 0x557f97639620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557f973ebc60 con 0x557f9762e600 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557f974c2bf0 con 0x557f97633fe0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557f974fd560 con 0x557f976336c0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 10 client.0 _ll_register_callbacks cb 0x557f97417570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54346/0 (socket says 172.21.15.26:54346) 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 -- 172.21.15.26:0/2706732513 learned_addr learned my addr 172.21.15.26:0/2706732513 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796f7fe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9762df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79749d6640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97633fe0 0x557f97639620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 -- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 msgr2=0x557f9762df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9762df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 -- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97633fe0 msgr2=0x557f97639620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.228 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97633fe0 0x557f97639620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 -- 172.21.15.26:0/2706732513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f9747b630 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796ffff640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f79600098b0 tx=0x7f796001d4d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2d0d5c28dc41ced server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79600cb030 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f79600c3040 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f79600a8ca0 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7960003b70 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 10 client.5325 fetch_fsmap learned FSMap version 19 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x557f973e0490 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f79600a8ca0 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f7960003d10 con 0x557f9762e600 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 10 client.5325 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 10 client.5325 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 20 client.5325 populate_metadata read hostname 'smithi026' 2024-04-23T10:15:42.229 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f9763a3c0 0x557f9763a7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 4 client.5325 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x557f973da7f0 con 0x557f9763a3c0 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f9763a3c0 0x557f9763a7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f9763a3c0 0x557f9763a7d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=363898ba22840eae server_cookie=7c1eee83b50045b8 in_seq=0 out_seq=0 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.219+0000 7f794effd640 10 client.5325 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f794effd640 1 -- 172.21.15.26:0/2706732513 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x557f973da7f0 con 0x557f9763a3c0 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f794effd640 10 client.5325 handle_command_reply: tid=0 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 client.5325 shutdown 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 msgr2=0x557f9762d9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f79600098b0 tx=0x7f796001d4d0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 shutdown_connections 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f9763a3c0 0x557f9763a7d0 crc :-1 s=READY pgs=44 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f97633fe0 0x557f97639620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.230 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9762df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 --2- 172.21.15.26:0/2706732513 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f9762e600 0x557f9762d9e0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f794effd640 0 client.5325 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 >> 172.21.15.26:0/2706732513 conn(0x557f9762f470 msgr2=0x557f976326b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 shutdown_connections 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 1 -- 172.21.15.26:0/2706732513 wait complete. 2024-04-23T10:15:42.231 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.223+0000 7f79795bb000 20 client.5325 trim_cache size 0 max 16384 2024-04-23T10:15:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 Processor -- start 2024-04-23T10:15:42.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- start start 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f9762e600 0x557f976454f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f9763b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f79701fe670 con 0x557f97633fe0 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f79701fed40 con 0x557f976336c0 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f79701fcf60 con 0x557f9762e600 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54356/0 (socket says 172.21.15.26:54356) 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 -- 172.21.15.26:0/2678034806 learned_addr learned my addr 172.21.15.26:0/2678034806 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f9763b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f796ffff640 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f9762e600 0x557f976454f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 -- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f9762e600 msgr2=0x557f976454f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f9762e600 0x557f976454f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 -- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 msgr2=0x557f9763b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f9763b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 -- 172.21.15.26:0/2678034806 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557f973dba70 con 0x557f97633fe0 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79749d6640 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7968004c50 tx=0x7f7968004c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9a611de2525ff4df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79557fa640 1 -- 172.21.15.26:0/2678034806 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f79680078f0 con 0x557f97633fe0 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79557fa640 1 -- 172.21.15.26:0/2678034806 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968016420 con 0x557f97633fe0 2024-04-23T10:15:42.249 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79557fa640 1 -- 172.21.15.26:0/2678034806 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968016810 con 0x557f97633fe0 2024-04-23T10:15:42.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- 172.21.15.26:0/2678034806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 msgr2=0x557f9763bf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f7968004c50 tx=0x7f7968004c80 comp rx=0 tx=0).stop 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- 172.21.15.26:0/2678034806 shutdown_connections 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bf00 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f976336c0 0x557f9763b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 --2- 172.21.15.26:0/2678034806 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f9762e600 0x557f976454f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- 172.21.15.26:0/2678034806 >> 172.21.15.26:0/2678034806 conn(0x557f9762f470 msgr2=0x557f9764f230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- 172.21.15.26:0/2678034806 shutdown_connections 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.243+0000 7f79795bb000 1 -- 172.21.15.26:0/2678034806 wait complete. 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- start start 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 Processor -- start 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 0x557f975f78f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9763ba70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557f9743f900 con 0x557f97633fe0 2024-04-23T10:15:42.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x557f9740ae60 con 0x557f9762e600 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x557f97444c20 con 0x557f976336c0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 10 client.0 _ll_register_callbacks cb 0x7f79600c9070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54364/0 (socket says 172.21.15.26:54364) 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 -- 172.21.15.26:0/2941793704 learned_addr learned my addr 172.21.15.26:0/2941793704 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796ffff640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 0x557f975f78f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9763ba70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 -- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 msgr2=0x557f9763ba70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9763ba70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 -- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 msgr2=0x557f975f78f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 0x557f975f78f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 -- 172.21.15.26:0/2941793704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557f974c3080 con 0x557f97633fe0 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796f7fe640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9763ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:42.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796ffff640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 0x557f975f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79749d6640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79680012f0 tx=0x7f79680015d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=81f43e138c603cfb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f7968016a60 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f7968016c00 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f7968016420 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7968032050 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 10 client.5331 fetch_fsmap learned FSMap version 19 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x557f973e63e0 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7968016420 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f7968035020 con 0x557f97633fe0 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 10 client.5331 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 10 client.5331 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 20 client.5331 populate_metadata read hostname 'smithi026' 2024-04-23T10:15:42.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f975f5790 0x557f976b0a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:15:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 4 client.5331 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.4, "await_for": 42.0}] 2024-04-23T10:15:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 92.4, "await_for": 42.0}) -- 0x557f973e9940 con 0x557f975f5790 2024-04-23T10:15:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796ffff640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f975f5790 0x557f976b0a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:15:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f796ffff640 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f975f5790 0x557f976b0a90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=9376f0a1fd86d7a2 server_cookie=c8166a484ee0ee8a in_seq=0 out_seq=0 2024-04-23T10:15:42.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:42.247+0000 7f794effd640 10 client.5331 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:15:45.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f794effd640 1 -- 172.21.15.26:0/2941793704 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x557f973e9940 con 0x557f975f5790 2024-04-23T10:15:45.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f794effd640 10 client.5331 handle_command_reply: tid=0 2024-04-23T10:15:45.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 client.5331 shutdown 2024-04-23T10:15:45.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 msgr2=0x557f9763bfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f79680012f0 tx=0x7f79680015d0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 shutdown_connections 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557f975f5790 0x557f976b0a90 crc :-1 s=READY pgs=45 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557f97633fe0 0x557f9763bfb0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f794effd640 0 client.5331 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557f976336c0 0x557f9763ba70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 --2- 172.21.15.26:0/2941793704 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557f9762e600 0x557f975f78f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 >> 172.21.15.26:0/2941793704 conn(0x557f9762f470 msgr2=0x557f9764e010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 shutdown_connections 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 1 -- 172.21.15.26:0/2941793704 wait complete. 2024-04-23T10:15:45.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f79795bb000 20 client.5331 trim_cache size 0 max 16384 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 10, 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "fac62d7e": { 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 10, 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:15:45.779 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 92.4, 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:15:45.780 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 msgr2=0x7f795c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 0x7f795c06a870 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f79600b2000 tx=0x7f79600aa070 comp rx=0 tx=0).stop 2024-04-23T10:15:45.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 msgr2=0x7f79701f0ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f796400c500 tx=0x7f796400c9c0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 shutdown_connections 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f795c0683b0 0x7f795c06a870 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f79700cd490 0x7f79701f11e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f7970073740 0x7f79701f0ca0 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 --2- 172.21.15.26:0/2703879822 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f7970073360 0x7f79700d0390 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 >> 172.21.15.26:0/2703879822 conn(0x7f797006cc30 msgr2=0x7f7970150220 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 shutdown_connections 2024-04-23T10:15:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:15:45.775+0000 7f7976439640 1 -- 172.21.15.26:0/2703879822 wait complete. 2024-04-23T10:15:45.803 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'fac62d7e', quiesce took 4.2 seconds. Will release after: 32.4 2024-04-23T10:16:05.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:05.869 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:18.206 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:16:18.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.334+0000 7fa72f60c640 1 Processor -- start 2024-04-23T10:16:18.341 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 -- start start 2024-04-23T10:16:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fa72814fbc0 0x7fa72806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa72814ffa0 0x7fa7280c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa728074100 0x7fa7280c8760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa7280c5d70 con 0x7fa72814ffa0 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fa7280c6050 con 0x7fa72814fbc0 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72f60c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa7280c6330 con 0x7fa728074100 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa72814ffa0 0x7fa7280c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa72814ffa0 0x7fa7280c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54216/0 (socket says 172.21.15.26:54216) 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 -- 172.21.15.26:0/3554048469 learned_addr learned my addr 172.21.15.26:0/3554048469 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72d3a8640 1 --2- 172.21.15.26:0/3554048469 >> v2:172.21.15.190:3300/0 conn(0x7fa72814fbc0 0x7fa72806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72dba9640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa728074100 0x7fa7280c8760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 -- 172.21.15.26:0/3554048469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa728074100 msgr2=0x7fa7280c8760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa728074100 0x7fa7280c8760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 -- 172.21.15.26:0/3554048469 >> v2:172.21.15.190:3300/0 conn(0x7fa72814fbc0 msgr2=0x7fa72806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 --2- 172.21.15.26:0/3554048469 >> v2:172.21.15.190:3300/0 conn(0x7fa72814fbc0 0x7fa72806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 -- 172.21.15.26:0/3554048469 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280c6610 con 0x7fa72814ffa0 2024-04-23T10:16:18.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.338+0000 7fa72cba7640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa7280c8220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa728050430 tx=0x7fa71c01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa72b7171907516 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa71bfff640 1 -- 172.21.15.26:0/3554048469 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c0aa660 con 0x7fa72814ffa0 2024-04-23T10:16:18.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa71bfff640 1 -- 172.21.15.26:0/3554048469 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa71c0af070 con 0x7fa72814ffa0 2024-04-23T10:16:18.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa71bfff640 1 -- 172.21.15.26:0/3554048469 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa71c0aaa20 con 0x7fa72814ffa0 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/3554048469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 msgr2=0x7fa7280c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa7280c8220 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 crypto rx=0x7fa728050430 tx=0x7fa71c01c520 comp rx=0 tx=0).stop 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/3554048469 shutdown_connections 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa728074100 0x7fa7280c8760 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- 172.21.15.26:0/3554048469 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa7280c8220 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- 172.21.15.26:0/3554048469 >> v2:172.21.15.190:3300/0 conn(0x7fa72814fbc0 0x7fa72806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/3554048469 >> 172.21.15.26:0/3554048469 conn(0x7fa72806b9d0 msgr2=0x7fa72806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/3554048469 shutdown_connections 2024-04-23T10:16:18.346 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/3554048469 wait complete. 2024-04-23T10:16:18.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 Processor -- start 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- start start 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728074100 0x7fa72813d560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa72814fbc0 0x7fa72813bef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa728159320 con 0x7fa72814ffa0 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa7281591a0 con 0x7fa728074100 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa7281594a0 con 0x7fa72814fbc0 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54220/0 (socket says 172.21.15.26:54220) 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 -- 172.21.15.26:0/2681549085 learned_addr learned my addr 172.21.15.26:0/2681549085 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72cba7640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa72814fbc0 0x7fa72813bef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72d3a8640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728074100 0x7fa72813d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 -- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa72814fbc0 msgr2=0x7fa72813bef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa72814fbc0 0x7fa72813bef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 -- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728074100 msgr2=0x7fa72813d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728074100 0x7fa72813d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 -- 172.21.15.26:0/2681549085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa7280695d0 con 0x7fa72814ffa0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72dba9640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa720007d60 tx=0x7fa72000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720014420 con 0x7fa72814ffa0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa720019070 con 0x7fa72814ffa0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa720014820 con 0x7fa72814ffa0 2024-04-23T10:16:18.350 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa728071db0 con 0x7fa72814ffa0 2024-04-23T10:16:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.342+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa7281420b0 con 0x7fa72814ffa0 2024-04-23T10:16:18.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa728075df0 con 0x7fa72814ffa0 2024-04-23T10:16:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa7200149c0 con 0x7fa72814ffa0 2024-04-23T10:16:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa719ffb640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 0x7fa70c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa7200884a0 con 0x7fa72814ffa0 2024-04-23T10:16:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa72d3a8640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 0x7fa70c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.346+0000 7fa72d3a8640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 0x7fa70c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b9d0 tx=0x7fa724008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.350+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fa72001c360 con 0x7fa72814ffa0 2024-04-23T10:16:18.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.546+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fa7280730c0 con 0x7fa72814ffa0 2024-04-23T10:16:18.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa719ffb640 1 -- 172.21.15.26:0/2681549085 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7fa720058690 con 0x7fa72814ffa0 2024-04-23T10:16:18.553 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:16:18.554 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:16:18.554 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 msgr2=0x7fa70c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 0x7fa70c06a840 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fa72400b9d0 tx=0x7fa724008040 comp rx=0 tx=0).stop 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 msgr2=0x7fa72813fea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fa720007d60 tx=0x7fa72000e4b0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 shutdown_connections 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa70c068380 0x7fa70c06a840 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa72814ffa0 0x7fa72813fea0 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa72814fbc0 0x7fa72813bef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 --2- 172.21.15.26:0/2681549085 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa728074100 0x7fa72813d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 >> 172.21.15.26:0/2681549085 conn(0x7fa72806b9d0 msgr2=0x7fa728072650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 shutdown_connections 2024-04-23T10:16:18.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.550+0000 7fa72f60c640 1 -- 172.21.15.26:0/2681549085 wait complete. 2024-04-23T10:16:18.573 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id fac62d7e --release --await' 2024-04-23T10:16:18.573 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id fac62d7e --release --await 2024-04-23T10:16:18.709 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 Processor -- start 2024-04-23T10:16:18.710 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 -- start start 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee3414f810 0x7fee340c9930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fee340c78c0 0x7fee34159470 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fee340c4c50 con 0x7fee3414fbf0 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fee34158fe0 con 0x7fee3414f810 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee3ab3f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fee340c4f30 con 0x7fee340c78c0 2024-04-23T10:16:18.711 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee3414f810 0x7fee340c9930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee33fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fee3414fbf0 0x7fee340cd640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:39112/0 (socket says 172.21.15.26:39112) 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fee3414f810 0x7fee340c9930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54234/0 (socket says 172.21.15.26:54234) 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee33fff640 1 -- 172.21.15.26:0/4118070041 learned_addr learned my addr 172.21.15.26:0/4118070041 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee390dc640 1 --2- 172.21.15.26:0/4118070041 >> v2:172.21.15.190:3300/0 conn(0x7fee340c78c0 0x7fee34159470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 -- 172.21.15.26:0/4118070041 >> v2:172.21.15.190:3300/0 conn(0x7fee340c78c0 msgr2=0x7fee34159470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 --2- 172.21.15.26:0/4118070041 >> v2:172.21.15.190:3300/0 conn(0x7fee340c78c0 0x7fee34159470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 -- 172.21.15.26:0/4118070041 >> v1:172.21.15.26:6789/0 conn(0x7fee3414fbf0 legacy=0x7fee340cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.712 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.706+0000 7fee388db640 1 -- 172.21.15.26:0/4118070041 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee340c5210 con 0x7fee3414f810 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- 172.21.15.26:0/4118070041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3414f810 0x7fee340c9930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee340c4a60 tx=0x7fee2c01f110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eadae6d9e78d20c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee337fe640 1 -- 172.21.15.26:0/4118070041 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0b4070 con 0x7fee3414f810 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee337fe640 1 -- 172.21.15.26:0/4118070041 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0af600 con 0x7fee3414f810 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee337fe640 1 -- 172.21.15.26:0/4118070041 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0af9d0 con 0x7fee3414f810 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/4118070041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3414f810 msgr2=0x7fee340c9930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/4118070041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3414f810 0x7fee340c9930 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fee340c4a60 tx=0x7fee2c01f110 comp rx=0 tx=0).stop 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/4118070041 shutdown_connections 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/4118070041 >> v2:172.21.15.190:3300/0 conn(0x7fee340c78c0 0x7fee34159470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.714 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/4118070041 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee3414f810 0x7fee340c9930 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/4118070041 >> 172.21.15.26:0/4118070041 conn(0x7fee3406fca0 msgr2=0x7fee340700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/4118070041 shutdown_connections 2024-04-23T10:16:18.715 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/4118070041 wait complete. 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 Processor -- start 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- start start 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee3414f810 0x7fee34157510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee3414fbf0 0x7fee34144880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.717 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fee3406bb90 con 0x7fee340c78c0 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee340c57d0 con 0x7fee3414f810 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fee340c9e70 con 0x7fee3414fbf0 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54246/0 (socket says 172.21.15.26:54246) 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 -- 172.21.15.26:0/132786522 learned_addr learned my addr 172.21.15.26:0/132786522 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 -- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee3414fbf0 msgr2=0x7fee34144880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee3414fbf0 0x7fee34144880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 -- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee3414f810 msgr2=0x7fee34157510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee3414f810 0x7fee34157510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.718 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 -- 172.21.15.26:0/132786522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fee34157a50 con 0x7fee340c78c0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee388db640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fee2c01cd40 tx=0x7fee2c01beb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee317fa640 1 -- 172.21.15.26:0/132786522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0b4040 con 0x7fee340c78c0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee317fa640 1 -- 172.21.15.26:0/132786522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee2c0c1070 con 0x7fee340c78c0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fee3414eb60 con 0x7fee340c78c0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee317fa640 1 -- 172.21.15.26:0/132786522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0ba690 con 0x7fee340c78c0 2024-04-23T10:16:18.719 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.710+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fee340722e0 con 0x7fee340c78c0 2024-04-23T10:16:18.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee317fa640 1 -- 172.21.15.26:0/132786522 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fee2c0ba830 con 0x7fee340c78c0 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee317fa640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 0x7fee1406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee317fa640 1 -- 172.21.15.26:0/132786522 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fee2c125910 con 0x7fee340c78c0 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee33fff640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 0x7fee1406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 Processor -- start 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 -- start start 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee33fff640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 0x7fee1406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee1c000f70 tx=0x7fee1c007a90 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee4cd9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee509500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5569ee315660 con 0x5569ee4cdf00 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569ee2ba5d0 con 0x5569ee509120 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569ee311620 con 0x5569ee5048a0 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54250/0 (socket says 172.21.15.26:54250) 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.714+0000 7fee33fff640 1 -- 172.21.15.26:0/2724289504 learned_addr learned my addr 172.21.15.26:0/2724289504 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee4cd9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee390dc640 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee509500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 -- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 msgr2=0x5569ee4cd9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee4cd9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 -- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 msgr2=0x5569ee509500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee509500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 -- 172.21.15.26:0/2724289504 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ee2eebd0 con 0x5569ee4cdf00 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee33fff640 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee1c005cf0 tx=0x7fee1c00f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58f93bf541bb5754 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee2a7fc640 1 -- 172.21.15.26:0/2724289504 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c016110 con 0x5569ee4cdf00 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee2a7fc640 1 -- 172.21.15.26:0/2724289504 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee1c007560 con 0x5569ee4cdf00 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee2a7fc640 1 -- 172.21.15.26:0/2724289504 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c016b90 con 0x5569ee4cdf00 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2724289504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 msgr2=0x5569ee4ce2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fee1c005cf0 tx=0x7fee1c00f000 comp rx=0 tx=0).stop 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2724289504 shutdown_connections 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee509500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee4ce2e0 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2724289504 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee4cd9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2724289504 >> 172.21.15.26:0/2724289504 conn(0x5569ee3afb00 msgr2=0x5569ee506ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.728 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2724289504 shutdown_connections 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2724289504 wait complete. 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- start start 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 Processor -- start 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee503b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee4c8900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5569ee3d2d40 con 0x5569ee4cdf00 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569ee2cfeb0 con 0x5569ee509120 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569ee3102a0 con 0x5569ee5048a0 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 10 client.0 _ll_register_callbacks cb 0x5569ee4b3a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:18.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54264/0 (socket says 172.21.15.26:54264) 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 -- 172.21.15.26:0/2337294216 learned_addr learned my addr 172.21.15.26:0/2337294216 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee390dc640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee4c8900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 -- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 msgr2=0x5569ee503b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee503b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 -- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 msgr2=0x5569ee4c8900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee4c8900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 -- 172.21.15.26:0/2337294216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ee35bb30 con 0x5569ee4cdf00 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee388db640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0f5160 tx=0x7fee2c0f5be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66aa2a2c40c66645 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee137fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:16:18.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2c0fe040 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fee2c0fdbb0 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5569ee2af060 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee2c0fddb0 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 10 client.5352 fetch_fsmap learned FSMap version 19 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5569ee2b4b70 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.718+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5569ee2af060 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fee2c10db80 con 0x5569ee4cdf00 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 10 client.5352 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 10 client.5352 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 20 client.5352 populate_metadata read hostname 'smithi026' 2024-04-23T10:16:18.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee4c9670 0x5569ee4c9a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 4 client.5352 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:16:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5569ee2ede30 con 0x5569ee4c9670 2024-04-23T10:16:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee33fff640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee4c9670 0x5569ee4c9a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee137fe640 10 client.5352 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:16:18.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee33fff640 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee4c9670 0x5569ee4c9a50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=90b5383a902a9063 server_cookie=4f9c78f495216c6f in_seq=0 out_seq=0 2024-04-23T10:16:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee137fe640 1 -- 172.21.15.26:0/2337294216 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5569ee2ede30 con 0x5569ee4c9670 2024-04-23T10:16:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee137fe640 10 client.5352 handle_command_reply: tid=0 2024-04-23T10:16:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 client.5352 shutdown 2024-04-23T10:16:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 msgr2=0x5569ee503650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fee2c0f5160 tx=0x7fee2c0f5be0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 shutdown_connections 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee4c9670 0x5569ee4c9a50 crc :-1 s=READY pgs=50 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee509120 0x5569ee4c8900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee503b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee137fe640 0 client.5352 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/2337294216 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee4cdf00 0x5569ee503650 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 >> 172.21.15.26:0/2337294216 conn(0x5569ee3afb00 msgr2=0x5569ee5089a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 shutdown_connections 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 1 -- 172.21.15.26:0/2337294216 wait complete. 2024-04-23T10:16:18.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.722+0000 7fee3dcc1000 20 client.5352 trim_cache size 0 max 16384 2024-04-23T10:16:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 Processor -- start 2024-04-23T10:16:18.745 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- start start 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee572d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee573240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fee341fe640 con 0x5569ee509120 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fee341fed10 con 0x5569ee4cdf00 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fee3413f370 con 0x5569ee5048a0 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54280/0 (socket says 172.21.15.26:54280) 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 -- 172.21.15.26:0/3937645439 learned_addr learned my addr 172.21.15.26:0/3937645439 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.748 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee33fff640 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee573240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 -- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 msgr2=0x5569ee573240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee573240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 -- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 msgr2=0x5569ee572d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee388db640 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee572d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee572d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 -- 172.21.15.26:0/3937645439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5569ee3975e0 con 0x5569ee509120 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee390dc640 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b750 tx=0x7fee2400bc10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=54850753813535ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee29ffb640 1 -- 172.21.15.26:0/3937645439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee24019070 con 0x5569ee509120 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee29ffb640 1 -- 172.21.15.26:0/3937645439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee24011840 con 0x5569ee509120 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee29ffb640 1 -- 172.21.15.26:0/3937645439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee2400be60 con 0x5569ee509120 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- 172.21.15.26:0/3937645439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 msgr2=0x5569ee573780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:18.749 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 crypto rx=0x7fee2400b750 tx=0x7fee2400bc10 comp rx=0 tx=0).stop 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- 172.21.15.26:0/3937645439 shutdown_connections 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee509120 0x5569ee573780 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee5048a0 0x5569ee573240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/3937645439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee572d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- 172.21.15.26:0/3937645439 >> 172.21.15.26:0/3937645439 conn(0x5569ee3afb00 msgr2=0x5569ee4cba60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- 172.21.15.26:0/3937645439 shutdown_connections 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- 172.21.15.26:0/3937645439 wait complete. 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 -- start start 2024-04-23T10:16:18.750 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.742+0000 7fee3dcc1000 1 Processor -- start 2024-04-23T10:16:18.753 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee523130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee509120 0x5569ee523bb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5569ee314970 con 0x5569ee5048a0 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5569ee2ca8f0 con 0x5569ee4cdf00 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5569ee319c90 con 0x5569ee509120 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 10 client.0 _ll_register_callbacks cb 0x7fee2c0f5230 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:54290/0 (socket says 172.21.15.26:54290) 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 -- 172.21.15.26:0/294558368 learned_addr learned my addr 172.21.15.26:0/294558368 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee390dc640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee509120 0x5569ee523bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.754 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee388db640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee523130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 -- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee509120 msgr2=0x5569ee523bb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee509120 0x5569ee523bb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 -- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 msgr2=0x5569ee523130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee523130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 -- 172.21.15.26:0/294558368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5569ee2a7ae0 con 0x5569ee5048a0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee388db640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee523130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee33fff640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c015000 tx=0x7fee1c011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=589c209081ccbcc2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fee1c029bc0 con 0x5569ee5048a0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fee1c029d60 con 0x5569ee5048a0 2024-04-23T10:16:18.755 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fee24011840 con 0x5569ee5048a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fee1c036050 con 0x5569ee5048a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 10 client.5358 fetch_fsmap learned FSMap version 19 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5569ee2aad80 con 0x5569ee5048a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fee24011840 con 0x5569ee5048a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fee1c039020 con 0x5569ee5048a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 10 client.5358 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 10 client.5358 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 20 client.5358 populate_metadata read hostname 'smithi026' 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee5835a0 0x5569ee585990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 4 client.5358 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "fac62d7e", "release": true, "await": true}] 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "fac62d7e", "release": true, "await": true}) -- 0x5569ee2b30d0 con 0x5569ee5835a0 2024-04-23T10:16:18.756 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee388db640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee5835a0 0x5569ee585990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:16:18.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee388db640 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee5835a0 0x5569ee585990 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ff6570f13c22126b server_cookie=d3862ef24ed3130f in_seq=0 out_seq=0 2024-04-23T10:16:18.757 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:18.746+0000 7fee137fe640 10 client.5358 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:16:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee137fe640 1 -- 172.21.15.26:0/294558368 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5569ee2b30d0 con 0x5569ee5835a0 2024-04-23T10:16:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee137fe640 10 client.5358 handle_command_reply: tid=0 2024-04-23T10:16:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 client.5358 shutdown 2024-04-23T10:16:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 msgr2=0x5569ee523670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.057 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7fee1c015000 tx=0x7fee1c011000 comp rx=0 tx=0).stop 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 shutdown_connections 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5569ee5835a0 0x5569ee585990 crc :-1 s=READY pgs=51 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5569ee509120 0x5569ee523bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5569ee5048a0 0x5569ee523670 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 --2- 172.21.15.26:0/294558368 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5569ee4cdf00 0x5569ee523130 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee137fe640 0 client.5358 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:16:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 >> 172.21.15.26:0/294558368 conn(0x5569ee3afb00 msgr2=0x5569ee4cc2f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 shutdown_connections 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 1 -- 172.21.15.26:0/294558368 wait complete. 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3dcc1000 20 client.5358 trim_cache size 0 max 16384 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 12, 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:16:19.059 INFO:teuthology.orchestra.run.smithi026.stdout: "fac62d7e": { 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 12, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 92.4, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:16:19.060 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:16:19.061 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 msgr2=0x7fee1406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 0x7fee1406a840 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7fee1c000f70 tx=0x7fee1c007a90 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 msgr2=0x7fee341587d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fee2c01cd40 tx=0x7fee2c01beb0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 shutdown_connections 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fee14068380 0x7fee1406a840 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fee3414fbf0 0x7fee34144880 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fee3414f810 0x7fee34157510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 --2- 172.21.15.26:0/132786522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fee340c78c0 0x7fee341587d0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 >> 172.21.15.26:0/132786522 conn(0x7fee3406fca0 msgr2=0x7fee341480b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 shutdown_connections 2024-04-23T10:16:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:16:19.054+0000 7fee3ab3f640 1 -- 172.21.15.26:0/132786522 wait complete. 2024-04-23T10:16:19.088 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'fac62d7e', seconds elapsed: 37.5 2024-04-23T10:16:35.937 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:16:35.940 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:06.177 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:06.180 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:19.260 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 12.7 2024-04-23T10:17:19.260 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:17:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 Processor -- start 2024-04-23T10:17:19.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 -- start start 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c15ce10 0x7f5c1c06cec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5c1c15f450 con 0x7f5c1c071970 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5c1c070ce0 con 0x7f5c1c06cae0 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c22fa0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c15e840 con 0x7f5c1c15ce10 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38746/0 (socket says 172.21.15.26:38746) 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 -- 172.21.15.26:0/3865121887 learned_addr learned my addr 172.21.15.26:0/3865121887 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c2153d640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c15ce10 0x7f5c1c06cec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 -- 172.21.15.26:0/3865121887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c15ce10 msgr2=0x7f5c1c06cec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c15ce10 0x7f5c1c06cec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 -- 172.21.15.26:0/3865121887 >> v1:172.21.15.190:6789/0 conn(0x7f5c1c071970 legacy=0x7f5c1c15c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.410+0000 7f5c20d3c640 1 -- 172.21.15.26:0/3865121887 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c15eb20 con 0x7f5c1c06cae0 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c20d3c640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1001ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29d783d160c0fd47 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c1b7fe640 1 -- 172.21.15.26:0/3865121887 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100b5070 con 0x7f5c1c06cae0 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c1b7fe640 1 -- 172.21.15.26:0/3865121887 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c100a89d0 con 0x7f5c1c06cae0 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c1b7fe640 1 -- 172.21.15.26:0/3865121887 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c100a8da0 con 0x7f5c1c06cae0 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3865121887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c06cae0 msgr2=0x7f5c1c15b9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f5c10009870 tx=0x7f5c1001ed10 comp rx=0 tx=0).stop 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3865121887 shutdown_connections 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c15ce10 0x7f5c1c06cec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3865121887 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c06cae0 0x7f5c1c15b9f0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.414 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3865121887 >> 172.21.15.26:0/3865121887 conn(0x7f5c1c0676a0 msgr2=0x7f5c1c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3865121887 shutdown_connections 2024-04-23T10:17:19.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3865121887 wait complete. 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 Processor -- start 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- start start 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c06cae0 0x7f5c1c0c9e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c1c071970 0x7f5c1c0c6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c15e520 con 0x7f5c1c15ce10 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5c1c15f0e0 con 0x7f5c1c071970 2024-04-23T10:17:19.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c22fa0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5c1c1555d0 con 0x7f5c1c06cae0 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.414+0000 7f5c2153d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38748/0 (socket says 172.21.15.26:38748) 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 -- 172.21.15.26:0/3613025152 learned_addr learned my addr 172.21.15.26:0/3613025152 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c20d3c640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c06cae0 0x7f5c1c0c9e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c1bfff640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c1c071970 0x7f5c1c0c6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 -- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c06cae0 msgr2=0x7f5c1c0c9e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c06cae0 0x7f5c1c0c9e30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 -- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c1c071970 msgr2=0x7f5c1c0c6640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c1c071970 0x7f5c1c0c6640 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 -- 172.21.15.26:0/3613025152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5c1c0cf690 con 0x7f5c1c15ce10 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c2153d640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007d80 tx=0x7f5c1400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14014420 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c14019070 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5c1c0ca6e0 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5c14014800 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5c1c0ca980 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5c1c075df0 con 0x7f5c1c15ce10 2024-04-23T10:17:19.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.418+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5c140149a0 con 0x7f5c1c15ce10 2024-04-23T10:17:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.422+0000 7f5c197fa640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 0x7f5c0006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.422+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5c14087ed0 con 0x7f5c1c15ce10 2024-04-23T10:17:19.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.422+0000 7f5c20d3c640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 0x7f5c0006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.422+0000 7f5c20d3c640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 0x7f5c0006a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b2000 tx=0x7f5c10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.426 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.426+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5c14057b00 con 0x7f5c1c15ce10 2024-04-23T10:17:19.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.634+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f5c1c0cb980 con 0x7f5c1c15ce10 2024-04-23T10:17:19.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c197fa640 1 -- 172.21.15.26:0/3613025152 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f5c1405be00 con 0x7f5c1c15ce10 2024-04-23T10:17:19.637 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:17:19.637 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:17:19.637 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 msgr2=0x7f5c0006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 0x7f5c0006a870 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f5c100b2000 tx=0x7f5c10009040 comp rx=0 tx=0).stop 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 msgr2=0x7f5c1c0c6b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x7f5c14007d80 tx=0x7f5c1400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 shutdown_connections 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5c000683b0 0x7f5c0006a870 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5c1c15ce10 0x7f5c1c0c6b80 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5c1c071970 0x7f5c1c0c6640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 --2- 172.21.15.26:0/3613025152 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5c1c06cae0 0x7f5c1c0c9e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 >> 172.21.15.26:0/3613025152 conn(0x7f5c1c0676a0 msgr2=0x7f5c1c0cef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 shutdown_connections 2024-04-23T10:17:19.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.638+0000 7f5c22fa0640 1 -- 172.21.15.26:0/3613025152 wait complete. 2024-04-23T10:17:19.658 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 72.7 --await-for 42.0' 2024-04-23T10:17:19.659 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 72.7 --await-for 42.0 2024-04-23T10:17:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 Processor -- start 2024-04-23T10:17:19.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 -- start start 2024-04-23T10:17:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c0c8f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f387c0c9490 0x7f387c0c7ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f387c15a1e0 con 0x7f387c0c6d40 2024-04-23T10:17:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f387c067d40 con 0x7f387c0c9490 2024-04-23T10:17:19.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.810+0000 7f3883d0d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f387c073b20 con 0x7f387c0c8a00 2024-04-23T10:17:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c0c8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f3881aa9640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f387c0c6d40 0x7f387c159ad0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:55006/0 (socket says 172.21.15.26:55006) 2024-04-23T10:17:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f3881aa9640 1 -- 172.21.15.26:0/2213849103 learned_addr learned my addr 172.21.15.26:0/2213849103 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:17:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38822aa640 1 --2- 172.21.15.26:0/2213849103 >> v2:172.21.15.190:3300/0 conn(0x7f387c0c9490 0x7f387c0c7ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f3880aa7640 1 -- 172.21.15.26:0/2213849103 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2737806243 0 0) 0x7f3878001120 con 0x7f387c0c6d40 2024-04-23T10:17:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f3880aa7640 1 -- 172.21.15.26:0/2213849103 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3868003530 con 0x7f387c0c6d40 2024-04-23T10:17:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 -- 172.21.15.26:0/2213849103 >> v2:172.21.15.190:3300/0 conn(0x7f387c0c9490 msgr2=0x7f387c0c7ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 --2- 172.21.15.26:0/2213849103 >> v2:172.21.15.190:3300/0 conn(0x7f387c0c9490 0x7f387c0c7ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 -- 172.21.15.26:0/2213849103 >> v1:172.21.15.190:6789/0 conn(0x7f387c0c6d40 legacy=0x7f387c159ad0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 -- 172.21.15.26:0/2213849103 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c073e00 con 0x7f387c0c8a00 2024-04-23T10:17:19.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.814+0000 7f38812a8640 1 --2- 172.21.15.26:0/2213849103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c0c8f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f386c0097c0 tx=0x7f386c01ec90 comp rx=0 tx=0).ready entity=mon.2 client_cookie=b321e35c9f26d32c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3880aa7640 1 -- 172.21.15.26:0/2213849103 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0b5070 con 0x7f387c0c8a00 2024-04-23T10:17:19.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3880aa7640 1 -- 172.21.15.26:0/2213849103 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f386c0a8990 con 0x7f387c0c8a00 2024-04-23T10:17:19.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3880aa7640 1 -- 172.21.15.26:0/2213849103 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0a8d40 con 0x7f387c0c8a00 2024-04-23T10:17:19.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- 172.21.15.26:0/2213849103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 msgr2=0x7f387c0c8f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- 172.21.15.26:0/2213849103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c0c8f50 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f386c0097c0 tx=0x7f386c01ec90 comp rx=0 tx=0).stop 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- 172.21.15.26:0/2213849103 shutdown_connections 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- 172.21.15.26:0/2213849103 >> v2:172.21.15.190:3300/0 conn(0x7f387c0c9490 0x7f387c0c7ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- 172.21.15.26:0/2213849103 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c0c8f50 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- 172.21.15.26:0/2213849103 >> 172.21.15.26:0/2213849103 conn(0x7f387c0cce00 msgr2=0x7f387c0cd210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- 172.21.15.26:0/2213849103 shutdown_connections 2024-04-23T10:17:19.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- 172.21.15.26:0/2213849103 wait complete. 2024-04-23T10:17:19.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 Processor -- start 2024-04-23T10:17:19.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- start start 2024-04-23T10:17:19.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.821 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c1f20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0c9490 0x7f387c1f25e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1595b0 con 0x7f387c0c6d40 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f387c0743c0 con 0x7f387c0c9490 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.818+0000 7f3883d0d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f387c159260 con 0x7f387c0c8a00 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38754/0 (socket says 172.21.15.26:38754) 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 -- 172.21.15.26:0/3214105135 learned_addr learned my addr 172.21.15.26:0/3214105135 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38822aa640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0c9490 0x7f387c1f25e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38812a8640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c1f20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 -- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 msgr2=0x7f387c1f20a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c1f20a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 -- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0c9490 msgr2=0x7f387c1f25e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0c9490 0x7f387c1f25e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 -- 172.21.15.26:0/3214105135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f387c0b24e0 con 0x7f387c0c6d40 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38812a8640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c1f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f387800c760 tx=0x7f387800cc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 -- 172.21.15.26:0/3214105135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878017070 con 0x7f387c0c6d40 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 -- 172.21.15.26:0/3214105135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878005ac0 con 0x7f387c0c6d40 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f387c0b2780 con 0x7f387c0c6d40 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 -- 172.21.15.26:0/3214105135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878007070 con 0x7f387c0c6d40 2024-04-23T10:17:19.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f387c1548b0 con 0x7f387c0c6d40 2024-04-23T10:17:19.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 -- 172.21.15.26:0/3214105135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f387801a070 con 0x7f387c0c6d40 2024-04-23T10:17:19.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 0x7f386006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38727fc640 1 -- 172.21.15.26:0/3214105135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3878086240 con 0x7f387c0c6d40 2024-04-23T10:17:19.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.822+0000 7f38812a8640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 0x7f386006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 Processor -- start 2024-04-23T10:17:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- start start 2024-04-23T10:17:19.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f38812a8640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 0x7f386006a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b2000 tx=0x7f386c0aa070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fd6c0 0x55b6995fdaa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b6995fe3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b6994a42a0 con 0x55b6995f8600 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b69940a5f0 con 0x55b6995fd6c0 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b6993a5820 con 0x55b6995fdfe0 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38770/0 (socket says 172.21.15.26:38770) 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 -- 172.21.15.26:0/2494152136 learned_addr learned my addr 172.21.15.26:0/2494152136 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f38822aa640 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b6995fe3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 -- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 msgr2=0x55b6995fe3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b6995fe3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 -- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fd6c0 msgr2=0x55b6995fdaa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fd6c0 0x55b6995fdaa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 -- 172.21.15.26:0/2494152136 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b699450c00 con 0x55b6995f8600 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f38822aa640 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b6995fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3878001ec0 tx=0x7f3878055d90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddc0913823fd57c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f385f7fe640 1 -- 172.21.15.26:0/2494152136 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878086070 con 0x55b6995f8600 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f385f7fe640 1 -- 172.21.15.26:0/2494152136 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878007d90 con 0x55b6995f8600 2024-04-23T10:17:19.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f385f7fe640 1 -- 172.21.15.26:0/2494152136 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f387806e1d0 con 0x55b6995f8600 2024-04-23T10:17:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- 172.21.15.26:0/2494152136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 msgr2=0x55b6995f89e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f3878001ec0 tx=0x7f3878055d90 comp rx=0 tx=0).stop 2024-04-23T10:17:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- 172.21.15.26:0/2494152136 shutdown_connections 2024-04-23T10:17:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b6995fe3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fd6c0 0x55b6995fdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2494152136 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b6995f89e0 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- 172.21.15.26:0/2494152136 >> 172.21.15.26:0/2494152136 conn(0x55b6995f9470 msgr2=0x55b6995fb890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- 172.21.15.26:0/2494152136 shutdown_connections 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.826+0000 7f3886e8f000 1 -- 172.21.15.26:0/2494152136 wait complete. 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- start start 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 Processor -- start 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 0x55b6995f79e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b699603620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b6993b5c60 con 0x55b6995fd6c0 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b69948cbf0 con 0x55b6995f8600 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b6994c7560 con 0x55b6995fdfe0 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 10 client.0 _ll_register_callbacks cb 0x55b6993e1570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:19.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38778/0 (socket says 172.21.15.26:38778) 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 -- 172.21.15.26:0/4276993936 learned_addr learned my addr 172.21.15.26:0/4276993936 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38822aa640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b699603620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3881aa9640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 0x55b6995f79e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 -- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 msgr2=0x55b699603620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b699603620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 -- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 msgr2=0x55b6995f79e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 0x55b6995f79e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 -- 172.21.15.26:0/4276993936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b699445630 con 0x55b6995fd6c0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3881aa9640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 0x55b6995f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f38812a8640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f386c09b4b0 tx=0x7f386c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f68bcb99cd9c778c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0cb060 con 0x55b6995fd6c0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f386c0a8910 con 0x55b6995fd6c0 2024-04-23T10:17:19.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3878007d90 con 0x55b6995fd6c0 2024-04-23T10:17:19.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f386c0d1050 con 0x55b6995fd6c0 2024-04-23T10:17:19.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 10 client.5373 fetch_fsmap learned FSMap version 19 2024-04-23T10:17:19.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b6993aa490 con 0x55b6995fd6c0 2024-04-23T10:17:19.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878007d90 con 0x55b6995fd6c0 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f386c0d4020 con 0x55b6995fd6c0 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 10 client.5373 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 10 client.5373 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.830+0000 7f3886e8f000 20 client.5373 populate_metadata read hostname 'smithi026' 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b6996043c0 0x55b6996047d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f3886e8f000 4 client.5373 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55b6993a47f0 con 0x55b6996043c0 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f3881aa9640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b6996043c0 0x55b6996047d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f385cff9640 10 client.5373 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:19.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.834+0000 7f3881aa9640 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b6996043c0 0x55b6996047d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=245590d249d7fb45 server_cookie=58b5a6011875e0e1 in_seq=0 out_seq=0 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f385cff9640 1 -- 172.21.15.26:0/4276993936 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55b6993a47f0 con 0x55b6996043c0 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f385cff9640 10 client.5373 handle_command_reply: tid=0 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 client.5373 shutdown 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 msgr2=0x55b6995f7f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f386c09b4b0 tx=0x7f386c01ba30 comp rx=0 tx=0).stop 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 shutdown_connections 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b6996043c0 0x55b6996047d0 crc :-1 s=READY pgs=58 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fdfe0 0x55b699603620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b6995f7f20 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 --2- 172.21.15.26:0/4276993936 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995f8600 0x55b6995f79e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f385cff9640 0 client.5373 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 >> 172.21.15.26:0/4276993936 conn(0x55b6995f9470 msgr2=0x55b6995fc6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 shutdown_connections 2024-04-23T10:17:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 1 -- 172.21.15.26:0/4276993936 wait complete. 2024-04-23T10:17:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.838+0000 7f3886e8f000 20 client.5373 trim_cache size 0 max 16384 2024-04-23T10:17:19.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 Processor -- start 2024-04-23T10:17:19.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 -- start start 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fd6c0 0x55b6996047a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b699604ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1fc640 con 0x55b6995f8600 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f387c1fcd10 con 0x55b6995fdfe0 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f387c1faea0 con 0x55b6995fd6c0 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38790/0 (socket says 172.21.15.26:38790) 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 -- 172.21.15.26:0/2131679773 learned_addr learned my addr 172.21.15.26:0/2131679773 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f38812a8640 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fd6c0 0x55b6996047a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 -- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fd6c0 msgr2=0x55b6996047a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fd6c0 0x55b6996047a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 -- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 msgr2=0x55b699604ce0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b699604ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 -- 172.21.15.26:0/2131679773 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b6993a5a70 con 0x55b6995f8600 2024-04-23T10:17:19.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f3881aa9640 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3878005fd0 tx=0x7f3878086000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96669d8e7c4bdc82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f385effd640 1 -- 172.21.15.26:0/2131679773 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3878007d90 con 0x55b6995f8600 2024-04-23T10:17:19.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f385effd640 1 -- 172.21.15.26:0/2131679773 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878053f50 con 0x55b6995f8600 2024-04-23T10:17:19.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.862+0000 7f385effd640 1 -- 172.21.15.26:0/2131679773 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f38780522c0 con 0x55b6995f8600 2024-04-23T10:17:19.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/2131679773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 msgr2=0x55b699605bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:19.865 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 crypto rx=0x7f3878005fd0 tx=0x7f3878086000 comp rx=0 tx=0).stop 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/2131679773 shutdown_connections 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b699604ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995fd6c0 0x55b6996047a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- 172.21.15.26:0/2131679773 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995f8600 0x55b699605bd0 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/2131679773 >> 172.21.15.26:0/2131679773 conn(0x55b6995f9470 msgr2=0x55b69960eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/2131679773 shutdown_connections 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/2131679773 wait complete. 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- start start 2024-04-23T10:17:19.866 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 Processor -- start 2024-04-23T10:17:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995f8600 0x55b699605e60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b69966d140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55b699409900 con 0x55b6995fd6c0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55b6993d4e60 con 0x55b6995fdfe0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55b69940ec20 con 0x55b6995f8600 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 10 client.0 _ll_register_callbacks cb 0x7f386c0b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:38800/0 (socket says 172.21.15.26:38800) 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 -- 172.21.15.26:0/3017349896 learned_addr learned my addr 172.21.15.26:0/3017349896 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995f8600 0x55b699605e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 -- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995f8600 msgr2=0x55b699605e60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995f8600 0x55b699605e60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 -- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 msgr2=0x55b69966d140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b69966d140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 -- 172.21.15.26:0/3017349896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b69948d080 con 0x55b6995fd6c0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f38812a8640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b3040 tx=0x7f386c0aa000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6ae939e7c00de953 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:19.869 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f385cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f386c0b5040 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f386c0a8910 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f3878053f50 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f386c004100 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 10 client.5379 fetch_fsmap learned FSMap version 19 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.866+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55b6993b03e0 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3878053f50 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f386c0d4040 con 0x55b6995fd6c0 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 10 client.5379 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 10 client.5379 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 20 client.5379 populate_metadata read hostname 'smithi026' 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b69966b9e0 0x55b69966bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 4 client.5379 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 72.7, "await_for": 42.0}] 2024-04-23T10:17:19.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 72.7, "await_for": 42.0}) -- 0x55b6993b3940 con 0x55b69966b9e0 2024-04-23T10:17:19.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b69966b9e0 0x55b69966bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:19.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f3881aa9640 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b69966b9e0 0x55b69966bdf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3dc70be6b6a1688 server_cookie=ccb04484de073fe5 in_seq=0 out_seq=0 2024-04-23T10:17:19.871 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:19.870+0000 7f385cff9640 10 client.5379 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f385cff9640 1 -- 172.21.15.26:0/3017349896 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55b6993b3940 con 0x55b69966b9e0 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f385cff9640 10 client.5379 handle_command_reply: tid=0 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 client.5379 shutdown 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 msgr2=0x55b69966cc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b3040 tx=0x7f386c0aa000 comp rx=0 tx=0).stop 2024-04-23T10:17:26.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 shutdown_connections 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55b69966b9e0 0x55b69966bdf0 crc :-1 s=READY pgs=59 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55b6995fdfe0 0x55b69966d140 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55b6995fd6c0 0x55b69966cc00 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 --2- 172.21.15.26:0/3017349896 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55b6995f8600 0x55b699605e60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f385cff9640 0 client.5379 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 >> 172.21.15.26:0/3017349896 conn(0x55b6995f9470 msgr2=0x55b6996023e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 shutdown_connections 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 1 -- 172.21.15.26:0/3017349896 wait complete. 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.722+0000 7f3886e8f000 20 client.5379 trim_cache size 0 max 16384 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:17:26.725 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:17:26.726 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:17:26.726 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 14, 2024-04-23T10:17:26.726 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:17:26.726 INFO:teuthology.orchestra.run.smithi026.stdout: "7d040643": { 2024-04-23T10:17:26.726 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 14, 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 72.7, 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:17:26.727 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:26.728 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 msgr2=0x7f386006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 0x7f386006a870 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f386c0b2000 tx=0x7f386c0aa070 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 msgr2=0x7f387c1efd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f387800c760 tx=0x7f387800cc20 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 shutdown_connections 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f38600683b0 0x7f386006a870 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f387c0c9490 0x7f387c1f25e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f387c0c8a00 0x7f387c1f20a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 --2- 172.21.15.26:0/3214105135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f387c0c6d40 0x7f387c1efd40 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 >> 172.21.15.26:0/3214105135 conn(0x7f387c0cce00 msgr2=0x7f387c0cafc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 shutdown_connections 2024-04-23T10:17:26.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:26.726+0000 7f3883d0d640 1 -- 172.21.15.26:0/3214105135 wait complete. 2024-04-23T10:17:26.748 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '7d040643', quiesce took 7.5 seconds. Will release after: 12.7 2024-04-23T10:17:36.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:36.228 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:17:39.449 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:17:39.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.582+0000 7f43cd87b640 1 Processor -- start 2024-04-23T10:17:39.584 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.582+0000 7f43cd87b640 1 -- start start 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43cd87b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814fbc0 0x7f43c806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43cd87b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43c814ffa0 0x7f43c80c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43cd87b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f43c80c5d70 con 0x7f43c8074100 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43cd87b640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f43c80c6050 con 0x7f43c814ffa0 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43cd87b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43c80c6330 con 0x7f43c814fbc0 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43c814ffa0 0x7f43c80c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f43c814ffa0 0x7f43c80c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36992/0 (socket says 172.21.15.26:36992) 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 -- 172.21.15.26:0/4092716075 learned_addr learned my addr 172.21.15.26:0/4092716075 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c6ffd640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814fbc0 0x7f43c806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 -- 172.21.15.26:0/4092716075 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814fbc0 msgr2=0x7f43c806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814fbc0 0x7f43c806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 -- 172.21.15.26:0/4092716075 >> v1:172.21.15.190:6789/0 conn(0x7f43c8074100 legacy=0x7f43c80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.587 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 -- 172.21.15.26:0/4092716075 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c80c6610 con 0x7f43c814ffa0 2024-04-23T10:17:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.586+0000 7f43c67fc640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814ffa0 0x7f43c80c8220 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009870 tx=0x7f43bc01c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2199c851e7f641d2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c5ffb640 1 -- 172.21.15.26:0/4092716075 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0aa660 con 0x7f43c814ffa0 2024-04-23T10:17:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c5ffb640 1 -- 172.21.15.26:0/4092716075 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0af070 con 0x7f43c814ffa0 2024-04-23T10:17:39.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c5ffb640 1 -- 172.21.15.26:0/4092716075 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0aaa20 con 0x7f43c814ffa0 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- 172.21.15.26:0/4092716075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814ffa0 msgr2=0x7f43c80c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814ffa0 0x7f43c80c8220 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f43bc009870 tx=0x7f43bc01c520 comp rx=0 tx=0).stop 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- 172.21.15.26:0/4092716075 shutdown_connections 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814ffa0 0x7f43c80c8220 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4092716075 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814fbc0 0x7f43c806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- 172.21.15.26:0/4092716075 >> 172.21.15.26:0/4092716075 conn(0x7f43c806b9d0 msgr2=0x7f43c806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- 172.21.15.26:0/4092716075 shutdown_connections 2024-04-23T10:17:39.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- 172.21.15.26:0/4092716075 wait complete. 2024-04-23T10:17:39.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 Processor -- start 2024-04-23T10:17:39.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- start start 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 0x7f43c80c3c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814ffa0 0x7f43c8161d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43c8166420 con 0x7f43c814fbc0 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f43c81662a0 con 0x7f43c8074100 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43cd87b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43c81665a0 con 0x7f43c814ffa0 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37000/0 (socket says 172.21.15.26:37000) 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 -- 172.21.15.26:0/4143970761 learned_addr learned my addr 172.21.15.26:0/4143970761 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c6ffd640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 0x7f43c80c3c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c77fe640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814ffa0 0x7f43c8161d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 -- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814ffa0 msgr2=0x7f43c8161d20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814ffa0 0x7f43c8161d20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 -- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 msgr2=0x7f43c80c3c40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 0x7f43c80c3c40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 -- 172.21.15.26:0/4143970761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43c806c320 con 0x7f43c814fbc0 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c6ffd640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 0x7f43c80c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43c67fc640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0ac040 tx=0x7f43bc01ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.590+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0bd5f0 con 0x7f43c814fbc0 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f43bc0bd7b0 con 0x7f43c814fbc0 2024-04-23T10:17:39.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f43bc0bdba0 con 0x7f43c814fbc0 2024-04-23T10:17:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f43c80cb430 con 0x7f43c814fbc0 2024-04-23T10:17:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f43c8140c50 con 0x7f43c814fbc0 2024-04-23T10:17:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f43c8075df0 con 0x7f43c814fbc0 2024-04-23T10:17:39.594 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f43bc0b33f0 con 0x7f43c814fbc0 2024-04-23T10:17:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43affff640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 0x7f43b406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f43bc1219b0 con 0x7f43c814fbc0 2024-04-23T10:17:39.595 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43c6ffd640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 0x7f43b406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.594+0000 7f43c6ffd640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 0x7f43b406a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43b8007a70 tx=0x7f43b8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.598+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f43bc016110 con 0x7f43c814fbc0 2024-04-23T10:17:39.797 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.798+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f43c8075df0 con 0x7f43c814fbc0 2024-04-23T10:17:39.798 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.798+0000 7f43affff640 1 -- 172.21.15.26:0/4143970761 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f43bc0f1690 con 0x7f43c814fbc0 2024-04-23T10:17:39.799 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:17:39.799 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:17:39.799 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 msgr2=0x7f43b406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 0x7f43b406a840 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f43b8007a70 tx=0x7f43b8008040 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 msgr2=0x7f43c80c4180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f43bc0ac040 tx=0x7f43bc01ad60 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 shutdown_connections 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f43b4068380 0x7f43b406a840 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f43c814ffa0 0x7f43c8161d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f43c814fbc0 0x7f43c80c4180 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 --2- 172.21.15.26:0/4143970761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f43c8074100 0x7f43c80c3c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.802 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 >> 172.21.15.26:0/4143970761 conn(0x7f43c806b9d0 msgr2=0x7f43c80cbc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 shutdown_connections 2024-04-23T10:17:39.803 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.802+0000 7f43cd87b640 1 -- 172.21.15.26:0/4143970761 wait complete. 2024-04-23T10:17:39.817 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id 7d040643 --release --await' 2024-04-23T10:17:39.817 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id 7d040643 --release --await 2024-04-23T10:17:39.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 Processor -- start 2024-04-23T10:17:39.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 -- start start 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f977014ffa0 0x7f977006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9770074100 0x7f97700c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f97700c5d70 con 0x7f977014fbc0 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f97700c6050 con 0x7f977014ffa0 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9777603640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f97700c6330 con 0x7f9770074100 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9774b9e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f977014ffa0 0x7f977006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f977539f640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f977014fbc0 0x7f97700c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:38006/0 (socket says 172.21.15.26:38006) 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f977539f640 1 -- 172.21.15.26:0/3218576520 learned_addr learned my addr 172.21.15.26:0/3218576520 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9775ba0640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9770074100 0x7f97700c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9774b9e640 1 -- 172.21.15.26:0/3218576520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9770074100 msgr2=0x7f97700c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9774b9e640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9770074100 0x7f97700c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9774b9e640 1 -- 172.21.15.26:0/3218576520 >> v1:172.21.15.26:6789/0 conn(0x7f977014fbc0 legacy=0x7f97700c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9767fff640 1 -- 172.21.15.26:0/3218576520 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3818454430 0 0) 0x7f97700c5d70 con 0x7f977014fbc0 2024-04-23T10:17:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.950+0000 7f9774b9e640 1 -- 172.21.15.26:0/3218576520 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f97700c6610 con 0x7f977014ffa0 2024-04-23T10:17:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9774b9e640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014ffa0 0x7f977006f700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f97600097c0 tx=0x7f976001c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=234f7a39608526fe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9767fff640 1 -- 172.21.15.26:0/3218576520 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600aa620 con 0x7f977014ffa0 2024-04-23T10:17:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9767fff640 1 -- 172.21.15.26:0/3218576520 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97600af070 con 0x7f977014ffa0 2024-04-23T10:17:39.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9767fff640 1 -- 172.21.15.26:0/3218576520 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600aa9e0 con 0x7f977014ffa0 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 -- 172.21.15.26:0/3218576520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014ffa0 msgr2=0x7f977006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014ffa0 0x7f977006f700 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f97600097c0 tx=0x7f976001c4a0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 -- 172.21.15.26:0/3218576520 shutdown_connections 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9770074100 0x7f97700c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 --2- 172.21.15.26:0/3218576520 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014ffa0 0x7f977006f700 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 -- 172.21.15.26:0/3218576520 >> 172.21.15.26:0/3218576520 conn(0x7f977006b9d0 msgr2=0x7f977006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 -- 172.21.15.26:0/3218576520 shutdown_connections 2024-04-23T10:17:39.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.954+0000 7f9777603640 1 -- 172.21.15.26:0/3218576520 wait complete. 2024-04-23T10:17:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 Processor -- start 2024-04-23T10:17:39.957 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- start start 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9770074100 0x7f97701eb720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 0x7f97701431d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f97700c8ab0 con 0x7f977014fbc0 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f97700c8930 con 0x7f9770074100 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9770166090 con 0x7f977014ffa0 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37008/0 (socket says 172.21.15.26:37008) 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 -- 172.21.15.26:0/4068491405 learned_addr learned my addr 172.21.15.26:0/4068491405 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.959 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9775ba0640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 0x7f97701431d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f977539f640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9770074100 0x7f97701eb720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.960 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 -- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 msgr2=0x7f97701431d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 0x7f97701431d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 -- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9770074100 msgr2=0x7f97701eb720 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9770074100 0x7f97701eb720 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 -- 172.21.15.26:0/4068491405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9770143710 con 0x7f977014fbc0 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9775ba0640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 0x7f97701431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:17:39.961 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9774b9e640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f976001a0d0 tx=0x7f9760019240 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9765ffb640 1 -- 172.21.15.26:0/4068491405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600aacd0 con 0x7f977014fbc0 2024-04-23T10:17:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9765ffb640 1 -- 172.21.15.26:0/4068491405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f97600be450 con 0x7f977014fbc0 2024-04-23T10:17:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9765ffb640 1 -- 172.21.15.26:0/4068491405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600be840 con 0x7f977014fbc0 2024-04-23T10:17:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f977015d070 con 0x7f977014fbc0 2024-04-23T10:17:39.962 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.958+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9770150660 con 0x7f977014fbc0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9765ffb640 1 -- 172.21.15.26:0/4068491405 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f97600be9e0 con 0x7f977014fbc0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9765ffb640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 0x7f975406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9765ffb640 1 -- 172.21.15.26:0/4068491405 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9760121420 con 0x7f977014fbc0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 0x7f975406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 Processor -- start 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- start start 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 0x7f975406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f976c000f70 tx=0x7f976c007b60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe67500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56308fc73660 con 0x56308fe628a0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56308fc185d0 con 0x56308fe67120 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56308fc6f620 con 0x56308fe2bf00 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37020/0 (socket says 172.21.15.26:37020) 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 -- 172.21.15.26:0/2574920043 learned_addr learned my addr 172.21.15.26:0/2574920043 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9774b9e640 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9775ba0640 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe67500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 -- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 msgr2=0x56308fe2c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 -- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 msgr2=0x56308fe67500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe67500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 -- 172.21.15.26:0/2574920043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308fc4cbd0 con 0x56308fe628a0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977539f640 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f976c005d10 tx=0x7f976c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb4ebc466f1e53cb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9752ffd640 1 -- 172.21.15.26:0/2574920043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c015110 con 0x56308fe628a0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9752ffd640 1 -- 172.21.15.26:0/2574920043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976c0159c0 con 0x56308fe628a0 2024-04-23T10:17:39.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f9752ffd640 1 -- 172.21.15.26:0/2574920043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c015d70 con 0x56308fe628a0 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- 172.21.15.26:0/2574920043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 msgr2=0x56308fe2b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 crypto rx=0x7f976c005d10 tx=0x7f976c012000 comp rx=0 tx=0).stop 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- 172.21.15.26:0/2574920043 shutdown_connections 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe67500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 --2- 172.21.15.26:0/2574920043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2b9c0 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.962+0000 7f977a785000 1 -- 172.21.15.26:0/2574920043 >> 172.21.15.26:0/2574920043 conn(0x56308fd0db00 msgr2=0x56308fe64ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- 172.21.15.26:0/2574920043 shutdown_connections 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- 172.21.15.26:0/2574920043 wait complete. 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- start start 2024-04-23T10:17:39.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 Processor -- start 2024-04-23T10:17:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe61650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fe61b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56308fd30d40 con 0x56308fe67120 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56308fc2deb0 con 0x56308fe628a0 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56308fc6e2a0 con 0x56308fe2bf00 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 10 client.0 _ll_register_callbacks cb 0x56308fe11a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37030/0 (socket says 172.21.15.26:37030) 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 -- 172.21.15.26:0/823310839 learned_addr learned my addr 172.21.15.26:0/823310839 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977539f640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe61650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9774b9e640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fe61b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 -- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 msgr2=0x56308fe61650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe61650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 -- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 msgr2=0x56308fe61b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fe61b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.971 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 -- 172.21.15.26:0/823310839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56308fcb9b30 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f9775ba0640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9768007af0 tx=0x7f9768009f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=161a88e1f7b78fa7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976801b020 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9768011ba0 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x56308fc0d060 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f9768025050 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 10 client.5400 fetch_fsmap learned FSMap version 19 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56308fc12b70 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x56308fc0d060 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f9768028020 con 0x56308fe67120 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 10 client.5400 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 10 client.5400 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 20 client.5400 populate_metadata read hostname 'smithi026' 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe27640 0x56308fe27a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 4 client.5400 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:17:39.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x56308fc4be30 con 0x56308fe27640 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977539f640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe27640 0x56308fe27a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f977539f640 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe27640 0x56308fe27a50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=782fa2771de99eec server_cookie=c8c6bcc63c0f41ab in_seq=0 out_seq=0 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.966+0000 7f974bfff640 10 client.5400 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f974bfff640 1 -- 172.21.15.26:0/823310839 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x56308fc4be30 con 0x56308fe27640 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f974bfff640 10 client.5400 handle_command_reply: tid=0 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 client.5400 shutdown 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 msgr2=0x56308fe268d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7f9768007af0 tx=0x7f9768009f70 comp rx=0 tx=0).stop 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 shutdown_connections 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe27640 0x56308fe27a50 crc :-1 s=READY pgs=61 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe67120 0x56308fe268d0 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fe61b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f974bfff640 0 client.5400 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 --2- 172.21.15.26:0/823310839 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe61650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 >> 172.21.15.26:0/823310839 conn(0x56308fd0db00 msgr2=0x56308fe669a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 shutdown_connections 2024-04-23T10:17:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 1 -- 172.21.15.26:0/823310839 wait complete. 2024-04-23T10:17:39.974 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.970+0000 7f977a785000 20 client.5400 trim_cache size 0 max 16384 2024-04-23T10:17:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 Processor -- start 2024-04-23T10:17:39.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 -- start start 2024-04-23T10:17:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2a2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe7db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f97701ff4b0 con 0x56308fe628a0 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f97701ffb80 con 0x56308fe67120 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f97701fdbe0 con 0x56308fe2bf00 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37032/0 (socket says 172.21.15.26:37032) 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 -- 172.21.15.26:0/1646655914 learned_addr learned my addr 172.21.15.26:0/1646655914 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 -- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 msgr2=0x56308fe2a2f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2a2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 -- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 msgr2=0x56308fe7db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe7db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 -- 172.21.15.26:0/1646655914 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56308fcf55e0 con 0x56308fe628a0 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f9774b9e640 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97600ed3b0 tx=0x7f97600f0d20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1049aafae7ca2fea server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f97527fc640 1 -- 172.21.15.26:0/1646655914 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600c3040 con 0x56308fe628a0 2024-04-23T10:17:39.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f97527fc640 1 -- 172.21.15.26:0/1646655914 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976011f070 con 0x56308fe628a0 2024-04-23T10:17:39.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.986+0000 7f97527fc640 1 -- 172.21.15.26:0/1646655914 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f97600f1650 con 0x56308fe628a0 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/1646655914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 msgr2=0x56308fe2a830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7f97600ed3b0 tx=0x7f97600f0d20 comp rx=0 tx=0).stop 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/1646655914 shutdown_connections 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe67120 0x56308fe7db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe628a0 0x56308fe2a830 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- 172.21.15.26:0/1646655914 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe2bf00 0x56308fe2a2f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/1646655914 >> 172.21.15.26:0/1646655914 conn(0x56308fd0db00 msgr2=0x56308fe62080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/1646655914 shutdown_connections 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/1646655914 wait complete. 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- start start 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 Processor -- start 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fed5250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 0x56308fe7fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x56308fc72970 con 0x56308fe2bf00 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x56308fc288f0 con 0x56308fe628a0 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x56308fc77c90 con 0x56308fe67120 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 10 client.0 _ll_register_callbacks cb 0x7f9768009830 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:37044/0 (socket says 172.21.15.26:37044) 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 -- 172.21.15.26:0/2745948569 learned_addr learned my addr 172.21.15.26:0/2745948569 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f9775ba0640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 0x56308fe7fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 -- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 msgr2=0x56308fe7fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 0x56308fe7fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 -- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 msgr2=0x56308fed5250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f9774b9e640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fed5250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fed5250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:39.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 -- 172.21.15.26:0/2745948569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56308fc05ae0 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f9775ba0640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 0x56308fe7fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977539f640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f976c005cb0 tx=0x7f976c000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a54009cc8989314f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f976c02e020 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f976c02e1c0 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f976011f070 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f976c0159c0 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 10 client.5406 fetch_fsmap learned FSMap version 19 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x56308fc08d80 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f976011f070 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f976c015b60 con 0x56308fe2bf00 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 10 client.5406 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 10 client.5406 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 20 client.5406 populate_metadata read hostname 'smithi026' 2024-04-23T10:17:39.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe80ad0 0x56308fe80ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:17:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 4 client.5406 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "7d040643", "release": true, "await": true}] 2024-04-23T10:17:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "7d040643", "release": true, "await": true}) -- 0x56308fc110d0 con 0x56308fe80ad0 2024-04-23T10:17:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f9774b9e640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe80ad0 0x56308fe80ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:17:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f974bfff640 10 client.5406 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:39.995 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:39.990+0000 7f9774b9e640 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe80ad0 0x56308fe80ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e36a08b5ff1f6204 server_cookie=a42094e89da0ba40 in_seq=0 out_seq=0 2024-04-23T10:17:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f974bfff640 1 -- 172.21.15.26:0/2745948569 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x56308fc110d0 con 0x56308fe80ad0 2024-04-23T10:17:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f974bfff640 10 client.5406 handle_command_reply: tid=0 2024-04-23T10:17:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 client.5406 shutdown 2024-04-23T10:17:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 msgr2=0x56308fed4d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:40.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7f976c005cb0 tx=0x7f976c000ee0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 shutdown_connections 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x56308fe80ad0 0x56308fe80ee0 crc :-1 s=READY pgs=62 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x56308fe67120 0x56308fe7fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x56308fe628a0 0x56308fed5250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.502+0000 7f977a785000 1 --2- 172.21.15.26:0/2745948569 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x56308fe2bf00 0x56308fed4d10 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f974bfff640 0 client.5406 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 >> 172.21.15.26:0/2745948569 conn(0x56308fd0db00 msgr2=0x56308fe25cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 shutdown_connections 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f977a785000 1 -- 172.21.15.26:0/2745948569 wait complete. 2024-04-23T10:17:40.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f977a785000 20 client.5406 trim_cache size 0 max 16384 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 16, 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "7d040643": { 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 16, 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:17:40.506 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 72.7, 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:40.507 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:40.508 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:17:40.508 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 msgr2=0x7f975406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 0x7f975406a840 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x7f976c000f70 tx=0x7f976c007b60 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 msgr2=0x7f9770142c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f976001a0d0 tx=0x7f9760019240 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 shutdown_connections 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9754068380 0x7f975406a840 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f977014ffa0 0x7f97701431d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f977014fbc0 0x7f9770142c90 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 --2- 172.21.15.26:0/4068491405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9770074100 0x7f97701eb720 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 >> 172.21.15.26:0/4068491405 conn(0x7f977006b9d0 msgr2=0x7f977014b470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 shutdown_connections 2024-04-23T10:17:40.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:17:40.506+0000 7f9777603640 1 -- 172.21.15.26:0/4068491405 wait complete. 2024-04-23T10:17:40.538 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '7d040643', seconds elapsed: 21.3 2024-04-23T10:17:40.797 INFO:tasks.workunit.client.0.smithi026.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-04-23T10:17:40.825 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:17:40.825 INFO:tasks.workunit.client.0.smithi026.stderr:+ make 2024-04-23T10:17:40.926 INFO:tasks.workunit.client.0.smithi026.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-04-23T10:17:41.759 INFO:tasks.workunit.client.0.smithi026.stderr:++ readlink -f fsstress 2024-04-23T10:17:41.761 INFO:tasks.workunit.client.0.smithi026.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-04-23T10:17:41.761 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2024-04-23T10:17:41.763 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:17:41.763 INFO:tasks.workunit.client.0.smithi026.stderr:+ popd 2024-04-23T10:17:41.764 INFO:tasks.workunit.client.0.smithi026.stdout:~/cephtest/mnt.0/client.0/tmp 2024-04-23T10:17:41.764 INFO:tasks.workunit.client.0.smithi026.stderr:++ mktemp -d -p . 2024-04-23T10:17:41.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ T=./tmp.IyREBomXiq 2024-04-23T10:17:41.769 INFO:tasks.workunit.client.0.smithi026.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.IyREBomXiq -l 1 -n 1000 -p 10 -v 2024-04-23T10:17:41.774 INFO:tasks.workunit.client.0.smithi026.stdout:seed = 1714180201 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/0: write - no filename 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/1: write - no filename 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/2: dwrite - no filename 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/3: dread - no filename 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/4: dwrite - no filename 2024-04-23T10:17:41.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/5: dwrite - no filename 2024-04-23T10:17:41.785 INFO:tasks.workunit.client.0.smithi026.stdout:0/6: creat f0 x:0 0 0 2024-04-23T10:17:41.786 INFO:tasks.workunit.client.0.smithi026.stdout:2/0: dwrite - no filename 2024-04-23T10:17:41.788 INFO:tasks.workunit.client.0.smithi026.stdout:0/7: creat f1 x:0 0 0 2024-04-23T10:17:41.790 INFO:tasks.workunit.client.0.smithi026.stdout:1/0: creat f0 x:0 0 0 2024-04-23T10:17:41.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/0: dwrite - no filename 2024-04-23T10:17:41.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/1: readlink - no filename 2024-04-23T10:17:41.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/2: write - no filename 2024-04-23T10:17:41.794 INFO:tasks.workunit.client.0.smithi026.stdout:0/8: mknod c2 0 2024-04-23T10:17:41.794 INFO:tasks.workunit.client.0.smithi026.stdout:0/9: fdatasync f1 0 2024-04-23T10:17:41.796 INFO:tasks.workunit.client.0.smithi026.stdout:1/1: unlink f0 0 2024-04-23T10:17:41.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/1: mknod c0 0 2024-04-23T10:17:41.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/2: dwrite - no filename 2024-04-23T10:17:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:0/10: creat f3 x:0 0 0 2024-04-23T10:17:41.802 INFO:tasks.workunit.client.0.smithi026.stdout:0/11: rmdir - no directory 2024-04-23T10:17:41.803 INFO:tasks.workunit.client.0.smithi026.stdout:1/2: creat f1 x:0 0 0 2024-04-23T10:17:41.804 INFO:tasks.workunit.client.0.smithi026.stdout:1/3: truncate f1 217982 0 2024-04-23T10:17:41.804 INFO:tasks.workunit.client.0.smithi026.stdout:3/3: getdents . 0 2024-04-23T10:17:41.808 INFO:tasks.workunit.client.0.smithi026.stdout:0/12: creat f4 x:0 0 0 2024-04-23T10:17:41.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/13: readlink - no filename 2024-04-23T10:17:41.811 INFO:tasks.workunit.client.0.smithi026.stdout:4/0: symlink l0 0 2024-04-23T10:17:41.811 INFO:tasks.workunit.client.0.smithi026.stdout:4/1: write - no filename 2024-04-23T10:17:41.812 INFO:tasks.workunit.client.0.smithi026.stdout:4/2: chown l0 6238618 1 2024-04-23T10:17:41.812 INFO:tasks.workunit.client.0.smithi026.stdout:4/3: write - no filename 2024-04-23T10:17:41.812 INFO:tasks.workunit.client.0.smithi026.stdout:4/4: write - no filename 2024-04-23T10:17:41.814 INFO:tasks.workunit.client.0.smithi026.stdout:6/0: chown . 106679907 1 2024-04-23T10:17:41.815 INFO:tasks.workunit.client.0.smithi026.stdout:0/14: symlink l5 0 2024-04-23T10:17:41.815 INFO:tasks.workunit.client.0.smithi026.stdout:0/15: rmdir - no directory 2024-04-23T10:17:41.815 INFO:tasks.workunit.client.0.smithi026.stdout:0/16: chown f3 1 1 2024-04-23T10:17:41.816 INFO:tasks.workunit.client.0.smithi026.stdout:2/3: link c0 c1 0 2024-04-23T10:17:41.816 INFO:tasks.workunit.client.0.smithi026.stdout:2/4: dread - no filename 2024-04-23T10:17:41.817 INFO:tasks.workunit.client.0.smithi026.stdout:0/17: write f0 [392767,83943] 0 2024-04-23T10:17:41.817 INFO:tasks.workunit.client.0.smithi026.stdout:3/4: getdents . 0 2024-04-23T10:17:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/0: mkdir d0 0 2024-04-23T10:17:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/1: dwrite - no filename 2024-04-23T10:17:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/2: chown d0 26490051 1 2024-04-23T10:17:41.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/3: write - no filename 2024-04-23T10:17:41.820 INFO:tasks.workunit.client.0.smithi026.stdout:7/0: dread - no filename 2024-04-23T10:17:41.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/1: rename - no filename 2024-04-23T10:17:41.823 INFO:tasks.workunit.client.0.smithi026.stdout:0/18: creat f6 x:0 0 0 2024-04-23T10:17:41.824 INFO:tasks.workunit.client.0.smithi026.stdout:6/1: creat f0 x:0 0 0 2024-04-23T10:17:41.826 INFO:tasks.workunit.client.0.smithi026.stdout:6/2: write f0 [104289,109122] 0 2024-04-23T10:17:41.828 INFO:tasks.workunit.client.0.smithi026.stdout:3/5: mkdir d0 0 2024-04-23T10:17:41.829 INFO:tasks.workunit.client.0.smithi026.stdout:5/4: symlink d0/l1 0 2024-04-23T10:17:41.832 INFO:tasks.workunit.client.0.smithi026.stdout:0/19: dread f0 [0,4194304] 0 2024-04-23T10:17:41.834 INFO:tasks.workunit.client.0.smithi026.stdout:9/0: dwrite - no filename 2024-04-23T10:17:41.834 INFO:tasks.workunit.client.0.smithi026.stdout:9/1: chown . 28 1 2024-04-23T10:17:41.836 INFO:tasks.workunit.client.0.smithi026.stdout:6/3: symlink l1 0 2024-04-23T10:17:41.840 INFO:tasks.workunit.client.0.smithi026.stdout:7/2: symlink l0 0 2024-04-23T10:17:41.840 INFO:tasks.workunit.client.0.smithi026.stdout:7/3: dread - no filename 2024-04-23T10:17:41.842 INFO:tasks.workunit.client.0.smithi026.stdout:5/5: creat d0/f2 x:0 0 0 2024-04-23T10:17:41.843 INFO:tasks.workunit.client.0.smithi026.stdout:5/6: truncate d0/f2 501454 0 2024-04-23T10:17:41.847 INFO:tasks.workunit.client.0.smithi026.stdout:0/20: mkdir d7 0 2024-04-23T10:17:41.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/4: creat f2 x:0 0 0 2024-04-23T10:17:41.853 INFO:tasks.workunit.client.0.smithi026.stdout:8/0: symlink l0 0 2024-04-23T10:17:41.855 INFO:tasks.workunit.client.0.smithi026.stdout:3/6: symlink d0/l1 0 2024-04-23T10:17:41.858 INFO:tasks.workunit.client.0.smithi026.stdout:6/5: dread f0 [0,4194304] 0 2024-04-23T10:17:41.859 INFO:tasks.workunit.client.0.smithi026.stdout:7/4: rename l0 to l1 0 2024-04-23T10:17:41.864 INFO:tasks.workunit.client.0.smithi026.stdout:9/2: symlink l0 0 2024-04-23T10:17:41.868 INFO:tasks.workunit.client.0.smithi026.stdout:8/1: symlink l1 0 2024-04-23T10:17:41.870 INFO:tasks.workunit.client.0.smithi026.stdout:3/7: symlink d0/l2 0 2024-04-23T10:17:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:3/8: stat d0/l2 0 2024-04-23T10:17:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:3/9: readlink d0/l1 0 2024-04-23T10:17:41.871 INFO:tasks.workunit.client.0.smithi026.stdout:3/10: write - no filename 2024-04-23T10:17:41.873 INFO:tasks.workunit.client.0.smithi026.stdout:6/6: creat f3 x:0 0 0 2024-04-23T10:17:41.875 INFO:tasks.workunit.client.0.smithi026.stdout:7/5: mknod c2 0 2024-04-23T10:17:41.875 INFO:tasks.workunit.client.0.smithi026.stdout:7/6: dwrite - no filename 2024-04-23T10:17:41.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/5: getdents . 0 2024-04-23T10:17:41.880 INFO:tasks.workunit.client.0.smithi026.stdout:0/21: mkdir d7/d8 0 2024-04-23T10:17:41.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/22: write f3 [761295,24957] 0 2024-04-23T10:17:41.883 INFO:tasks.workunit.client.0.smithi026.stdout:9/3: symlink l1 0 2024-04-23T10:17:41.888 INFO:tasks.workunit.client.0.smithi026.stdout:8/2: creat f2 x:0 0 0 2024-04-23T10:17:41.891 INFO:tasks.workunit.client.0.smithi026.stdout:3/11: mknod d0/c3 0 2024-04-23T10:17:41.893 INFO:tasks.workunit.client.0.smithi026.stdout:6/7: fdatasync f0 0 2024-04-23T10:17:41.894 INFO:tasks.workunit.client.0.smithi026.stdout:6/8: write f2 [977627,118645] 0 2024-04-23T10:17:41.895 INFO:tasks.workunit.client.0.smithi026.stdout:7/7: mknod c3 0 2024-04-23T10:17:41.899 INFO:tasks.workunit.client.0.smithi026.stdout:2/6: stat c1 0 2024-04-23T10:17:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:9/4: symlink l2 0 2024-04-23T10:17:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:9/5: dwrite - no filename 2024-04-23T10:17:41.902 INFO:tasks.workunit.client.0.smithi026.stdout:9/6: read - no filename 2024-04-23T10:17:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:8/3: creat f3 x:0 0 0 2024-04-23T10:17:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:8/4: chown l0 3515 1 2024-04-23T10:17:41.904 INFO:tasks.workunit.client.0.smithi026.stdout:8/5: dread - f3 zero size 2024-04-23T10:17:41.906 INFO:tasks.workunit.client.0.smithi026.stdout:3/12: creat d0/f4 x:0 0 0 2024-04-23T10:17:41.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/13: truncate d0/f4 374230 0 2024-04-23T10:17:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/14: write d0/f4 [663011,10432] 0 2024-04-23T10:17:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:6/9: creat f4 x:0 0 0 2024-04-23T10:17:41.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/15: chown d0 13493936 1 2024-04-23T10:17:41.910 INFO:tasks.workunit.client.0.smithi026.stdout:7/8: creat f4 x:0 0 0 2024-04-23T10:17:41.911 INFO:tasks.workunit.client.0.smithi026.stdout:7/9: write f4 [762325,76380] 0 2024-04-23T10:17:41.912 INFO:tasks.workunit.client.0.smithi026.stdout:5/7: getdents d0 0 2024-04-23T10:17:41.915 INFO:tasks.workunit.client.0.smithi026.stdout:2/7: rename c0 to c2 0 2024-04-23T10:17:41.920 INFO:tasks.workunit.client.0.smithi026.stdout:0/23: creat d7/d8/f9 x:0 0 0 2024-04-23T10:17:41.922 INFO:tasks.workunit.client.0.smithi026.stdout:9/7: symlink l3 0 2024-04-23T10:17:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:8/6: rename f3 to f4 0 2024-04-23T10:17:41.924 INFO:tasks.workunit.client.0.smithi026.stdout:8/7: dread - f2 zero size 2024-04-23T10:17:41.927 INFO:tasks.workunit.client.0.smithi026.stdout:6/10: mkdir d5 0 2024-04-23T10:17:41.927 INFO:tasks.workunit.client.0.smithi026.stdout:6/11: stat f0 0 2024-04-23T10:17:41.929 INFO:tasks.workunit.client.0.smithi026.stdout:3/16: creat d0/f5 x:0 0 0 2024-04-23T10:17:41.929 INFO:tasks.workunit.client.0.smithi026.stdout:3/17: readlink d0/l1 0 2024-04-23T10:17:41.930 INFO:tasks.workunit.client.0.smithi026.stdout:7/10: readlink l1 0 2024-04-23T10:17:41.932 INFO:tasks.workunit.client.0.smithi026.stdout:5/8: creat d0/f3 x:0 0 0 2024-04-23T10:17:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:5/9: read d0/f2 [39386,90945] 0 2024-04-23T10:17:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:9/8: symlink l4 0 2024-04-23T10:17:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:9/9: dread - no filename 2024-04-23T10:17:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:9/10: write - no filename 2024-04-23T10:17:41.935 INFO:tasks.workunit.client.0.smithi026.stdout:9/11: write - no filename 2024-04-23T10:17:41.937 INFO:tasks.workunit.client.0.smithi026.stdout:8/8: mkdir d5 0 2024-04-23T10:17:41.939 INFO:tasks.workunit.client.0.smithi026.stdout:5/10: read d0/f2 [177728,30043] 0 2024-04-23T10:17:41.943 INFO:tasks.workunit.client.0.smithi026.stdout:3/18: dread d0/f4 [0,4194304] 0 2024-04-23T10:17:41.943 INFO:tasks.workunit.client.0.smithi026.stdout:2/8: unlink c1 0 2024-04-23T10:17:41.944 INFO:tasks.workunit.client.0.smithi026.stdout:9/12: creat f5 x:0 0 0 2024-04-23T10:17:41.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/12: dwrite f2 [0,4194304] 0 2024-04-23T10:17:41.946 INFO:tasks.workunit.client.0.smithi026.stdout:9/13: fdatasync f5 0 2024-04-23T10:17:41.946 INFO:tasks.workunit.client.0.smithi026.stdout:6/13: dread - f3 zero size 2024-04-23T10:17:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:3/19: truncate d0/f5 255262 0 2024-04-23T10:17:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:7/11: dwrite f4 [0,4194304] 0 2024-04-23T10:17:41.948 INFO:tasks.workunit.client.0.smithi026.stdout:9/14: dread - f5 zero size 2024-04-23T10:17:41.950 INFO:tasks.workunit.client.0.smithi026.stdout:2/9: mkdir d3 0 2024-04-23T10:17:41.950 INFO:tasks.workunit.client.0.smithi026.stdout:2/10: dwrite - no filename 2024-04-23T10:17:41.953 INFO:tasks.workunit.client.0.smithi026.stdout:3/20: creat d0/f6 x:0 0 0 2024-04-23T10:17:41.957 INFO:tasks.workunit.client.0.smithi026.stdout:7/12: creat f5 x:0 0 0 2024-04-23T10:17:41.958 INFO:tasks.workunit.client.0.smithi026.stdout:2/11: creat d3/f4 x:0 0 0 2024-04-23T10:17:41.959 INFO:tasks.workunit.client.0.smithi026.stdout:7/13: write f5 [76175,9622] 0 2024-04-23T10:17:41.960 INFO:tasks.workunit.client.0.smithi026.stdout:3/21: write d0/f4 [828737,10627] 0 2024-04-23T10:17:41.960 INFO:tasks.workunit.client.0.smithi026.stdout:6/14: rmdir d5 0 2024-04-23T10:17:41.963 INFO:tasks.workunit.client.0.smithi026.stdout:9/15: dwrite f5 [0,4194304] 0 2024-04-23T10:17:41.965 INFO:tasks.workunit.client.0.smithi026.stdout:7/14: creat f6 x:0 0 0 2024-04-23T10:17:41.972 INFO:tasks.workunit.client.0.smithi026.stdout:3/22: creat d0/f7 x:0 0 0 2024-04-23T10:17:41.972 INFO:tasks.workunit.client.0.smithi026.stdout:6/15: mkdir d6 0 2024-04-23T10:17:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:3/23: read d0/f5 [239685,55109] 0 2024-04-23T10:17:41.974 INFO:tasks.workunit.client.0.smithi026.stdout:7/15: rename f5 to f7 0 2024-04-23T10:17:41.975 INFO:tasks.workunit.client.0.smithi026.stdout:7/16: chown c2 118135 1 2024-04-23T10:17:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:9/16: fdatasync f5 0 2024-04-23T10:17:41.982 INFO:tasks.workunit.client.0.smithi026.stdout:7/17: symlink l8 0 2024-04-23T10:17:41.984 INFO:tasks.workunit.client.0.smithi026.stdout:7/18: fdatasync f4 0 2024-04-23T10:17:41.984 INFO:tasks.workunit.client.0.smithi026.stdout:6/16: symlink d6/l7 0 2024-04-23T10:17:41.985 INFO:tasks.workunit.client.0.smithi026.stdout:3/24: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:17:41.986 INFO:tasks.workunit.client.0.smithi026.stdout:6/17: write f2 [2451892,56647] 0 2024-04-23T10:17:41.987 INFO:tasks.workunit.client.0.smithi026.stdout:3/25: write d0/f6 [237152,103277] 0 2024-04-23T10:17:41.987 INFO:tasks.workunit.client.0.smithi026.stdout:6/18: dread - f4 zero size 2024-04-23T10:17:41.988 INFO:tasks.workunit.client.0.smithi026.stdout:3/26: write d0/f6 [862390,35261] 0 2024-04-23T10:17:41.991 INFO:tasks.workunit.client.0.smithi026.stdout:6/19: creat d6/f8 x:0 0 0 2024-04-23T10:17:41.991 INFO:tasks.workunit.client.0.smithi026.stdout:6/20: readlink d6/l7 0 2024-04-23T10:17:41.991 INFO:tasks.workunit.client.0.smithi026.stdout:6/21: fdatasync f3 0 2024-04-23T10:17:41.993 INFO:tasks.workunit.client.0.smithi026.stdout:7/19: dread f7 [0,4194304] 0 2024-04-23T10:17:41.993 INFO:tasks.workunit.client.0.smithi026.stdout:6/22: rmdir d6 39 2024-04-23T10:17:41.994 INFO:tasks.workunit.client.0.smithi026.stdout:7/20: fdatasync f4 0 2024-04-23T10:17:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/21: symlink l9 0 2024-04-23T10:17:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/22: read - f6 zero size 2024-04-23T10:17:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/23: chown l9 11 1 2024-04-23T10:17:42.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/24: stat l8 0 2024-04-23T10:17:42.003 INFO:tasks.workunit.client.0.smithi026.stdout:7/25: mknod ca 0 2024-04-23T10:17:42.003 INFO:tasks.workunit.client.0.smithi026.stdout:7/26: stat c3 0 2024-04-23T10:17:42.003 INFO:tasks.workunit.client.0.smithi026.stdout:3/27: getdents d0 0 2024-04-23T10:17:42.005 INFO:tasks.workunit.client.0.smithi026.stdout:6/23: chown d6/l7 5404 1 2024-04-23T10:17:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:6/24: write d6/f8 [472234,86754] 0 2024-04-23T10:17:42.007 INFO:tasks.workunit.client.0.smithi026.stdout:3/28: mkdir d0/d8 0 2024-04-23T10:17:42.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/29: stat d0/f4 0 2024-04-23T10:17:42.009 INFO:tasks.workunit.client.0.smithi026.stdout:6/25: readlink d6/l7 0 2024-04-23T10:17:42.010 INFO:tasks.workunit.client.0.smithi026.stdout:9/17: dwrite f5 [4194304,4194304] 0 2024-04-23T10:17:42.012 INFO:tasks.workunit.client.0.smithi026.stdout:3/30: dread d0/f5 [0,4194304] 0 2024-04-23T10:17:42.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/31: mknod d0/d8/c9 0 2024-04-23T10:17:42.016 INFO:tasks.workunit.client.0.smithi026.stdout:6/26: getdents d6 0 2024-04-23T10:17:42.018 INFO:tasks.workunit.client.0.smithi026.stdout:6/27: getdents d6 0 2024-04-23T10:17:42.019 INFO:tasks.workunit.client.0.smithi026.stdout:6/28: chown f2 149184077 1 2024-04-23T10:17:42.020 INFO:tasks.workunit.client.0.smithi026.stdout:3/32: link d0/f5 d0/d8/fa 0 2024-04-23T10:17:42.021 INFO:tasks.workunit.client.0.smithi026.stdout:9/18: dwrite f5 [0,4194304] 0 2024-04-23T10:17:42.022 INFO:tasks.workunit.client.0.smithi026.stdout:6/29: unlink d6/f8 0 2024-04-23T10:17:42.023 INFO:tasks.workunit.client.0.smithi026.stdout:6/30: fsync f2 0 2024-04-23T10:17:42.024 INFO:tasks.workunit.client.0.smithi026.stdout:3/33: symlink d0/d8/lb 0 2024-04-23T10:17:42.026 INFO:tasks.workunit.client.0.smithi026.stdout:9/19: creat f6 x:0 0 0 2024-04-23T10:17:42.027 INFO:tasks.workunit.client.0.smithi026.stdout:9/20: truncate f6 577906 0 2024-04-23T10:17:42.027 INFO:tasks.workunit.client.0.smithi026.stdout:6/31: rmdir d6 39 2024-04-23T10:17:42.028 INFO:tasks.workunit.client.0.smithi026.stdout:6/32: write f2 [1066617,60812] 0 2024-04-23T10:17:42.029 INFO:tasks.workunit.client.0.smithi026.stdout:3/34: unlink d0/f5 0 2024-04-23T10:17:42.032 INFO:tasks.workunit.client.0.smithi026.stdout:9/21: creat f7 x:0 0 0 2024-04-23T10:17:42.034 INFO:tasks.workunit.client.0.smithi026.stdout:3/35: creat d0/fc x:0 0 0 2024-04-23T10:17:42.034 INFO:tasks.workunit.client.0.smithi026.stdout:3/36: stat d0/d8/c9 0 2024-04-23T10:17:42.036 INFO:tasks.workunit.client.0.smithi026.stdout:6/33: creat d6/f9 x:0 0 0 2024-04-23T10:17:42.037 INFO:tasks.workunit.client.0.smithi026.stdout:6/34: rename d6 to d6/da 22 2024-04-23T10:17:42.039 INFO:tasks.workunit.client.0.smithi026.stdout:3/37: symlink d0/d8/ld 0 2024-04-23T10:17:42.040 INFO:tasks.workunit.client.0.smithi026.stdout:6/35: mknod d6/cb 0 2024-04-23T10:17:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/38: rename d0/l1 to d0/d8/le 0 2024-04-23T10:17:42.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/39: truncate d0/fc 194897 0 2024-04-23T10:17:42.044 INFO:tasks.workunit.client.0.smithi026.stdout:6/36: link f2 d6/fc 0 2024-04-23T10:17:42.047 INFO:tasks.workunit.client.0.smithi026.stdout:6/37: creat d6/fd x:0 0 0 2024-04-23T10:17:42.049 INFO:tasks.workunit.client.0.smithi026.stdout:6/38: creat d6/fe x:0 0 0 2024-04-23T10:17:42.050 INFO:tasks.workunit.client.0.smithi026.stdout:9/22: truncate f5 7899882 0 2024-04-23T10:17:42.051 INFO:tasks.workunit.client.0.smithi026.stdout:9/23: write f7 [572615,65990] 0 2024-04-23T10:17:42.053 INFO:tasks.workunit.client.0.smithi026.stdout:3/40: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:17:42.055 INFO:tasks.workunit.client.0.smithi026.stdout:9/24: creat f8 x:0 0 0 2024-04-23T10:17:42.056 INFO:tasks.workunit.client.0.smithi026.stdout:6/39: link d6/f9 d6/ff 0 2024-04-23T10:17:42.056 INFO:tasks.workunit.client.0.smithi026.stdout:3/41: chown d0/f7 829134 1 2024-04-23T10:17:42.056 INFO:tasks.workunit.client.0.smithi026.stdout:6/40: read - f3 zero size 2024-04-23T10:17:42.057 INFO:tasks.workunit.client.0.smithi026.stdout:9/25: write f8 [904571,108107] 0 2024-04-23T10:17:42.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/42: dread d0/fc [0,4194304] 0 2024-04-23T10:17:42.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/43: stat d0 0 2024-04-23T10:17:42.061 INFO:tasks.workunit.client.0.smithi026.stdout:9/26: write f8 [877518,8885] 0 2024-04-23T10:17:42.061 INFO:tasks.workunit.client.0.smithi026.stdout:9/27: write f7 [920348,15851] 0 2024-04-23T10:17:42.062 INFO:tasks.workunit.client.0.smithi026.stdout:6/41: rename d6/f9 to d6/f10 0 2024-04-23T10:17:42.066 INFO:tasks.workunit.client.0.smithi026.stdout:6/42: symlink d6/l11 0 2024-04-23T10:17:42.067 INFO:tasks.workunit.client.0.smithi026.stdout:6/43: dread - f3 zero size 2024-04-23T10:17:42.070 INFO:tasks.workunit.client.0.smithi026.stdout:3/44: getdents d0 0 2024-04-23T10:17:42.071 INFO:tasks.workunit.client.0.smithi026.stdout:3/45: write d0/f6 [636511,34974] 0 2024-04-23T10:17:42.075 INFO:tasks.workunit.client.0.smithi026.stdout:3/46: mkdir d0/d8/df 0 2024-04-23T10:17:42.078 INFO:tasks.workunit.client.0.smithi026.stdout:3/47: creat d0/d8/df/f10 x:0 0 0 2024-04-23T10:17:42.080 INFO:tasks.workunit.client.0.smithi026.stdout:9/28: dread f8 [0,4194304] 0 2024-04-23T10:17:42.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/48: rename d0/f7 to d0/f11 0 2024-04-23T10:17:42.084 INFO:tasks.workunit.client.0.smithi026.stdout:3/49: symlink d0/d8/l12 0 2024-04-23T10:17:42.085 INFO:tasks.workunit.client.0.smithi026.stdout:3/50: stat d0/fc 0 2024-04-23T10:17:42.085 INFO:tasks.workunit.client.0.smithi026.stdout:6/44: dwrite d6/fc [4194304,4194304] 0 2024-04-23T10:17:42.087 INFO:tasks.workunit.client.0.smithi026.stdout:6/45: chown f0 6 1 2024-04-23T10:17:42.087 INFO:tasks.workunit.client.0.smithi026.stdout:3/51: stat d0/d8/le 0 2024-04-23T10:17:42.089 INFO:tasks.workunit.client.0.smithi026.stdout:3/52: creat d0/f13 x:0 0 0 2024-04-23T10:17:42.090 INFO:tasks.workunit.client.0.smithi026.stdout:6/46: creat d6/f12 x:0 0 0 2024-04-23T10:17:42.091 INFO:tasks.workunit.client.0.smithi026.stdout:3/53: creat d0/f14 x:0 0 0 2024-04-23T10:17:42.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/47: mkdir d6/d13 0 2024-04-23T10:17:42.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/48: write d6/fd [837920,101003] 0 2024-04-23T10:17:42.092 INFO:tasks.workunit.client.0.smithi026.stdout:3/54: creat d0/f15 x:0 0 0 2024-04-23T10:17:42.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/55: truncate d0/f4 4331404 0 2024-04-23T10:17:42.094 INFO:tasks.workunit.client.0.smithi026.stdout:3/56: chown d0/d8/le 802624 1 2024-04-23T10:17:42.094 INFO:tasks.workunit.client.0.smithi026.stdout:6/49: symlink d6/l14 0 2024-04-23T10:17:42.096 INFO:tasks.workunit.client.0.smithi026.stdout:3/57: symlink d0/d8/df/l16 0 2024-04-23T10:17:42.098 INFO:tasks.workunit.client.0.smithi026.stdout:3/58: write d0/f15 [212959,26985] 0 2024-04-23T10:17:42.105 INFO:tasks.workunit.client.0.smithi026.stdout:3/59: write d0/f11 [609740,109097] 0 2024-04-23T10:17:42.106 INFO:tasks.workunit.client.0.smithi026.stdout:3/60: fdatasync d0/f6 0 2024-04-23T10:17:42.108 INFO:tasks.workunit.client.0.smithi026.stdout:6/50: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:42.108 INFO:tasks.workunit.client.0.smithi026.stdout:3/61: mkdir d0/d8/df/d17 0 2024-04-23T10:17:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/51: dwrite d6/fc [4194304,4194304] 0 2024-04-23T10:17:42.117 INFO:tasks.workunit.client.0.smithi026.stdout:3/62: dread d0/f6 [0,4194304] 0 2024-04-23T10:17:42.118 INFO:tasks.workunit.client.0.smithi026.stdout:6/52: read - d6/ff zero size 2024-04-23T10:17:42.121 INFO:tasks.workunit.client.0.smithi026.stdout:3/63: creat d0/d8/df/f18 x:0 0 0 2024-04-23T10:17:42.123 INFO:tasks.workunit.client.0.smithi026.stdout:3/64: fsync d0/fc 0 2024-04-23T10:17:42.132 INFO:tasks.workunit.client.0.smithi026.stdout:3/65: dwrite d0/f15 [0,4194304] 0 2024-04-23T10:17:42.134 INFO:tasks.workunit.client.0.smithi026.stdout:6/53: truncate d6/ff 639134 0 2024-04-23T10:17:42.135 INFO:tasks.workunit.client.0.smithi026.stdout:6/54: truncate f4 895459 0 2024-04-23T10:17:42.136 INFO:tasks.workunit.client.0.smithi026.stdout:3/66: mknod d0/d8/c19 0 2024-04-23T10:17:42.137 INFO:tasks.workunit.client.0.smithi026.stdout:6/55: truncate f0 1073446 0 2024-04-23T10:17:42.139 INFO:tasks.workunit.client.0.smithi026.stdout:3/67: dread d0/f6 [0,4194304] 0 2024-04-23T10:17:42.139 INFO:tasks.workunit.client.0.smithi026.stdout:6/56: dread f4 [0,4194304] 0 2024-04-23T10:17:42.147 INFO:tasks.workunit.client.0.smithi026.stdout:3/68: dread d0/f15 [0,4194304] 0 2024-04-23T10:17:42.149 INFO:tasks.workunit.client.0.smithi026.stdout:3/69: dread - d0/d8/df/f10 zero size 2024-04-23T10:17:42.150 INFO:tasks.workunit.client.0.smithi026.stdout:3/70: readlink d0/d8/le 0 2024-04-23T10:17:42.151 INFO:tasks.workunit.client.0.smithi026.stdout:6/57: dwrite d6/f12 [0,4194304] 0 2024-04-23T10:17:42.151 INFO:tasks.workunit.client.0.smithi026.stdout:3/71: read - d0/d8/df/f10 zero size 2024-04-23T10:17:42.152 INFO:tasks.workunit.client.0.smithi026.stdout:6/58: dread - d6/fe zero size 2024-04-23T10:17:42.152 INFO:tasks.workunit.client.0.smithi026.stdout:6/59: chown f4 461701 1 2024-04-23T10:17:42.154 INFO:tasks.workunit.client.0.smithi026.stdout:3/72: dread d0/f6 [0,4194304] 0 2024-04-23T10:17:42.154 INFO:tasks.workunit.client.0.smithi026.stdout:3/73: chown d0/f4 15 1 2024-04-23T10:17:42.157 INFO:tasks.workunit.client.0.smithi026.stdout:6/60: dread f2 [4194304,4194304] 0 2024-04-23T10:17:42.157 INFO:tasks.workunit.client.0.smithi026.stdout:3/74: creat d0/d8/df/f1a x:0 0 0 2024-04-23T10:17:42.160 INFO:tasks.workunit.client.0.smithi026.stdout:3/75: chown d0/d8/fa 25 1 2024-04-23T10:17:42.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/61: truncate d6/f10 18503 0 2024-04-23T10:17:42.168 INFO:tasks.workunit.client.0.smithi026.stdout:3/76: dwrite d0/f4 [0,4194304] 0 2024-04-23T10:17:42.170 INFO:tasks.workunit.client.0.smithi026.stdout:3/77: write d0/d8/df/f10 [433415,123789] 0 2024-04-23T10:17:42.173 INFO:tasks.workunit.client.0.smithi026.stdout:3/78: creat d0/d8/df/f1b x:0 0 0 2024-04-23T10:17:42.174 INFO:tasks.workunit.client.0.smithi026.stdout:3/79: write d0/d8/df/f18 [31523,80053] 0 2024-04-23T10:17:42.181 INFO:tasks.workunit.client.0.smithi026.stdout:1/4: sync 2024-04-23T10:17:42.183 INFO:tasks.workunit.client.0.smithi026.stdout:6/62: unlink d6/ff 0 2024-04-23T10:17:42.185 INFO:tasks.workunit.client.0.smithi026.stdout:3/80: rename d0/d8/le to d0/d8/df/l1c 0 2024-04-23T10:17:42.186 INFO:tasks.workunit.client.0.smithi026.stdout:3/81: read d0/d8/df/f18 [91437,71067] 0 2024-04-23T10:17:42.187 INFO:tasks.workunit.client.0.smithi026.stdout:1/5: link f1 f2 0 2024-04-23T10:17:42.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/63: mkdir d6/d13/d15 0 2024-04-23T10:17:42.190 INFO:tasks.workunit.client.0.smithi026.stdout:1/6: creat f3 x:0 0 0 2024-04-23T10:17:42.191 INFO:tasks.workunit.client.0.smithi026.stdout:3/82: creat d0/d8/df/d17/f1d x:0 0 0 2024-04-23T10:17:42.193 INFO:tasks.workunit.client.0.smithi026.stdout:6/64: rename d6/l7 to d6/d13/d15/l16 0 2024-04-23T10:17:42.194 INFO:tasks.workunit.client.0.smithi026.stdout:6/65: truncate d6/fe 468709 0 2024-04-23T10:17:42.194 INFO:tasks.workunit.client.0.smithi026.stdout:3/83: rmdir d0/d8/df/d17 39 2024-04-23T10:17:42.194 INFO:tasks.workunit.client.0.smithi026.stdout:6/66: chown f4 23808586 1 2024-04-23T10:17:42.197 INFO:tasks.workunit.client.0.smithi026.stdout:6/67: dread f0 [0,4194304] 0 2024-04-23T10:17:42.197 INFO:tasks.workunit.client.0.smithi026.stdout:1/7: fsync f2 0 2024-04-23T10:17:42.198 INFO:tasks.workunit.client.0.smithi026.stdout:3/84: truncate d0/d8/df/d17/f1d 750469 0 2024-04-23T10:17:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/8: read f1 [213303,110162] 0 2024-04-23T10:17:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/9: readlink - no filename 2024-04-23T10:17:42.199 INFO:tasks.workunit.client.0.smithi026.stdout:1/10: dread - f3 zero size 2024-04-23T10:17:42.204 INFO:tasks.workunit.client.0.smithi026.stdout:6/68: dread d6/fd [0,4194304] 0 2024-04-23T10:17:42.211 INFO:tasks.workunit.client.0.smithi026.stdout:3/85: dwrite d0/f13 [0,4194304] 0 2024-04-23T10:17:42.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/29: truncate f5 4606014 0 2024-04-23T10:17:42.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/30: write f7 [642577,100868] 0 2024-04-23T10:17:42.216 INFO:tasks.workunit.client.0.smithi026.stdout:9/31: chown f7 27001 1 2024-04-23T10:17:42.218 INFO:tasks.workunit.client.0.smithi026.stdout:3/86: mkdir d0/d1e 0 2024-04-23T10:17:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:1/11: dwrite f2 [0,4194304] 0 2024-04-23T10:17:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:9/32: symlink l9 0 2024-04-23T10:17:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:9/33: rmdir - no directory 2024-04-23T10:17:42.223 INFO:tasks.workunit.client.0.smithi026.stdout:6/69: dwrite d6/fe [0,4194304] 0 2024-04-23T10:17:42.227 INFO:tasks.workunit.client.0.smithi026.stdout:3/87: unlink d0/f15 0 2024-04-23T10:17:42.230 INFO:tasks.workunit.client.0.smithi026.stdout:9/34: dread f8 [0,4194304] 0 2024-04-23T10:17:42.232 INFO:tasks.workunit.client.0.smithi026.stdout:6/70: creat d6/d13/f17 x:0 0 0 2024-04-23T10:17:42.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/12: dread f1 [0,4194304] 0 2024-04-23T10:17:42.234 INFO:tasks.workunit.client.0.smithi026.stdout:1/13: write f2 [1033423,54980] 0 2024-04-23T10:17:42.237 INFO:tasks.workunit.client.0.smithi026.stdout:9/35: dread f7 [0,4194304] 0 2024-04-23T10:17:42.239 INFO:tasks.workunit.client.0.smithi026.stdout:3/88: mkdir d0/d8/df/d1f 0 2024-04-23T10:17:42.239 INFO:tasks.workunit.client.0.smithi026.stdout:6/71: symlink d6/d13/d15/l18 0 2024-04-23T10:17:42.240 INFO:tasks.workunit.client.0.smithi026.stdout:3/89: write d0/d8/df/f1b [673820,48958] 0 2024-04-23T10:17:42.241 INFO:tasks.workunit.client.0.smithi026.stdout:6/72: fsync d6/fd 0 2024-04-23T10:17:42.242 INFO:tasks.workunit.client.0.smithi026.stdout:3/90: creat d0/f20 x:0 0 0 2024-04-23T10:17:42.244 INFO:tasks.workunit.client.0.smithi026.stdout:1/14: link f1 f4 0 2024-04-23T10:17:42.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/15: dwrite f3 [0,4194304] 0 2024-04-23T10:17:42.260 INFO:tasks.workunit.client.0.smithi026.stdout:6/73: write f0 [124237,4174] 0 2024-04-23T10:17:42.261 INFO:tasks.workunit.client.0.smithi026.stdout:6/74: truncate f3 945751 0 2024-04-23T10:17:42.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/16: fsync f3 0 2024-04-23T10:17:42.282 INFO:tasks.workunit.client.0.smithi026.stdout:6/75: write d6/f10 [270668,99620] 0 2024-04-23T10:17:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/17: truncate f1 1951491 0 2024-04-23T10:17:42.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/18: read f3 [199011,3008] 0 2024-04-23T10:17:42.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/76: link f4 d6/f19 0 2024-04-23T10:17:42.296 INFO:tasks.workunit.client.0.smithi026.stdout:6/77: rename d6/d13/d15/l16 to d6/d13/l1a 0 2024-04-23T10:17:42.300 INFO:tasks.workunit.client.0.smithi026.stdout:1/19: truncate f4 285235 0 2024-04-23T10:17:42.308 INFO:tasks.workunit.client.0.smithi026.stdout:6/78: dwrite d6/fc [0,4194304] 0 2024-04-23T10:17:42.309 INFO:tasks.workunit.client.0.smithi026.stdout:6/79: write f2 [7542603,102924] 0 2024-04-23T10:17:42.310 INFO:tasks.workunit.client.0.smithi026.stdout:1/20: creat f5 x:0 0 0 2024-04-23T10:17:42.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/80: dwrite d6/d13/f17 [0,4194304] 0 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/5: sync 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/6: chown l0 454 1 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/7: truncate - no filename 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/8: dread - no filename 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/9: dwrite - no filename 2024-04-23T10:17:42.343 INFO:tasks.workunit.client.0.smithi026.stdout:4/10: dread - no filename 2024-04-23T10:17:42.346 INFO:tasks.workunit.client.0.smithi026.stdout:6/81: dread f4 [0,4194304] 0 2024-04-23T10:17:42.348 INFO:tasks.workunit.client.0.smithi026.stdout:4/11: creat f1 x:0 0 0 2024-04-23T10:17:42.349 INFO:tasks.workunit.client.0.smithi026.stdout:4/12: chown l0 12924 1 2024-04-23T10:17:42.349 INFO:tasks.workunit.client.0.smithi026.stdout:4/13: write f1 [317008,124292] 0 2024-04-23T10:17:42.492 INFO:tasks.workunit.client.0.smithi026.stdout:6/82: link d6/cb d6/d13/d15/c1b 0 2024-04-23T10:17:42.497 INFO:tasks.workunit.client.0.smithi026.stdout:6/83: creat d6/d13/d15/f1c x:0 0 0 2024-04-23T10:17:42.501 INFO:tasks.workunit.client.0.smithi026.stdout:6/84: dread d6/f19 [0,4194304] 0 2024-04-23T10:17:42.503 INFO:tasks.workunit.client.0.smithi026.stdout:6/85: chown d6/f12 3231 1 2024-04-23T10:17:42.504 INFO:tasks.workunit.client.0.smithi026.stdout:6/86: chown d6/f12 68 1 2024-04-23T10:17:42.505 INFO:tasks.workunit.client.0.smithi026.stdout:6/87: stat l1 0 2024-04-23T10:17:42.509 INFO:tasks.workunit.client.0.smithi026.stdout:6/88: unlink l1 0 2024-04-23T10:17:42.513 INFO:tasks.workunit.client.0.smithi026.stdout:6/89: creat d6/f1d x:0 0 0 2024-04-23T10:17:42.517 INFO:tasks.workunit.client.0.smithi026.stdout:6/90: mknod d6/c1e 0 2024-04-23T10:17:42.518 INFO:tasks.workunit.client.0.smithi026.stdout:6/91: chown d6/d13/d15 395178506 1 2024-04-23T10:17:42.522 INFO:tasks.workunit.client.0.smithi026.stdout:6/92: symlink d6/d13/d15/l1f 0 2024-04-23T10:17:42.584 INFO:tasks.workunit.client.0.smithi026.stdout:0/24: sync 2024-04-23T10:17:42.585 INFO:tasks.workunit.client.0.smithi026.stdout:0/25: dread - f4 zero size 2024-04-23T10:17:42.587 INFO:tasks.workunit.client.0.smithi026.stdout:0/26: dread f0 [0,4194304] 0 2024-04-23T10:17:42.591 INFO:tasks.workunit.client.0.smithi026.stdout:0/27: mkdir d7/da 0 2024-04-23T10:17:42.592 INFO:tasks.workunit.client.0.smithi026.stdout:0/28: chown f1 150894 1 2024-04-23T10:17:42.612 INFO:tasks.workunit.client.0.smithi026.stdout:0/29: dwrite f4 [0,4194304] 0 2024-04-23T10:17:42.613 INFO:tasks.workunit.client.0.smithi026.stdout:1/21: dread f1 [0,4194304] 0 2024-04-23T10:17:42.620 INFO:tasks.workunit.client.0.smithi026.stdout:5/11: sync 2024-04-23T10:17:42.620 INFO:tasks.workunit.client.0.smithi026.stdout:3/91: sync 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:2/12: sync 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:8/9: sync 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:9/36: sync 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:4/14: fsync f1 0 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:7/27: sync 2024-04-23T10:17:42.621 INFO:tasks.workunit.client.0.smithi026.stdout:6/93: sync 2024-04-23T10:17:42.623 INFO:tasks.workunit.client.0.smithi026.stdout:8/10: rename d5 to d5/d6 22 2024-04-23T10:17:42.627 INFO:tasks.workunit.client.0.smithi026.stdout:0/30: unlink c2 0 2024-04-23T10:17:42.627 INFO:tasks.workunit.client.0.smithi026.stdout:3/92: rename d0/d8 to d0/d8/df/d17/d21 22 2024-04-23T10:17:42.627 INFO:tasks.workunit.client.0.smithi026.stdout:7/28: mknod cb 0 2024-04-23T10:17:42.628 INFO:tasks.workunit.client.0.smithi026.stdout:8/11: write f2 [686341,124525] 0 2024-04-23T10:17:42.630 INFO:tasks.workunit.client.0.smithi026.stdout:5/12: truncate d0/f3 1008318 0 2024-04-23T10:17:42.632 INFO:tasks.workunit.client.0.smithi026.stdout:4/15: creat f2 x:0 0 0 2024-04-23T10:17:42.633 INFO:tasks.workunit.client.0.smithi026.stdout:4/16: chown f1 27954625 1 2024-04-23T10:17:42.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/22: dwrite f5 [0,4194304] 0 2024-04-23T10:17:42.635 INFO:tasks.workunit.client.0.smithi026.stdout:4/17: chown f2 1471 1 2024-04-23T10:17:42.635 INFO:tasks.workunit.client.0.smithi026.stdout:2/13: symlink d3/l5 0 2024-04-23T10:17:42.638 INFO:tasks.workunit.client.0.smithi026.stdout:6/94: symlink d6/d13/d15/l20 0 2024-04-23T10:17:42.639 INFO:tasks.workunit.client.0.smithi026.stdout:1/23: dread f2 [0,4194304] 0 2024-04-23T10:17:42.642 INFO:tasks.workunit.client.0.smithi026.stdout:0/31: mknod d7/cb 0 2024-04-23T10:17:42.642 INFO:tasks.workunit.client.0.smithi026.stdout:1/24: chown f5 99207459 1 2024-04-23T10:17:42.645 INFO:tasks.workunit.client.0.smithi026.stdout:7/29: dwrite f4 [0,4194304] 0 2024-04-23T10:17:42.646 INFO:tasks.workunit.client.0.smithi026.stdout:5/13: dwrite d0/f3 [0,4194304] 0 2024-04-23T10:17:42.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/14: chown d0/f3 1250 1 2024-04-23T10:17:42.649 INFO:tasks.workunit.client.0.smithi026.stdout:1/25: dread f3 [0,4194304] 0 2024-04-23T10:17:42.653 INFO:tasks.workunit.client.0.smithi026.stdout:1/26: dread f5 [0,4194304] 0 2024-04-23T10:17:42.654 INFO:tasks.workunit.client.0.smithi026.stdout:1/27: chown f3 13672762 1 2024-04-23T10:17:42.659 INFO:tasks.workunit.client.0.smithi026.stdout:4/18: rename f1 to f3 0 2024-04-23T10:17:42.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/14: creat d3/f6 x:0 0 0 2024-04-23T10:17:42.666 INFO:tasks.workunit.client.0.smithi026.stdout:6/95: mkdir d6/d21 0 2024-04-23T10:17:42.670 INFO:tasks.workunit.client.0.smithi026.stdout:3/93: symlink d0/d1e/l22 0 2024-04-23T10:17:42.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/12: creat d5/f7 x:0 0 0 2024-04-23T10:17:42.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/32: creat d7/d8/fc x:0 0 0 2024-04-23T10:17:42.677 INFO:tasks.workunit.client.0.smithi026.stdout:7/30: symlink lc 0 2024-04-23T10:17:42.679 INFO:tasks.workunit.client.0.smithi026.stdout:5/15: fsync d0/f2 0 2024-04-23T10:17:42.682 INFO:tasks.workunit.client.0.smithi026.stdout:9/37: link l0 la 0 2024-04-23T10:17:42.684 INFO:tasks.workunit.client.0.smithi026.stdout:1/28: symlink l6 0 2024-04-23T10:17:42.685 INFO:tasks.workunit.client.0.smithi026.stdout:7/31: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:42.686 INFO:tasks.workunit.client.0.smithi026.stdout:2/15: unlink d3/l5 0 2024-04-23T10:17:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:2/16: truncate d3/f6 715563 0 2024-04-23T10:17:42.687 INFO:tasks.workunit.client.0.smithi026.stdout:2/17: readlink - no filename 2024-04-23T10:17:42.689 INFO:tasks.workunit.client.0.smithi026.stdout:3/94: stat d0/d8/ld 0 2024-04-23T10:17:42.690 INFO:tasks.workunit.client.0.smithi026.stdout:8/13: rmdir d5 39 2024-04-23T10:17:42.694 INFO:tasks.workunit.client.0.smithi026.stdout:5/16: mknod d0/c4 0 2024-04-23T10:17:42.696 INFO:tasks.workunit.client.0.smithi026.stdout:9/38: mknod cb 0 2024-04-23T10:17:42.698 INFO:tasks.workunit.client.0.smithi026.stdout:1/29: creat f7 x:0 0 0 2024-04-23T10:17:42.699 INFO:tasks.workunit.client.0.smithi026.stdout:1/30: dread f4 [0,4194304] 0 2024-04-23T10:17:42.699 INFO:tasks.workunit.client.0.smithi026.stdout:7/32: mkdir dd 0 2024-04-23T10:17:42.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/31: fsync f3 0 2024-04-23T10:17:42.701 INFO:tasks.workunit.client.0.smithi026.stdout:2/18: mknod d3/c7 0 2024-04-23T10:17:42.702 INFO:tasks.workunit.client.0.smithi026.stdout:3/95: mkdir d0/d1e/d23 0 2024-04-23T10:17:42.703 INFO:tasks.workunit.client.0.smithi026.stdout:3/96: truncate d0/f14 682332 0 2024-04-23T10:17:42.704 INFO:tasks.workunit.client.0.smithi026.stdout:8/14: chown d5 734 1 2024-04-23T10:17:42.704 INFO:tasks.workunit.client.0.smithi026.stdout:8/15: dread - f4 zero size 2024-04-23T10:17:42.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/33: symlink d7/da/ld 0 2024-04-23T10:17:42.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/17: mknod d0/c5 0 2024-04-23T10:17:42.709 INFO:tasks.workunit.client.0.smithi026.stdout:9/39: creat fc x:0 0 0 2024-04-23T10:17:42.709 INFO:tasks.workunit.client.0.smithi026.stdout:9/40: chown f7 1555 1 2024-04-23T10:17:42.710 INFO:tasks.workunit.client.0.smithi026.stdout:1/32: creat f8 x:0 0 0 2024-04-23T10:17:42.712 INFO:tasks.workunit.client.0.smithi026.stdout:2/19: rename d3/f4 to d3/f8 0 2024-04-23T10:17:42.712 INFO:tasks.workunit.client.0.smithi026.stdout:2/20: chown d3 56 1 2024-04-23T10:17:42.714 INFO:tasks.workunit.client.0.smithi026.stdout:0/34: unlink d7/da/ld 0 2024-04-23T10:17:42.715 INFO:tasks.workunit.client.0.smithi026.stdout:7/33: creat dd/fe x:0 0 0 2024-04-23T10:17:42.716 INFO:tasks.workunit.client.0.smithi026.stdout:7/34: stat dd 0 2024-04-23T10:17:42.717 INFO:tasks.workunit.client.0.smithi026.stdout:3/97: mknod d0/d8/df/d1f/c24 0 2024-04-23T10:17:42.718 INFO:tasks.workunit.client.0.smithi026.stdout:0/35: rmdir d7 39 2024-04-23T10:17:42.718 INFO:tasks.workunit.client.0.smithi026.stdout:7/35: truncate dd/fe 633257 0 2024-04-23T10:17:42.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/33: dwrite f3 [0,4194304] 0 2024-04-23T10:17:42.720 INFO:tasks.workunit.client.0.smithi026.stdout:5/18: link d0/f2 d0/f6 0 2024-04-23T10:17:42.720 INFO:tasks.workunit.client.0.smithi026.stdout:9/41: truncate f5 5264388 0 2024-04-23T10:17:42.723 INFO:tasks.workunit.client.0.smithi026.stdout:1/34: creat f9 x:0 0 0 2024-04-23T10:17:42.726 INFO:tasks.workunit.client.0.smithi026.stdout:1/35: write f7 [663933,127339] 0 2024-04-23T10:17:42.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/98: rename d0/f14 to d0/d8/df/f25 0 2024-04-23T10:17:42.731 INFO:tasks.workunit.client.0.smithi026.stdout:1/36: mknod ca 0 2024-04-23T10:17:42.733 INFO:tasks.workunit.client.0.smithi026.stdout:3/99: chown d0/f6 1677 1 2024-04-23T10:17:42.737 INFO:tasks.workunit.client.0.smithi026.stdout:7/36: dwrite dd/fe [0,4194304] 0 2024-04-23T10:17:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:0/36: dwrite d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:42.742 INFO:tasks.workunit.client.0.smithi026.stdout:7/37: dread f7 [0,4194304] 0 2024-04-23T10:17:42.748 INFO:tasks.workunit.client.0.smithi026.stdout:3/100: mknod d0/d8/df/c26 0 2024-04-23T10:17:42.749 INFO:tasks.workunit.client.0.smithi026.stdout:9/42: fsync fc 0 2024-04-23T10:17:42.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/37: write f6 [473860,50870] 0 2024-04-23T10:17:42.752 INFO:tasks.workunit.client.0.smithi026.stdout:2/21: getdents d3 0 2024-04-23T10:17:42.754 INFO:tasks.workunit.client.0.smithi026.stdout:6/96: dwrite d6/f19 [0,4194304] 0 2024-04-23T10:17:42.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/43: symlink ld 0 2024-04-23T10:17:42.758 INFO:tasks.workunit.client.0.smithi026.stdout:9/44: dread - fc zero size 2024-04-23T10:17:42.760 INFO:tasks.workunit.client.0.smithi026.stdout:2/22: mknod d3/c9 0 2024-04-23T10:17:42.760 INFO:tasks.workunit.client.0.smithi026.stdout:2/23: fdatasync d3/f6 0 2024-04-23T10:17:42.768 INFO:tasks.workunit.client.0.smithi026.stdout:1/37: getdents . 0 2024-04-23T10:17:42.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/45: rename l4 to le 0 2024-04-23T10:17:42.769 INFO:tasks.workunit.client.0.smithi026.stdout:5/19: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:17:42.774 INFO:tasks.workunit.client.0.smithi026.stdout:6/97: link f2 d6/d21/f22 0 2024-04-23T10:17:42.774 INFO:tasks.workunit.client.0.smithi026.stdout:1/38: creat fb x:0 0 0 2024-04-23T10:17:42.778 INFO:tasks.workunit.client.0.smithi026.stdout:1/39: chown ca 1496 1 2024-04-23T10:17:42.778 INFO:tasks.workunit.client.0.smithi026.stdout:9/46: dread f8 [0,4194304] 0 2024-04-23T10:17:42.779 INFO:tasks.workunit.client.0.smithi026.stdout:0/38: dread f6 [0,4194304] 0 2024-04-23T10:17:42.781 INFO:tasks.workunit.client.0.smithi026.stdout:6/98: creat d6/d21/f23 x:0 0 0 2024-04-23T10:17:42.781 INFO:tasks.workunit.client.0.smithi026.stdout:9/47: dread - fc zero size 2024-04-23T10:17:42.784 INFO:tasks.workunit.client.0.smithi026.stdout:0/39: truncate f6 571830 0 2024-04-23T10:17:42.788 INFO:tasks.workunit.client.0.smithi026.stdout:7/38: dwrite dd/fe [4194304,4194304] 0 2024-04-23T10:17:42.788 INFO:tasks.workunit.client.0.smithi026.stdout:1/40: truncate f4 273586 0 2024-04-23T10:17:42.790 INFO:tasks.workunit.client.0.smithi026.stdout:7/39: stat l9 0 2024-04-23T10:17:42.791 INFO:tasks.workunit.client.0.smithi026.stdout:9/48: dread f8 [0,4194304] 0 2024-04-23T10:17:42.793 INFO:tasks.workunit.client.0.smithi026.stdout:5/20: dread d0/f2 [0,4194304] 0 2024-04-23T10:17:42.794 INFO:tasks.workunit.client.0.smithi026.stdout:4/19: sync 2024-04-23T10:17:42.795 INFO:tasks.workunit.client.0.smithi026.stdout:2/24: dwrite d3/f8 [0,4194304] 0 2024-04-23T10:17:42.800 INFO:tasks.workunit.client.0.smithi026.stdout:0/40: link f6 d7/d8/fe 0 2024-04-23T10:17:42.806 INFO:tasks.workunit.client.0.smithi026.stdout:7/40: creat dd/ff x:0 0 0 2024-04-23T10:17:42.807 INFO:tasks.workunit.client.0.smithi026.stdout:3/101: dwrite d0/fc [0,4194304] 0 2024-04-23T10:17:42.808 INFO:tasks.workunit.client.0.smithi026.stdout:5/21: symlink d0/l7 0 2024-04-23T10:17:42.808 INFO:tasks.workunit.client.0.smithi026.stdout:6/99: dwrite d6/f12 [4194304,4194304] 0 2024-04-23T10:17:42.811 INFO:tasks.workunit.client.0.smithi026.stdout:0/41: mknod d7/cf 0 2024-04-23T10:17:42.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/25: creat d3/fa x:0 0 0 2024-04-23T10:17:42.811 INFO:tasks.workunit.client.0.smithi026.stdout:3/102: chown d0/f4 45195611 1 2024-04-23T10:17:42.811 INFO:tasks.workunit.client.0.smithi026.stdout:5/22: truncate d0/f3 4264537 0 2024-04-23T10:17:42.812 INFO:tasks.workunit.client.0.smithi026.stdout:8/16: sync 2024-04-23T10:17:42.812 INFO:tasks.workunit.client.0.smithi026.stdout:7/41: rename f7 to dd/f10 0 2024-04-23T10:17:42.812 INFO:tasks.workunit.client.0.smithi026.stdout:0/42: stat d7/cf 0 2024-04-23T10:17:42.813 INFO:tasks.workunit.client.0.smithi026.stdout:6/100: symlink d6/d13/d15/l24 0 2024-04-23T10:17:42.817 INFO:tasks.workunit.client.0.smithi026.stdout:9/49: getdents . 0 2024-04-23T10:17:42.817 INFO:tasks.workunit.client.0.smithi026.stdout:6/101: rename d6/d13 to d6/d13/d15/d25 22 2024-04-23T10:17:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:9/50: write fc [124015,114648] 0 2024-04-23T10:17:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:4/20: dread f3 [0,4194304] 0 2024-04-23T10:17:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:1/41: dread f4 [0,4194304] 0 2024-04-23T10:17:42.820 INFO:tasks.workunit.client.0.smithi026.stdout:9/51: stat f6 0 2024-04-23T10:17:42.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/102: fsync d6/fe 0 2024-04-23T10:17:42.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/103: fdatasync f4 0 2024-04-23T10:17:42.822 INFO:tasks.workunit.client.0.smithi026.stdout:9/52: chown le 24723 1 2024-04-23T10:17:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:6/104: write d6/fe [811367,88630] 0 2024-04-23T10:17:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:6/105: stat f4 0 2024-04-23T10:17:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:6/106: fdatasync f3 0 2024-04-23T10:17:42.823 INFO:tasks.workunit.client.0.smithi026.stdout:2/26: mknod d3/cb 0 2024-04-23T10:17:42.824 INFO:tasks.workunit.client.0.smithi026.stdout:5/23: unlink d0/f6 0 2024-04-23T10:17:42.824 INFO:tasks.workunit.client.0.smithi026.stdout:8/17: mknod d5/c8 0 2024-04-23T10:17:42.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/43: rmdir d7 39 2024-04-23T10:17:42.825 INFO:tasks.workunit.client.0.smithi026.stdout:3/103: symlink d0/d1e/l27 0 2024-04-23T10:17:42.825 INFO:tasks.workunit.client.0.smithi026.stdout:5/24: readlink d0/l7 0 2024-04-23T10:17:42.825 INFO:tasks.workunit.client.0.smithi026.stdout:8/18: fsync f2 0 2024-04-23T10:17:42.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/21: fsync f3 0 2024-04-23T10:17:42.827 INFO:tasks.workunit.client.0.smithi026.stdout:4/22: dread f3 [0,4194304] 0 2024-04-23T10:17:42.828 INFO:tasks.workunit.client.0.smithi026.stdout:1/42: rename f8 to fc 0 2024-04-23T10:17:42.829 INFO:tasks.workunit.client.0.smithi026.stdout:3/104: dread d0/d8/df/f25 [0,4194304] 0 2024-04-23T10:17:42.830 INFO:tasks.workunit.client.0.smithi026.stdout:9/53: write f7 [884585,102541] 0 2024-04-23T10:17:42.830 INFO:tasks.workunit.client.0.smithi026.stdout:4/23: write f3 [1194580,83144] 0 2024-04-23T10:17:42.831 INFO:tasks.workunit.client.0.smithi026.stdout:2/27: creat d3/fc x:0 0 0 2024-04-23T10:17:42.832 INFO:tasks.workunit.client.0.smithi026.stdout:1/43: write f9 [590171,91684] 0 2024-04-23T10:17:42.833 INFO:tasks.workunit.client.0.smithi026.stdout:5/25: creat d0/f8 x:0 0 0 2024-04-23T10:17:42.833 INFO:tasks.workunit.client.0.smithi026.stdout:3/105: readlink d0/d8/lb 0 2024-04-23T10:17:42.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/24: mkdir d4 0 2024-04-23T10:17:42.841 INFO:tasks.workunit.client.0.smithi026.stdout:5/26: write d0/f2 [4051124,6074] 0 2024-04-23T10:17:42.843 INFO:tasks.workunit.client.0.smithi026.stdout:0/44: getdents d7 0 2024-04-23T10:17:42.844 INFO:tasks.workunit.client.0.smithi026.stdout:8/19: dwrite f4 [0,4194304] 0 2024-04-23T10:17:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:5/27: creat d0/f9 x:0 0 0 2024-04-23T10:17:42.846 INFO:tasks.workunit.client.0.smithi026.stdout:5/28: stat d0/l7 0 2024-04-23T10:17:42.849 INFO:tasks.workunit.client.0.smithi026.stdout:5/29: symlink d0/la 0 2024-04-23T10:17:42.849 INFO:tasks.workunit.client.0.smithi026.stdout:5/30: fdatasync d0/f9 0 2024-04-23T10:17:42.850 INFO:tasks.workunit.client.0.smithi026.stdout:8/20: dread f4 [0,4194304] 0 2024-04-23T10:17:42.850 INFO:tasks.workunit.client.0.smithi026.stdout:5/31: dread - d0/f8 zero size 2024-04-23T10:17:42.853 INFO:tasks.workunit.client.0.smithi026.stdout:8/21: getdents d5 0 2024-04-23T10:17:42.856 INFO:tasks.workunit.client.0.smithi026.stdout:4/25: dread - f2 zero size 2024-04-23T10:17:42.857 INFO:tasks.workunit.client.0.smithi026.stdout:4/26: readlink l0 0 2024-04-23T10:17:42.857 INFO:tasks.workunit.client.0.smithi026.stdout:7/42: read dd/fe [4449461,52017] 0 2024-04-23T10:17:42.858 INFO:tasks.workunit.client.0.smithi026.stdout:0/45: creat d7/da/f10 x:0 0 0 2024-04-23T10:17:42.858 INFO:tasks.workunit.client.0.smithi026.stdout:4/27: readlink l0 0 2024-04-23T10:17:42.858 INFO:tasks.workunit.client.0.smithi026.stdout:6/107: rename d6/cb to d6/d21/c26 0 2024-04-23T10:17:42.859 INFO:tasks.workunit.client.0.smithi026.stdout:7/43: fsync f6 0 2024-04-23T10:17:42.862 INFO:tasks.workunit.client.0.smithi026.stdout:6/108: write d6/f19 [2335353,60654] 0 2024-04-23T10:17:42.863 INFO:tasks.workunit.client.0.smithi026.stdout:0/46: rename f3 to d7/da/f11 0 2024-04-23T10:17:42.865 INFO:tasks.workunit.client.0.smithi026.stdout:4/28: creat d4/f5 x:0 0 0 2024-04-23T10:17:42.869 INFO:tasks.workunit.client.0.smithi026.stdout:7/44: creat dd/f11 x:0 0 0 2024-04-23T10:17:42.872 INFO:tasks.workunit.client.0.smithi026.stdout:0/47: dread f0 [0,4194304] 0 2024-04-23T10:17:42.873 INFO:tasks.workunit.client.0.smithi026.stdout:2/28: getdents d3 0 2024-04-23T10:17:42.873 INFO:tasks.workunit.client.0.smithi026.stdout:1/44: dread f3 [0,4194304] 0 2024-04-23T10:17:42.876 INFO:tasks.workunit.client.0.smithi026.stdout:4/29: symlink d4/l6 0 2024-04-23T10:17:42.877 INFO:tasks.workunit.client.0.smithi026.stdout:7/45: symlink dd/l12 0 2024-04-23T10:17:42.877 INFO:tasks.workunit.client.0.smithi026.stdout:2/29: write d3/f6 [627451,105] 0 2024-04-23T10:17:42.878 INFO:tasks.workunit.client.0.smithi026.stdout:8/22: write f4 [4358477,15819] 0 2024-04-23T10:17:42.879 INFO:tasks.workunit.client.0.smithi026.stdout:3/106: dwrite d0/f20 [0,4194304] 0 2024-04-23T10:17:42.880 INFO:tasks.workunit.client.0.smithi026.stdout:1/45: fdatasync fc 0 2024-04-23T10:17:42.883 INFO:tasks.workunit.client.0.smithi026.stdout:2/30: mkdir d3/dd 0 2024-04-23T10:17:42.883 INFO:tasks.workunit.client.0.smithi026.stdout:4/30: fdatasync f3 0 2024-04-23T10:17:42.883 INFO:tasks.workunit.client.0.smithi026.stdout:1/46: mkdir dd 0 2024-04-23T10:17:42.884 INFO:tasks.workunit.client.0.smithi026.stdout:9/54: dwrite f7 [0,4194304] 0 2024-04-23T10:17:42.884 INFO:tasks.workunit.client.0.smithi026.stdout:8/23: chown l0 1792483 1 2024-04-23T10:17:42.886 INFO:tasks.workunit.client.0.smithi026.stdout:4/31: chown d4 25355 1 2024-04-23T10:17:42.888 INFO:tasks.workunit.client.0.smithi026.stdout:6/109: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:42.890 INFO:tasks.workunit.client.0.smithi026.stdout:2/31: mknod d3/ce 0 2024-04-23T10:17:42.899 INFO:tasks.workunit.client.0.smithi026.stdout:6/110: chown d6/f12 764 1 2024-04-23T10:17:42.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/55: rename fc to ff 0 2024-04-23T10:17:42.900 INFO:tasks.workunit.client.0.smithi026.stdout:4/32: dread f3 [0,4194304] 0 2024-04-23T10:17:42.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/46: dread f4 [4194304,4194304] 0 2024-04-23T10:17:42.901 INFO:tasks.workunit.client.0.smithi026.stdout:3/107: symlink d0/d8/df/l28 0 2024-04-23T10:17:42.902 INFO:tasks.workunit.client.0.smithi026.stdout:1/47: creat dd/fe x:0 0 0 2024-04-23T10:17:42.903 INFO:tasks.workunit.client.0.smithi026.stdout:9/56: mknod c10 0 2024-04-23T10:17:42.903 INFO:tasks.workunit.client.0.smithi026.stdout:8/24: getdents d5 0 2024-04-23T10:17:42.904 INFO:tasks.workunit.client.0.smithi026.stdout:8/25: fsync f2 0 2024-04-23T10:17:42.905 INFO:tasks.workunit.client.0.smithi026.stdout:0/48: dwrite f0 [0,4194304] 0 2024-04-23T10:17:42.905 INFO:tasks.workunit.client.0.smithi026.stdout:6/111: rename f2 to d6/d13/d15/f27 0 2024-04-23T10:17:42.907 INFO:tasks.workunit.client.0.smithi026.stdout:1/48: mknod dd/cf 0 2024-04-23T10:17:42.907 INFO:tasks.workunit.client.0.smithi026.stdout:0/49: chown d7/da 1019 1 2024-04-23T10:17:42.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/112: symlink d6/d13/l28 0 2024-04-23T10:17:42.909 INFO:tasks.workunit.client.0.smithi026.stdout:8/26: write f4 [408165,35598] 0 2024-04-23T10:17:42.910 INFO:tasks.workunit.client.0.smithi026.stdout:7/47: rename f4 to dd/f13 0 2024-04-23T10:17:42.912 INFO:tasks.workunit.client.0.smithi026.stdout:0/50: rmdir d7/da 39 2024-04-23T10:17:42.914 INFO:tasks.workunit.client.0.smithi026.stdout:1/49: mknod dd/c10 0 2024-04-23T10:17:42.917 INFO:tasks.workunit.client.0.smithi026.stdout:9/57: dread f7 [0,4194304] 0 2024-04-23T10:17:42.919 INFO:tasks.workunit.client.0.smithi026.stdout:0/51: symlink d7/d8/l12 0 2024-04-23T10:17:42.919 INFO:tasks.workunit.client.0.smithi026.stdout:7/48: write dd/f10 [855065,72564] 0 2024-04-23T10:17:42.920 INFO:tasks.workunit.client.0.smithi026.stdout:5/32: truncate d0/f3 1848900 0 2024-04-23T10:17:42.921 INFO:tasks.workunit.client.0.smithi026.stdout:7/49: stat lc 0 2024-04-23T10:17:42.923 INFO:tasks.workunit.client.0.smithi026.stdout:4/33: dwrite f3 [0,4194304] 0 2024-04-23T10:17:42.925 INFO:tasks.workunit.client.0.smithi026.stdout:9/58: symlink l11 0 2024-04-23T10:17:42.925 INFO:tasks.workunit.client.0.smithi026.stdout:8/27: getdents d5 0 2024-04-23T10:17:42.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/33: mknod d0/cb 0 2024-04-23T10:17:42.926 INFO:tasks.workunit.client.0.smithi026.stdout:4/34: mkdir d4/d7 0 2024-04-23T10:17:42.928 INFO:tasks.workunit.client.0.smithi026.stdout:0/52: mknod d7/c13 0 2024-04-23T10:17:42.933 INFO:tasks.workunit.client.0.smithi026.stdout:4/35: write d4/f5 [155776,26405] 0 2024-04-23T10:17:42.936 INFO:tasks.workunit.client.0.smithi026.stdout:0/53: stat d7/da 0 2024-04-23T10:17:42.940 INFO:tasks.workunit.client.0.smithi026.stdout:6/113: dwrite d6/f19 [0,4194304] 0 2024-04-23T10:17:42.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/36: stat d4/d7 0 2024-04-23T10:17:42.944 INFO:tasks.workunit.client.0.smithi026.stdout:6/114: stat d6/l11 0 2024-04-23T10:17:42.944 INFO:tasks.workunit.client.0.smithi026.stdout:3/108: dwrite d0/f20 [4194304,4194304] 0 2024-04-23T10:17:42.953 INFO:tasks.workunit.client.0.smithi026.stdout:7/50: dwrite dd/f11 [0,4194304] 0 2024-04-23T10:17:42.961 INFO:tasks.workunit.client.0.smithi026.stdout:6/115: chown d6/d13/l1a 111302238 1 2024-04-23T10:17:42.963 INFO:tasks.workunit.client.0.smithi026.stdout:9/59: dwrite f8 [0,4194304] 0 2024-04-23T10:17:42.964 INFO:tasks.workunit.client.0.smithi026.stdout:8/28: dwrite f2 [0,4194304] 0 2024-04-23T10:17:42.967 INFO:tasks.workunit.client.0.smithi026.stdout:6/116: chown f3 1493 1 2024-04-23T10:17:42.971 INFO:tasks.workunit.client.0.smithi026.stdout:5/34: getdents d0 0 2024-04-23T10:17:42.972 INFO:tasks.workunit.client.0.smithi026.stdout:3/109: mkdir d0/d8/d29 0 2024-04-23T10:17:42.974 INFO:tasks.workunit.client.0.smithi026.stdout:4/37: dwrite d4/f5 [0,4194304] 0 2024-04-23T10:17:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:0/54: creat d7/f14 x:0 0 0 2024-04-23T10:17:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:6/117: mkdir d6/d13/d29 0 2024-04-23T10:17:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:9/60: chown l0 2981246 1 2024-04-23T10:17:42.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/29: dread f2 [0,4194304] 0 2024-04-23T10:17:42.987 INFO:tasks.workunit.client.0.smithi026.stdout:4/38: creat d4/d7/f8 x:0 0 0 2024-04-23T10:17:42.987 INFO:tasks.workunit.client.0.smithi026.stdout:3/110: symlink d0/d8/l2a 0 2024-04-23T10:17:42.989 INFO:tasks.workunit.client.0.smithi026.stdout:5/35: dwrite d0/f2 [0,4194304] 0 2024-04-23T10:17:42.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/39: unlink f2 0 2024-04-23T10:17:42.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/51: dwrite dd/f13 [4194304,4194304] 0 2024-04-23T10:17:42.993 INFO:tasks.workunit.client.0.smithi026.stdout:9/61: dread f7 [0,4194304] 0 2024-04-23T10:17:42.994 INFO:tasks.workunit.client.0.smithi026.stdout:6/118: getdents d6/d13/d29 0 2024-04-23T10:17:42.998 INFO:tasks.workunit.client.0.smithi026.stdout:3/111: symlink d0/d8/df/d1f/l2b 0 2024-04-23T10:17:43.001 INFO:tasks.workunit.client.0.smithi026.stdout:7/52: mkdir dd/d14 0 2024-04-23T10:17:43.006 INFO:tasks.workunit.client.0.smithi026.stdout:4/40: rmdir d4/d7 39 2024-04-23T10:17:43.011 INFO:tasks.workunit.client.0.smithi026.stdout:9/62: symlink l12 0 2024-04-23T10:17:43.012 INFO:tasks.workunit.client.0.smithi026.stdout:6/119: symlink d6/l2a 0 2024-04-23T10:17:43.012 INFO:tasks.workunit.client.0.smithi026.stdout:9/63: stat ld 0 2024-04-23T10:17:43.012 INFO:tasks.workunit.client.0.smithi026.stdout:5/36: dwrite d0/f9 [0,4194304] 0 2024-04-23T10:17:43.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/112: mkdir d0/d8/df/d1f/d2c 0 2024-04-23T10:17:43.020 INFO:tasks.workunit.client.0.smithi026.stdout:5/37: chown d0/c5 25017 1 2024-04-23T10:17:43.022 INFO:tasks.workunit.client.0.smithi026.stdout:9/64: mkdir d13 0 2024-04-23T10:17:43.023 INFO:tasks.workunit.client.0.smithi026.stdout:8/30: dwrite f2 [4194304,4194304] 0 2024-04-23T10:17:43.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/55: dwrite d7/d8/fe [0,4194304] 0 2024-04-23T10:17:43.023 INFO:tasks.workunit.client.0.smithi026.stdout:5/38: chown d0/f8 91001425 1 2024-04-23T10:17:43.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/120: write d6/d21/f22 [8985079,68431] 0 2024-04-23T10:17:43.027 INFO:tasks.workunit.client.0.smithi026.stdout:7/53: rmdir dd/d14 0 2024-04-23T10:17:43.029 INFO:tasks.workunit.client.0.smithi026.stdout:4/41: dwrite d4/f5 [0,4194304] 0 2024-04-23T10:17:43.032 INFO:tasks.workunit.client.0.smithi026.stdout:8/31: mkdir d5/d9 0 2024-04-23T10:17:43.039 INFO:tasks.workunit.client.0.smithi026.stdout:5/39: mknod d0/cc 0 2024-04-23T10:17:43.039 INFO:tasks.workunit.client.0.smithi026.stdout:6/121: mknod d6/d21/c2b 0 2024-04-23T10:17:43.039 INFO:tasks.workunit.client.0.smithi026.stdout:7/54: symlink dd/l15 0 2024-04-23T10:17:43.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/65: creat d13/f14 x:0 0 0 2024-04-23T10:17:43.042 INFO:tasks.workunit.client.0.smithi026.stdout:5/40: symlink d0/ld 0 2024-04-23T10:17:43.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/55: creat dd/f16 x:0 0 0 2024-04-23T10:17:43.044 INFO:tasks.workunit.client.0.smithi026.stdout:9/66: symlink d13/l15 0 2024-04-23T10:17:43.044 INFO:tasks.workunit.client.0.smithi026.stdout:3/113: link d0/d8/fa d0/d8/f2d 0 2024-04-23T10:17:43.049 INFO:tasks.workunit.client.0.smithi026.stdout:0/56: link d7/da/f10 d7/da/f15 0 2024-04-23T10:17:43.050 INFO:tasks.workunit.client.0.smithi026.stdout:6/122: rename d6/d21/f22 to d6/d13/d29/f2c 0 2024-04-23T10:17:43.051 INFO:tasks.workunit.client.0.smithi026.stdout:5/41: read d0/f3 [1412572,130221] 0 2024-04-23T10:17:43.052 INFO:tasks.workunit.client.0.smithi026.stdout:7/56: mknod dd/c17 0 2024-04-23T10:17:43.052 INFO:tasks.workunit.client.0.smithi026.stdout:4/42: link f3 d4/d7/f9 0 2024-04-23T10:17:43.054 INFO:tasks.workunit.client.0.smithi026.stdout:8/32: truncate f2 6051575 0 2024-04-23T10:17:43.054 INFO:tasks.workunit.client.0.smithi026.stdout:6/123: creat d6/d13/d29/f2d x:0 0 0 2024-04-23T10:17:43.055 INFO:tasks.workunit.client.0.smithi026.stdout:7/57: unlink c3 0 2024-04-23T10:17:43.057 INFO:tasks.workunit.client.0.smithi026.stdout:9/67: dread f8 [0,4194304] 0 2024-04-23T10:17:43.058 INFO:tasks.workunit.client.0.smithi026.stdout:3/114: mknod d0/d8/df/d1f/d2c/c2e 0 2024-04-23T10:17:43.062 INFO:tasks.workunit.client.0.smithi026.stdout:0/57: dwrite f4 [0,4194304] 0 2024-04-23T10:17:43.062 INFO:tasks.workunit.client.0.smithi026.stdout:3/115: chown d0/d8/df/d1f/d2c 229 1 2024-04-23T10:17:43.067 INFO:tasks.workunit.client.0.smithi026.stdout:6/124: rename d6/d13/d15/f27 to d6/d13/d15/f2e 0 2024-04-23T10:17:43.070 INFO:tasks.workunit.client.0.smithi026.stdout:4/43: dread f3 [0,4194304] 0 2024-04-23T10:17:43.072 INFO:tasks.workunit.client.0.smithi026.stdout:5/42: dwrite d0/f8 [0,4194304] 0 2024-04-23T10:17:43.072 INFO:tasks.workunit.client.0.smithi026.stdout:3/116: chown d0/d8/df/f1a 827 1 2024-04-23T10:17:43.075 INFO:tasks.workunit.client.0.smithi026.stdout:6/125: mkdir d6/d21/d2f 0 2024-04-23T10:17:43.075 INFO:tasks.workunit.client.0.smithi026.stdout:3/117: read d0/fc [3372021,24498] 0 2024-04-23T10:17:43.078 INFO:tasks.workunit.client.0.smithi026.stdout:3/118: readlink d0/d8/l12 0 2024-04-23T10:17:43.078 INFO:tasks.workunit.client.0.smithi026.stdout:7/58: dwrite dd/f10 [0,4194304] 0 2024-04-23T10:17:43.079 INFO:tasks.workunit.client.0.smithi026.stdout:8/33: dread f2 [0,4194304] 0 2024-04-23T10:17:43.079 INFO:tasks.workunit.client.0.smithi026.stdout:3/119: fsync d0/d8/df/f1b 0 2024-04-23T10:17:43.079 INFO:tasks.workunit.client.0.smithi026.stdout:0/58: dread d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:43.080 INFO:tasks.workunit.client.0.smithi026.stdout:3/120: readlink d0/d8/l12 0 2024-04-23T10:17:43.080 INFO:tasks.workunit.client.0.smithi026.stdout:9/68: getdents d13 0 2024-04-23T10:17:43.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/121: readlink d0/d8/ld 0 2024-04-23T10:17:43.082 INFO:tasks.workunit.client.0.smithi026.stdout:5/43: creat d0/fe x:0 0 0 2024-04-23T10:17:43.082 INFO:tasks.workunit.client.0.smithi026.stdout:6/126: mknod d6/d13/c30 0 2024-04-23T10:17:43.083 INFO:tasks.workunit.client.0.smithi026.stdout:5/44: chown d0 133004 1 2024-04-23T10:17:43.084 INFO:tasks.workunit.client.0.smithi026.stdout:8/34: rename d5/f7 to d5/d9/fa 0 2024-04-23T10:17:43.086 INFO:tasks.workunit.client.0.smithi026.stdout:0/59: creat d7/d8/f16 x:0 0 0 2024-04-23T10:17:43.090 INFO:tasks.workunit.client.0.smithi026.stdout:3/122: rename d0/d8/df/c26 to d0/c2f 0 2024-04-23T10:17:43.092 INFO:tasks.workunit.client.0.smithi026.stdout:0/60: mkdir d7/da/d17 0 2024-04-23T10:17:43.092 INFO:tasks.workunit.client.0.smithi026.stdout:9/69: dwrite f6 [0,4194304] 0 2024-04-23T10:17:43.100 INFO:tasks.workunit.client.0.smithi026.stdout:3/123: unlink d0/d1e/l27 0 2024-04-23T10:17:43.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/127: dread d6/f10 [0,4194304] 0 2024-04-23T10:17:43.100 INFO:tasks.workunit.client.0.smithi026.stdout:9/70: dread f8 [0,4194304] 0 2024-04-23T10:17:43.100 INFO:tasks.workunit.client.0.smithi026.stdout:5/45: truncate d0/f8 2486699 0 2024-04-23T10:17:43.100 INFO:tasks.workunit.client.0.smithi026.stdout:0/61: fsync d7/da/f10 0 2024-04-23T10:17:43.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/124: mkdir d0/d1e/d30 0 2024-04-23T10:17:43.102 INFO:tasks.workunit.client.0.smithi026.stdout:6/128: rmdir d6/d13/d29 39 2024-04-23T10:17:43.103 INFO:tasks.workunit.client.0.smithi026.stdout:9/71: mknod d13/c16 0 2024-04-23T10:17:43.106 INFO:tasks.workunit.client.0.smithi026.stdout:3/125: dread d0/d8/f2d [0,4194304] 0 2024-04-23T10:17:43.107 INFO:tasks.workunit.client.0.smithi026.stdout:5/46: creat d0/ff x:0 0 0 2024-04-23T10:17:43.108 INFO:tasks.workunit.client.0.smithi026.stdout:6/129: chown d6/d13/d29 48 1 2024-04-23T10:17:43.110 INFO:tasks.workunit.client.0.smithi026.stdout:0/62: creat d7/da/d17/f18 x:0 0 0 2024-04-23T10:17:43.110 INFO:tasks.workunit.client.0.smithi026.stdout:3/126: fdatasync d0/fc 0 2024-04-23T10:17:43.111 INFO:tasks.workunit.client.0.smithi026.stdout:5/47: creat d0/f10 x:0 0 0 2024-04-23T10:17:43.112 INFO:tasks.workunit.client.0.smithi026.stdout:0/63: rmdir d7/da 39 2024-04-23T10:17:43.112 INFO:tasks.workunit.client.0.smithi026.stdout:0/64: dread - d7/d8/fc zero size 2024-04-23T10:17:43.113 INFO:tasks.workunit.client.0.smithi026.stdout:6/130: mkdir d6/d21/d2f/d31 0 2024-04-23T10:17:43.113 INFO:tasks.workunit.client.0.smithi026.stdout:3/127: rmdir d0/d8/df/d1f 39 2024-04-23T10:17:43.115 INFO:tasks.workunit.client.0.smithi026.stdout:0/65: rename d7 to d7/da/d19 22 2024-04-23T10:17:43.116 INFO:tasks.workunit.client.0.smithi026.stdout:9/72: getdents d13 0 2024-04-23T10:17:43.117 INFO:tasks.workunit.client.0.smithi026.stdout:3/128: rename d0/d8/df/f10 to d0/d1e/f31 0 2024-04-23T10:17:43.118 INFO:tasks.workunit.client.0.smithi026.stdout:0/66: rmdir d7/da/d17 39 2024-04-23T10:17:43.118 INFO:tasks.workunit.client.0.smithi026.stdout:6/131: dread d6/fe [0,4194304] 0 2024-04-23T10:17:43.119 INFO:tasks.workunit.client.0.smithi026.stdout:0/67: fdatasync d7/d8/fc 0 2024-04-23T10:17:43.119 INFO:tasks.workunit.client.0.smithi026.stdout:0/68: chown f0 535 1 2024-04-23T10:17:43.119 INFO:tasks.workunit.client.0.smithi026.stdout:9/73: creat d13/f17 x:0 0 0 2024-04-23T10:17:43.120 INFO:tasks.workunit.client.0.smithi026.stdout:0/69: read d7/d8/fe [178913,126225] 0 2024-04-23T10:17:43.122 INFO:tasks.workunit.client.0.smithi026.stdout:6/132: unlink d6/d13/d15/l1f 0 2024-04-23T10:17:43.123 INFO:tasks.workunit.client.0.smithi026.stdout:0/70: rename d7 to d7/da/d1a 22 2024-04-23T10:17:43.131 INFO:tasks.workunit.client.0.smithi026.stdout:0/71: symlink d7/da/d17/l1b 0 2024-04-23T10:17:43.131 INFO:tasks.workunit.client.0.smithi026.stdout:3/129: dwrite d0/d8/df/f25 [0,4194304] 0 2024-04-23T10:17:43.136 INFO:tasks.workunit.client.0.smithi026.stdout:6/133: dwrite d6/f10 [0,4194304] 0 2024-04-23T10:17:43.137 INFO:tasks.workunit.client.0.smithi026.stdout:9/74: dwrite f5 [4194304,4194304] 0 2024-04-23T10:17:43.139 INFO:tasks.workunit.client.0.smithi026.stdout:3/130: creat d0/d8/df/d17/f32 x:0 0 0 2024-04-23T10:17:43.140 INFO:tasks.workunit.client.0.smithi026.stdout:9/75: write f7 [171501,28263] 0 2024-04-23T10:17:43.140 INFO:tasks.workunit.client.0.smithi026.stdout:0/72: write d7/da/f15 [684892,18193] 0 2024-04-23T10:17:43.141 INFO:tasks.workunit.client.0.smithi026.stdout:3/131: write d0/f6 [960888,59427] 0 2024-04-23T10:17:43.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/76: chown ff 113 1 2024-04-23T10:17:43.143 INFO:tasks.workunit.client.0.smithi026.stdout:0/73: write d7/f14 [153894,527] 0 2024-04-23T10:17:43.149 INFO:tasks.workunit.client.0.smithi026.stdout:6/134: truncate d6/f12 5153829 0 2024-04-23T10:17:43.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/77: write ff [261902,123160] 0 2024-04-23T10:17:43.156 INFO:tasks.workunit.client.0.smithi026.stdout:0/74: creat d7/d8/f1c x:0 0 0 2024-04-23T10:17:43.156 INFO:tasks.workunit.client.0.smithi026.stdout:9/78: rmdir d13 39 2024-04-23T10:17:43.157 INFO:tasks.workunit.client.0.smithi026.stdout:9/79: readlink l1 0 2024-04-23T10:17:43.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/135: mkdir d6/d21/d2f/d32 0 2024-04-23T10:17:43.159 INFO:tasks.workunit.client.0.smithi026.stdout:3/132: dwrite d0/f6 [0,4194304] 0 2024-04-23T10:17:43.166 INFO:tasks.workunit.client.0.smithi026.stdout:6/136: write f4 [3635974,9688] 0 2024-04-23T10:17:43.166 INFO:tasks.workunit.client.0.smithi026.stdout:9/80: chown d13 44 1 2024-04-23T10:17:43.173 INFO:tasks.workunit.client.0.smithi026.stdout:0/75: dwrite d7/d8/f1c [0,4194304] 0 2024-04-23T10:17:43.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/76: mkdir d7/da/d17/d1d 0 2024-04-23T10:17:43.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/77: fsync d7/f14 0 2024-04-23T10:17:43.180 INFO:tasks.workunit.client.0.smithi026.stdout:6/137: dread d6/d13/d15/f2e [0,4194304] 0 2024-04-23T10:17:43.180 INFO:tasks.workunit.client.0.smithi026.stdout:9/81: link l1 d13/l18 0 2024-04-23T10:17:43.183 INFO:tasks.workunit.client.0.smithi026.stdout:0/78: unlink d7/d8/f1c 0 2024-04-23T10:17:43.183 INFO:tasks.workunit.client.0.smithi026.stdout:6/138: rmdir d6/d13 39 2024-04-23T10:17:43.192 INFO:tasks.workunit.client.0.smithi026.stdout:9/82: dwrite f6 [4194304,4194304] 0 2024-04-23T10:17:43.202 INFO:tasks.workunit.client.0.smithi026.stdout:9/83: dwrite d13/f17 [0,4194304] 0 2024-04-23T10:17:43.213 INFO:tasks.workunit.client.0.smithi026.stdout:0/79: rename d7/da/d17 to d7/d8/d1e 0 2024-04-23T10:17:43.213 INFO:tasks.workunit.client.0.smithi026.stdout:0/80: dread - d7/d8/fc zero size 2024-04-23T10:17:43.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/84: mkdir d13/d19 0 2024-04-23T10:17:43.216 INFO:tasks.workunit.client.0.smithi026.stdout:0/81: symlink d7/da/l1f 0 2024-04-23T10:17:43.218 INFO:tasks.workunit.client.0.smithi026.stdout:6/139: rename d6/d13/d29 to d6/d33 0 2024-04-23T10:17:43.220 INFO:tasks.workunit.client.0.smithi026.stdout:0/82: rename d7/da/f15 to d7/d8/d1e/d1d/f20 0 2024-04-23T10:17:43.220 INFO:tasks.workunit.client.0.smithi026.stdout:6/140: symlink d6/d33/l34 0 2024-04-23T10:17:43.222 INFO:tasks.workunit.client.0.smithi026.stdout:0/83: creat d7/d8/d1e/f21 x:0 0 0 2024-04-23T10:17:43.229 INFO:tasks.workunit.client.0.smithi026.stdout:9/85: getdents d13 0 2024-04-23T10:17:43.229 INFO:tasks.workunit.client.0.smithi026.stdout:0/84: mknod d7/c22 0 2024-04-23T10:17:43.230 INFO:tasks.workunit.client.0.smithi026.stdout:9/86: symlink d13/l1a 0 2024-04-23T10:17:43.236 INFO:tasks.workunit.client.0.smithi026.stdout:9/87: dread f5 [0,4194304] 0 2024-04-23T10:17:43.242 INFO:tasks.workunit.client.0.smithi026.stdout:6/141: dwrite d6/f12 [4194304,4194304] 0 2024-04-23T10:17:43.244 INFO:tasks.workunit.client.0.smithi026.stdout:2/32: sync 2024-04-23T10:17:43.246 INFO:tasks.workunit.client.0.smithi026.stdout:9/88: dwrite d13/f14 [0,4194304] 0 2024-04-23T10:17:43.246 INFO:tasks.workunit.client.0.smithi026.stdout:6/142: fsync d6/fc 0 2024-04-23T10:17:43.247 INFO:tasks.workunit.client.0.smithi026.stdout:9/89: write d13/f17 [2360450,114520] 0 2024-04-23T10:17:43.249 INFO:tasks.workunit.client.0.smithi026.stdout:6/143: mknod d6/d21/c35 0 2024-04-23T10:17:43.252 INFO:tasks.workunit.client.0.smithi026.stdout:0/85: truncate f0 1421669 0 2024-04-23T10:17:43.254 INFO:tasks.workunit.client.0.smithi026.stdout:9/90: dread f5 [0,4194304] 0 2024-04-23T10:17:43.259 INFO:tasks.workunit.client.0.smithi026.stdout:2/33: dread d3/f6 [0,4194304] 0 2024-04-23T10:17:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:9/91: mkdir d13/d1b 0 2024-04-23T10:17:43.260 INFO:tasks.workunit.client.0.smithi026.stdout:6/144: dwrite d6/d13/d15/f2e [4194304,4194304] 0 2024-04-23T10:17:43.263 INFO:tasks.workunit.client.0.smithi026.stdout:9/92: creat d13/f1c x:0 0 0 2024-04-23T10:17:43.266 INFO:tasks.workunit.client.0.smithi026.stdout:0/86: creat d7/da/f23 x:0 0 0 2024-04-23T10:17:43.267 INFO:tasks.workunit.client.0.smithi026.stdout:2/34: creat d3/dd/ff x:0 0 0 2024-04-23T10:17:43.267 INFO:tasks.workunit.client.0.smithi026.stdout:6/145: rmdir d6/d33 39 2024-04-23T10:17:43.270 INFO:tasks.workunit.client.0.smithi026.stdout:0/87: mknod d7/d8/c24 0 2024-04-23T10:17:43.270 INFO:tasks.workunit.client.0.smithi026.stdout:2/35: symlink d3/dd/l10 0 2024-04-23T10:17:43.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/93: dwrite f6 [8388608,4194304] 0 2024-04-23T10:17:43.276 INFO:tasks.workunit.client.0.smithi026.stdout:0/88: creat d7/d8/f25 x:0 0 0 2024-04-23T10:17:43.276 INFO:tasks.workunit.client.0.smithi026.stdout:9/94: write d13/f1c [211047,123868] 0 2024-04-23T10:17:43.280 INFO:tasks.workunit.client.0.smithi026.stdout:2/36: mknod d3/c11 0 2024-04-23T10:17:43.283 INFO:tasks.workunit.client.0.smithi026.stdout:6/146: dwrite f0 [0,4194304] 0 2024-04-23T10:17:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:6/147: write d6/d13/d15/f2e [2893728,78093] 0 2024-04-23T10:17:43.287 INFO:tasks.workunit.client.0.smithi026.stdout:2/37: symlink d3/dd/l12 0 2024-04-23T10:17:43.292 INFO:tasks.workunit.client.0.smithi026.stdout:9/95: dwrite ff [0,4194304] 0 2024-04-23T10:17:43.295 INFO:tasks.workunit.client.0.smithi026.stdout:9/96: chown d13/l1a 597 1 2024-04-23T10:17:43.299 INFO:tasks.workunit.client.0.smithi026.stdout:0/89: rename d7/d8/fe to d7/da/f26 0 2024-04-23T10:17:43.302 INFO:tasks.workunit.client.0.smithi026.stdout:6/148: dwrite d6/f1d [0,4194304] 0 2024-04-23T10:17:43.305 INFO:tasks.workunit.client.0.smithi026.stdout:0/90: mkdir d7/d8/d1e/d1d/d27 0 2024-04-23T10:17:43.309 INFO:tasks.workunit.client.0.smithi026.stdout:2/38: fsync d3/dd/ff 0 2024-04-23T10:17:43.312 INFO:tasks.workunit.client.0.smithi026.stdout:0/91: dread d7/f14 [0,4194304] 0 2024-04-23T10:17:43.312 INFO:tasks.workunit.client.0.smithi026.stdout:6/149: rmdir d6/d13/d15 39 2024-04-23T10:17:43.314 INFO:tasks.workunit.client.0.smithi026.stdout:9/97: dwrite d13/f1c [0,4194304] 0 2024-04-23T10:17:43.315 INFO:tasks.workunit.client.0.smithi026.stdout:2/39: creat d3/f13 x:0 0 0 2024-04-23T10:17:43.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/98: dread f6 [0,4194304] 0 2024-04-23T10:17:43.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/99: chown d13/d19 10397395 1 2024-04-23T10:17:43.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/150: creat d6/d21/d2f/d31/f36 x:0 0 0 2024-04-23T10:17:43.325 INFO:tasks.workunit.client.0.smithi026.stdout:6/151: mkdir d6/d21/d2f/d37 0 2024-04-23T10:17:43.329 INFO:tasks.workunit.client.0.smithi026.stdout:2/40: getdents d3/dd 0 2024-04-23T10:17:43.330 INFO:tasks.workunit.client.0.smithi026.stdout:2/41: readlink d3/dd/l10 0 2024-04-23T10:17:43.330 INFO:tasks.workunit.client.0.smithi026.stdout:2/42: dread - d3/fc zero size 2024-04-23T10:17:43.332 INFO:tasks.workunit.client.0.smithi026.stdout:6/152: mkdir d6/d21/d2f/d32/d38 0 2024-04-23T10:17:43.333 INFO:tasks.workunit.client.0.smithi026.stdout:2/43: symlink d3/dd/l14 0 2024-04-23T10:17:43.334 INFO:tasks.workunit.client.0.smithi026.stdout:2/44: chown d3/fa 0 1 2024-04-23T10:17:43.335 INFO:tasks.workunit.client.0.smithi026.stdout:6/153: write d6/d33/f2c [5480009,59475] 0 2024-04-23T10:17:43.336 INFO:tasks.workunit.client.0.smithi026.stdout:2/45: creat d3/dd/f15 x:0 0 0 2024-04-23T10:17:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:6/154: creat d6/d21/d2f/d37/f39 x:0 0 0 2024-04-23T10:17:43.337 INFO:tasks.workunit.client.0.smithi026.stdout:2/46: rmdir d3 39 2024-04-23T10:17:43.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/47: chown d3/c7 1198 1 2024-04-23T10:17:43.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/48: dread - d3/fc zero size 2024-04-23T10:17:43.343 INFO:tasks.workunit.client.0.smithi026.stdout:0/92: write d7/da/f26 [2057320,128157] 0 2024-04-23T10:17:43.348 INFO:tasks.workunit.client.0.smithi026.stdout:6/155: dwrite d6/f19 [0,4194304] 0 2024-04-23T10:17:43.349 INFO:tasks.workunit.client.0.smithi026.stdout:0/93: rename f6 to d7/d8/d1e/d1d/f28 0 2024-04-23T10:17:43.350 INFO:tasks.workunit.client.0.smithi026.stdout:2/49: dwrite d3/f8 [4194304,4194304] 0 2024-04-23T10:17:43.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/100: truncate d13/f17 2172497 0 2024-04-23T10:17:43.355 INFO:tasks.workunit.client.0.smithi026.stdout:0/94: rename d7/d8/fc to d7/da/f29 0 2024-04-23T10:17:43.355 INFO:tasks.workunit.client.0.smithi026.stdout:2/50: rename d3 to d3/dd/d16 22 2024-04-23T10:17:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:6/156: dwrite d6/f1d [0,4194304] 0 2024-04-23T10:17:43.360 INFO:tasks.workunit.client.0.smithi026.stdout:0/95: mkdir d7/d8/d1e/d2a 0 2024-04-23T10:17:43.362 INFO:tasks.workunit.client.0.smithi026.stdout:2/51: creat d3/f17 x:0 0 0 2024-04-23T10:17:43.364 INFO:tasks.workunit.client.0.smithi026.stdout:2/52: readlink d3/dd/l14 0 2024-04-23T10:17:43.368 INFO:tasks.workunit.client.0.smithi026.stdout:0/96: write d7/d8/d1e/d1d/f20 [680583,11121] 0 2024-04-23T10:17:43.369 INFO:tasks.workunit.client.0.smithi026.stdout:6/157: rename d6/d21/d2f/d31/f36 to d6/d21/d2f/d37/f3a 0 2024-04-23T10:17:43.371 INFO:tasks.workunit.client.0.smithi026.stdout:6/158: chown d6/d13/l28 1 1 2024-04-23T10:17:43.372 INFO:tasks.workunit.client.0.smithi026.stdout:6/159: chown d6/d21 0 1 2024-04-23T10:17:43.372 INFO:tasks.workunit.client.0.smithi026.stdout:9/101: dwrite f5 [4194304,4194304] 0 2024-04-23T10:17:43.374 INFO:tasks.workunit.client.0.smithi026.stdout:0/97: symlink d7/d8/d1e/d2a/l2b 0 2024-04-23T10:17:43.374 INFO:tasks.workunit.client.0.smithi026.stdout:2/53: rename d3/dd/ff to d3/dd/f18 0 2024-04-23T10:17:43.375 INFO:tasks.workunit.client.0.smithi026.stdout:2/54: chown d3/dd/f15 301312994 1 2024-04-23T10:17:43.376 INFO:tasks.workunit.client.0.smithi026.stdout:9/102: mkdir d13/d19/d1d 0 2024-04-23T10:17:43.376 INFO:tasks.workunit.client.0.smithi026.stdout:2/55: truncate d3/fc 263017 0 2024-04-23T10:17:43.376 INFO:tasks.workunit.client.0.smithi026.stdout:0/98: fsync d7/d8/f9 0 2024-04-23T10:17:43.378 INFO:tasks.workunit.client.0.smithi026.stdout:6/160: creat d6/f3b x:0 0 0 2024-04-23T10:17:43.378 INFO:tasks.workunit.client.0.smithi026.stdout:0/99: chown d7/c13 670210 1 2024-04-23T10:17:43.380 INFO:tasks.workunit.client.0.smithi026.stdout:2/56: mkdir d3/d19 0 2024-04-23T10:17:43.381 INFO:tasks.workunit.client.0.smithi026.stdout:9/103: unlink f7 0 2024-04-23T10:17:43.382 INFO:tasks.workunit.client.0.smithi026.stdout:0/100: mknod d7/d8/d1e/d1d/c2c 0 2024-04-23T10:17:43.382 INFO:tasks.workunit.client.0.smithi026.stdout:2/57: rmdir d3 39 2024-04-23T10:17:43.383 INFO:tasks.workunit.client.0.smithi026.stdout:6/161: chown d6/d13/d15/l20 21 1 2024-04-23T10:17:43.384 INFO:tasks.workunit.client.0.smithi026.stdout:9/104: chown d13/l18 44319 1 2024-04-23T10:17:43.384 INFO:tasks.workunit.client.0.smithi026.stdout:2/58: dread - d3/f13 zero size 2024-04-23T10:17:43.387 INFO:tasks.workunit.client.0.smithi026.stdout:0/101: dread d7/da/f26 [0,4194304] 0 2024-04-23T10:17:43.389 INFO:tasks.workunit.client.0.smithi026.stdout:9/105: rmdir d13/d19/d1d 0 2024-04-23T10:17:43.390 INFO:tasks.workunit.client.0.smithi026.stdout:9/106: fsync d13/f1c 0 2024-04-23T10:17:43.391 INFO:tasks.workunit.client.0.smithi026.stdout:6/162: dread d6/d13/d15/f2e [8388608,4194304] 0 2024-04-23T10:17:43.392 INFO:tasks.workunit.client.0.smithi026.stdout:0/102: rmdir d7/d8/d1e/d1d/d27 0 2024-04-23T10:17:43.392 INFO:tasks.workunit.client.0.smithi026.stdout:9/107: truncate d13/f14 4342069 0 2024-04-23T10:17:43.394 INFO:tasks.workunit.client.0.smithi026.stdout:0/103: fsync d7/da/f10 0 2024-04-23T10:17:43.395 INFO:tasks.workunit.client.0.smithi026.stdout:2/59: dwrite d3/fc [0,4194304] 0 2024-04-23T10:17:43.395 INFO:tasks.workunit.client.0.smithi026.stdout:6/163: symlink d6/d21/d2f/l3c 0 2024-04-23T10:17:43.395 INFO:tasks.workunit.client.0.smithi026.stdout:0/104: stat d7/f14 0 2024-04-23T10:17:43.396 INFO:tasks.workunit.client.0.smithi026.stdout:2/60: read - d3/dd/f18 zero size 2024-04-23T10:17:43.396 INFO:tasks.workunit.client.0.smithi026.stdout:2/61: stat d3/c7 0 2024-04-23T10:17:43.397 INFO:tasks.workunit.client.0.smithi026.stdout:9/108: creat d13/f1e x:0 0 0 2024-04-23T10:17:43.397 INFO:tasks.workunit.client.0.smithi026.stdout:9/109: stat d13/d1b 0 2024-04-23T10:17:43.397 INFO:tasks.workunit.client.0.smithi026.stdout:2/62: dread - d3/dd/f15 zero size 2024-04-23T10:17:43.400 INFO:tasks.workunit.client.0.smithi026.stdout:0/105: mkdir d7/d8/d2d 0 2024-04-23T10:17:43.402 INFO:tasks.workunit.client.0.smithi026.stdout:2/63: write d3/f6 [676271,81382] 0 2024-04-23T10:17:43.404 INFO:tasks.workunit.client.0.smithi026.stdout:9/110: symlink d13/d19/l1f 0 2024-04-23T10:17:43.407 INFO:tasks.workunit.client.0.smithi026.stdout:2/64: symlink d3/dd/l1a 0 2024-04-23T10:17:43.409 INFO:tasks.workunit.client.0.smithi026.stdout:6/164: getdents d6/d13/d15 0 2024-04-23T10:17:43.411 INFO:tasks.workunit.client.0.smithi026.stdout:6/165: fsync d6/d21/f23 0 2024-04-23T10:17:43.414 INFO:tasks.workunit.client.0.smithi026.stdout:0/106: dwrite d7/da/f23 [0,4194304] 0 2024-04-23T10:17:43.414 INFO:tasks.workunit.client.0.smithi026.stdout:6/166: readlink d6/d13/d15/l20 0 2024-04-23T10:17:43.416 INFO:tasks.workunit.client.0.smithi026.stdout:9/111: dread d13/f17 [0,4194304] 0 2024-04-23T10:17:43.419 INFO:tasks.workunit.client.0.smithi026.stdout:9/112: symlink d13/d19/l20 0 2024-04-23T10:17:43.420 INFO:tasks.workunit.client.0.smithi026.stdout:2/65: dwrite d3/dd/f18 [0,4194304] 0 2024-04-23T10:17:43.422 INFO:tasks.workunit.client.0.smithi026.stdout:6/167: rename d6/d33/f2d to d6/d21/d2f/f3d 0 2024-04-23T10:17:43.427 INFO:tasks.workunit.client.0.smithi026.stdout:2/66: symlink d3/l1b 0 2024-04-23T10:17:43.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/168: rmdir d6/d21 39 2024-04-23T10:17:43.431 INFO:tasks.workunit.client.0.smithi026.stdout:9/113: dwrite d13/f1e [0,4194304] 0 2024-04-23T10:17:43.432 INFO:tasks.workunit.client.0.smithi026.stdout:0/107: getdents d7/d8/d1e/d1d 0 2024-04-23T10:17:43.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/67: link d3/dd/f18 d3/d19/f1c 0 2024-04-23T10:17:43.437 INFO:tasks.workunit.client.0.smithi026.stdout:2/68: stat d3/ce 0 2024-04-23T10:17:43.437 INFO:tasks.workunit.client.0.smithi026.stdout:0/108: creat d7/d8/d1e/d2a/f2e x:0 0 0 2024-04-23T10:17:43.439 INFO:tasks.workunit.client.0.smithi026.stdout:9/114: dread f8 [0,4194304] 0 2024-04-23T10:17:43.441 INFO:tasks.workunit.client.0.smithi026.stdout:2/69: write d3/f17 [535767,84683] 0 2024-04-23T10:17:43.442 INFO:tasks.workunit.client.0.smithi026.stdout:6/169: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:43.447 INFO:tasks.workunit.client.0.smithi026.stdout:6/170: write d6/f10 [3324214,2098] 0 2024-04-23T10:17:43.447 INFO:tasks.workunit.client.0.smithi026.stdout:0/109: rename d7/da to d7/d8/d1e/d1d/d2f 0 2024-04-23T10:17:43.449 INFO:tasks.workunit.client.0.smithi026.stdout:0/110: fsync f1 0 2024-04-23T10:17:43.450 INFO:tasks.workunit.client.0.smithi026.stdout:0/111: fdatasync d7/d8/f16 0 2024-04-23T10:17:43.450 INFO:tasks.workunit.client.0.smithi026.stdout:0/112: stat d7/d8/d1e 0 2024-04-23T10:17:43.451 INFO:tasks.workunit.client.0.smithi026.stdout:2/70: mkdir d3/d19/d1d 0 2024-04-23T10:17:43.452 INFO:tasks.workunit.client.0.smithi026.stdout:9/115: dread f5 [0,4194304] 0 2024-04-23T10:17:43.453 INFO:tasks.workunit.client.0.smithi026.stdout:2/71: truncate d3/f13 357158 0 2024-04-23T10:17:43.453 INFO:tasks.workunit.client.0.smithi026.stdout:0/113: read d7/d8/d1e/d1d/d2f/f10 [148122,105138] 0 2024-04-23T10:17:43.454 INFO:tasks.workunit.client.0.smithi026.stdout:6/171: rename d6/l11 to d6/d21/d2f/d32/l3e 0 2024-04-23T10:17:43.456 INFO:tasks.workunit.client.0.smithi026.stdout:9/116: rename c10 to d13/c21 0 2024-04-23T10:17:43.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/114: write d7/d8/d1e/d1d/d2f/f11 [1505589,38022] 0 2024-04-23T10:17:43.459 INFO:tasks.workunit.client.0.smithi026.stdout:9/117: creat d13/f22 x:0 0 0 2024-04-23T10:17:43.462 INFO:tasks.workunit.client.0.smithi026.stdout:0/115: mkdir d7/d8/d1e/d30 0 2024-04-23T10:17:43.462 INFO:tasks.workunit.client.0.smithi026.stdout:9/118: truncate d13/f14 4763813 0 2024-04-23T10:17:43.464 INFO:tasks.workunit.client.0.smithi026.stdout:6/172: dwrite f3 [0,4194304] 0 2024-04-23T10:17:43.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/72: dwrite d3/dd/f15 [0,4194304] 0 2024-04-23T10:17:43.466 INFO:tasks.workunit.client.0.smithi026.stdout:2/73: read d3/f8 [7692412,39289] 0 2024-04-23T10:17:43.467 INFO:tasks.workunit.client.0.smithi026.stdout:0/116: fsync d7/d8/d1e/d1d/d2f/f26 0 2024-04-23T10:17:43.467 INFO:tasks.workunit.client.0.smithi026.stdout:2/74: write d3/f13 [521732,69718] 0 2024-04-23T10:17:43.468 INFO:tasks.workunit.client.0.smithi026.stdout:0/117: chown d7/d8/d1e/d1d/d2f/l1f 97 1 2024-04-23T10:17:43.469 INFO:tasks.workunit.client.0.smithi026.stdout:6/173: unlink d6/d21/f23 0 2024-04-23T10:17:43.472 INFO:tasks.workunit.client.0.smithi026.stdout:2/75: rename d3/ce to d3/dd/c1e 0 2024-04-23T10:17:43.477 INFO:tasks.workunit.client.0.smithi026.stdout:6/174: dread d6/f1d [0,4194304] 0 2024-04-23T10:17:43.479 INFO:tasks.workunit.client.0.smithi026.stdout:6/175: write f3 [1747723,75705] 0 2024-04-23T10:17:43.480 INFO:tasks.workunit.client.0.smithi026.stdout:0/118: rmdir d7/d8/d1e/d1d/d2f 39 2024-04-23T10:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:2/76: dwrite d3/fc [0,4194304] 0 2024-04-23T10:17:43.483 INFO:tasks.workunit.client.0.smithi026.stdout:9/119: fsync d13/f22 0 2024-04-23T10:17:43.485 INFO:tasks.workunit.client.0.smithi026.stdout:0/119: getdents d7/d8/d1e/d30 0 2024-04-23T10:17:43.486 INFO:tasks.workunit.client.0.smithi026.stdout:9/120: dread d13/f17 [0,4194304] 0 2024-04-23T10:17:43.487 INFO:tasks.workunit.client.0.smithi026.stdout:0/120: creat d7/d8/f31 x:0 0 0 2024-04-23T10:17:43.487 INFO:tasks.workunit.client.0.smithi026.stdout:6/176: getdents d6/d21/d2f/d37 0 2024-04-23T10:17:43.492 INFO:tasks.workunit.client.0.smithi026.stdout:6/177: fsync d6/d21/d2f/f3d 0 2024-04-23T10:17:43.492 INFO:tasks.workunit.client.0.smithi026.stdout:1/50: sync 2024-04-23T10:17:43.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/77: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:43.495 INFO:tasks.workunit.client.0.smithi026.stdout:0/121: link d7/d8/d1e/d2a/f2e d7/d8/d1e/f32 0 2024-04-23T10:17:43.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/78: truncate d3/f13 1580894 0 2024-04-23T10:17:43.495 INFO:tasks.workunit.client.0.smithi026.stdout:1/51: creat dd/f11 x:0 0 0 2024-04-23T10:17:43.501 INFO:tasks.workunit.client.0.smithi026.stdout:0/122: mknod d7/d8/d1e/d1d/c33 0 2024-04-23T10:17:43.504 INFO:tasks.workunit.client.0.smithi026.stdout:1/52: creat dd/f12 x:0 0 0 2024-04-23T10:17:43.504 INFO:tasks.workunit.client.0.smithi026.stdout:0/123: dread - d7/d8/f31 zero size 2024-04-23T10:17:43.504 INFO:tasks.workunit.client.0.smithi026.stdout:6/178: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:43.509 INFO:tasks.workunit.client.0.smithi026.stdout:1/53: mkdir dd/d13 0 2024-04-23T10:17:43.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/124: dread - d7/d8/d1e/d2a/f2e zero size 2024-04-23T10:17:43.515 INFO:tasks.workunit.client.0.smithi026.stdout:9/121: dwrite d13/f17 [0,4194304] 0 2024-04-23T10:17:43.515 INFO:tasks.workunit.client.0.smithi026.stdout:1/54: write dd/fe [183987,5071] 0 2024-04-23T10:17:43.524 INFO:tasks.workunit.client.0.smithi026.stdout:6/179: dwrite d6/f12 [4194304,4194304] 0 2024-04-23T10:17:43.528 INFO:tasks.workunit.client.0.smithi026.stdout:1/55: symlink dd/l14 0 2024-04-23T10:17:43.530 INFO:tasks.workunit.client.0.smithi026.stdout:2/79: dwrite d3/f8 [0,4194304] 0 2024-04-23T10:17:43.530 INFO:tasks.workunit.client.0.smithi026.stdout:9/122: symlink d13/l23 0 2024-04-23T10:17:43.530 INFO:tasks.workunit.client.0.smithi026.stdout:6/180: truncate d6/fe 4280187 0 2024-04-23T10:17:43.531 INFO:tasks.workunit.client.0.smithi026.stdout:1/56: chown dd/cf 2 1 2024-04-23T10:17:43.531 INFO:tasks.workunit.client.0.smithi026.stdout:0/125: getdents d7/d8 0 2024-04-23T10:17:43.533 INFO:tasks.workunit.client.0.smithi026.stdout:1/57: mkdir dd/d15 0 2024-04-23T10:17:43.534 INFO:tasks.workunit.client.0.smithi026.stdout:9/123: getdents d13/d1b 0 2024-04-23T10:17:43.535 INFO:tasks.workunit.client.0.smithi026.stdout:9/124: read f5 [6082281,18285] 0 2024-04-23T10:17:43.535 INFO:tasks.workunit.client.0.smithi026.stdout:2/80: read d3/f17 [57877,79979] 0 2024-04-23T10:17:43.536 INFO:tasks.workunit.client.0.smithi026.stdout:1/58: getdents dd/d15 0 2024-04-23T10:17:43.537 INFO:tasks.workunit.client.0.smithi026.stdout:9/125: fdatasync d13/f1e 0 2024-04-23T10:17:43.538 INFO:tasks.workunit.client.0.smithi026.stdout:0/126: creat d7/d8/d1e/d1d/d2f/f34 x:0 0 0 2024-04-23T10:17:43.541 INFO:tasks.workunit.client.0.smithi026.stdout:0/127: fsync d7/d8/f9 0 2024-04-23T10:17:43.541 INFO:tasks.workunit.client.0.smithi026.stdout:6/181: dread d6/d33/f2c [4194304,4194304] 0 2024-04-23T10:17:43.541 INFO:tasks.workunit.client.0.smithi026.stdout:2/81: write d3/dd/f18 [1114176,103631] 0 2024-04-23T10:17:43.542 INFO:tasks.workunit.client.0.smithi026.stdout:2/82: chown d3/cb 199 1 2024-04-23T10:17:43.542 INFO:tasks.workunit.client.0.smithi026.stdout:9/126: unlink d13/c21 0 2024-04-23T10:17:43.542 INFO:tasks.workunit.client.0.smithi026.stdout:6/182: chown d6/d21/d2f/d37/f39 156032 1 2024-04-23T10:17:43.543 INFO:tasks.workunit.client.0.smithi026.stdout:9/127: write d13/f14 [3257800,14842] 0 2024-04-23T10:17:43.544 INFO:tasks.workunit.client.0.smithi026.stdout:9/128: write d13/f22 [677685,72120] 0 2024-04-23T10:17:43.544 INFO:tasks.workunit.client.0.smithi026.stdout:9/129: fdatasync d13/f17 0 2024-04-23T10:17:43.545 INFO:tasks.workunit.client.0.smithi026.stdout:1/59: link f4 dd/d13/f16 0 2024-04-23T10:17:43.546 INFO:tasks.workunit.client.0.smithi026.stdout:1/60: chown dd/d15 116227157 1 2024-04-23T10:17:43.552 INFO:tasks.workunit.client.0.smithi026.stdout:1/61: rename dd/f11 to dd/f17 0 2024-04-23T10:17:43.553 INFO:tasks.workunit.client.0.smithi026.stdout:9/130: dwrite d13/f17 [0,4194304] 0 2024-04-23T10:17:43.553 INFO:tasks.workunit.client.0.smithi026.stdout:0/128: creat d7/f35 x:0 0 0 2024-04-23T10:17:43.554 INFO:tasks.workunit.client.0.smithi026.stdout:6/183: rmdir d6/d21/d2f/d32/d38 0 2024-04-23T10:17:43.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/83: fsync d3/f8 0 2024-04-23T10:17:43.562 INFO:tasks.workunit.client.0.smithi026.stdout:9/131: rename d13/l1a to d13/l24 0 2024-04-23T10:17:43.562 INFO:tasks.workunit.client.0.smithi026.stdout:1/62: creat dd/d13/f18 x:0 0 0 2024-04-23T10:17:43.562 INFO:tasks.workunit.client.0.smithi026.stdout:0/129: creat d7/d8/d1e/f36 x:0 0 0 2024-04-23T10:17:43.563 INFO:tasks.workunit.client.0.smithi026.stdout:6/184: unlink d6/d21/c2b 0 2024-04-23T10:17:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/132: truncate d13/f14 4856636 0 2024-04-23T10:17:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:1/63: mknod dd/d13/c19 0 2024-04-23T10:17:43.565 INFO:tasks.workunit.client.0.smithi026.stdout:9/133: chown l2 58806 1 2024-04-23T10:17:43.568 INFO:tasks.workunit.client.0.smithi026.stdout:1/64: mkdir dd/d1a 0 2024-04-23T10:17:43.570 INFO:tasks.workunit.client.0.smithi026.stdout:9/134: creat d13/f25 x:0 0 0 2024-04-23T10:17:43.574 INFO:tasks.workunit.client.0.smithi026.stdout:2/84: link d3/dd/c1e d3/d19/d1d/c1f 0 2024-04-23T10:17:43.576 INFO:tasks.workunit.client.0.smithi026.stdout:6/185: getdents d6/d21/d2f/d32 0 2024-04-23T10:17:43.577 INFO:tasks.workunit.client.0.smithi026.stdout:2/85: mknod d3/c20 0 2024-04-23T10:17:43.577 INFO:tasks.workunit.client.0.smithi026.stdout:9/135: dwrite d13/f1c [0,4194304] 0 2024-04-23T10:17:43.578 INFO:tasks.workunit.client.0.smithi026.stdout:2/86: readlink d3/dd/l14 0 2024-04-23T10:17:43.580 INFO:tasks.workunit.client.0.smithi026.stdout:1/65: write f2 [92310,110647] 0 2024-04-23T10:17:43.581 INFO:tasks.workunit.client.0.smithi026.stdout:6/186: truncate d6/d21/d2f/d37/f39 764398 0 2024-04-23T10:17:43.582 INFO:tasks.workunit.client.0.smithi026.stdout:9/136: mkdir d13/d1b/d26 0 2024-04-23T10:17:43.584 INFO:tasks.workunit.client.0.smithi026.stdout:1/66: dread - dd/f17 zero size 2024-04-23T10:17:43.584 INFO:tasks.workunit.client.0.smithi026.stdout:0/130: dwrite d7/d8/d1e/f32 [0,4194304] 0 2024-04-23T10:17:43.585 INFO:tasks.workunit.client.0.smithi026.stdout:2/87: getdents d3/dd 0 2024-04-23T10:17:43.586 INFO:tasks.workunit.client.0.smithi026.stdout:0/131: write d7/d8/d1e/d1d/f28 [3695582,99696] 0 2024-04-23T10:17:43.586 INFO:tasks.workunit.client.0.smithi026.stdout:6/187: write d6/fd [267692,68158] 0 2024-04-23T10:17:43.593 INFO:tasks.workunit.client.0.smithi026.stdout:0/132: link f1 d7/d8/d2d/f37 0 2024-04-23T10:17:43.595 INFO:tasks.workunit.client.0.smithi026.stdout:1/67: dwrite dd/f17 [0,4194304] 0 2024-04-23T10:17:43.595 INFO:tasks.workunit.client.0.smithi026.stdout:0/133: rmdir d7/d8/d1e 39 2024-04-23T10:17:43.604 INFO:tasks.workunit.client.0.smithi026.stdout:0/134: dwrite d7/d8/d1e/d1d/f28 [4194304,4194304] 0 2024-04-23T10:17:43.609 INFO:tasks.workunit.client.0.smithi026.stdout:1/68: creat dd/d15/f1b x:0 0 0 2024-04-23T10:17:43.609 INFO:tasks.workunit.client.0.smithi026.stdout:2/88: dread d3/f13 [0,4194304] 0 2024-04-23T10:17:43.610 INFO:tasks.workunit.client.0.smithi026.stdout:1/69: truncate fb 623596 0 2024-04-23T10:17:43.617 INFO:tasks.workunit.client.0.smithi026.stdout:2/89: truncate d3/f8 4869525 0 2024-04-23T10:17:43.620 INFO:tasks.workunit.client.0.smithi026.stdout:0/135: creat d7/f38 x:0 0 0 2024-04-23T10:17:43.621 INFO:tasks.workunit.client.0.smithi026.stdout:1/70: dwrite f9 [0,4194304] 0 2024-04-23T10:17:43.621 INFO:tasks.workunit.client.0.smithi026.stdout:1/71: chown f5 7 1 2024-04-23T10:17:43.622 INFO:tasks.workunit.client.0.smithi026.stdout:2/90: mkdir d3/d19/d21 0 2024-04-23T10:17:43.622 INFO:tasks.workunit.client.0.smithi026.stdout:1/72: chown f5 959675 1 2024-04-23T10:17:43.625 INFO:tasks.workunit.client.0.smithi026.stdout:2/91: read d3/f8 [275797,70640] 0 2024-04-23T10:17:43.631 INFO:tasks.workunit.client.0.smithi026.stdout:0/136: creat d7/f39 x:0 0 0 2024-04-23T10:17:43.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/73: dwrite fc [0,4194304] 0 2024-04-23T10:17:43.633 INFO:tasks.workunit.client.0.smithi026.stdout:0/137: chown d7/d8/d1e/f36 2077 1 2024-04-23T10:17:43.634 INFO:tasks.workunit.client.0.smithi026.stdout:1/74: write dd/fe [555815,138] 0 2024-04-23T10:17:43.634 INFO:tasks.workunit.client.0.smithi026.stdout:0/138: dread - d7/d8/f25 zero size 2024-04-23T10:17:43.637 INFO:tasks.workunit.client.0.smithi026.stdout:1/75: readlink l6 0 2024-04-23T10:17:43.638 INFO:tasks.workunit.client.0.smithi026.stdout:1/76: mknod dd/c1c 0 2024-04-23T10:17:43.638 INFO:tasks.workunit.client.0.smithi026.stdout:0/139: symlink d7/d8/d1e/d2a/l3a 0 2024-04-23T10:17:43.638 INFO:tasks.workunit.client.0.smithi026.stdout:1/77: write fc [1297129,63774] 0 2024-04-23T10:17:43.645 INFO:tasks.workunit.client.0.smithi026.stdout:0/140: rename l5 to d7/d8/d1e/d1d/d2f/l3b 0 2024-04-23T10:17:43.645 INFO:tasks.workunit.client.0.smithi026.stdout:1/78: dread dd/d13/f16 [0,4194304] 0 2024-04-23T10:17:43.649 INFO:tasks.workunit.client.0.smithi026.stdout:1/79: write f2 [691281,72473] 0 2024-04-23T10:17:43.651 INFO:tasks.workunit.client.0.smithi026.stdout:0/141: rename d7/d8/d1e/d1d/c2c to d7/d8/c3c 0 2024-04-23T10:17:43.652 INFO:tasks.workunit.client.0.smithi026.stdout:1/80: symlink dd/d15/l1d 0 2024-04-23T10:17:43.653 INFO:tasks.workunit.client.0.smithi026.stdout:0/142: symlink d7/d8/d1e/d2a/l3d 0 2024-04-23T10:17:43.653 INFO:tasks.workunit.client.0.smithi026.stdout:0/143: dread - d7/d8/f31 zero size 2024-04-23T10:17:43.657 INFO:tasks.workunit.client.0.smithi026.stdout:0/144: truncate d7/d8/d1e/d1d/d2f/f10 694411 0 2024-04-23T10:17:43.658 INFO:tasks.workunit.client.0.smithi026.stdout:0/145: truncate d7/f14 525533 0 2024-04-23T10:17:43.659 INFO:tasks.workunit.client.0.smithi026.stdout:1/81: dwrite fb [0,4194304] 0 2024-04-23T10:17:43.659 INFO:tasks.workunit.client.0.smithi026.stdout:0/146: chown d7/d8 4763 1 2024-04-23T10:17:43.662 INFO:tasks.workunit.client.0.smithi026.stdout:0/147: mknod d7/c3e 0 2024-04-23T10:17:43.663 INFO:tasks.workunit.client.0.smithi026.stdout:1/82: dread f2 [0,4194304] 0 2024-04-23T10:17:43.732 INFO:tasks.workunit.client.0.smithi026.stdout:4/44: sync 2024-04-23T10:17:43.732 INFO:tasks.workunit.client.0.smithi026.stdout:3/133: sync 2024-04-23T10:17:43.732 INFO:tasks.workunit.client.0.smithi026.stdout:8/35: sync 2024-04-23T10:17:43.733 INFO:tasks.workunit.client.0.smithi026.stdout:7/59: sync 2024-04-23T10:17:43.735 INFO:tasks.workunit.client.0.smithi026.stdout:8/36: write f4 [2848314,18804] 0 2024-04-23T10:17:43.736 INFO:tasks.workunit.client.0.smithi026.stdout:4/45: read - d4/d7/f8 zero size 2024-04-23T10:17:43.738 INFO:tasks.workunit.client.0.smithi026.stdout:4/46: read d4/f5 [1242010,86438] 0 2024-04-23T10:17:43.746 INFO:tasks.workunit.client.0.smithi026.stdout:0/148: rename d7/d8/c3c to d7/d8/d1e/d1d/d2f/c3f 0 2024-04-23T10:17:43.748 INFO:tasks.workunit.client.0.smithi026.stdout:3/134: creat d0/d8/df/f33 x:0 0 0 2024-04-23T10:17:43.753 INFO:tasks.workunit.client.0.smithi026.stdout:7/60: write dd/fe [5343844,108608] 0 2024-04-23T10:17:43.756 INFO:tasks.workunit.client.0.smithi026.stdout:4/47: rename l0 to d4/d7/la 0 2024-04-23T10:17:43.761 INFO:tasks.workunit.client.0.smithi026.stdout:7/61: symlink dd/l18 0 2024-04-23T10:17:43.762 INFO:tasks.workunit.client.0.smithi026.stdout:4/48: symlink d4/d7/lb 0 2024-04-23T10:17:43.764 INFO:tasks.workunit.client.0.smithi026.stdout:0/149: fsync d7/d8/d1e/d1d/d2f/f10 0 2024-04-23T10:17:43.766 INFO:tasks.workunit.client.0.smithi026.stdout:8/37: getdents d5/d9 0 2024-04-23T10:17:43.767 INFO:tasks.workunit.client.0.smithi026.stdout:8/38: chown d5/c8 8058 1 2024-04-23T10:17:43.767 INFO:tasks.workunit.client.0.smithi026.stdout:8/39: readlink l0 0 2024-04-23T10:17:43.768 INFO:tasks.workunit.client.0.smithi026.stdout:7/62: mkdir dd/d19 0 2024-04-23T10:17:43.768 INFO:tasks.workunit.client.0.smithi026.stdout:8/40: readlink l1 0 2024-04-23T10:17:43.769 INFO:tasks.workunit.client.0.smithi026.stdout:8/41: read f2 [1741509,129118] 0 2024-04-23T10:17:43.773 INFO:tasks.workunit.client.0.smithi026.stdout:8/42: dread f2 [4194304,4194304] 0 2024-04-23T10:17:43.773 INFO:tasks.workunit.client.0.smithi026.stdout:8/43: readlink l0 0 2024-04-23T10:17:43.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/44: truncate f2 6054253 0 2024-04-23T10:17:43.775 INFO:tasks.workunit.client.0.smithi026.stdout:0/150: rmdir d7/d8/d1e 39 2024-04-23T10:17:43.783 INFO:tasks.workunit.client.0.smithi026.stdout:3/135: getdents d0/d8/df/d17 0 2024-04-23T10:17:43.786 INFO:tasks.workunit.client.0.smithi026.stdout:8/45: creat d5/d9/fb x:0 0 0 2024-04-23T10:17:43.788 INFO:tasks.workunit.client.0.smithi026.stdout:8/46: write d5/d9/fb [553320,126039] 0 2024-04-23T10:17:43.788 INFO:tasks.workunit.client.0.smithi026.stdout:0/151: rmdir d7/d8/d1e/d1d/d2f 39 2024-04-23T10:17:43.791 INFO:tasks.workunit.client.0.smithi026.stdout:3/136: creat d0/d8/d29/f34 x:0 0 0 2024-04-23T10:17:43.794 INFO:tasks.workunit.client.0.smithi026.stdout:4/49: rename d4/d7/la to d4/lc 0 2024-04-23T10:17:43.794 INFO:tasks.workunit.client.0.smithi026.stdout:8/47: write f2 [6666236,109264] 0 2024-04-23T10:17:43.798 INFO:tasks.workunit.client.0.smithi026.stdout:0/152: creat d7/d8/d1e/d30/f40 x:0 0 0 2024-04-23T10:17:43.801 INFO:tasks.workunit.client.0.smithi026.stdout:4/50: rmdir d4/d7 39 2024-04-23T10:17:43.803 INFO:tasks.workunit.client.0.smithi026.stdout:3/137: read d0/d8/df/f1b [321616,90387] 0 2024-04-23T10:17:43.805 INFO:tasks.workunit.client.0.smithi026.stdout:3/138: chown d0/d8/df/f18 112 1 2024-04-23T10:17:43.806 INFO:tasks.workunit.client.0.smithi026.stdout:0/153: rename f0 to d7/d8/d1e/f41 0 2024-04-23T10:17:43.807 INFO:tasks.workunit.client.0.smithi026.stdout:7/63: dread dd/fe [4194304,4194304] 0 2024-04-23T10:17:43.808 INFO:tasks.workunit.client.0.smithi026.stdout:3/139: write d0/d8/df/f1b [1298340,5453] 0 2024-04-23T10:17:43.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/140: write d0/d8/df/f1b [255813,6574] 0 2024-04-23T10:17:43.812 INFO:tasks.workunit.client.0.smithi026.stdout:0/154: mknod d7/d8/c42 0 2024-04-23T10:17:43.813 INFO:tasks.workunit.client.0.smithi026.stdout:7/64: mknod dd/c1a 0 2024-04-23T10:17:43.813 INFO:tasks.workunit.client.0.smithi026.stdout:0/155: dread - d7/d8/f31 zero size 2024-04-23T10:17:43.820 INFO:tasks.workunit.client.0.smithi026.stdout:3/141: creat d0/d8/d29/f35 x:0 0 0 2024-04-23T10:17:43.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/51: unlink d4/lc 0 2024-04-23T10:17:43.826 INFO:tasks.workunit.client.0.smithi026.stdout:7/65: dwrite dd/f11 [0,4194304] 0 2024-04-23T10:17:43.829 INFO:tasks.workunit.client.0.smithi026.stdout:0/156: mkdir d7/d43 0 2024-04-23T10:17:43.830 INFO:tasks.workunit.client.0.smithi026.stdout:8/48: dread f4 [0,4194304] 0 2024-04-23T10:17:43.831 INFO:tasks.workunit.client.0.smithi026.stdout:3/142: symlink d0/l36 0 2024-04-23T10:17:43.832 INFO:tasks.workunit.client.0.smithi026.stdout:4/52: chown d4/d7 89 1 2024-04-23T10:17:43.842 INFO:tasks.workunit.client.0.smithi026.stdout:8/49: unlink f4 0 2024-04-23T10:17:43.842 INFO:tasks.workunit.client.0.smithi026.stdout:7/66: dwrite dd/f10 [0,4194304] 0 2024-04-23T10:17:43.843 INFO:tasks.workunit.client.0.smithi026.stdout:3/143: write d0/d1e/f31 [787549,34674] 0 2024-04-23T10:17:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:8/50: fsync f2 0 2024-04-23T10:17:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:7/67: dread - dd/ff zero size 2024-04-23T10:17:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:0/157: write d7/d8/d1e/d1d/d2f/f29 [491399,95783] 0 2024-04-23T10:17:43.845 INFO:tasks.workunit.client.0.smithi026.stdout:3/144: stat d0/d8/l12 0 2024-04-23T10:17:43.851 INFO:tasks.workunit.client.0.smithi026.stdout:8/51: rmdir d5 39 2024-04-23T10:17:43.853 INFO:tasks.workunit.client.0.smithi026.stdout:3/145: dread d0/d8/df/d17/f1d [0,4194304] 0 2024-04-23T10:17:43.856 INFO:tasks.workunit.client.0.smithi026.stdout:8/52: rmdir d5/d9 39 2024-04-23T10:17:43.856 INFO:tasks.workunit.client.0.smithi026.stdout:4/53: dwrite d4/d7/f9 [0,4194304] 0 2024-04-23T10:17:43.859 INFO:tasks.workunit.client.0.smithi026.stdout:0/158: creat d7/d8/d1e/d1d/d2f/f44 x:0 0 0 2024-04-23T10:17:43.862 INFO:tasks.workunit.client.0.smithi026.stdout:3/146: link d0/f6 d0/d1e/f37 0 2024-04-23T10:17:43.866 INFO:tasks.workunit.client.0.smithi026.stdout:8/53: creat d5/d9/fc x:0 0 0 2024-04-23T10:17:43.867 INFO:tasks.workunit.client.0.smithi026.stdout:4/54: link f3 d4/d7/fd 0 2024-04-23T10:17:43.870 INFO:tasks.workunit.client.0.smithi026.stdout:0/159: symlink d7/d8/d1e/d1d/d2f/l45 0 2024-04-23T10:17:43.870 INFO:tasks.workunit.client.0.smithi026.stdout:8/54: read d5/d9/fb [318941,75027] 0 2024-04-23T10:17:43.872 INFO:tasks.workunit.client.0.smithi026.stdout:8/55: write f2 [6108538,71909] 0 2024-04-23T10:17:43.873 INFO:tasks.workunit.client.0.smithi026.stdout:4/55: symlink d4/le 0 2024-04-23T10:17:43.873 INFO:tasks.workunit.client.0.smithi026.stdout:8/56: write f2 [6866916,7929] 0 2024-04-23T10:17:43.875 INFO:tasks.workunit.client.0.smithi026.stdout:3/147: link d0/fc d0/d8/f38 0 2024-04-23T10:17:43.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/148: readlink d0/d8/df/l16 0 2024-04-23T10:17:43.878 INFO:tasks.workunit.client.0.smithi026.stdout:0/160: mknod d7/d8/d1e/d1d/c46 0 2024-04-23T10:17:43.879 INFO:tasks.workunit.client.0.smithi026.stdout:3/149: mkdir d0/d8/d29/d39 0 2024-04-23T10:17:43.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/56: mknod d4/cf 0 2024-04-23T10:17:43.881 INFO:tasks.workunit.client.0.smithi026.stdout:8/57: creat d5/fd x:0 0 0 2024-04-23T10:17:43.883 INFO:tasks.workunit.client.0.smithi026.stdout:7/68: dread dd/f13 [0,4194304] 0 2024-04-23T10:17:43.883 INFO:tasks.workunit.client.0.smithi026.stdout:4/57: mkdir d4/d10 0 2024-04-23T10:17:43.883 INFO:tasks.workunit.client.0.smithi026.stdout:0/161: truncate d7/d8/d1e/d1d/d2f/f44 1016877 0 2024-04-23T10:17:43.884 INFO:tasks.workunit.client.0.smithi026.stdout:3/150: getdents d0/d8/df/d17 0 2024-04-23T10:17:43.885 INFO:tasks.workunit.client.0.smithi026.stdout:8/58: mknod d5/ce 0 2024-04-23T10:17:43.885 INFO:tasks.workunit.client.0.smithi026.stdout:3/151: fsync d0/d8/d29/f34 0 2024-04-23T10:17:43.889 INFO:tasks.workunit.client.0.smithi026.stdout:3/152: symlink d0/d8/df/d1f/l3a 0 2024-04-23T10:17:43.891 INFO:tasks.workunit.client.0.smithi026.stdout:4/58: dread d4/f5 [0,4194304] 0 2024-04-23T10:17:43.895 INFO:tasks.workunit.client.0.smithi026.stdout:3/153: link d0/d8/df/f18 d0/d8/f3b 0 2024-04-23T10:17:43.899 INFO:tasks.workunit.client.0.smithi026.stdout:4/59: dwrite d4/d7/fd [0,4194304] 0 2024-04-23T10:17:43.900 INFO:tasks.workunit.client.0.smithi026.stdout:8/59: getdents d5 0 2024-04-23T10:17:43.900 INFO:tasks.workunit.client.0.smithi026.stdout:7/69: truncate dd/f10 1462611 0 2024-04-23T10:17:43.901 INFO:tasks.workunit.client.0.smithi026.stdout:4/60: symlink d4/l11 0 2024-04-23T10:17:43.903 INFO:tasks.workunit.client.0.smithi026.stdout:8/60: rename d5/fd to d5/d9/ff 0 2024-04-23T10:17:43.904 INFO:tasks.workunit.client.0.smithi026.stdout:5/48: sync 2024-04-23T10:17:43.905 INFO:tasks.workunit.client.0.smithi026.stdout:3/154: write d0/d8/f3b [469556,84681] 0 2024-04-23T10:17:43.910 INFO:tasks.workunit.client.0.smithi026.stdout:3/155: creat d0/f3c x:0 0 0 2024-04-23T10:17:43.911 INFO:tasks.workunit.client.0.smithi026.stdout:7/70: rmdir dd/d19 0 2024-04-23T10:17:43.911 INFO:tasks.workunit.client.0.smithi026.stdout:7/71: dread - dd/f16 zero size 2024-04-23T10:17:43.915 INFO:tasks.workunit.client.0.smithi026.stdout:4/61: truncate d4/d7/fd 2197513 0 2024-04-23T10:17:43.916 INFO:tasks.workunit.client.0.smithi026.stdout:3/156: symlink d0/d8/d29/d39/l3d 0 2024-04-23T10:17:43.918 INFO:tasks.workunit.client.0.smithi026.stdout:5/49: getdents d0 0 2024-04-23T10:17:43.923 INFO:tasks.workunit.client.0.smithi026.stdout:5/50: mknod d0/c11 0 2024-04-23T10:17:43.924 INFO:tasks.workunit.client.0.smithi026.stdout:3/157: mknod d0/d1e/d23/c3e 0 2024-04-23T10:17:43.925 INFO:tasks.workunit.client.0.smithi026.stdout:8/61: link f2 d5/d9/f10 0 2024-04-23T10:17:43.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/51: mkdir d0/d12 0 2024-04-23T10:17:43.928 INFO:tasks.workunit.client.0.smithi026.stdout:5/52: write d0/f2 [1276461,105559] 0 2024-04-23T10:17:43.928 INFO:tasks.workunit.client.0.smithi026.stdout:3/158: creat d0/d8/d29/f3f x:0 0 0 2024-04-23T10:17:43.930 INFO:tasks.workunit.client.0.smithi026.stdout:5/53: write d0/ff [17187,39455] 0 2024-04-23T10:17:43.930 INFO:tasks.workunit.client.0.smithi026.stdout:3/159: write d0/d8/d29/f3f [1021056,16188] 0 2024-04-23T10:17:43.931 INFO:tasks.workunit.client.0.smithi026.stdout:8/62: creat d5/f11 x:0 0 0 2024-04-23T10:17:43.933 INFO:tasks.workunit.client.0.smithi026.stdout:3/160: write d0/d8/df/f1a [27581,35012] 0 2024-04-23T10:17:43.937 INFO:tasks.workunit.client.0.smithi026.stdout:3/161: symlink d0/l40 0 2024-04-23T10:17:43.937 INFO:tasks.workunit.client.0.smithi026.stdout:8/63: chown d5/d9/f10 226729 1 2024-04-23T10:17:43.939 INFO:tasks.workunit.client.0.smithi026.stdout:8/64: read d5/d9/f10 [4428110,102934] 0 2024-04-23T10:17:43.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/162: read d0/d1e/f37 [2243850,76301] 0 2024-04-23T10:17:43.940 INFO:tasks.workunit.client.0.smithi026.stdout:7/72: dwrite dd/f10 [0,4194304] 0 2024-04-23T10:17:43.940 INFO:tasks.workunit.client.0.smithi026.stdout:8/65: chown f2 10 1 2024-04-23T10:17:43.941 INFO:tasks.workunit.client.0.smithi026.stdout:3/163: truncate d0/f3c 923469 0 2024-04-23T10:17:43.944 INFO:tasks.workunit.client.0.smithi026.stdout:8/66: mknod d5/c12 0 2024-04-23T10:17:43.946 INFO:tasks.workunit.client.0.smithi026.stdout:7/73: link dd/f13 dd/f1b 0 2024-04-23T10:17:43.946 INFO:tasks.workunit.client.0.smithi026.stdout:5/54: dread d0/f8 [0,4194304] 0 2024-04-23T10:17:43.947 INFO:tasks.workunit.client.0.smithi026.stdout:7/74: dread - f6 zero size 2024-04-23T10:17:43.947 INFO:tasks.workunit.client.0.smithi026.stdout:5/55: readlink d0/l1 0 2024-04-23T10:17:43.948 INFO:tasks.workunit.client.0.smithi026.stdout:7/75: write dd/f11 [1418564,18165] 0 2024-04-23T10:17:43.949 INFO:tasks.workunit.client.0.smithi026.stdout:7/76: write dd/ff [285731,1153] 0 2024-04-23T10:17:43.953 INFO:tasks.workunit.client.0.smithi026.stdout:8/67: rename d5/f11 to d5/f13 0 2024-04-23T10:17:43.953 INFO:tasks.workunit.client.0.smithi026.stdout:3/164: getdents d0/d8/d29/d39 0 2024-04-23T10:17:43.953 INFO:tasks.workunit.client.0.smithi026.stdout:8/68: read - d5/d9/fc zero size 2024-04-23T10:17:43.954 INFO:tasks.workunit.client.0.smithi026.stdout:7/77: symlink dd/l1c 0 2024-04-23T10:17:43.957 INFO:tasks.workunit.client.0.smithi026.stdout:3/165: creat d0/d1e/d23/f41 x:0 0 0 2024-04-23T10:17:43.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/69: mkdir d5/d9/d14 0 2024-04-23T10:17:43.960 INFO:tasks.workunit.client.0.smithi026.stdout:8/70: dread - d5/d9/ff zero size 2024-04-23T10:17:43.967 INFO:tasks.workunit.client.0.smithi026.stdout:3/166: dwrite d0/d8/d29/f35 [0,4194304] 0 2024-04-23T10:17:43.969 INFO:tasks.workunit.client.0.smithi026.stdout:3/167: fdatasync d0/d8/f38 0 2024-04-23T10:17:43.971 INFO:tasks.workunit.client.0.smithi026.stdout:3/168: chown d0/d8/df/d1f/c24 310 1 2024-04-23T10:17:43.971 INFO:tasks.workunit.client.0.smithi026.stdout:7/78: dwrite dd/f13 [0,4194304] 0 2024-04-23T10:17:43.974 INFO:tasks.workunit.client.0.smithi026.stdout:7/79: mkdir dd/d1d 0 2024-04-23T10:17:43.975 INFO:tasks.workunit.client.0.smithi026.stdout:3/169: creat d0/d8/f42 x:0 0 0 2024-04-23T10:17:43.976 INFO:tasks.workunit.client.0.smithi026.stdout:8/71: dwrite d5/d9/f10 [0,4194304] 0 2024-04-23T10:17:43.979 INFO:tasks.workunit.client.0.smithi026.stdout:3/170: unlink d0/d8/df/d17/f1d 0 2024-04-23T10:17:43.980 INFO:tasks.workunit.client.0.smithi026.stdout:7/80: dread dd/f11 [0,4194304] 0 2024-04-23T10:17:43.986 INFO:tasks.workunit.client.0.smithi026.stdout:8/72: mkdir d5/d9/d14/d15 0 2024-04-23T10:17:43.992 INFO:tasks.workunit.client.0.smithi026.stdout:8/73: dread d5/d9/f10 [0,4194304] 0 2024-04-23T10:17:43.993 INFO:tasks.workunit.client.0.smithi026.stdout:8/74: fsync d5/d9/fc 0 2024-04-23T10:17:43.993 INFO:tasks.workunit.client.0.smithi026.stdout:3/171: dwrite d0/fc [0,4194304] 0 2024-04-23T10:17:43.998 INFO:tasks.workunit.client.0.smithi026.stdout:8/75: dread f2 [0,4194304] 0 2024-04-23T10:17:43.998 INFO:tasks.workunit.client.0.smithi026.stdout:8/76: dread - d5/d9/fa zero size 2024-04-23T10:17:44.004 INFO:tasks.workunit.client.0.smithi026.stdout:8/77: write d5/d9/ff [386933,102488] 0 2024-04-23T10:17:44.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/172: getdents d0/d8 0 2024-04-23T10:17:44.008 INFO:tasks.workunit.client.0.smithi026.stdout:3/173: readlink d0/l2 0 2024-04-23T10:17:44.011 INFO:tasks.workunit.client.0.smithi026.stdout:8/78: symlink d5/l16 0 2024-04-23T10:17:44.013 INFO:tasks.workunit.client.0.smithi026.stdout:3/174: rename d0/d8 to d0/d1e/d30/d43 0 2024-04-23T10:17:44.014 INFO:tasks.workunit.client.0.smithi026.stdout:8/79: symlink d5/d9/l17 0 2024-04-23T10:17:44.014 INFO:tasks.workunit.client.0.smithi026.stdout:8/80: fsync d5/d9/ff 0 2024-04-23T10:17:44.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/137: sync 2024-04-23T10:17:44.072 INFO:tasks.workunit.client.0.smithi026.stdout:7/81: dread dd/fe [0,4194304] 0 2024-04-23T10:17:44.072 INFO:tasks.workunit.client.0.smithi026.stdout:9/138: chown d13/d1b/d26 24657 1 2024-04-23T10:17:44.073 INFO:tasks.workunit.client.0.smithi026.stdout:9/139: chown f8 4 1 2024-04-23T10:17:44.076 INFO:tasks.workunit.client.0.smithi026.stdout:8/81: dwrite d5/d9/ff [0,4194304] 0 2024-04-23T10:17:44.077 INFO:tasks.workunit.client.0.smithi026.stdout:9/140: symlink d13/d1b/l27 0 2024-04-23T10:17:44.079 INFO:tasks.workunit.client.0.smithi026.stdout:7/82: mkdir dd/d1d/d1e 0 2024-04-23T10:17:44.083 INFO:tasks.workunit.client.0.smithi026.stdout:7/83: write dd/f10 [180275,72409] 0 2024-04-23T10:17:44.088 INFO:tasks.workunit.client.0.smithi026.stdout:8/82: dread d5/d9/ff [0,4194304] 0 2024-04-23T10:17:44.093 INFO:tasks.workunit.client.0.smithi026.stdout:8/83: dread - d5/d9/fa zero size 2024-04-23T10:17:44.099 INFO:tasks.workunit.client.0.smithi026.stdout:8/84: unlink d5/d9/l17 0 2024-04-23T10:17:44.102 INFO:tasks.workunit.client.0.smithi026.stdout:9/141: truncate ff 1062301 0 2024-04-23T10:17:44.103 INFO:tasks.workunit.client.0.smithi026.stdout:7/84: dwrite dd/f1b [0,4194304] 0 2024-04-23T10:17:44.104 INFO:tasks.workunit.client.0.smithi026.stdout:7/85: fdatasync dd/f10 0 2024-04-23T10:17:44.104 INFO:tasks.workunit.client.0.smithi026.stdout:7/86: read dd/f11 [977014,63525] 0 2024-04-23T10:17:44.105 INFO:tasks.workunit.client.0.smithi026.stdout:9/142: unlink cb 0 2024-04-23T10:17:44.109 INFO:tasks.workunit.client.0.smithi026.stdout:8/85: creat d5/d9/d14/d15/f18 x:0 0 0 2024-04-23T10:17:44.112 INFO:tasks.workunit.client.0.smithi026.stdout:9/143: rename d13/d19/l1f to d13/d1b/d26/l28 0 2024-04-23T10:17:44.113 INFO:tasks.workunit.client.0.smithi026.stdout:8/86: symlink d5/d9/d14/l19 0 2024-04-23T10:17:44.114 INFO:tasks.workunit.client.0.smithi026.stdout:9/144: symlink d13/d1b/l29 0 2024-04-23T10:17:44.116 INFO:tasks.workunit.client.0.smithi026.stdout:9/145: mkdir d13/d2a 0 2024-04-23T10:17:44.116 INFO:tasks.workunit.client.0.smithi026.stdout:9/146: dread - d13/f25 zero size 2024-04-23T10:17:44.117 INFO:tasks.workunit.client.0.smithi026.stdout:9/147: chown l2 3248 1 2024-04-23T10:17:44.122 INFO:tasks.workunit.client.0.smithi026.stdout:9/148: mkdir d13/d1b/d2b 0 2024-04-23T10:17:44.123 INFO:tasks.workunit.client.0.smithi026.stdout:9/149: fdatasync d13/f1c 0 2024-04-23T10:17:44.125 INFO:tasks.workunit.client.0.smithi026.stdout:8/87: dwrite d5/d9/fb [0,4194304] 0 2024-04-23T10:17:44.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/87: fsync dd/f13 0 2024-04-23T10:17:44.131 INFO:tasks.workunit.client.0.smithi026.stdout:9/150: dread d13/f17 [0,4194304] 0 2024-04-23T10:17:44.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/88: dread - f6 zero size 2024-04-23T10:17:44.135 INFO:tasks.workunit.client.0.smithi026.stdout:7/89: write dd/f16 [665857,89915] 0 2024-04-23T10:17:44.149 INFO:tasks.workunit.client.0.smithi026.stdout:7/90: getdents dd/d1d 0 2024-04-23T10:17:44.149 INFO:tasks.workunit.client.0.smithi026.stdout:8/88: dwrite d5/d9/ff [4194304,4194304] 0 2024-04-23T10:17:44.152 INFO:tasks.workunit.client.0.smithi026.stdout:7/91: write dd/f13 [2968896,123243] 0 2024-04-23T10:17:44.155 INFO:tasks.workunit.client.0.smithi026.stdout:9/151: dwrite d13/f25 [0,4194304] 0 2024-04-23T10:17:44.159 INFO:tasks.workunit.client.0.smithi026.stdout:8/89: link d5/d9/d14/l19 d5/d9/l1a 0 2024-04-23T10:17:44.162 INFO:tasks.workunit.client.0.smithi026.stdout:9/152: getdents d13/d1b/d26 0 2024-04-23T10:17:44.164 INFO:tasks.workunit.client.0.smithi026.stdout:8/90: creat d5/f1b x:0 0 0 2024-04-23T10:17:44.167 INFO:tasks.workunit.client.0.smithi026.stdout:9/153: mkdir d13/d1b/d2b/d2c 0 2024-04-23T10:17:44.167 INFO:tasks.workunit.client.0.smithi026.stdout:7/92: dwrite dd/fe [4194304,4194304] 0 2024-04-23T10:17:44.169 INFO:tasks.workunit.client.0.smithi026.stdout:8/91: creat d5/d9/d14/f1c x:0 0 0 2024-04-23T10:17:44.171 INFO:tasks.workunit.client.0.smithi026.stdout:8/92: chown d5/d9/d14/f1c 93255 1 2024-04-23T10:17:44.176 INFO:tasks.workunit.client.0.smithi026.stdout:9/154: rename f8 to d13/f2d 0 2024-04-23T10:17:44.179 INFO:tasks.workunit.client.0.smithi026.stdout:8/93: getdents d5/d9/d14/d15 0 2024-04-23T10:17:44.181 INFO:tasks.workunit.client.0.smithi026.stdout:8/94: symlink d5/l1d 0 2024-04-23T10:17:44.182 INFO:tasks.workunit.client.0.smithi026.stdout:7/93: dread dd/f16 [0,4194304] 0 2024-04-23T10:17:44.183 INFO:tasks.workunit.client.0.smithi026.stdout:7/94: fsync f6 0 2024-04-23T10:17:44.188 INFO:tasks.workunit.client.0.smithi026.stdout:9/155: dwrite d13/f1e [0,4194304] 0 2024-04-23T10:17:44.190 INFO:tasks.workunit.client.0.smithi026.stdout:9/156: creat d13/d1b/d26/f2e x:0 0 0 2024-04-23T10:17:44.192 INFO:tasks.workunit.client.0.smithi026.stdout:9/157: truncate d13/d1b/d26/f2e 990445 0 2024-04-23T10:17:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:2/92: sync 2024-04-23T10:17:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:6/188: sync 2024-04-23T10:17:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:8/95: truncate d5/d9/ff 7541565 0 2024-04-23T10:17:44.198 INFO:tasks.workunit.client.0.smithi026.stdout:7/95: truncate dd/fe 6031792 0 2024-04-23T10:17:44.199 INFO:tasks.workunit.client.0.smithi026.stdout:7/96: stat dd/f11 0 2024-04-23T10:17:44.201 INFO:tasks.workunit.client.0.smithi026.stdout:7/97: dread - f6 zero size 2024-04-23T10:17:44.201 INFO:tasks.workunit.client.0.smithi026.stdout:2/93: creat d3/f22 x:0 0 0 2024-04-23T10:17:44.201 INFO:tasks.workunit.client.0.smithi026.stdout:8/96: write d5/f13 [513486,3977] 0 2024-04-23T10:17:44.203 INFO:tasks.workunit.client.0.smithi026.stdout:6/189: rename f4 to d6/d21/d2f/d37/f3f 0 2024-04-23T10:17:44.207 INFO:tasks.workunit.client.0.smithi026.stdout:9/158: dwrite d13/f1c [0,4194304] 0 2024-04-23T10:17:44.207 INFO:tasks.workunit.client.0.smithi026.stdout:8/97: symlink d5/d9/d14/d15/l1e 0 2024-04-23T10:17:44.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/98: dwrite dd/ff [0,4194304] 0 2024-04-23T10:17:44.218 INFO:tasks.workunit.client.0.smithi026.stdout:6/190: fdatasync d6/d21/d2f/d37/f3a 0 2024-04-23T10:17:44.219 INFO:tasks.workunit.client.0.smithi026.stdout:2/94: mkdir d3/d19/d21/d23 0 2024-04-23T10:17:44.221 INFO:tasks.workunit.client.0.smithi026.stdout:9/159: dwrite d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:44.223 INFO:tasks.workunit.client.0.smithi026.stdout:6/191: symlink d6/d21/l40 0 2024-04-23T10:17:44.223 INFO:tasks.workunit.client.0.smithi026.stdout:9/160: chown l12 0 1 2024-04-23T10:17:44.225 INFO:tasks.workunit.client.0.smithi026.stdout:7/99: mknod dd/d1d/d1e/c1f 0 2024-04-23T10:17:44.225 INFO:tasks.workunit.client.0.smithi026.stdout:7/100: chown l1 831604 1 2024-04-23T10:17:44.228 INFO:tasks.workunit.client.0.smithi026.stdout:6/192: rename d6/d21/d2f/f3d to d6/d21/d2f/d32/f41 0 2024-04-23T10:17:44.229 INFO:tasks.workunit.client.0.smithi026.stdout:9/161: link d13/f1e d13/d2a/f2f 0 2024-04-23T10:17:44.229 INFO:tasks.workunit.client.0.smithi026.stdout:2/95: dwrite d3/dd/f15 [0,4194304] 0 2024-04-23T10:17:44.231 INFO:tasks.workunit.client.0.smithi026.stdout:7/101: creat dd/d1d/f20 x:0 0 0 2024-04-23T10:17:44.232 INFO:tasks.workunit.client.0.smithi026.stdout:2/96: write d3/dd/f18 [1044204,125806] 0 2024-04-23T10:17:44.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/162: creat d13/d1b/d26/f30 x:0 0 0 2024-04-23T10:17:44.235 INFO:tasks.workunit.client.0.smithi026.stdout:9/163: write d13/f1c [2492515,44519] 0 2024-04-23T10:17:44.237 INFO:tasks.workunit.client.0.smithi026.stdout:6/193: symlink d6/l42 0 2024-04-23T10:17:44.240 INFO:tasks.workunit.client.0.smithi026.stdout:7/102: rename ca to dd/d1d/c21 0 2024-04-23T10:17:44.243 INFO:tasks.workunit.client.0.smithi026.stdout:8/98: truncate d5/d9/ff 8487351 0 2024-04-23T10:17:44.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/97: dwrite d3/fa [0,4194304] 0 2024-04-23T10:17:44.249 INFO:tasks.workunit.client.0.smithi026.stdout:8/99: creat d5/d9/d14/f1f x:0 0 0 2024-04-23T10:17:44.250 INFO:tasks.workunit.client.0.smithi026.stdout:9/164: dread d13/f22 [0,4194304] 0 2024-04-23T10:17:44.251 INFO:tasks.workunit.client.0.smithi026.stdout:8/100: truncate d5/d9/fc 61530 0 2024-04-23T10:17:44.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/101: readlink l0 0 2024-04-23T10:17:44.255 INFO:tasks.workunit.client.0.smithi026.stdout:7/103: truncate dd/f11 3258867 0 2024-04-23T10:17:44.259 INFO:tasks.workunit.client.0.smithi026.stdout:8/102: write d5/d9/d14/d15/f18 [261988,53618] 0 2024-04-23T10:17:44.259 INFO:tasks.workunit.client.0.smithi026.stdout:2/98: dwrite d3/f22 [0,4194304] 0 2024-04-23T10:17:44.266 INFO:tasks.workunit.client.0.smithi026.stdout:9/165: dread d13/f17 [0,4194304] 0 2024-04-23T10:17:44.266 INFO:tasks.workunit.client.0.smithi026.stdout:6/194: dread d6/d13/f17 [0,4194304] 0 2024-04-23T10:17:44.266 INFO:tasks.workunit.client.0.smithi026.stdout:2/99: unlink d3/f17 0 2024-04-23T10:17:44.267 INFO:tasks.workunit.client.0.smithi026.stdout:6/195: stat d6/d13/d15/l24 0 2024-04-23T10:17:44.267 INFO:tasks.workunit.client.0.smithi026.stdout:9/166: mkdir d13/d31 0 2024-04-23T10:17:44.267 INFO:tasks.workunit.client.0.smithi026.stdout:6/196: chown d6/d21/d2f/d31 535 1 2024-04-23T10:17:44.268 INFO:tasks.workunit.client.0.smithi026.stdout:8/103: getdents d5/d9/d14 0 2024-04-23T10:17:44.270 INFO:tasks.workunit.client.0.smithi026.stdout:2/100: creat d3/d19/d21/d23/f24 x:0 0 0 2024-04-23T10:17:44.271 INFO:tasks.workunit.client.0.smithi026.stdout:6/197: rename d6/d13/d15/l18 to d6/d21/d2f/l43 0 2024-04-23T10:17:44.272 INFO:tasks.workunit.client.0.smithi026.stdout:8/104: mknod d5/d9/d14/c20 0 2024-04-23T10:17:44.273 INFO:tasks.workunit.client.0.smithi026.stdout:8/105: write d5/f13 [387617,25956] 0 2024-04-23T10:17:44.274 INFO:tasks.workunit.client.0.smithi026.stdout:2/101: unlink d3/fc 0 2024-04-23T10:17:44.275 INFO:tasks.workunit.client.0.smithi026.stdout:8/106: chown d5/d9/f10 664795683 1 2024-04-23T10:17:44.277 INFO:tasks.workunit.client.0.smithi026.stdout:6/198: rename d6/d21/d2f/l3c to d6/d21/d2f/d31/l44 0 2024-04-23T10:17:44.277 INFO:tasks.workunit.client.0.smithi026.stdout:9/167: write d13/f1e [3339613,90709] 0 2024-04-23T10:17:44.278 INFO:tasks.workunit.client.0.smithi026.stdout:6/199: chown d6/d21/d2f 123731 1 2024-04-23T10:17:44.279 INFO:tasks.workunit.client.0.smithi026.stdout:9/168: chown d13/d1b/l29 107 1 2024-04-23T10:17:44.279 INFO:tasks.workunit.client.0.smithi026.stdout:6/200: write f0 [3427527,32431] 0 2024-04-23T10:17:44.284 INFO:tasks.workunit.client.0.smithi026.stdout:9/169: mknod d13/d1b/d2b/c32 0 2024-04-23T10:17:44.285 INFO:tasks.workunit.client.0.smithi026.stdout:6/201: dread d6/d13/f17 [0,4194304] 0 2024-04-23T10:17:44.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/102: write d3/f8 [3472909,4748] 0 2024-04-23T10:17:44.286 INFO:tasks.workunit.client.0.smithi026.stdout:6/202: fsync f0 0 2024-04-23T10:17:44.288 INFO:tasks.workunit.client.0.smithi026.stdout:8/107: getdents d5/d9 0 2024-04-23T10:17:44.291 INFO:tasks.workunit.client.0.smithi026.stdout:2/103: creat d3/d19/d1d/f25 x:0 0 0 2024-04-23T10:17:44.293 INFO:tasks.workunit.client.0.smithi026.stdout:9/170: dwrite d13/d1b/d26/f30 [0,4194304] 0 2024-04-23T10:17:44.296 INFO:tasks.workunit.client.0.smithi026.stdout:8/108: getdents d5 0 2024-04-23T10:17:44.297 INFO:tasks.workunit.client.0.smithi026.stdout:9/171: fsync ff 0 2024-04-23T10:17:44.298 INFO:tasks.workunit.client.0.smithi026.stdout:6/203: dwrite d6/d33/f2c [4194304,4194304] 0 2024-04-23T10:17:44.299 INFO:tasks.workunit.client.0.smithi026.stdout:8/109: chown d5/d9/d14/d15/f18 6 1 2024-04-23T10:17:44.299 INFO:tasks.workunit.client.0.smithi026.stdout:6/204: chown d6/d21/d2f/d37 20140 1 2024-04-23T10:17:44.300 INFO:tasks.workunit.client.0.smithi026.stdout:9/172: write f5 [2399021,112210] 0 2024-04-23T10:17:44.300 INFO:tasks.workunit.client.0.smithi026.stdout:2/104: getdents d3/d19/d1d 0 2024-04-23T10:17:44.301 INFO:tasks.workunit.client.0.smithi026.stdout:9/173: chown d13/f22 746 1 2024-04-23T10:17:44.301 INFO:tasks.workunit.client.0.smithi026.stdout:8/110: write f2 [3733757,78351] 0 2024-04-23T10:17:44.303 INFO:tasks.workunit.client.0.smithi026.stdout:2/105: mknod d3/d19/d1d/c26 0 2024-04-23T10:17:44.303 INFO:tasks.workunit.client.0.smithi026.stdout:8/111: truncate d5/f1b 773603 0 2024-04-23T10:17:44.304 INFO:tasks.workunit.client.0.smithi026.stdout:2/106: fdatasync d3/fa 0 2024-04-23T10:17:44.304 INFO:tasks.workunit.client.0.smithi026.stdout:8/112: dread - d5/d9/fa zero size 2024-04-23T10:17:44.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/174: dread d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:44.309 INFO:tasks.workunit.client.0.smithi026.stdout:9/175: read f5 [6449049,11731] 0 2024-04-23T10:17:44.310 INFO:tasks.workunit.client.0.smithi026.stdout:8/113: mknod d5/d9/c21 0 2024-04-23T10:17:44.312 INFO:tasks.workunit.client.0.smithi026.stdout:8/114: write d5/f13 [1170034,66623] 0 2024-04-23T10:17:44.315 INFO:tasks.workunit.client.0.smithi026.stdout:9/176: fdatasync f6 0 2024-04-23T10:17:44.315 INFO:tasks.workunit.client.0.smithi026.stdout:2/107: rename d3/d19/d1d/c1f to d3/dd/c27 0 2024-04-23T10:17:44.316 INFO:tasks.workunit.client.0.smithi026.stdout:2/108: stat d3/fa 0 2024-04-23T10:17:44.317 INFO:tasks.workunit.client.0.smithi026.stdout:6/205: truncate f3 526046 0 2024-04-23T10:17:44.318 INFO:tasks.workunit.client.0.smithi026.stdout:6/206: write d6/fd [1304188,9500] 0 2024-04-23T10:17:44.318 INFO:tasks.workunit.client.0.smithi026.stdout:8/115: unlink d5/f1b 0 2024-04-23T10:17:44.322 INFO:tasks.workunit.client.0.smithi026.stdout:2/109: symlink d3/d19/d21/l28 0 2024-04-23T10:17:44.323 INFO:tasks.workunit.client.0.smithi026.stdout:2/110: fsync d3/d19/f1c 0 2024-04-23T10:17:44.324 INFO:tasks.workunit.client.0.smithi026.stdout:2/111: fsync d3/d19/f1c 0 2024-04-23T10:17:44.327 INFO:tasks.workunit.client.0.smithi026.stdout:6/207: dwrite d6/f3b [0,4194304] 0 2024-04-23T10:17:44.329 INFO:tasks.workunit.client.0.smithi026.stdout:9/177: rmdir d13/d1b/d2b/d2c 0 2024-04-23T10:17:44.333 INFO:tasks.workunit.client.0.smithi026.stdout:6/208: symlink d6/d13/d15/l45 0 2024-04-23T10:17:44.334 INFO:tasks.workunit.client.0.smithi026.stdout:6/209: chown d6/d13 24019 1 2024-04-23T10:17:44.334 INFO:tasks.workunit.client.0.smithi026.stdout:9/178: truncate f5 5742910 0 2024-04-23T10:17:44.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/179: write d13/d1b/d26/f30 [3056959,64309] 0 2024-04-23T10:17:44.337 INFO:tasks.workunit.client.0.smithi026.stdout:2/112: truncate d3/d19/f1c 3175965 0 2024-04-23T10:17:44.338 INFO:tasks.workunit.client.0.smithi026.stdout:9/180: read ff [922933,111804] 0 2024-04-23T10:17:44.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/113: chown d3/f8 175598 1 2024-04-23T10:17:44.339 INFO:tasks.workunit.client.0.smithi026.stdout:6/210: mknod d6/d21/d2f/d32/c46 0 2024-04-23T10:17:44.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/114: fdatasync d3/d19/d21/d23/f24 0 2024-04-23T10:17:44.341 INFO:tasks.workunit.client.0.smithi026.stdout:8/116: mkdir d5/d9/d22 0 2024-04-23T10:17:44.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/115: read - d3/d19/d21/d23/f24 zero size 2024-04-23T10:17:44.345 INFO:tasks.workunit.client.0.smithi026.stdout:6/211: dread d6/d13/d15/f2e [4194304,4194304] 0 2024-04-23T10:17:44.346 INFO:tasks.workunit.client.0.smithi026.stdout:8/117: rmdir d5/d9 39 2024-04-23T10:17:44.346 INFO:tasks.workunit.client.0.smithi026.stdout:6/212: truncate d6/d13/d15/f1c 553472 0 2024-04-23T10:17:44.347 INFO:tasks.workunit.client.0.smithi026.stdout:2/116: creat d3/d19/d21/d23/f29 x:0 0 0 2024-04-23T10:17:44.349 INFO:tasks.workunit.client.0.smithi026.stdout:6/213: read d6/fe [763694,54520] 0 2024-04-23T10:17:44.351 INFO:tasks.workunit.client.0.smithi026.stdout:6/214: read d6/d13/d15/f2e [3290098,117505] 0 2024-04-23T10:17:44.352 INFO:tasks.workunit.client.0.smithi026.stdout:6/215: read d6/fd [2680426,117851] 0 2024-04-23T10:17:44.352 INFO:tasks.workunit.client.0.smithi026.stdout:2/117: rename d3/fa to d3/f2a 0 2024-04-23T10:17:44.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/118: chown d3/c20 41019 1 2024-04-23T10:17:44.359 INFO:tasks.workunit.client.0.smithi026.stdout:2/119: dwrite d3/f22 [0,4194304] 0 2024-04-23T10:17:44.361 INFO:tasks.workunit.client.0.smithi026.stdout:6/216: symlink d6/d13/l47 0 2024-04-23T10:17:44.364 INFO:tasks.workunit.client.0.smithi026.stdout:2/120: creat d3/d19/d1d/f2b x:0 0 0 2024-04-23T10:17:44.371 INFO:tasks.workunit.client.0.smithi026.stdout:6/217: dwrite d6/d21/d2f/d37/f3f [4194304,4194304] 0 2024-04-23T10:17:44.374 INFO:tasks.workunit.client.0.smithi026.stdout:8/118: getdents d5 0 2024-04-23T10:17:44.377 INFO:tasks.workunit.client.0.smithi026.stdout:2/121: mknod d3/d19/c2c 0 2024-04-23T10:17:44.377 INFO:tasks.workunit.client.0.smithi026.stdout:2/122: chown d3/dd 0 1 2024-04-23T10:17:44.379 INFO:tasks.workunit.client.0.smithi026.stdout:6/218: mknod d6/d13/d15/c48 0 2024-04-23T10:17:44.380 INFO:tasks.workunit.client.0.smithi026.stdout:6/219: chown d6/fe 46 1 2024-04-23T10:17:44.382 INFO:tasks.workunit.client.0.smithi026.stdout:2/123: creat d3/dd/f2d x:0 0 0 2024-04-23T10:17:44.384 INFO:tasks.workunit.client.0.smithi026.stdout:1/83: sync 2024-04-23T10:17:44.385 INFO:tasks.workunit.client.0.smithi026.stdout:0/162: sync 2024-04-23T10:17:44.387 INFO:tasks.workunit.client.0.smithi026.stdout:6/220: mkdir d6/d13/d49 0 2024-04-23T10:17:44.387 INFO:tasks.workunit.client.0.smithi026.stdout:1/84: symlink dd/l1e 0 2024-04-23T10:17:44.387 INFO:tasks.workunit.client.0.smithi026.stdout:8/119: getdents d5 0 2024-04-23T10:17:44.388 INFO:tasks.workunit.client.0.smithi026.stdout:0/163: creat d7/d8/d1e/d2a/f47 x:0 0 0 2024-04-23T10:17:44.389 INFO:tasks.workunit.client.0.smithi026.stdout:1/85: mknod dd/d13/c1f 0 2024-04-23T10:17:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:8/120: truncate d5/d9/d14/f1f 1001011 0 2024-04-23T10:17:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:0/164: chown d7/d8/c24 51620 1 2024-04-23T10:17:44.390 INFO:tasks.workunit.client.0.smithi026.stdout:6/221: write d6/d13/f17 [4615988,116639] 0 2024-04-23T10:17:44.391 INFO:tasks.workunit.client.0.smithi026.stdout:1/86: write dd/f17 [4552171,126774] 0 2024-04-23T10:17:44.392 INFO:tasks.workunit.client.0.smithi026.stdout:6/222: fsync f0 0 2024-04-23T10:17:44.393 INFO:tasks.workunit.client.0.smithi026.stdout:8/121: chown d5/d9/d14/c20 114206 1 2024-04-23T10:17:44.395 INFO:tasks.workunit.client.0.smithi026.stdout:1/87: fsync dd/d13/f18 0 2024-04-23T10:17:44.395 INFO:tasks.workunit.client.0.smithi026.stdout:2/124: dwrite d3/f13 [0,4194304] 0 2024-04-23T10:17:44.396 INFO:tasks.workunit.client.0.smithi026.stdout:1/88: chown dd/d1a 920657 1 2024-04-23T10:17:44.397 INFO:tasks.workunit.client.0.smithi026.stdout:6/223: chown d6/d21/d2f/d37/f3f 5268936 1 2024-04-23T10:17:44.398 INFO:tasks.workunit.client.0.smithi026.stdout:2/125: rmdir d3 39 2024-04-23T10:17:44.398 INFO:tasks.workunit.client.0.smithi026.stdout:1/89: dread f2 [0,4194304] 0 2024-04-23T10:17:44.400 INFO:tasks.workunit.client.0.smithi026.stdout:0/165: creat d7/d8/d1e/d1d/d2f/f48 x:0 0 0 2024-04-23T10:17:44.402 INFO:tasks.workunit.client.0.smithi026.stdout:6/224: rename f0 to d6/d21/d2f/f4a 0 2024-04-23T10:17:44.402 INFO:tasks.workunit.client.0.smithi026.stdout:1/90: unlink dd/fe 0 2024-04-23T10:17:44.405 INFO:tasks.workunit.client.0.smithi026.stdout:2/126: unlink d3/d19/d1d/f2b 0 2024-04-23T10:17:44.406 INFO:tasks.workunit.client.0.smithi026.stdout:2/127: write d3/dd/f15 [2756944,84337] 0 2024-04-23T10:17:44.407 INFO:tasks.workunit.client.0.smithi026.stdout:0/166: rename d7/d8/d1e/d2a/l3a to d7/d8/d1e/l49 0 2024-04-23T10:17:44.408 INFO:tasks.workunit.client.0.smithi026.stdout:1/91: write dd/d13/f16 [416914,10816] 0 2024-04-23T10:17:44.409 INFO:tasks.workunit.client.0.smithi026.stdout:8/122: getdents d5/d9/d14 0 2024-04-23T10:17:44.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/128: truncate d3/d19/d1d/f25 620845 0 2024-04-23T10:17:44.410 INFO:tasks.workunit.client.0.smithi026.stdout:1/92: dread - dd/f12 zero size 2024-04-23T10:17:44.410 INFO:tasks.workunit.client.0.smithi026.stdout:0/167: creat d7/d8/d1e/f4a x:0 0 0 2024-04-23T10:17:44.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/129: chown c2 0 1 2024-04-23T10:17:44.413 INFO:tasks.workunit.client.0.smithi026.stdout:8/123: creat d5/f23 x:0 0 0 2024-04-23T10:17:44.414 INFO:tasks.workunit.client.0.smithi026.stdout:0/168: mknod d7/d43/c4b 0 2024-04-23T10:17:44.416 INFO:tasks.workunit.client.0.smithi026.stdout:8/124: truncate d5/d9/fa 442797 0 2024-04-23T10:17:44.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/125: mkdir d5/d24 0 2024-04-23T10:17:44.419 INFO:tasks.workunit.client.0.smithi026.stdout:6/225: dwrite d6/d33/f2c [8388608,4194304] 0 2024-04-23T10:17:44.422 INFO:tasks.workunit.client.0.smithi026.stdout:8/126: mknod d5/d9/d22/c25 0 2024-04-23T10:17:44.424 INFO:tasks.workunit.client.0.smithi026.stdout:8/127: chown f2 1046250246 1 2024-04-23T10:17:44.424 INFO:tasks.workunit.client.0.smithi026.stdout:6/226: unlink d6/d21/d2f/d32/c46 0 2024-04-23T10:17:44.425 INFO:tasks.workunit.client.0.smithi026.stdout:0/169: dread d7/d8/d1e/d1d/d2f/f10 [0,4194304] 0 2024-04-23T10:17:44.426 INFO:tasks.workunit.client.0.smithi026.stdout:2/130: dwrite d3/f2a [4194304,4194304] 0 2024-04-23T10:17:44.427 INFO:tasks.workunit.client.0.smithi026.stdout:0/170: fdatasync d7/d8/d1e/f21 0 2024-04-23T10:17:44.428 INFO:tasks.workunit.client.0.smithi026.stdout:8/128: write d5/d9/d14/f1c [300505,76739] 0 2024-04-23T10:17:44.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/227: mknod d6/c4b 0 2024-04-23T10:17:44.431 INFO:tasks.workunit.client.0.smithi026.stdout:2/131: chown d3/dd/l10 1570078 1 2024-04-23T10:17:44.432 INFO:tasks.workunit.client.0.smithi026.stdout:8/129: rename l0 to d5/d24/l26 0 2024-04-23T10:17:44.433 INFO:tasks.workunit.client.0.smithi026.stdout:0/171: write d7/d8/d1e/d1d/d2f/f26 [2876427,26619] 0 2024-04-23T10:17:44.433 INFO:tasks.workunit.client.0.smithi026.stdout:8/130: dread - d5/f23 zero size 2024-04-23T10:17:44.435 INFO:tasks.workunit.client.0.smithi026.stdout:2/132: creat d3/d19/d1d/f2e x:0 0 0 2024-04-23T10:17:44.442 INFO:tasks.workunit.client.0.smithi026.stdout:1/93: dread f5 [0,4194304] 0 2024-04-23T10:17:44.443 INFO:tasks.workunit.client.0.smithi026.stdout:2/133: symlink d3/d19/l2f 0 2024-04-23T10:17:44.443 INFO:tasks.workunit.client.0.smithi026.stdout:1/94: fdatasync dd/f17 0 2024-04-23T10:17:44.446 INFO:tasks.workunit.client.0.smithi026.stdout:8/131: dwrite d5/d9/d14/f1c [0,4194304] 0 2024-04-23T10:17:44.447 INFO:tasks.workunit.client.0.smithi026.stdout:1/95: mkdir dd/d1a/d20 0 2024-04-23T10:17:44.448 INFO:tasks.workunit.client.0.smithi026.stdout:1/96: readlink dd/l14 0 2024-04-23T10:17:44.449 INFO:tasks.workunit.client.0.smithi026.stdout:2/134: link d3/d19/d1d/f2e d3/dd/f30 0 2024-04-23T10:17:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:2/135: write d3/f13 [686035,128888] 0 2024-04-23T10:17:44.454 INFO:tasks.workunit.client.0.smithi026.stdout:1/97: creat dd/f21 x:0 0 0 2024-04-23T10:17:44.458 INFO:tasks.workunit.client.0.smithi026.stdout:0/172: write d7/d8/d2d/f37 [710178,94784] 0 2024-04-23T10:17:44.459 INFO:tasks.workunit.client.0.smithi026.stdout:2/136: mkdir d3/d19/d31 0 2024-04-23T10:17:44.461 INFO:tasks.workunit.client.0.smithi026.stdout:8/132: dwrite d5/d9/d14/d15/f18 [0,4194304] 0 2024-04-23T10:17:44.461 INFO:tasks.workunit.client.0.smithi026.stdout:0/173: symlink d7/d8/d1e/l4c 0 2024-04-23T10:17:44.462 INFO:tasks.workunit.client.0.smithi026.stdout:1/98: write f3 [4682122,1221] 0 2024-04-23T10:17:44.464 INFO:tasks.workunit.client.0.smithi026.stdout:6/228: dread d6/d33/f2c [0,4194304] 0 2024-04-23T10:17:44.469 INFO:tasks.workunit.client.0.smithi026.stdout:2/137: rename d3/d19/d1d/f2e to d3/dd/f32 0 2024-04-23T10:17:44.472 INFO:tasks.workunit.client.0.smithi026.stdout:2/138: fdatasync d3/dd/f2d 0 2024-04-23T10:17:44.472 INFO:tasks.workunit.client.0.smithi026.stdout:6/229: creat d6/d13/d15/f4c x:0 0 0 2024-04-23T10:17:44.473 INFO:tasks.workunit.client.0.smithi026.stdout:1/99: dwrite f1 [0,4194304] 0 2024-04-23T10:17:44.473 INFO:tasks.workunit.client.0.smithi026.stdout:2/139: dread - d3/dd/f2d zero size 2024-04-23T10:17:44.475 INFO:tasks.workunit.client.0.smithi026.stdout:1/100: write f4 [1831761,20683] 0 2024-04-23T10:17:44.475 INFO:tasks.workunit.client.0.smithi026.stdout:8/133: rename d5/d9/ff to d5/d24/f27 0 2024-04-23T10:17:44.475 INFO:tasks.workunit.client.0.smithi026.stdout:6/230: rmdir d6 39 2024-04-23T10:17:44.475 INFO:tasks.workunit.client.0.smithi026.stdout:1/101: fsync dd/f12 0 2024-04-23T10:17:44.477 INFO:tasks.workunit.client.0.smithi026.stdout:0/174: rename d7/d8/d1e/d1d/d2f/f23 to d7/d8/d1e/d1d/d2f/f4d 0 2024-04-23T10:17:44.480 INFO:tasks.workunit.client.0.smithi026.stdout:8/134: creat d5/f28 x:0 0 0 2024-04-23T10:17:44.482 INFO:tasks.workunit.client.0.smithi026.stdout:1/102: symlink dd/d15/l22 0 2024-04-23T10:17:44.483 INFO:tasks.workunit.client.0.smithi026.stdout:6/231: stat d6/d21/c26 0 2024-04-23T10:17:44.487 INFO:tasks.workunit.client.0.smithi026.stdout:6/232: dread d6/fc [0,4194304] 0 2024-04-23T10:17:44.488 INFO:tasks.workunit.client.0.smithi026.stdout:1/103: rename dd/d13 to dd/d1a/d23 0 2024-04-23T10:17:44.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/104: creat dd/d1a/f24 x:0 0 0 2024-04-23T10:17:44.493 INFO:tasks.workunit.client.0.smithi026.stdout:8/135: link d5/d9/d14/d15/l1e d5/d24/l29 0 2024-04-23T10:17:44.496 INFO:tasks.workunit.client.0.smithi026.stdout:8/136: readlink d5/d9/l1a 0 2024-04-23T10:17:44.497 INFO:tasks.workunit.client.0.smithi026.stdout:0/175: truncate d7/d8/d1e/d1d/f28 4858888 0 2024-04-23T10:17:44.497 INFO:tasks.workunit.client.0.smithi026.stdout:1/105: mkdir dd/d1a/d20/d25 0 2024-04-23T10:17:44.498 INFO:tasks.workunit.client.0.smithi026.stdout:8/137: creat d5/f2a x:0 0 0 2024-04-23T10:17:44.500 INFO:tasks.workunit.client.0.smithi026.stdout:1/106: creat dd/d1a/f26 x:0 0 0 2024-04-23T10:17:44.500 INFO:tasks.workunit.client.0.smithi026.stdout:0/176: creat d7/d8/d2d/f4e x:0 0 0 2024-04-23T10:17:44.501 INFO:tasks.workunit.client.0.smithi026.stdout:1/107: write fc [921905,108898] 0 2024-04-23T10:17:44.503 INFO:tasks.workunit.client.0.smithi026.stdout:0/177: fsync d7/d8/d1e/d1d/d2f/f11 0 2024-04-23T10:17:44.505 INFO:tasks.workunit.client.0.smithi026.stdout:0/178: write d7/d8/d1e/d1d/d2f/f29 [168656,48599] 0 2024-04-23T10:17:44.506 INFO:tasks.workunit.client.0.smithi026.stdout:1/108: rename dd/d1a/d23/c1f to dd/d15/c27 0 2024-04-23T10:17:44.507 INFO:tasks.workunit.client.0.smithi026.stdout:8/138: dwrite d5/d9/fb [0,4194304] 0 2024-04-23T10:17:44.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/179: symlink d7/d8/d2d/l4f 0 2024-04-23T10:17:44.512 INFO:tasks.workunit.client.0.smithi026.stdout:1/109: creat dd/d1a/d23/f28 x:0 0 0 2024-04-23T10:17:44.515 INFO:tasks.workunit.client.0.smithi026.stdout:1/110: write dd/d1a/f26 [560550,100488] 0 2024-04-23T10:17:44.517 INFO:tasks.workunit.client.0.smithi026.stdout:0/180: creat d7/d8/d2d/f50 x:0 0 0 2024-04-23T10:17:44.518 INFO:tasks.workunit.client.0.smithi026.stdout:0/181: chown d7/f14 2 1 2024-04-23T10:17:44.519 INFO:tasks.workunit.client.0.smithi026.stdout:6/233: dread d6/fe [0,4194304] 0 2024-04-23T10:17:44.520 INFO:tasks.workunit.client.0.smithi026.stdout:0/182: truncate d7/f35 350111 0 2024-04-23T10:17:44.522 INFO:tasks.workunit.client.0.smithi026.stdout:1/111: unlink fb 0 2024-04-23T10:17:44.523 INFO:tasks.workunit.client.0.smithi026.stdout:0/183: creat d7/d8/d1e/f51 x:0 0 0 2024-04-23T10:17:44.524 INFO:tasks.workunit.client.0.smithi026.stdout:0/184: chown d7/f14 1516873636 1 2024-04-23T10:17:44.526 INFO:tasks.workunit.client.0.smithi026.stdout:6/234: unlink d6/d21/d2f/f4a 0 2024-04-23T10:17:44.528 INFO:tasks.workunit.client.0.smithi026.stdout:1/112: link f2 dd/d1a/d23/f29 0 2024-04-23T10:17:44.531 INFO:tasks.workunit.client.0.smithi026.stdout:1/113: truncate dd/d1a/d23/f18 919009 0 2024-04-23T10:17:44.531 INFO:tasks.workunit.client.0.smithi026.stdout:6/235: getdents d6/d33 0 2024-04-23T10:17:44.533 INFO:tasks.workunit.client.0.smithi026.stdout:0/185: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:44.534 INFO:tasks.workunit.client.0.smithi026.stdout:6/236: read d6/f1d [2555688,97626] 0 2024-04-23T10:17:44.534 INFO:tasks.workunit.client.0.smithi026.stdout:0/186: dread - d7/d8/d1e/f21 zero size 2024-04-23T10:17:44.538 INFO:tasks.workunit.client.0.smithi026.stdout:0/187: dread d7/d8/d1e/d1d/d2f/f44 [0,4194304] 0 2024-04-23T10:17:44.538 INFO:tasks.workunit.client.0.smithi026.stdout:6/237: creat d6/d13/f4d x:0 0 0 2024-04-23T10:17:44.540 INFO:tasks.workunit.client.0.smithi026.stdout:6/238: write d6/d21/d2f/d37/f3a [692980,80379] 0 2024-04-23T10:17:44.541 INFO:tasks.workunit.client.0.smithi026.stdout:1/114: dwrite dd/d1a/d23/f16 [0,4194304] 0 2024-04-23T10:17:44.545 INFO:tasks.workunit.client.0.smithi026.stdout:6/239: creat d6/d13/f4e x:0 0 0 2024-04-23T10:17:44.548 INFO:tasks.workunit.client.0.smithi026.stdout:0/188: dwrite d7/d8/d1e/d1d/d2f/f34 [0,4194304] 0 2024-04-23T10:17:44.549 INFO:tasks.workunit.client.0.smithi026.stdout:6/240: mkdir d6/d21/d2f/d37/d4f 0 2024-04-23T10:17:44.564 INFO:tasks.workunit.client.0.smithi026.stdout:1/115: truncate dd/d1a/d23/f18 802597 0 2024-04-23T10:17:44.566 INFO:tasks.workunit.client.0.smithi026.stdout:1/116: rmdir dd/d1a 39 2024-04-23T10:17:44.566 INFO:tasks.workunit.client.0.smithi026.stdout:1/117: chown f3 0 1 2024-04-23T10:17:44.566 INFO:tasks.workunit.client.0.smithi026.stdout:6/241: truncate d6/f12 2879047 0 2024-04-23T10:17:44.569 INFO:tasks.workunit.client.0.smithi026.stdout:6/242: write d6/d13/d15/f2e [8005562,128671] 0 2024-04-23T10:17:44.571 INFO:tasks.workunit.client.0.smithi026.stdout:6/243: chown d6/d13/d15/l45 1031824209 1 2024-04-23T10:17:44.571 INFO:tasks.workunit.client.0.smithi026.stdout:0/189: dwrite d7/d8/d1e/f41 [0,4194304] 0 2024-04-23T10:17:44.573 INFO:tasks.workunit.client.0.smithi026.stdout:1/118: link dd/cf dd/d1a/d23/c2a 0 2024-04-23T10:17:44.574 INFO:tasks.workunit.client.0.smithi026.stdout:0/190: read d7/d8/d1e/d1d/f20 [559124,115746] 0 2024-04-23T10:17:44.575 INFO:tasks.workunit.client.0.smithi026.stdout:6/244: dread d6/d21/d2f/d37/f39 [0,4194304] 0 2024-04-23T10:17:44.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/119: rename fc to dd/f2b 0 2024-04-23T10:17:44.584 INFO:tasks.workunit.client.0.smithi026.stdout:1/120: rmdir dd 39 2024-04-23T10:17:44.587 INFO:tasks.workunit.client.0.smithi026.stdout:0/191: dwrite d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:44.591 INFO:tasks.workunit.client.0.smithi026.stdout:1/121: rename f5 to dd/f2c 0 2024-04-23T10:17:44.592 INFO:tasks.workunit.client.0.smithi026.stdout:1/122: fsync dd/f2b 0 2024-04-23T10:17:44.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/192: creat d7/d8/d1e/d1d/d2f/f52 x:0 0 0 2024-04-23T10:17:44.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/193: readlink d7/d8/d1e/l4c 0 2024-04-23T10:17:44.598 INFO:tasks.workunit.client.0.smithi026.stdout:0/194: unlink d7/d8/d1e/d1d/d2f/f29 0 2024-04-23T10:17:44.601 INFO:tasks.workunit.client.0.smithi026.stdout:0/195: rename f1 to d7/d43/f53 0 2024-04-23T10:17:44.601 INFO:tasks.workunit.client.0.smithi026.stdout:1/123: dwrite dd/f2c [0,4194304] 0 2024-04-23T10:17:44.602 INFO:tasks.workunit.client.0.smithi026.stdout:0/196: readlink d7/d8/d2d/l4f 0 2024-04-23T10:17:44.604 INFO:tasks.workunit.client.0.smithi026.stdout:1/124: creat dd/d1a/d23/f2d x:0 0 0 2024-04-23T10:17:44.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/125: write dd/d1a/d23/f29 [56099,103992] 0 2024-04-23T10:17:44.606 INFO:tasks.workunit.client.0.smithi026.stdout:1/126: write dd/f17 [1109775,5076] 0 2024-04-23T10:17:44.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/127: link dd/f2b dd/d15/f2e 0 2024-04-23T10:17:44.613 INFO:tasks.workunit.client.0.smithi026.stdout:1/128: write f3 [1130323,66016] 0 2024-04-23T10:17:44.621 INFO:tasks.workunit.client.0.smithi026.stdout:0/197: dwrite d7/d8/d1e/d1d/d2f/f10 [0,4194304] 0 2024-04-23T10:17:44.622 INFO:tasks.workunit.client.0.smithi026.stdout:0/198: fdatasync d7/f38 0 2024-04-23T10:17:44.623 INFO:tasks.workunit.client.0.smithi026.stdout:1/129: dwrite dd/f2b [0,4194304] 0 2024-04-23T10:17:44.623 INFO:tasks.workunit.client.0.smithi026.stdout:0/199: write d7/f35 [334755,83104] 0 2024-04-23T10:17:44.628 INFO:tasks.workunit.client.0.smithi026.stdout:1/130: creat dd/d1a/d20/d25/f2f x:0 0 0 2024-04-23T10:17:44.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/131: dread f1 [0,4194304] 0 2024-04-23T10:17:44.635 INFO:tasks.workunit.client.0.smithi026.stdout:0/200: dwrite d7/d8/d2d/f37 [0,4194304] 0 2024-04-23T10:17:44.636 INFO:tasks.workunit.client.0.smithi026.stdout:0/201: fsync d7/d8/d1e/f51 0 2024-04-23T10:17:44.637 INFO:tasks.workunit.client.0.smithi026.stdout:0/202: read - d7/d8/d1e/d2a/f47 zero size 2024-04-23T10:17:44.637 INFO:tasks.workunit.client.0.smithi026.stdout:0/203: chown d7/d8/d2d/f4e 3 1 2024-04-23T10:17:44.641 INFO:tasks.workunit.client.0.smithi026.stdout:0/204: symlink d7/d8/d1e/d1d/l54 0 2024-04-23T10:17:44.641 INFO:tasks.workunit.client.0.smithi026.stdout:1/132: getdents dd/d1a/d20 0 2024-04-23T10:17:44.642 INFO:tasks.workunit.client.0.smithi026.stdout:1/133: rmdir dd 39 2024-04-23T10:17:44.645 INFO:tasks.workunit.client.0.smithi026.stdout:1/134: symlink dd/d1a/d23/l30 0 2024-04-23T10:17:44.646 INFO:tasks.workunit.client.0.smithi026.stdout:0/205: getdents d7/d8 0 2024-04-23T10:17:44.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/135: stat dd/d1a/d23/c19 0 2024-04-23T10:17:44.647 INFO:tasks.workunit.client.0.smithi026.stdout:0/206: fsync d7/d8/d1e/f21 0 2024-04-23T10:17:44.650 INFO:tasks.workunit.client.0.smithi026.stdout:0/207: truncate d7/d8/d1e/d1d/d2f/f44 1004622 0 2024-04-23T10:17:44.658 INFO:tasks.workunit.client.0.smithi026.stdout:1/136: dwrite dd/d1a/f24 [0,4194304] 0 2024-04-23T10:17:44.658 INFO:tasks.workunit.client.0.smithi026.stdout:0/208: truncate d7/d8/d1e/d1d/d2f/f26 2406113 0 2024-04-23T10:17:44.660 INFO:tasks.workunit.client.0.smithi026.stdout:0/209: link d7/f35 d7/d8/d1e/d2a/f55 0 2024-04-23T10:17:44.661 INFO:tasks.workunit.client.0.smithi026.stdout:1/137: truncate f9 482641 0 2024-04-23T10:17:44.665 INFO:tasks.workunit.client.0.smithi026.stdout:0/210: mknod d7/d8/d1e/d30/c56 0 2024-04-23T10:17:44.665 INFO:tasks.workunit.client.0.smithi026.stdout:1/138: mknod dd/d1a/d20/c31 0 2024-04-23T10:17:44.666 INFO:tasks.workunit.client.0.smithi026.stdout:0/211: chown d7/d8/d2d/f50 346 1 2024-04-23T10:17:44.668 INFO:tasks.workunit.client.0.smithi026.stdout:1/139: rename dd/d15/f2e to dd/d15/f32 0 2024-04-23T10:17:44.670 INFO:tasks.workunit.client.0.smithi026.stdout:1/140: symlink dd/d1a/d23/l33 0 2024-04-23T10:17:44.671 INFO:tasks.workunit.client.0.smithi026.stdout:1/141: symlink dd/d1a/d23/l34 0 2024-04-23T10:17:44.672 INFO:tasks.workunit.client.0.smithi026.stdout:4/62: sync 2024-04-23T10:17:44.672 INFO:tasks.workunit.client.0.smithi026.stdout:3/175: sync 2024-04-23T10:17:44.672 INFO:tasks.workunit.client.0.smithi026.stdout:5/56: sync 2024-04-23T10:17:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:4/63: stat d4/d7 0 2024-04-23T10:17:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:4/64: readlink d4/l6 0 2024-04-23T10:17:44.674 INFO:tasks.workunit.client.0.smithi026.stdout:0/212: dwrite d7/d8/d1e/d1d/d2f/f11 [0,4194304] 0 2024-04-23T10:17:44.675 INFO:tasks.workunit.client.0.smithi026.stdout:5/57: mkdir d0/d13 0 2024-04-23T10:17:44.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/213: fdatasync d7/f14 0 2024-04-23T10:17:44.676 INFO:tasks.workunit.client.0.smithi026.stdout:3/176: rmdir d0/d1e/d30/d43 39 2024-04-23T10:17:44.680 INFO:tasks.workunit.client.0.smithi026.stdout:4/65: dread f3 [0,4194304] 0 2024-04-23T10:17:44.680 INFO:tasks.workunit.client.0.smithi026.stdout:0/214: truncate d7/d8/f31 426019 0 2024-04-23T10:17:44.681 INFO:tasks.workunit.client.0.smithi026.stdout:5/58: rename d0/f8 to d0/d13/f14 0 2024-04-23T10:17:44.681 INFO:tasks.workunit.client.0.smithi026.stdout:0/215: chown d7/d43/c4b 290 1 2024-04-23T10:17:44.684 INFO:tasks.workunit.client.0.smithi026.stdout:1/142: dwrite dd/d1a/d23/f29 [0,4194304] 0 2024-04-23T10:17:44.684 INFO:tasks.workunit.client.0.smithi026.stdout:0/216: fdatasync d7/d8/f9 0 2024-04-23T10:17:44.688 INFO:tasks.workunit.client.0.smithi026.stdout:1/143: mkdir dd/d1a/d20/d25/d35 0 2024-04-23T10:17:44.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/144: rename dd/d1a to dd/d1a/d20/d25/d36 22 2024-04-23T10:17:44.691 INFO:tasks.workunit.client.0.smithi026.stdout:4/66: dwrite d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:44.692 INFO:tasks.workunit.client.0.smithi026.stdout:1/145: truncate dd/d1a/d23/f2d 961628 0 2024-04-23T10:17:44.694 INFO:tasks.workunit.client.0.smithi026.stdout:3/177: write d0/d1e/f37 [827075,61393] 0 2024-04-23T10:17:44.694 INFO:tasks.workunit.client.0.smithi026.stdout:5/59: getdents d0 0 2024-04-23T10:17:44.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/146: truncate dd/f21 786066 0 2024-04-23T10:17:44.696 INFO:tasks.workunit.client.0.smithi026.stdout:5/60: stat d0/ld 0 2024-04-23T10:17:44.696 INFO:tasks.workunit.client.0.smithi026.stdout:0/217: getdents d7/d8/d1e/d1d/d2f 0 2024-04-23T10:17:44.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/67: dread d4/d7/fd [0,4194304] 0 2024-04-23T10:17:44.700 INFO:tasks.workunit.client.0.smithi026.stdout:5/61: truncate d0/f2 4896174 0 2024-04-23T10:17:44.701 INFO:tasks.workunit.client.0.smithi026.stdout:0/218: rmdir d7/d8/d1e/d30 39 2024-04-23T10:17:44.704 INFO:tasks.workunit.client.0.smithi026.stdout:4/68: creat d4/d10/f12 x:0 0 0 2024-04-23T10:17:44.706 INFO:tasks.workunit.client.0.smithi026.stdout:3/178: creat d0/d1e/d30/d43/df/f44 x:0 0 0 2024-04-23T10:17:44.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/219: mkdir d7/d8/d1e/d57 0 2024-04-23T10:17:44.707 INFO:tasks.workunit.client.0.smithi026.stdout:4/69: fsync d4/d7/f9 0 2024-04-23T10:17:44.708 INFO:tasks.workunit.client.0.smithi026.stdout:1/147: dwrite dd/d15/f1b [0,4194304] 0 2024-04-23T10:17:44.709 INFO:tasks.workunit.client.0.smithi026.stdout:0/220: write d7/d8/f16 [993912,97910] 0 2024-04-23T10:17:44.710 INFO:tasks.workunit.client.0.smithi026.stdout:0/221: fdatasync d7/d8/d1e/f32 0 2024-04-23T10:17:44.711 INFO:tasks.workunit.client.0.smithi026.stdout:3/179: creat d0/d1e/d30/d43/df/d1f/f45 x:0 0 0 2024-04-23T10:17:44.712 INFO:tasks.workunit.client.0.smithi026.stdout:0/222: chown d7/d8/d2d/f50 919667 1 2024-04-23T10:17:44.713 INFO:tasks.workunit.client.0.smithi026.stdout:3/180: chown d0/d1e/d23/f41 1 1 2024-04-23T10:17:44.714 INFO:tasks.workunit.client.0.smithi026.stdout:4/70: dread d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:44.717 INFO:tasks.workunit.client.0.smithi026.stdout:1/148: dread dd/d1a/d23/f29 [0,4194304] 0 2024-04-23T10:17:44.718 INFO:tasks.workunit.client.0.smithi026.stdout:1/149: truncate dd/f12 904174 0 2024-04-23T10:17:44.718 INFO:tasks.workunit.client.0.smithi026.stdout:1/150: chown dd/d15/f1b 2122891 1 2024-04-23T10:17:44.721 INFO:tasks.workunit.client.0.smithi026.stdout:0/223: symlink d7/d8/d1e/d1d/d2f/l58 0 2024-04-23T10:17:44.722 INFO:tasks.workunit.client.0.smithi026.stdout:4/71: rmdir d4/d7 39 2024-04-23T10:17:44.723 INFO:tasks.workunit.client.0.smithi026.stdout:3/181: creat d0/d1e/d30/d43/df/d17/f46 x:0 0 0 2024-04-23T10:17:44.724 INFO:tasks.workunit.client.0.smithi026.stdout:5/62: write d0/f3 [1025461,48381] 0 2024-04-23T10:17:44.729 INFO:tasks.workunit.client.0.smithi026.stdout:4/72: truncate f3 107974 0 2024-04-23T10:17:44.730 INFO:tasks.workunit.client.0.smithi026.stdout:3/182: read d0/d1e/d30/d43/f3b [30276,105431] 0 2024-04-23T10:17:44.732 INFO:tasks.workunit.client.0.smithi026.stdout:5/63: fdatasync d0/f3 0 2024-04-23T10:17:44.734 INFO:tasks.workunit.client.0.smithi026.stdout:4/73: creat d4/d7/f13 x:0 0 0 2024-04-23T10:17:44.735 INFO:tasks.workunit.client.0.smithi026.stdout:5/64: symlink d0/d13/l15 0 2024-04-23T10:17:44.736 INFO:tasks.workunit.client.0.smithi026.stdout:3/183: dread d0/d1e/d30/d43/d29/f35 [0,4194304] 0 2024-04-23T10:17:44.737 INFO:tasks.workunit.client.0.smithi026.stdout:3/184: read - d0/d1e/d30/d43/df/f44 zero size 2024-04-23T10:17:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/65: write d0/d13/f14 [2125615,28136] 0 2024-04-23T10:17:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/66: fsync d0/f2 0 2024-04-23T10:17:44.739 INFO:tasks.workunit.client.0.smithi026.stdout:1/151: truncate dd/f2c 3245348 0 2024-04-23T10:17:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:3/185: symlink d0/l47 0 2024-04-23T10:17:44.741 INFO:tasks.workunit.client.0.smithi026.stdout:5/67: write d0/f2 [996195,4095] 0 2024-04-23T10:17:44.746 INFO:tasks.workunit.client.0.smithi026.stdout:4/74: dread d4/d7/fd [0,4194304] 0 2024-04-23T10:17:44.746 INFO:tasks.workunit.client.0.smithi026.stdout:5/68: creat d0/f16 x:0 0 0 2024-04-23T10:17:44.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/75: dread - d4/d10/f12 zero size 2024-04-23T10:17:44.749 INFO:tasks.workunit.client.0.smithi026.stdout:5/69: readlink d0/la 0 2024-04-23T10:17:44.750 INFO:tasks.workunit.client.0.smithi026.stdout:0/224: link d7/d8/d1e/d1d/d2f/c3f d7/d43/c59 0 2024-04-23T10:17:44.754 INFO:tasks.workunit.client.0.smithi026.stdout:1/152: dwrite dd/d1a/d20/d25/f2f [0,4194304] 0 2024-04-23T10:17:44.756 INFO:tasks.workunit.client.0.smithi026.stdout:3/186: dwrite d0/d1e/d30/d43/f42 [0,4194304] 0 2024-04-23T10:17:44.758 INFO:tasks.workunit.client.0.smithi026.stdout:4/76: rename d4/d10 to d4/d14 0 2024-04-23T10:17:44.758 INFO:tasks.workunit.client.0.smithi026.stdout:5/70: link d0/d13/l15 d0/d12/l17 0 2024-04-23T10:17:44.760 INFO:tasks.workunit.client.0.smithi026.stdout:3/187: creat d0/f48 x:0 0 0 2024-04-23T10:17:44.761 INFO:tasks.workunit.client.0.smithi026.stdout:4/77: creat d4/d7/f15 x:0 0 0 2024-04-23T10:17:44.766 INFO:tasks.workunit.client.0.smithi026.stdout:3/188: unlink d0/d1e/d30/d43/df/f25 0 2024-04-23T10:17:44.768 INFO:tasks.workunit.client.0.smithi026.stdout:0/225: dwrite d7/f35 [0,4194304] 0 2024-04-23T10:17:44.771 INFO:tasks.workunit.client.0.smithi026.stdout:3/189: read - d0/d1e/d30/d43/df/d1f/f45 zero size 2024-04-23T10:17:44.772 INFO:tasks.workunit.client.0.smithi026.stdout:0/226: chown d7/d8/f16 0 1 2024-04-23T10:17:44.773 INFO:tasks.workunit.client.0.smithi026.stdout:1/153: dwrite dd/f17 [4194304,4194304] 0 2024-04-23T10:17:44.773 INFO:tasks.workunit.client.0.smithi026.stdout:4/78: link d4/l11 d4/d7/l16 0 2024-04-23T10:17:44.777 INFO:tasks.workunit.client.0.smithi026.stdout:5/71: dwrite d0/d13/f14 [0,4194304] 0 2024-04-23T10:17:44.778 INFO:tasks.workunit.client.0.smithi026.stdout:5/72: chown d0/l7 0 1 2024-04-23T10:17:44.779 INFO:tasks.workunit.client.0.smithi026.stdout:5/73: chown d0/f10 2 1 2024-04-23T10:17:44.780 INFO:tasks.workunit.client.0.smithi026.stdout:1/154: chown dd/d1a/d23/c2a 30 1 2024-04-23T10:17:44.780 INFO:tasks.workunit.client.0.smithi026.stdout:4/79: mknod d4/c17 0 2024-04-23T10:17:44.781 INFO:tasks.workunit.client.0.smithi026.stdout:3/190: dread d0/d1e/d30/d43/f38 [0,4194304] 0 2024-04-23T10:17:44.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/227: mknod d7/d8/d1e/d1d/d2f/c5a 0 2024-04-23T10:17:44.787 INFO:tasks.workunit.client.0.smithi026.stdout:1/155: rename dd/l14 to dd/d1a/d23/l37 0 2024-04-23T10:17:44.787 INFO:tasks.workunit.client.0.smithi026.stdout:5/74: mknod d0/d12/c18 0 2024-04-23T10:17:44.787 INFO:tasks.workunit.client.0.smithi026.stdout:3/191: mknod d0/d1e/d30/d43/df/d17/c49 0 2024-04-23T10:17:44.791 INFO:tasks.workunit.client.0.smithi026.stdout:3/192: write d0/d1e/d30/d43/df/f33 [1002983,76438] 0 2024-04-23T10:17:44.794 INFO:tasks.workunit.client.0.smithi026.stdout:0/228: dwrite d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:44.800 INFO:tasks.workunit.client.0.smithi026.stdout:3/193: mknod d0/d1e/d30/d43/c4a 0 2024-04-23T10:17:44.802 INFO:tasks.workunit.client.0.smithi026.stdout:1/156: link f7 dd/d1a/d20/d25/f38 0 2024-04-23T10:17:44.803 INFO:tasks.workunit.client.0.smithi026.stdout:0/229: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:44.803 INFO:tasks.workunit.client.0.smithi026.stdout:4/80: link d4/l11 d4/l18 0 2024-04-23T10:17:44.804 INFO:tasks.workunit.client.0.smithi026.stdout:4/81: dread - d4/d7/f13 zero size 2024-04-23T10:17:44.805 INFO:tasks.workunit.client.0.smithi026.stdout:1/157: creat dd/d1a/d20/f39 x:0 0 0 2024-04-23T10:17:44.806 INFO:tasks.workunit.client.0.smithi026.stdout:4/82: mkdir d4/d7/d19 0 2024-04-23T10:17:44.807 INFO:tasks.workunit.client.0.smithi026.stdout:0/230: mkdir d7/d5b 0 2024-04-23T10:17:44.808 INFO:tasks.workunit.client.0.smithi026.stdout:0/231: write d7/f14 [802815,117685] 0 2024-04-23T10:17:44.808 INFO:tasks.workunit.client.0.smithi026.stdout:1/158: fsync dd/d1a/d23/f29 0 2024-04-23T10:17:44.811 INFO:tasks.workunit.client.0.smithi026.stdout:5/75: truncate d0/f2 2701765 0 2024-04-23T10:17:44.813 INFO:tasks.workunit.client.0.smithi026.stdout:1/159: unlink dd/d15/f1b 0 2024-04-23T10:17:44.815 INFO:tasks.workunit.client.0.smithi026.stdout:4/83: mknod d4/d7/d19/c1a 0 2024-04-23T10:17:44.815 INFO:tasks.workunit.client.0.smithi026.stdout:3/194: chown d0/d1e/d30/d43/f3b 482 1 2024-04-23T10:17:44.819 INFO:tasks.workunit.client.0.smithi026.stdout:0/232: creat d7/d8/d1e/d30/f5c x:0 0 0 2024-04-23T10:17:44.821 INFO:tasks.workunit.client.0.smithi026.stdout:5/76: link d0/ff d0/d13/f19 0 2024-04-23T10:17:44.822 INFO:tasks.workunit.client.0.smithi026.stdout:1/160: symlink dd/l3a 0 2024-04-23T10:17:44.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/233: symlink d7/d5b/l5d 0 2024-04-23T10:17:44.826 INFO:tasks.workunit.client.0.smithi026.stdout:1/161: dread f4 [0,4194304] 0 2024-04-23T10:17:44.827 INFO:tasks.workunit.client.0.smithi026.stdout:3/195: creat d0/d1e/d30/d43/df/f4b x:0 0 0 2024-04-23T10:17:44.827 INFO:tasks.workunit.client.0.smithi026.stdout:1/162: chown dd/d1a/d23/c2a 50130 1 2024-04-23T10:17:44.827 INFO:tasks.workunit.client.0.smithi026.stdout:1/163: readlink dd/l3a 0 2024-04-23T10:17:44.861 INFO:tasks.workunit.client.0.smithi026.stdout:7/104: sync 2024-04-23T10:17:44.861 INFO:tasks.workunit.client.0.smithi026.stdout:7/105: chown dd/d1d/f20 38338915 1 2024-04-23T10:17:44.864 INFO:tasks.workunit.client.0.smithi026.stdout:0/234: creat d7/d8/d1e/d57/f5e x:0 0 0 2024-04-23T10:17:44.867 INFO:tasks.workunit.client.0.smithi026.stdout:3/196: truncate d0/d1e/d30/d43/fa 168115 0 2024-04-23T10:17:45.029 INFO:tasks.workunit.client.0.smithi026.stdout:7/106: mknod dd/c22 0 2024-04-23T10:17:45.033 INFO:tasks.workunit.client.0.smithi026.stdout:0/235: rename d7/d8/d1e/f36 to d7/d5b/f5f 0 2024-04-23T10:17:45.034 INFO:tasks.workunit.client.0.smithi026.stdout:7/107: creat dd/d1d/d1e/f23 x:0 0 0 2024-04-23T10:17:45.052 INFO:tasks.workunit.client.0.smithi026.stdout:0/236: dwrite d7/d8/d1e/f41 [0,4194304] 0 2024-04-23T10:17:45.073 INFO:tasks.workunit.client.0.smithi026.stdout:7/108: creat dd/d1d/d1e/f24 x:0 0 0 2024-04-23T10:17:45.078 INFO:tasks.workunit.client.0.smithi026.stdout:9/181: sync 2024-04-23T10:17:45.082 INFO:tasks.workunit.client.0.smithi026.stdout:7/109: symlink dd/l25 0 2024-04-23T10:17:45.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/182: rmdir d13/d1b 39 2024-04-23T10:17:45.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/183: chown d13/f14 62 1 2024-04-23T10:17:45.088 INFO:tasks.workunit.client.0.smithi026.stdout:9/184: chown d13/f1c 2 1 2024-04-23T10:17:45.098 INFO:tasks.workunit.client.0.smithi026.stdout:7/110: creat dd/d1d/d1e/f26 x:0 0 0 2024-04-23T10:17:45.099 INFO:tasks.workunit.client.0.smithi026.stdout:7/111: dread - dd/d1d/d1e/f24 zero size 2024-04-23T10:17:45.104 INFO:tasks.workunit.client.0.smithi026.stdout:9/185: write ff [892334,37658] 0 2024-04-23T10:17:45.106 INFO:tasks.workunit.client.0.smithi026.stdout:9/186: fsync d13/f25 0 2024-04-23T10:17:45.109 INFO:tasks.workunit.client.0.smithi026.stdout:7/112: mknod dd/d1d/d1e/c27 0 2024-04-23T10:17:45.130 INFO:tasks.workunit.client.0.smithi026.stdout:9/187: rename f6 to d13/d1b/f33 0 2024-04-23T10:17:45.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/113: dwrite dd/f16 [0,4194304] 0 2024-04-23T10:17:45.131 INFO:tasks.workunit.client.0.smithi026.stdout:9/188: stat l1 0 2024-04-23T10:17:45.136 INFO:tasks.workunit.client.0.smithi026.stdout:9/189: unlink la 0 2024-04-23T10:17:45.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/114: symlink dd/l28 0 2024-04-23T10:17:45.158 INFO:tasks.workunit.client.0.smithi026.stdout:7/115: dwrite dd/d1d/d1e/f26 [0,4194304] 0 2024-04-23T10:17:45.160 INFO:tasks.workunit.client.0.smithi026.stdout:7/116: readlink dd/l28 0 2024-04-23T10:17:45.161 INFO:tasks.workunit.client.0.smithi026.stdout:9/190: rename le to d13/d31/l34 0 2024-04-23T10:17:45.178 INFO:tasks.workunit.client.0.smithi026.stdout:7/117: dwrite dd/d1d/f20 [0,4194304] 0 2024-04-23T10:17:45.223 INFO:tasks.workunit.client.0.smithi026.stdout:2/140: sync 2024-04-23T10:17:45.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/191: creat d13/d2a/f35 x:0 0 0 2024-04-23T10:17:45.227 INFO:tasks.workunit.client.0.smithi026.stdout:7/118: chown dd/f11 66330414 1 2024-04-23T10:17:45.227 INFO:tasks.workunit.client.0.smithi026.stdout:7/119: chown dd/fe 280138660 1 2024-04-23T10:17:45.229 INFO:tasks.workunit.client.0.smithi026.stdout:7/120: write dd/d1d/d1e/f26 [5142415,16366] 0 2024-04-23T10:17:45.230 INFO:tasks.workunit.client.0.smithi026.stdout:9/192: mkdir d13/d36 0 2024-04-23T10:17:45.232 INFO:tasks.workunit.client.0.smithi026.stdout:9/193: chown d13/d2a/f35 58328562 1 2024-04-23T10:17:45.237 INFO:tasks.workunit.client.0.smithi026.stdout:7/121: fsync dd/f11 0 2024-04-23T10:17:45.239 INFO:tasks.workunit.client.0.smithi026.stdout:9/194: mkdir d13/d19/d37 0 2024-04-23T10:17:45.293 INFO:tasks.workunit.client.0.smithi026.stdout:7/122: rmdir dd/d1d 39 2024-04-23T10:17:45.296 INFO:tasks.workunit.client.0.smithi026.stdout:7/123: write f6 [342238,52188] 0 2024-04-23T10:17:45.298 INFO:tasks.workunit.client.0.smithi026.stdout:7/124: chown dd/f10 299176554 1 2024-04-23T10:17:45.303 INFO:tasks.workunit.client.0.smithi026.stdout:9/195: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:45.303 INFO:tasks.workunit.client.0.smithi026.stdout:2/141: dwrite d3/d19/f1c [0,4194304] 0 2024-04-23T10:17:45.308 INFO:tasks.workunit.client.0.smithi026.stdout:9/196: mknod d13/d1b/c38 0 2024-04-23T10:17:45.310 INFO:tasks.workunit.client.0.smithi026.stdout:9/197: truncate d13/d2a/f35 710730 0 2024-04-23T10:17:45.312 INFO:tasks.workunit.client.0.smithi026.stdout:9/198: chown d13/d1b/l27 15425439 1 2024-04-23T10:17:45.313 INFO:tasks.workunit.client.0.smithi026.stdout:9/199: readlink l3 0 2024-04-23T10:17:45.315 INFO:tasks.workunit.client.0.smithi026.stdout:7/125: link dd/l12 dd/d1d/d1e/l29 0 2024-04-23T10:17:45.319 INFO:tasks.workunit.client.0.smithi026.stdout:9/200: dread d13/d2a/f35 [0,4194304] 0 2024-04-23T10:17:45.321 INFO:tasks.workunit.client.0.smithi026.stdout:2/142: dwrite d3/f2a [8388608,4194304] 0 2024-04-23T10:17:45.323 INFO:tasks.workunit.client.0.smithi026.stdout:9/201: write d13/f25 [709137,2420] 0 2024-04-23T10:17:45.330 INFO:tasks.workunit.client.0.smithi026.stdout:9/202: unlink l9 0 2024-04-23T10:17:45.336 INFO:tasks.workunit.client.0.smithi026.stdout:7/126: dwrite dd/f11 [0,4194304] 0 2024-04-23T10:17:45.337 INFO:tasks.workunit.client.0.smithi026.stdout:2/143: creat d3/d19/d21/d23/f33 x:0 0 0 2024-04-23T10:17:45.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/139: sync 2024-04-23T10:17:45.338 INFO:tasks.workunit.client.0.smithi026.stdout:6/245: sync 2024-04-23T10:17:45.339 INFO:tasks.workunit.client.0.smithi026.stdout:7/127: chown dd/fe 7377624 1 2024-04-23T10:17:45.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/144: fsync d3/dd/f15 0 2024-04-23T10:17:45.340 INFO:tasks.workunit.client.0.smithi026.stdout:9/203: symlink d13/d1b/d26/l39 0 2024-04-23T10:17:45.340 INFO:tasks.workunit.client.0.smithi026.stdout:6/246: fsync d6/d13/f4e 0 2024-04-23T10:17:45.342 INFO:tasks.workunit.client.0.smithi026.stdout:8/140: write d5/f23 [696096,38976] 0 2024-04-23T10:17:45.343 INFO:tasks.workunit.client.0.smithi026.stdout:2/145: chown d3/dd/f15 1393717679 1 2024-04-23T10:17:45.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/146: mknod d3/c34 0 2024-04-23T10:17:45.360 INFO:tasks.workunit.client.0.smithi026.stdout:9/204: mkdir d13/d19/d37/d3a 0 2024-04-23T10:17:45.360 INFO:tasks.workunit.client.0.smithi026.stdout:2/147: mkdir d3/d35 0 2024-04-23T10:17:45.360 INFO:tasks.workunit.client.0.smithi026.stdout:6/247: dwrite d6/f10 [0,4194304] 0 2024-04-23T10:17:45.361 INFO:tasks.workunit.client.0.smithi026.stdout:7/128: link dd/l15 dd/d1d/l2a 0 2024-04-23T10:17:45.362 INFO:tasks.workunit.client.0.smithi026.stdout:2/148: write d3/f8 [3888545,865] 0 2024-04-23T10:17:45.364 INFO:tasks.workunit.client.0.smithi026.stdout:8/141: link d5/l1d d5/l2b 0 2024-04-23T10:17:45.368 INFO:tasks.workunit.client.0.smithi026.stdout:9/205: mkdir d13/d3b 0 2024-04-23T10:17:45.372 INFO:tasks.workunit.client.0.smithi026.stdout:9/206: readlink d13/d1b/l29 0 2024-04-23T10:17:45.373 INFO:tasks.workunit.client.0.smithi026.stdout:2/149: creat d3/d19/d31/f36 x:0 0 0 2024-04-23T10:17:45.382 INFO:tasks.workunit.client.0.smithi026.stdout:7/129: dwrite dd/d1d/d1e/f23 [0,4194304] 0 2024-04-23T10:17:45.386 INFO:tasks.workunit.client.0.smithi026.stdout:9/207: dread d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:45.388 INFO:tasks.workunit.client.0.smithi026.stdout:9/208: fsync d13/f1c 0 2024-04-23T10:17:45.388 INFO:tasks.workunit.client.0.smithi026.stdout:7/130: unlink dd/f10 0 2024-04-23T10:17:45.390 INFO:tasks.workunit.client.0.smithi026.stdout:2/150: dread d3/f22 [0,4194304] 0 2024-04-23T10:17:45.390 INFO:tasks.workunit.client.0.smithi026.stdout:6/248: dread d6/f1d [0,4194304] 0 2024-04-23T10:17:45.391 INFO:tasks.workunit.client.0.smithi026.stdout:7/131: truncate dd/d1d/d1e/f24 835671 0 2024-04-23T10:17:45.392 INFO:tasks.workunit.client.0.smithi026.stdout:9/209: mknod d13/d31/c3c 0 2024-04-23T10:17:45.392 INFO:tasks.workunit.client.0.smithi026.stdout:8/142: write d5/d9/d14/f1c [4780579,28821] 0 2024-04-23T10:17:45.394 INFO:tasks.workunit.client.0.smithi026.stdout:8/143: chown l1 51429278 1 2024-04-23T10:17:45.395 INFO:tasks.workunit.client.0.smithi026.stdout:7/132: rename dd/fe to dd/d1d/d1e/f2b 0 2024-04-23T10:17:45.398 INFO:tasks.workunit.client.0.smithi026.stdout:9/210: write d13/d1b/d26/f2e [1809699,111536] 0 2024-04-23T10:17:45.398 INFO:tasks.workunit.client.0.smithi026.stdout:9/211: chown l11 1008 1 2024-04-23T10:17:45.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/144: mkdir d5/d9/d22/d2c 0 2024-04-23T10:17:45.399 INFO:tasks.workunit.client.0.smithi026.stdout:9/212: chown d13 44447218 1 2024-04-23T10:17:45.400 INFO:tasks.workunit.client.0.smithi026.stdout:9/213: write d13/f14 [982373,2229] 0 2024-04-23T10:17:45.401 INFO:tasks.workunit.client.0.smithi026.stdout:2/151: rename d3/c7 to d3/d19/d21/d23/c37 0 2024-04-23T10:17:45.402 INFO:tasks.workunit.client.0.smithi026.stdout:9/214: write d13/f14 [1401824,53491] 0 2024-04-23T10:17:45.405 INFO:tasks.workunit.client.0.smithi026.stdout:8/145: symlink d5/d9/l2d 0 2024-04-23T10:17:45.406 INFO:tasks.workunit.client.0.smithi026.stdout:8/146: write d5/d9/fc [747855,13439] 0 2024-04-23T10:17:45.406 INFO:tasks.workunit.client.0.smithi026.stdout:9/215: chown d13/d2a/f2f 87 1 2024-04-23T10:17:45.407 INFO:tasks.workunit.client.0.smithi026.stdout:7/133: dread dd/d1d/d1e/f26 [0,4194304] 0 2024-04-23T10:17:45.412 INFO:tasks.workunit.client.0.smithi026.stdout:2/152: creat d3/d19/d31/f38 x:0 0 0 2024-04-23T10:17:45.413 INFO:tasks.workunit.client.0.smithi026.stdout:2/153: chown d3/f22 132936644 1 2024-04-23T10:17:45.414 INFO:tasks.workunit.client.0.smithi026.stdout:7/134: mkdir dd/d2c 0 2024-04-23T10:17:45.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/135: chown l9 10 1 2024-04-23T10:17:45.416 INFO:tasks.workunit.client.0.smithi026.stdout:2/154: symlink d3/d19/d21/l39 0 2024-04-23T10:17:45.419 INFO:tasks.workunit.client.0.smithi026.stdout:8/147: dwrite d5/f23 [0,4194304] 0 2024-04-23T10:17:45.420 INFO:tasks.workunit.client.0.smithi026.stdout:8/148: fdatasync d5/d9/fb 0 2024-04-23T10:17:45.424 INFO:tasks.workunit.client.0.smithi026.stdout:7/136: dwrite dd/ff [0,4194304] 0 2024-04-23T10:17:45.426 INFO:tasks.workunit.client.0.smithi026.stdout:4/84: sync 2024-04-23T10:17:45.426 INFO:tasks.workunit.client.0.smithi026.stdout:5/77: sync 2024-04-23T10:17:45.431 INFO:tasks.workunit.client.0.smithi026.stdout:4/85: mkdir d4/d1b 0 2024-04-23T10:17:45.432 INFO:tasks.workunit.client.0.smithi026.stdout:4/86: truncate d4/d7/f13 527843 0 2024-04-23T10:17:45.436 INFO:tasks.workunit.client.0.smithi026.stdout:4/87: creat d4/d14/f1c x:0 0 0 2024-04-23T10:17:45.437 INFO:tasks.workunit.client.0.smithi026.stdout:4/88: chown d4/d7/d19/c1a 21887 1 2024-04-23T10:17:45.437 INFO:tasks.workunit.client.0.smithi026.stdout:8/149: fsync d5/d9/fa 0 2024-04-23T10:17:45.438 INFO:tasks.workunit.client.0.smithi026.stdout:8/150: write d5/f2a [688595,77721] 0 2024-04-23T10:17:45.439 INFO:tasks.workunit.client.0.smithi026.stdout:4/89: truncate d4/f5 4255531 0 2024-04-23T10:17:45.440 INFO:tasks.workunit.client.0.smithi026.stdout:4/90: dread d4/d7/fd [0,4194304] 0 2024-04-23T10:17:45.440 INFO:tasks.workunit.client.0.smithi026.stdout:4/91: chown d4 130092 1 2024-04-23T10:17:45.441 INFO:tasks.workunit.client.0.smithi026.stdout:4/92: chown d4/d7 2 1 2024-04-23T10:17:45.441 INFO:tasks.workunit.client.0.smithi026.stdout:8/151: readlink d5/d9/d14/d15/l1e 0 2024-04-23T10:17:45.444 INFO:tasks.workunit.client.0.smithi026.stdout:4/93: creat d4/d7/f1d x:0 0 0 2024-04-23T10:17:45.445 INFO:tasks.workunit.client.0.smithi026.stdout:4/94: dread f3 [0,4194304] 0 2024-04-23T10:17:45.447 INFO:tasks.workunit.client.0.smithi026.stdout:8/152: creat d5/d9/f2e x:0 0 0 2024-04-23T10:17:45.447 INFO:tasks.workunit.client.0.smithi026.stdout:4/95: rmdir d4/d7/d19 39 2024-04-23T10:17:45.449 INFO:tasks.workunit.client.0.smithi026.stdout:4/96: truncate d4/d7/f15 461514 0 2024-04-23T10:17:45.450 INFO:tasks.workunit.client.0.smithi026.stdout:4/97: mknod d4/d1b/c1e 0 2024-04-23T10:17:45.455 INFO:tasks.workunit.client.0.smithi026.stdout:4/98: link d4/d14/f12 d4/d7/f1f 0 2024-04-23T10:17:45.456 INFO:tasks.workunit.client.0.smithi026.stdout:8/153: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:45.459 INFO:tasks.workunit.client.0.smithi026.stdout:4/99: rename d4/d7/fd to d4/d1b/f20 0 2024-04-23T10:17:45.459 INFO:tasks.workunit.client.0.smithi026.stdout:6/249: dread f3 [0,4194304] 0 2024-04-23T10:17:45.462 INFO:tasks.workunit.client.0.smithi026.stdout:4/100: readlink d4/l18 0 2024-04-23T10:17:45.463 INFO:tasks.workunit.client.0.smithi026.stdout:6/250: mknod d6/d21/d2f/d32/c50 0 2024-04-23T10:17:45.465 INFO:tasks.workunit.client.0.smithi026.stdout:6/251: fdatasync d6/d13/d15/f4c 0 2024-04-23T10:17:45.465 INFO:tasks.workunit.client.0.smithi026.stdout:6/252: stat d6/d21 0 2024-04-23T10:17:45.467 INFO:tasks.workunit.client.0.smithi026.stdout:8/154: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:45.470 INFO:tasks.workunit.client.0.smithi026.stdout:6/253: mknod d6/d13/d49/c51 0 2024-04-23T10:17:45.471 INFO:tasks.workunit.client.0.smithi026.stdout:4/101: dread d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:45.471 INFO:tasks.workunit.client.0.smithi026.stdout:6/254: write d6/d13/f4e [151941,14663] 0 2024-04-23T10:17:45.472 INFO:tasks.workunit.client.0.smithi026.stdout:4/102: fsync d4/d14/f1c 0 2024-04-23T10:17:45.475 INFO:tasks.workunit.client.0.smithi026.stdout:4/103: write d4/d7/f8 [2964134,126211] 0 2024-04-23T10:17:45.478 INFO:tasks.workunit.client.0.smithi026.stdout:8/155: truncate d5/d9/d14/f1c 1603925 0 2024-04-23T10:17:45.480 INFO:tasks.workunit.client.0.smithi026.stdout:8/156: symlink d5/d9/d22/l2f 0 2024-04-23T10:17:45.482 INFO:tasks.workunit.client.0.smithi026.stdout:6/255: truncate d6/f10 529983 0 2024-04-23T10:17:45.483 INFO:tasks.workunit.client.0.smithi026.stdout:8/157: dread d5/d9/fa [0,4194304] 0 2024-04-23T10:17:45.484 INFO:tasks.workunit.client.0.smithi026.stdout:4/104: getdents d4/d7 0 2024-04-23T10:17:45.487 INFO:tasks.workunit.client.0.smithi026.stdout:8/158: link d5/l16 d5/d24/l30 0 2024-04-23T10:17:45.488 INFO:tasks.workunit.client.0.smithi026.stdout:8/159: write d5/f13 [1200191,22416] 0 2024-04-23T10:17:45.489 INFO:tasks.workunit.client.0.smithi026.stdout:8/160: truncate d5/f2a 1621470 0 2024-04-23T10:17:45.492 INFO:tasks.workunit.client.0.smithi026.stdout:4/105: write d4/d14/f12 [681273,78444] 0 2024-04-23T10:17:45.497 INFO:tasks.workunit.client.0.smithi026.stdout:4/106: creat d4/d7/d19/f21 x:0 0 0 2024-04-23T10:17:45.498 INFO:tasks.workunit.client.0.smithi026.stdout:4/107: write d4/d7/f13 [1168773,22149] 0 2024-04-23T10:17:45.509 INFO:tasks.workunit.client.0.smithi026.stdout:4/108: dwrite d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:45.519 INFO:tasks.workunit.client.0.smithi026.stdout:4/109: mkdir d4/d22 0 2024-04-23T10:17:45.521 INFO:tasks.workunit.client.0.smithi026.stdout:4/110: write d4/d14/f12 [663980,34762] 0 2024-04-23T10:17:45.524 INFO:tasks.workunit.client.0.smithi026.stdout:4/111: rename d4/l11 to d4/d7/l23 0 2024-04-23T10:17:45.525 INFO:tasks.workunit.client.0.smithi026.stdout:4/112: readlink d4/le 0 2024-04-23T10:17:45.531 INFO:tasks.workunit.client.0.smithi026.stdout:4/113: dread d4/d14/f12 [0,4194304] 0 2024-04-23T10:17:45.543 INFO:tasks.workunit.client.0.smithi026.stdout:4/114: dwrite d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:45.544 INFO:tasks.workunit.client.0.smithi026.stdout:4/115: chown d4/d7/f15 33048 1 2024-04-23T10:17:45.607 INFO:tasks.workunit.client.0.smithi026.stdout:7/137: dread dd/f13 [0,4194304] 0 2024-04-23T10:17:45.608 INFO:tasks.workunit.client.0.smithi026.stdout:7/138: chown l1 53932183 1 2024-04-23T10:17:45.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/139: symlink dd/d1d/l2d 0 2024-04-23T10:17:45.631 INFO:tasks.workunit.client.0.smithi026.stdout:3/197: sync 2024-04-23T10:17:45.631 INFO:tasks.workunit.client.0.smithi026.stdout:0/237: sync 2024-04-23T10:17:45.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/164: sync 2024-04-23T10:17:45.635 INFO:tasks.workunit.client.0.smithi026.stdout:0/238: truncate d7/d8/d1e/d30/f5c 437351 0 2024-04-23T10:17:45.640 INFO:tasks.workunit.client.0.smithi026.stdout:3/198: rename d0/d1e/d30/d43/df/d1f/d2c to d0/d4c 0 2024-04-23T10:17:45.643 INFO:tasks.workunit.client.0.smithi026.stdout:7/140: getdents dd/d1d 0 2024-04-23T10:17:45.646 INFO:tasks.workunit.client.0.smithi026.stdout:1/165: creat dd/f3b x:0 0 0 2024-04-23T10:17:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:1/166: chown dd/d1a/f24 57574836 1 2024-04-23T10:17:45.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/199: write d0/d1e/d30/d43/f3b [335759,108701] 0 2024-04-23T10:17:45.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/200: unlink d0/f6 0 2024-04-23T10:17:45.661 INFO:tasks.workunit.client.0.smithi026.stdout:1/167: dread dd/d1a/d23/f2d [0,4194304] 0 2024-04-23T10:17:45.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/168: fdatasync f2 0 2024-04-23T10:17:45.664 INFO:tasks.workunit.client.0.smithi026.stdout:7/141: dwrite dd/d1d/d1e/f23 [0,4194304] 0 2024-04-23T10:17:45.665 INFO:tasks.workunit.client.0.smithi026.stdout:3/201: mknod d0/d1e/d30/d43/df/d17/c4d 0 2024-04-23T10:17:45.675 INFO:tasks.workunit.client.0.smithi026.stdout:1/169: write dd/d1a/d23/f2d [1120294,17435] 0 2024-04-23T10:17:45.678 INFO:tasks.workunit.client.0.smithi026.stdout:7/142: dread dd/d1d/d1e/f24 [0,4194304] 0 2024-04-23T10:17:45.679 INFO:tasks.workunit.client.0.smithi026.stdout:0/239: dwrite d7/d8/d1e/d1d/d2f/f44 [0,4194304] 0 2024-04-23T10:17:45.682 INFO:tasks.workunit.client.0.smithi026.stdout:3/202: symlink d0/d1e/d30/d43/d29/l4e 0 2024-04-23T10:17:45.690 INFO:tasks.workunit.client.0.smithi026.stdout:7/143: dread dd/f11 [0,4194304] 0 2024-04-23T10:17:45.692 INFO:tasks.workunit.client.0.smithi026.stdout:1/170: symlink dd/d1a/l3c 0 2024-04-23T10:17:45.692 INFO:tasks.workunit.client.0.smithi026.stdout:0/240: mkdir d7/d8/d2d/d60 0 2024-04-23T10:17:45.695 INFO:tasks.workunit.client.0.smithi026.stdout:0/241: write d7/f14 [955550,86510] 0 2024-04-23T10:17:45.699 INFO:tasks.workunit.client.0.smithi026.stdout:3/203: rmdir d0/d1e/d30/d43/df/d17 39 2024-04-23T10:17:45.717 INFO:tasks.workunit.client.0.smithi026.stdout:7/144: truncate dd/d1d/f20 1768088 0 2024-04-23T10:17:45.719 INFO:tasks.workunit.client.0.smithi026.stdout:0/242: truncate d7/d43/f53 3596795 0 2024-04-23T10:17:45.721 INFO:tasks.workunit.client.0.smithi026.stdout:0/243: rmdir d7/d5b 39 2024-04-23T10:17:45.724 INFO:tasks.workunit.client.0.smithi026.stdout:0/244: symlink d7/d8/d1e/d2a/l61 0 2024-04-23T10:17:45.728 INFO:tasks.workunit.client.0.smithi026.stdout:0/245: chown d7/d43/f53 92680 1 2024-04-23T10:17:45.732 INFO:tasks.workunit.client.0.smithi026.stdout:3/204: write d0/d1e/d30/d43/fa [1072658,91569] 0 2024-04-23T10:17:45.735 INFO:tasks.workunit.client.0.smithi026.stdout:0/246: rename d7/d8/d1e/d30 to d7/d8/d2d/d60/d62 0 2024-04-23T10:17:45.740 INFO:tasks.workunit.client.0.smithi026.stdout:0/247: symlink d7/d8/d2d/d60/d62/l63 0 2024-04-23T10:17:45.741 INFO:tasks.workunit.client.0.smithi026.stdout:7/145: write dd/d1d/f20 [1578711,47902] 0 2024-04-23T10:17:45.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/205: creat d0/d1e/d30/f4f x:0 0 0 2024-04-23T10:17:45.780 INFO:tasks.workunit.client.0.smithi026.stdout:9/216: sync 2024-04-23T10:17:45.781 INFO:tasks.workunit.client.0.smithi026.stdout:0/248: symlink d7/d8/d1e/d2a/l64 0 2024-04-23T10:17:45.781 INFO:tasks.workunit.client.0.smithi026.stdout:7/146: rename f6 to dd/d1d/d1e/f2e 0 2024-04-23T10:17:45.784 INFO:tasks.workunit.client.0.smithi026.stdout:9/217: fdatasync d13/d2a/f35 0 2024-04-23T10:17:45.790 INFO:tasks.workunit.client.0.smithi026.stdout:9/218: rename d13/l15 to d13/d2a/l3d 0 2024-04-23T10:17:45.791 INFO:tasks.workunit.client.0.smithi026.stdout:9/219: chown d13/f1e 1122373 1 2024-04-23T10:17:45.793 INFO:tasks.workunit.client.0.smithi026.stdout:9/220: chown d13/d31/c3c 925657284 1 2024-04-23T10:17:45.793 INFO:tasks.workunit.client.0.smithi026.stdout:0/249: dwrite d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:45.794 INFO:tasks.workunit.client.0.smithi026.stdout:0/250: write d7/d8/d1e/f21 [933905,105410] 0 2024-04-23T10:17:45.796 INFO:tasks.workunit.client.0.smithi026.stdout:0/251: fdatasync d7/d8/d2d/d60/d62/f40 0 2024-04-23T10:17:45.798 INFO:tasks.workunit.client.0.smithi026.stdout:3/206: link d0/d4c/c2e d0/d1e/d30/d43/d29/d39/c50 0 2024-04-23T10:17:45.809 INFO:tasks.workunit.client.0.smithi026.stdout:3/207: mkdir d0/d51 0 2024-04-23T10:17:45.811 INFO:tasks.workunit.client.0.smithi026.stdout:3/208: chown d0/d1e/d30/d43/df/l16 177609 1 2024-04-23T10:17:45.812 INFO:tasks.workunit.client.0.smithi026.stdout:9/221: mkdir d13/d3e 0 2024-04-23T10:17:45.814 INFO:tasks.workunit.client.0.smithi026.stdout:9/222: read d13/f14 [3300432,44810] 0 2024-04-23T10:17:45.816 INFO:tasks.workunit.client.0.smithi026.stdout:0/252: rename d7/f35 to d7/d5b/f65 0 2024-04-23T10:17:45.821 INFO:tasks.workunit.client.0.smithi026.stdout:9/223: dread d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:45.823 INFO:tasks.workunit.client.0.smithi026.stdout:7/147: truncate dd/d1d/d1e/f2b 308756 0 2024-04-23T10:17:45.824 INFO:tasks.workunit.client.0.smithi026.stdout:7/148: write dd/d1d/f20 [375644,69980] 0 2024-04-23T10:17:45.825 INFO:tasks.workunit.client.0.smithi026.stdout:7/149: readlink dd/d1d/l2d 0 2024-04-23T10:17:45.826 INFO:tasks.workunit.client.0.smithi026.stdout:0/253: creat d7/d8/d2d/d60/f66 x:0 0 0 2024-04-23T10:17:45.828 INFO:tasks.workunit.client.0.smithi026.stdout:3/209: mkdir d0/d1e/d23/d52 0 2024-04-23T10:17:45.836 INFO:tasks.workunit.client.0.smithi026.stdout:7/150: rmdir dd/d1d 39 2024-04-23T10:17:45.841 INFO:tasks.workunit.client.0.smithi026.stdout:3/210: symlink d0/d1e/l53 0 2024-04-23T10:17:45.853 INFO:tasks.workunit.client.0.smithi026.stdout:0/254: link d7/d8/d1e/d1d/d2f/f48 d7/d8/d1e/d1d/f67 0 2024-04-23T10:17:45.853 INFO:tasks.workunit.client.0.smithi026.stdout:0/255: chown d7/d8/d2d/f4e 0 1 2024-04-23T10:17:45.858 INFO:tasks.workunit.client.0.smithi026.stdout:7/151: rename dd/d1d/f20 to dd/f2f 0 2024-04-23T10:17:45.859 INFO:tasks.workunit.client.0.smithi026.stdout:9/224: truncate d13/f2d 1981184 0 2024-04-23T10:17:45.860 INFO:tasks.workunit.client.0.smithi026.stdout:3/211: symlink d0/d1e/d23/d52/l54 0 2024-04-23T10:17:45.862 INFO:tasks.workunit.client.0.smithi026.stdout:0/256: symlink d7/d8/d2d/d60/d62/l68 0 2024-04-23T10:17:45.865 INFO:tasks.workunit.client.0.smithi026.stdout:7/152: rmdir dd 39 2024-04-23T10:17:45.866 INFO:tasks.workunit.client.0.smithi026.stdout:9/225: rmdir d13/d31 39 2024-04-23T10:17:45.874 INFO:tasks.workunit.client.0.smithi026.stdout:9/226: symlink d13/d19/d37/d3a/l3f 0 2024-04-23T10:17:45.875 INFO:tasks.workunit.client.0.smithi026.stdout:9/227: rename d13/d3e to d13/d3e/d40 22 2024-04-23T10:17:45.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/228: chown d13 26070636 1 2024-04-23T10:17:45.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/212: dwrite d0/d1e/d30/d43/f3b [0,4194304] 0 2024-04-23T10:17:45.876 INFO:tasks.workunit.client.0.smithi026.stdout:7/153: symlink dd/d1d/l30 0 2024-04-23T10:17:45.878 INFO:tasks.workunit.client.0.smithi026.stdout:3/213: write d0/d1e/d30/d43/df/f33 [1117929,30763] 0 2024-04-23T10:17:45.878 INFO:tasks.workunit.client.0.smithi026.stdout:0/257: link d7/d5b/f5f d7/d8/d1e/d1d/f69 0 2024-04-23T10:17:45.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/229: write d13/f17 [833393,62607] 0 2024-04-23T10:17:45.881 INFO:tasks.workunit.client.0.smithi026.stdout:0/258: write d7/d8/d1e/d1d/d2f/f44 [5176803,124228] 0 2024-04-23T10:17:45.889 INFO:tasks.workunit.client.0.smithi026.stdout:3/214: dread d0/f4 [4194304,4194304] 0 2024-04-23T10:17:45.893 INFO:tasks.workunit.client.0.smithi026.stdout:0/259: unlink d7/d8/d1e/f21 0 2024-04-23T10:17:45.894 INFO:tasks.workunit.client.0.smithi026.stdout:0/260: chown d7/d8/d2d 22948889 1 2024-04-23T10:17:45.899 INFO:tasks.workunit.client.0.smithi026.stdout:0/261: mkdir d7/d8/d1e/d2a/d6a 0 2024-04-23T10:17:45.899 INFO:tasks.workunit.client.0.smithi026.stdout:3/215: dwrite d0/f48 [0,4194304] 0 2024-04-23T10:17:45.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/154: truncate dd/f2f 1738863 0 2024-04-23T10:17:45.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/155: readlink dd/l18 0 2024-04-23T10:17:45.903 INFO:tasks.workunit.client.0.smithi026.stdout:3/216: mknod d0/d1e/d23/d52/c55 0 2024-04-23T10:17:45.904 INFO:tasks.workunit.client.0.smithi026.stdout:0/262: creat d7/d8/d1e/d2a/d6a/f6b x:0 0 0 2024-04-23T10:17:45.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/217: unlink d0/f13 0 2024-04-23T10:17:45.908 INFO:tasks.workunit.client.0.smithi026.stdout:2/155: sync 2024-04-23T10:17:45.908 INFO:tasks.workunit.client.0.smithi026.stdout:5/78: sync 2024-04-23T10:17:45.908 INFO:tasks.workunit.client.0.smithi026.stdout:9/230: dwrite d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:45.909 INFO:tasks.workunit.client.0.smithi026.stdout:5/79: stat d0/fe 0 2024-04-23T10:17:45.914 INFO:tasks.workunit.client.0.smithi026.stdout:0/263: unlink d7/d8/d1e/d2a/l61 0 2024-04-23T10:17:45.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/218: creat d0/f56 x:0 0 0 2024-04-23T10:17:45.916 INFO:tasks.workunit.client.0.smithi026.stdout:9/231: rmdir d13/d19/d37 39 2024-04-23T10:17:45.918 INFO:tasks.workunit.client.0.smithi026.stdout:2/156: mkdir d3/d19/d21/d23/d3a 0 2024-04-23T10:17:45.920 INFO:tasks.workunit.client.0.smithi026.stdout:9/232: rename ff to d13/d3e/f41 0 2024-04-23T10:17:45.921 INFO:tasks.workunit.client.0.smithi026.stdout:0/264: dread f4 [4194304,4194304] 0 2024-04-23T10:17:45.922 INFO:tasks.workunit.client.0.smithi026.stdout:5/80: link d0/f16 d0/f1a 0 2024-04-23T10:17:45.927 INFO:tasks.workunit.client.0.smithi026.stdout:7/156: dread dd/f2f [0,4194304] 0 2024-04-23T10:17:45.929 INFO:tasks.workunit.client.0.smithi026.stdout:2/157: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:45.931 INFO:tasks.workunit.client.0.smithi026.stdout:3/219: dread d0/d1e/d30/d43/d29/f3f [0,4194304] 0 2024-04-23T10:17:45.932 INFO:tasks.workunit.client.0.smithi026.stdout:0/265: mkdir d7/d8/d1e/d1d/d2f/d6c 0 2024-04-23T10:17:45.933 INFO:tasks.workunit.client.0.smithi026.stdout:0/266: dread - d7/d8/d2d/d60/d62/f40 zero size 2024-04-23T10:17:45.933 INFO:tasks.workunit.client.0.smithi026.stdout:5/81: link d0/d13/f14 d0/d12/f1b 0 2024-04-23T10:17:45.935 INFO:tasks.workunit.client.0.smithi026.stdout:7/157: rename dd/f16 to dd/d1d/f31 0 2024-04-23T10:17:45.941 INFO:tasks.workunit.client.0.smithi026.stdout:0/267: fdatasync d7/d8/d1e/d1d/f67 0 2024-04-23T10:17:45.944 INFO:tasks.workunit.client.0.smithi026.stdout:9/233: dread d13/f2d [0,4194304] 0 2024-04-23T10:17:45.946 INFO:tasks.workunit.client.0.smithi026.stdout:5/82: getdents d0 0 2024-04-23T10:17:45.951 INFO:tasks.workunit.client.0.smithi026.stdout:0/268: link d7/d8/d2d/f50 d7/d8/d1e/d1d/f6d 0 2024-04-23T10:17:45.953 INFO:tasks.workunit.client.0.smithi026.stdout:7/158: dwrite dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/220: dread d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:45.956 INFO:tasks.workunit.client.0.smithi026.stdout:0/269: creat d7/d8/d1e/d2a/f6e x:0 0 0 2024-04-23T10:17:45.958 INFO:tasks.workunit.client.0.smithi026.stdout:9/234: dwrite d13/d2a/f2f [0,4194304] 0 2024-04-23T10:17:45.960 INFO:tasks.workunit.client.0.smithi026.stdout:7/159: unlink dd/d1d/d1e/f2b 0 2024-04-23T10:17:45.962 INFO:tasks.workunit.client.0.smithi026.stdout:0/270: rmdir d7 39 2024-04-23T10:17:45.967 INFO:tasks.workunit.client.0.smithi026.stdout:5/83: dwrite d0/d13/f14 [4194304,4194304] 0 2024-04-23T10:17:45.969 INFO:tasks.workunit.client.0.smithi026.stdout:2/158: dwrite d3/dd/f32 [0,4194304] 0 2024-04-23T10:17:45.969 INFO:tasks.workunit.client.0.smithi026.stdout:3/221: creat d0/d1e/d30/f57 x:0 0 0 2024-04-23T10:17:45.976 INFO:tasks.workunit.client.0.smithi026.stdout:9/235: rmdir d13/d19/d37/d3a 39 2024-04-23T10:17:45.977 INFO:tasks.workunit.client.0.smithi026.stdout:5/84: symlink d0/l1c 0 2024-04-23T10:17:45.978 INFO:tasks.workunit.client.0.smithi026.stdout:2/159: rename d3/d19/d31/f36 to d3/d19/d31/f3b 0 2024-04-23T10:17:45.979 INFO:tasks.workunit.client.0.smithi026.stdout:5/85: chown d0/f16 17718 1 2024-04-23T10:17:45.979 INFO:tasks.workunit.client.0.smithi026.stdout:3/222: symlink d0/l58 0 2024-04-23T10:17:45.983 INFO:tasks.workunit.client.0.smithi026.stdout:5/86: symlink d0/d12/l1d 0 2024-04-23T10:17:45.983 INFO:tasks.workunit.client.0.smithi026.stdout:0/271: rename d7/d8/f16 to d7/f6f 0 2024-04-23T10:17:45.984 INFO:tasks.workunit.client.0.smithi026.stdout:8/161: sync 2024-04-23T10:17:45.984 INFO:tasks.workunit.client.0.smithi026.stdout:6/256: sync 2024-04-23T10:17:45.984 INFO:tasks.workunit.client.0.smithi026.stdout:9/236: symlink d13/d31/l42 0 2024-04-23T10:17:45.985 INFO:tasks.workunit.client.0.smithi026.stdout:3/223: write d0/d1e/d30/d43/df/d17/f32 [143521,119258] 0 2024-04-23T10:17:45.988 INFO:tasks.workunit.client.0.smithi026.stdout:5/87: creat d0/f1e x:0 0 0 2024-04-23T10:17:45.989 INFO:tasks.workunit.client.0.smithi026.stdout:7/160: dread dd/d1d/d1e/f2e [0,4194304] 0 2024-04-23T10:17:45.989 INFO:tasks.workunit.client.0.smithi026.stdout:2/160: mkdir d3/d19/d21/d23/d3a/d3c 0 2024-04-23T10:17:45.989 INFO:tasks.workunit.client.0.smithi026.stdout:9/237: truncate d13/f1c 4360616 0 2024-04-23T10:17:45.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/161: read dd/f2f [1406127,116809] 0 2024-04-23T10:17:45.992 INFO:tasks.workunit.client.0.smithi026.stdout:2/161: write d3/dd/f32 [694581,102234] 0 2024-04-23T10:17:45.995 INFO:tasks.workunit.client.0.smithi026.stdout:9/238: symlink d13/d2a/l43 0 2024-04-23T10:17:46.000 INFO:tasks.workunit.client.0.smithi026.stdout:2/162: truncate d3/f22 4454513 0 2024-04-23T10:17:46.000 INFO:tasks.workunit.client.0.smithi026.stdout:9/239: read d13/d2a/f35 [316964,74225] 0 2024-04-23T10:17:46.001 INFO:tasks.workunit.client.0.smithi026.stdout:0/272: rmdir d7/d8/d1e/d57 39 2024-04-23T10:17:46.002 INFO:tasks.workunit.client.0.smithi026.stdout:8/162: dwrite d5/d9/fa [0,4194304] 0 2024-04-23T10:17:46.005 INFO:tasks.workunit.client.0.smithi026.stdout:0/273: readlink d7/d8/d1e/l4c 0 2024-04-23T10:17:46.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/163: rename c2 to d3/d35/c3d 0 2024-04-23T10:17:46.005 INFO:tasks.workunit.client.0.smithi026.stdout:7/162: truncate dd/f13 8159146 0 2024-04-23T10:17:46.008 INFO:tasks.workunit.client.0.smithi026.stdout:9/240: creat d13/d3e/f44 x:0 0 0 2024-04-23T10:17:46.009 INFO:tasks.workunit.client.0.smithi026.stdout:8/163: creat d5/d9/d14/d15/f31 x:0 0 0 2024-04-23T10:17:46.009 INFO:tasks.workunit.client.0.smithi026.stdout:6/257: dwrite d6/d13/d15/f1c [0,4194304] 0 2024-04-23T10:17:46.009 INFO:tasks.workunit.client.0.smithi026.stdout:7/163: write dd/d1d/d1e/f23 [4520410,71143] 0 2024-04-23T10:17:46.012 INFO:tasks.workunit.client.0.smithi026.stdout:3/224: dwrite d0/d1e/d30/f4f [0,4194304] 0 2024-04-23T10:17:46.015 INFO:tasks.workunit.client.0.smithi026.stdout:8/164: symlink d5/d24/l32 0 2024-04-23T10:17:46.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/225: unlink d0/f48 0 2024-04-23T10:17:46.021 INFO:tasks.workunit.client.0.smithi026.stdout:6/258: unlink d6/c4b 0 2024-04-23T10:17:46.022 INFO:tasks.workunit.client.0.smithi026.stdout:8/165: rmdir d5 39 2024-04-23T10:17:46.025 INFO:tasks.workunit.client.0.smithi026.stdout:2/164: getdents d3 0 2024-04-23T10:17:46.026 INFO:tasks.workunit.client.0.smithi026.stdout:0/274: getdents d7/d43 0 2024-04-23T10:17:46.028 INFO:tasks.workunit.client.0.smithi026.stdout:3/226: write d0/d1e/d30/d43/df/f1b [2338681,126842] 0 2024-04-23T10:17:46.028 INFO:tasks.workunit.client.0.smithi026.stdout:6/259: mkdir d6/d21/d2f/d31/d52 0 2024-04-23T10:17:46.029 INFO:tasks.workunit.client.0.smithi026.stdout:9/241: dwrite d13/f25 [0,4194304] 0 2024-04-23T10:17:46.030 INFO:tasks.workunit.client.0.smithi026.stdout:0/275: chown d7/d8/d1e 51 1 2024-04-23T10:17:46.030 INFO:tasks.workunit.client.0.smithi026.stdout:2/165: readlink d3/d19/d21/l28 0 2024-04-23T10:17:46.035 INFO:tasks.workunit.client.0.smithi026.stdout:7/164: dwrite dd/f2f [0,4194304] 0 2024-04-23T10:17:46.040 INFO:tasks.workunit.client.0.smithi026.stdout:0/276: chown d7/d8/d2d/l4f 3 1 2024-04-23T10:17:46.042 INFO:tasks.workunit.client.0.smithi026.stdout:8/166: rename d5/d9/d22/d2c to d5/d9/d14/d33 0 2024-04-23T10:17:46.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/227: symlink d0/d1e/d30/d43/d29/l59 0 2024-04-23T10:17:46.043 INFO:tasks.workunit.client.0.smithi026.stdout:0/277: chown d7/d8/d1e/d1d/l54 41597293 1 2024-04-23T10:17:46.043 INFO:tasks.workunit.client.0.smithi026.stdout:8/167: chown l1 15 1 2024-04-23T10:17:46.047 INFO:tasks.workunit.client.0.smithi026.stdout:2/166: dwrite d3/dd/f2d [0,4194304] 0 2024-04-23T10:17:46.053 INFO:tasks.workunit.client.0.smithi026.stdout:9/242: rename d13/d19/d37 to d13/d2a/d45 0 2024-04-23T10:17:46.054 INFO:tasks.workunit.client.0.smithi026.stdout:3/228: rmdir d0/d1e/d30/d43/df/d17 39 2024-04-23T10:17:46.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/243: chown d13/d2a/d45 62 1 2024-04-23T10:17:46.055 INFO:tasks.workunit.client.0.smithi026.stdout:2/167: write d3/d19/f1c [4418270,130419] 0 2024-04-23T10:17:46.059 INFO:tasks.workunit.client.0.smithi026.stdout:8/168: creat d5/d9/d14/d15/f34 x:0 0 0 2024-04-23T10:17:46.060 INFO:tasks.workunit.client.0.smithi026.stdout:7/165: dread dd/d1d/d1e/f24 [0,4194304] 0 2024-04-23T10:17:46.062 INFO:tasks.workunit.client.0.smithi026.stdout:9/244: rmdir d13/d1b/d26 39 2024-04-23T10:17:46.066 INFO:tasks.workunit.client.0.smithi026.stdout:0/278: getdents d7/d8/d1e/d2a/d6a 0 2024-04-23T10:17:46.066 INFO:tasks.workunit.client.0.smithi026.stdout:3/229: write d0/d1e/d30/d43/f38 [2204350,18803] 0 2024-04-23T10:17:46.067 INFO:tasks.workunit.client.0.smithi026.stdout:6/260: dwrite f3 [0,4194304] 0 2024-04-23T10:17:46.069 INFO:tasks.workunit.client.0.smithi026.stdout:7/166: mknod dd/c32 0 2024-04-23T10:17:46.074 INFO:tasks.workunit.client.0.smithi026.stdout:7/167: rmdir dd/d1d 39 2024-04-23T10:17:46.075 INFO:tasks.workunit.client.0.smithi026.stdout:3/230: chown d0/d1e/d30/d43/f2d 31980 1 2024-04-23T10:17:46.077 INFO:tasks.workunit.client.0.smithi026.stdout:9/245: link d13/d1b/d26/l28 d13/l46 0 2024-04-23T10:17:46.077 INFO:tasks.workunit.client.0.smithi026.stdout:2/168: dwrite d3/d19/f1c [4194304,4194304] 0 2024-04-23T10:17:46.078 INFO:tasks.workunit.client.0.smithi026.stdout:2/169: stat d3/f6 0 2024-04-23T10:17:46.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/246: chown d13/d2a/l3d 54758 1 2024-04-23T10:17:46.081 INFO:tasks.workunit.client.0.smithi026.stdout:3/231: mknod d0/d1e/d30/d43/df/c5a 0 2024-04-23T10:17:46.081 INFO:tasks.workunit.client.0.smithi026.stdout:8/169: dwrite d5/d24/f27 [0,4194304] 0 2024-04-23T10:17:46.082 INFO:tasks.workunit.client.0.smithi026.stdout:9/247: read d13/d2a/f2f [2787030,50878] 0 2024-04-23T10:17:46.082 INFO:tasks.workunit.client.0.smithi026.stdout:8/170: fdatasync d5/d9/fb 0 2024-04-23T10:17:46.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/279: truncate d7/f14 31194 0 2024-04-23T10:17:46.088 INFO:tasks.workunit.client.0.smithi026.stdout:3/232: mknod d0/d1e/d30/d43/df/d1f/c5b 0 2024-04-23T10:17:46.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/233: write d0/d1e/d30/d43/df/f1b [1860145,16702] 0 2024-04-23T10:17:46.093 INFO:tasks.workunit.client.0.smithi026.stdout:2/170: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:46.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/171: fsync d3/d19/f1c 0 2024-04-23T10:17:46.102 INFO:tasks.workunit.client.0.smithi026.stdout:9/248: read d13/f14 [71204,5733] 0 2024-04-23T10:17:46.103 INFO:tasks.workunit.client.0.smithi026.stdout:0/280: mkdir d7/d8/d1e/d2a/d6a/d70 0 2024-04-23T10:17:46.106 INFO:tasks.workunit.client.0.smithi026.stdout:3/234: creat d0/d1e/d30/d43/d29/f5c x:0 0 0 2024-04-23T10:17:46.106 INFO:tasks.workunit.client.0.smithi026.stdout:6/261: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:46.108 INFO:tasks.workunit.client.0.smithi026.stdout:8/171: write d5/d9/d14/f1c [2279524,82534] 0 2024-04-23T10:17:46.109 INFO:tasks.workunit.client.0.smithi026.stdout:8/172: read - d5/d9/d14/d15/f34 zero size 2024-04-23T10:17:46.121 INFO:tasks.workunit.client.0.smithi026.stdout:3/235: dwrite d0/d1e/d23/f41 [0,4194304] 0 2024-04-23T10:17:46.122 INFO:tasks.workunit.client.0.smithi026.stdout:0/281: dwrite d7/d8/d1e/d1d/d2f/f44 [0,4194304] 0 2024-04-23T10:17:46.123 INFO:tasks.workunit.client.0.smithi026.stdout:0/282: stat d7/d8/d1e/d1d/d2f/d6c 0 2024-04-23T10:17:46.125 INFO:tasks.workunit.client.0.smithi026.stdout:4/116: sync 2024-04-23T10:17:46.126 INFO:tasks.workunit.client.0.smithi026.stdout:1/171: sync 2024-04-23T10:17:46.129 INFO:tasks.workunit.client.0.smithi026.stdout:6/262: mkdir d6/d21/d2f/d32/d53 0 2024-04-23T10:17:46.129 INFO:tasks.workunit.client.0.smithi026.stdout:8/173: mknod d5/d9/d22/c35 0 2024-04-23T10:17:46.131 INFO:tasks.workunit.client.0.smithi026.stdout:0/283: creat d7/d8/d1e/d2a/f71 x:0 0 0 2024-04-23T10:17:46.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/117: symlink d4/d22/l24 0 2024-04-23T10:17:46.135 INFO:tasks.workunit.client.0.smithi026.stdout:6/263: read d6/d13/f17 [383086,48624] 0 2024-04-23T10:17:46.136 INFO:tasks.workunit.client.0.smithi026.stdout:3/236: creat d0/d1e/f5d x:0 0 0 2024-04-23T10:17:46.139 INFO:tasks.workunit.client.0.smithi026.stdout:6/264: chown d6/d13/d49 2 1 2024-04-23T10:17:46.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/118: dread d4/d1b/f20 [0,4194304] 0 2024-04-23T10:17:46.144 INFO:tasks.workunit.client.0.smithi026.stdout:0/284: creat d7/d8/d1e/f72 x:0 0 0 2024-04-23T10:17:46.145 INFO:tasks.workunit.client.0.smithi026.stdout:3/237: chown d0/d1e/d30/d43/d29/f3f 1578610 1 2024-04-23T10:17:46.147 INFO:tasks.workunit.client.0.smithi026.stdout:2/172: dwrite d3/d19/d31/f3b [0,4194304] 0 2024-04-23T10:17:46.148 INFO:tasks.workunit.client.0.smithi026.stdout:2/173: chown d3/d35 58004161 1 2024-04-23T10:17:46.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/174: dwrite d5/d9/fa [0,4194304] 0 2024-04-23T10:17:46.152 INFO:tasks.workunit.client.0.smithi026.stdout:2/174: stat d3/dd/l1a 0 2024-04-23T10:17:46.152 INFO:tasks.workunit.client.0.smithi026.stdout:4/119: readlink d4/d7/l16 0 2024-04-23T10:17:46.154 INFO:tasks.workunit.client.0.smithi026.stdout:9/249: truncate d13/f25 3439230 0 2024-04-23T10:17:46.154 INFO:tasks.workunit.client.0.smithi026.stdout:4/120: readlink d4/le 0 2024-04-23T10:17:46.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/265: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:46.160 INFO:tasks.workunit.client.0.smithi026.stdout:6/266: write d6/fc [3704000,79573] 0 2024-04-23T10:17:46.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/175: creat d5/d9/d22/f36 x:0 0 0 2024-04-23T10:17:46.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/267: stat d6/l42 0 2024-04-23T10:17:46.163 INFO:tasks.workunit.client.0.smithi026.stdout:2/175: creat d3/d19/d21/d23/f3e x:0 0 0 2024-04-23T10:17:46.171 INFO:tasks.workunit.client.0.smithi026.stdout:8/176: unlink f2 0 2024-04-23T10:17:46.174 INFO:tasks.workunit.client.0.smithi026.stdout:9/250: creat d13/d1b/f47 x:0 0 0 2024-04-23T10:17:46.176 INFO:tasks.workunit.client.0.smithi026.stdout:0/285: rename d7/d8/d1e/d1d/d2f/f11 to d7/d8/d1e/d1d/f73 0 2024-04-23T10:17:46.178 INFO:tasks.workunit.client.0.smithi026.stdout:4/121: dwrite d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:46.178 INFO:tasks.workunit.client.0.smithi026.stdout:6/268: creat d6/d21/d2f/d32/d53/f54 x:0 0 0 2024-04-23T10:17:46.178 INFO:tasks.workunit.client.0.smithi026.stdout:3/238: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:46.181 INFO:tasks.workunit.client.0.smithi026.stdout:2/176: dread d3/dd/f18 [4194304,4194304] 0 2024-04-23T10:17:46.182 INFO:tasks.workunit.client.0.smithi026.stdout:0/286: rename d7/d8/d1e/d2a/d6a/d70 to d7/d8/d1e/d2a/d6a/d70/d74 22 2024-04-23T10:17:46.185 INFO:tasks.workunit.client.0.smithi026.stdout:4/122: fsync d4/d7/d19/f21 0 2024-04-23T10:17:46.188 INFO:tasks.workunit.client.0.smithi026.stdout:0/287: readlink d7/d8/d2d/l4f 0 2024-04-23T10:17:46.188 INFO:tasks.workunit.client.0.smithi026.stdout:2/177: stat d3/f8 0 2024-04-23T10:17:46.190 INFO:tasks.workunit.client.0.smithi026.stdout:3/239: mkdir d0/d51/d5e 0 2024-04-23T10:17:46.194 INFO:tasks.workunit.client.0.smithi026.stdout:0/288: truncate d7/d8/d1e/d1d/f73 4493977 0 2024-04-23T10:17:46.195 INFO:tasks.workunit.client.0.smithi026.stdout:6/269: dwrite d6/fe [4194304,4194304] 0 2024-04-23T10:17:46.201 INFO:tasks.workunit.client.0.smithi026.stdout:4/123: dread d4/d7/f1f [0,4194304] 0 2024-04-23T10:17:46.202 INFO:tasks.workunit.client.0.smithi026.stdout:0/289: dread d7/d8/d1e/d1d/d2f/f44 [0,4194304] 0 2024-04-23T10:17:46.203 INFO:tasks.workunit.client.0.smithi026.stdout:6/270: chown d6/d21/d2f/l43 10735248 1 2024-04-23T10:17:46.203 INFO:tasks.workunit.client.0.smithi026.stdout:2/178: link d3/cb d3/c3f 0 2024-04-23T10:17:46.205 INFO:tasks.workunit.client.0.smithi026.stdout:4/124: creat d4/d14/f25 x:0 0 0 2024-04-23T10:17:46.208 INFO:tasks.workunit.client.0.smithi026.stdout:2/179: mknod d3/d19/d21/c40 0 2024-04-23T10:17:46.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/251: truncate d13/d1b/d26/f30 3869276 0 2024-04-23T10:17:46.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/240: read d0/d1e/d30/d43/df/f1b [1781628,114816] 0 2024-04-23T10:17:46.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/252: mkdir d13/d2a/d45/d3a/d48 0 2024-04-23T10:17:46.216 INFO:tasks.workunit.client.0.smithi026.stdout:0/290: dwrite d7/d8/d1e/d2a/f2e [0,4194304] 0 2024-04-23T10:17:46.217 INFO:tasks.workunit.client.0.smithi026.stdout:3/241: fdatasync d0/d1e/d30/d43/f38 0 2024-04-23T10:17:46.220 INFO:tasks.workunit.client.0.smithi026.stdout:9/253: mknod d13/c49 0 2024-04-23T10:17:46.223 INFO:tasks.workunit.client.0.smithi026.stdout:4/125: truncate d4/d7/f13 92652 0 2024-04-23T10:17:46.224 INFO:tasks.workunit.client.0.smithi026.stdout:0/291: creat d7/d8/d2d/f75 x:0 0 0 2024-04-23T10:17:46.225 INFO:tasks.workunit.client.0.smithi026.stdout:3/242: write d0/d1e/d30/d43/f2d [709333,8580] 0 2024-04-23T10:17:46.229 INFO:tasks.workunit.client.0.smithi026.stdout:6/271: dwrite d6/d21/d2f/d37/f39 [0,4194304] 0 2024-04-23T10:17:46.230 INFO:tasks.workunit.client.0.smithi026.stdout:2/180: dwrite d3/dd/f30 [0,4194304] 0 2024-04-23T10:17:46.230 INFO:tasks.workunit.client.0.smithi026.stdout:0/292: creat d7/d5b/f76 x:0 0 0 2024-04-23T10:17:46.232 INFO:tasks.workunit.client.0.smithi026.stdout:8/177: dread d5/d24/f27 [4194304,4194304] 0 2024-04-23T10:17:46.236 INFO:tasks.workunit.client.0.smithi026.stdout:9/254: rename d13/d1b/f47 to d13/d2a/d45/d3a/f4a 0 2024-04-23T10:17:46.236 INFO:tasks.workunit.client.0.smithi026.stdout:4/126: creat d4/f26 x:0 0 0 2024-04-23T10:17:46.238 INFO:tasks.workunit.client.0.smithi026.stdout:0/293: rmdir d7/d8/d2d/d60 39 2024-04-23T10:17:46.239 INFO:tasks.workunit.client.0.smithi026.stdout:9/255: rename l2 to d13/d31/l4b 0 2024-04-23T10:17:46.246 INFO:tasks.workunit.client.0.smithi026.stdout:8/178: write d5/d9/fc [770062,116074] 0 2024-04-23T10:17:46.246 INFO:tasks.workunit.client.0.smithi026.stdout:0/294: mkdir d7/d8/d2d/d60/d77 0 2024-04-23T10:17:46.248 INFO:tasks.workunit.client.0.smithi026.stdout:9/256: rename f5 to d13/d36/f4c 0 2024-04-23T10:17:46.250 INFO:tasks.workunit.client.0.smithi026.stdout:8/179: write d5/d9/d22/f36 [575408,104347] 0 2024-04-23T10:17:46.254 INFO:tasks.workunit.client.0.smithi026.stdout:3/243: dread d0/f4 [0,4194304] 0 2024-04-23T10:17:46.261 INFO:tasks.workunit.client.0.smithi026.stdout:0/295: creat d7/d8/f78 x:0 0 0 2024-04-23T10:17:46.263 INFO:tasks.workunit.client.0.smithi026.stdout:8/180: link d5/d9/d22/c35 d5/d9/d22/c37 0 2024-04-23T10:17:46.267 INFO:tasks.workunit.client.0.smithi026.stdout:0/296: symlink d7/d8/l79 0 2024-04-23T10:17:46.269 INFO:tasks.workunit.client.0.smithi026.stdout:3/244: rename d0/d1e/d30/d43/f42 to d0/d1e/d30/d43/f5f 0 2024-04-23T10:17:46.269 INFO:tasks.workunit.client.0.smithi026.stdout:8/181: symlink d5/d9/d14/d33/l38 0 2024-04-23T10:17:46.272 INFO:tasks.workunit.client.0.smithi026.stdout:8/182: dread d5/d9/d14/f1f [0,4194304] 0 2024-04-23T10:17:46.328 INFO:tasks.workunit.client.0.smithi026.stdout:6/272: write d6/f12 [2891531,77287] 0 2024-04-23T10:17:46.333 INFO:tasks.workunit.client.0.smithi026.stdout:9/257: unlink d13/d31/l4b 0 2024-04-23T10:17:46.333 INFO:tasks.workunit.client.0.smithi026.stdout:9/258: stat d13/f17 0 2024-04-23T10:17:46.334 INFO:tasks.workunit.client.0.smithi026.stdout:0/297: creat d7/d8/d1e/f7a x:0 0 0 2024-04-23T10:17:46.337 INFO:tasks.workunit.client.0.smithi026.stdout:6/273: unlink d6/d21/d2f/d32/c50 0 2024-04-23T10:17:46.338 INFO:tasks.workunit.client.0.smithi026.stdout:6/274: chown d6/d13/d15 58967290 1 2024-04-23T10:17:46.343 INFO:tasks.workunit.client.0.smithi026.stdout:8/183: getdents d5/d9/d22 0 2024-04-23T10:17:46.345 INFO:tasks.workunit.client.0.smithi026.stdout:8/184: write d5/f2a [1636602,49831] 0 2024-04-23T10:17:46.345 INFO:tasks.workunit.client.0.smithi026.stdout:6/275: write d6/f1d [4035347,37719] 0 2024-04-23T10:17:46.345 INFO:tasks.workunit.client.0.smithi026.stdout:9/259: unlink l0 0 2024-04-23T10:17:46.368 INFO:tasks.workunit.client.0.smithi026.stdout:0/298: dread d7/d8/d2d/f37 [0,4194304] 0 2024-04-23T10:17:46.374 INFO:tasks.workunit.client.0.smithi026.stdout:0/299: truncate d7/d8/d1e/d1d/d2f/f48 338487 0 2024-04-23T10:17:46.390 INFO:tasks.workunit.client.0.smithi026.stdout:5/88: sync 2024-04-23T10:17:46.406 INFO:tasks.workunit.client.0.smithi026.stdout:6/276: truncate d6/d13/f4e 49983 0 2024-04-23T10:17:46.409 INFO:tasks.workunit.client.0.smithi026.stdout:3/245: rename d0/d1e/d30/d43/lb to d0/d1e/l60 0 2024-04-23T10:17:46.410 INFO:tasks.workunit.client.0.smithi026.stdout:3/246: fsync d0/f20 0 2024-04-23T10:17:46.423 INFO:tasks.workunit.client.0.smithi026.stdout:6/277: dwrite d6/d33/f2c [0,4194304] 0 2024-04-23T10:17:46.423 INFO:tasks.workunit.client.0.smithi026.stdout:3/247: creat d0/d1e/d23/d52/f61 x:0 0 0 2024-04-23T10:17:46.427 INFO:tasks.workunit.client.0.smithi026.stdout:6/278: stat d6/f12 0 2024-04-23T10:17:46.432 INFO:tasks.workunit.client.0.smithi026.stdout:9/260: rename d13/f14 to d13/d19/f4d 0 2024-04-23T10:17:46.440 INFO:tasks.workunit.client.0.smithi026.stdout:3/248: dread d0/fc [0,4194304] 0 2024-04-23T10:17:46.440 INFO:tasks.workunit.client.0.smithi026.stdout:0/300: dread d7/d8/d1e/d1d/d2f/f10 [0,4194304] 0 2024-04-23T10:17:46.443 INFO:tasks.workunit.client.0.smithi026.stdout:8/185: rename d5/d9/d14/d15/l1e to d5/d9/d22/l39 0 2024-04-23T10:17:46.446 INFO:tasks.workunit.client.0.smithi026.stdout:9/261: write d13/f22 [1185093,56051] 0 2024-04-23T10:17:46.451 INFO:tasks.workunit.client.0.smithi026.stdout:9/262: dread d13/f2d [0,4194304] 0 2024-04-23T10:17:46.451 INFO:tasks.workunit.client.0.smithi026.stdout:0/301: mknod d7/d5b/c7b 0 2024-04-23T10:17:46.453 INFO:tasks.workunit.client.0.smithi026.stdout:0/302: fsync d7/d8/d2d/d60/f66 0 2024-04-23T10:17:46.454 INFO:tasks.workunit.client.0.smithi026.stdout:9/263: dread d13/d2a/f35 [0,4194304] 0 2024-04-23T10:17:46.456 INFO:tasks.workunit.client.0.smithi026.stdout:8/186: read d5/d9/f10 [732708,77887] 0 2024-04-23T10:17:46.458 INFO:tasks.workunit.client.0.smithi026.stdout:8/187: write d5/d9/d14/d15/f34 [693236,94714] 0 2024-04-23T10:17:46.459 INFO:tasks.workunit.client.0.smithi026.stdout:3/249: write d0/d1e/d30/d43/d29/f3f [1399673,84421] 0 2024-04-23T10:17:46.460 INFO:tasks.workunit.client.0.smithi026.stdout:8/188: readlink d5/d9/d14/l19 0 2024-04-23T10:17:46.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/303: mknod d7/d8/c7c 0 2024-04-23T10:17:46.465 INFO:tasks.workunit.client.0.smithi026.stdout:9/264: mkdir d13/d3b/d4e 0 2024-04-23T10:17:46.468 INFO:tasks.workunit.client.0.smithi026.stdout:0/304: chown d7/d8/l79 1342772857 1 2024-04-23T10:17:46.472 INFO:tasks.workunit.client.0.smithi026.stdout:0/305: stat d7/d8/d1e/d1d/d2f/l58 0 2024-04-23T10:17:46.473 INFO:tasks.workunit.client.0.smithi026.stdout:6/279: dwrite d6/d13/f4e [0,4194304] 0 2024-04-23T10:17:46.476 INFO:tasks.workunit.client.0.smithi026.stdout:0/306: chown d7/d8/d1e/f32 16365853 1 2024-04-23T10:17:46.476 INFO:tasks.workunit.client.0.smithi026.stdout:8/189: dwrite d5/f13 [0,4194304] 0 2024-04-23T10:17:46.477 INFO:tasks.workunit.client.0.smithi026.stdout:8/190: fdatasync d5/f28 0 2024-04-23T10:17:46.478 INFO:tasks.workunit.client.0.smithi026.stdout:9/265: mkdir d13/d2a/d45/d3a/d4f 0 2024-04-23T10:17:46.482 INFO:tasks.workunit.client.0.smithi026.stdout:6/280: creat d6/d21/d2f/d32/f55 x:0 0 0 2024-04-23T10:17:46.488 INFO:tasks.workunit.client.0.smithi026.stdout:3/250: link d0/d1e/d30/d43/df/f4b d0/d1e/d30/d43/df/d1f/f62 0 2024-04-23T10:17:46.493 INFO:tasks.workunit.client.0.smithi026.stdout:0/307: symlink d7/d8/d1e/d1d/d2f/d6c/l7d 0 2024-04-23T10:17:46.494 INFO:tasks.workunit.client.0.smithi026.stdout:0/308: truncate d7/f38 286983 0 2024-04-23T10:17:46.496 INFO:tasks.workunit.client.0.smithi026.stdout:6/281: rename d6/d21/d2f/d32/l3e to d6/d21/d2f/d32/d53/l56 0 2024-04-23T10:17:46.497 INFO:tasks.workunit.client.0.smithi026.stdout:6/282: write d6/fe [1748013,65728] 0 2024-04-23T10:17:46.504 INFO:tasks.workunit.client.0.smithi026.stdout:0/309: dread d7/d8/d1e/d1d/f67 [0,4194304] 0 2024-04-23T10:17:46.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/283: creat d6/d21/d2f/f57 x:0 0 0 2024-04-23T10:17:46.512 INFO:tasks.workunit.client.0.smithi026.stdout:6/284: truncate d6/d13/d15/f2e 13461214 0 2024-04-23T10:17:46.519 INFO:tasks.workunit.client.0.smithi026.stdout:8/191: truncate d5/f23 2742296 0 2024-04-23T10:17:46.520 INFO:tasks.workunit.client.0.smithi026.stdout:8/192: write d5/f28 [341400,12898] 0 2024-04-23T10:17:46.520 INFO:tasks.workunit.client.0.smithi026.stdout:3/251: mkdir d0/d1e/d30/d43/df/d63 0 2024-04-23T10:17:46.521 INFO:tasks.workunit.client.0.smithi026.stdout:6/285: dwrite d6/d13/f4d [0,4194304] 0 2024-04-23T10:17:46.521 INFO:tasks.workunit.client.0.smithi026.stdout:9/266: write d13/d1b/d26/f30 [3716630,13831] 0 2024-04-23T10:17:46.524 INFO:tasks.workunit.client.0.smithi026.stdout:6/286: dread - d6/d21/d2f/d32/f55 zero size 2024-04-23T10:17:46.531 INFO:tasks.workunit.client.0.smithi026.stdout:3/252: mkdir d0/d1e/d30/d43/df/d1f/d64 0 2024-04-23T10:17:46.535 INFO:tasks.workunit.client.0.smithi026.stdout:7/168: sync 2024-04-23T10:17:46.536 INFO:tasks.workunit.client.0.smithi026.stdout:7/169: chown dd/f2f 292562097 1 2024-04-23T10:17:46.536 INFO:tasks.workunit.client.0.smithi026.stdout:9/267: dwrite d13/d1b/d26/f30 [0,4194304] 0 2024-04-23T10:17:46.543 INFO:tasks.workunit.client.0.smithi026.stdout:0/310: symlink d7/d8/d1e/d57/l7e 0 2024-04-23T10:17:46.553 INFO:tasks.workunit.client.0.smithi026.stdout:9/268: write d13/d3e/f41 [421081,78761] 0 2024-04-23T10:17:46.555 INFO:tasks.workunit.client.0.smithi026.stdout:0/311: chown d7/d8/d1e/d1d/d2f/f52 175514 1 2024-04-23T10:17:46.557 INFO:tasks.workunit.client.0.smithi026.stdout:7/170: dread dd/d1d/d1e/f23 [0,4194304] 0 2024-04-23T10:17:46.557 INFO:tasks.workunit.client.0.smithi026.stdout:0/312: chown d7/d8/d1e/d2a/l3d 94116558 1 2024-04-23T10:17:46.563 INFO:tasks.workunit.client.0.smithi026.stdout:6/287: getdents d6 0 2024-04-23T10:17:46.564 INFO:tasks.workunit.client.0.smithi026.stdout:7/171: rmdir dd 39 2024-04-23T10:17:46.566 INFO:tasks.workunit.client.0.smithi026.stdout:0/313: mkdir d7/d8/d1e/d1d/d2f/d6c/d7f 0 2024-04-23T10:17:46.569 INFO:tasks.workunit.client.0.smithi026.stdout:6/288: mkdir d6/d21/d58 0 2024-04-23T10:17:46.569 INFO:tasks.workunit.client.0.smithi026.stdout:2/181: sync 2024-04-23T10:17:46.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/89: sync 2024-04-23T10:17:46.569 INFO:tasks.workunit.client.0.smithi026.stdout:4/127: sync 2024-04-23T10:17:46.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/172: sync 2024-04-23T10:17:46.570 INFO:tasks.workunit.client.0.smithi026.stdout:8/193: truncate d5/d24/f27 1933835 0 2024-04-23T10:17:46.573 INFO:tasks.workunit.client.0.smithi026.stdout:9/269: rename d13/l18 to d13/l50 0 2024-04-23T10:17:46.574 INFO:tasks.workunit.client.0.smithi026.stdout:6/289: rmdir d6/d33 39 2024-04-23T10:17:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:2/182: mknod d3/d19/d21/c41 0 2024-04-23T10:17:46.575 INFO:tasks.workunit.client.0.smithi026.stdout:5/90: write d0/d12/f1b [7301311,17605] 0 2024-04-23T10:17:46.576 INFO:tasks.workunit.client.0.smithi026.stdout:7/172: mknod dd/d1d/d1e/c33 0 2024-04-23T10:17:46.576 INFO:tasks.workunit.client.0.smithi026.stdout:4/128: write d4/d14/f1c [343525,60358] 0 2024-04-23T10:17:46.578 INFO:tasks.workunit.client.0.smithi026.stdout:5/91: stat d0/c5 0 2024-04-23T10:17:46.581 INFO:tasks.workunit.client.0.smithi026.stdout:8/194: rename d5/d9/d14 to d5/d24/d3a 0 2024-04-23T10:17:46.581 INFO:tasks.workunit.client.0.smithi026.stdout:2/183: write d3/f13 [1916672,6841] 0 2024-04-23T10:17:46.582 INFO:tasks.workunit.client.0.smithi026.stdout:0/314: dwrite d7/f38 [0,4194304] 0 2024-04-23T10:17:46.586 INFO:tasks.workunit.client.0.smithi026.stdout:4/129: unlink d4/f26 0 2024-04-23T10:17:46.586 INFO:tasks.workunit.client.0.smithi026.stdout:3/253: dwrite d0/d1e/f37 [0,4194304] 0 2024-04-23T10:17:46.587 INFO:tasks.workunit.client.0.smithi026.stdout:6/290: chown d6/f19 1389420 1 2024-04-23T10:17:46.589 INFO:tasks.workunit.client.0.smithi026.stdout:8/195: write d5/d24/d3a/d15/f34 [880103,113684] 0 2024-04-23T10:17:46.601 INFO:tasks.workunit.client.0.smithi026.stdout:1/173: symlink dd/d1a/d20/d25/d35/l3d 0 2024-04-23T10:17:46.602 INFO:tasks.workunit.client.0.smithi026.stdout:5/92: rename d0/f1e to d0/d12/f1f 0 2024-04-23T10:17:46.602 INFO:tasks.workunit.client.0.smithi026.stdout:2/184: rmdir d3/d35 39 2024-04-23T10:17:46.603 INFO:tasks.workunit.client.0.smithi026.stdout:9/270: dwrite d13/f1c [0,4194304] 0 2024-04-23T10:17:46.605 INFO:tasks.workunit.client.0.smithi026.stdout:6/291: fsync d6/d13/f4d 0 2024-04-23T10:17:46.606 INFO:tasks.workunit.client.0.smithi026.stdout:0/315: truncate d7/d43/f53 1929205 0 2024-04-23T10:17:46.607 INFO:tasks.workunit.client.0.smithi026.stdout:9/271: read d13/f1c [3040536,92308] 0 2024-04-23T10:17:46.608 INFO:tasks.workunit.client.0.smithi026.stdout:5/93: rmdir d0/d12 39 2024-04-23T10:17:46.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/185: mknod d3/dd/c42 0 2024-04-23T10:17:46.616 INFO:tasks.workunit.client.0.smithi026.stdout:8/196: write d5/d9/f10 [6227883,30844] 0 2024-04-23T10:17:46.618 INFO:tasks.workunit.client.0.smithi026.stdout:3/254: rename d0/f56 to d0/d1e/d30/d43/df/d63/f65 0 2024-04-23T10:17:46.620 INFO:tasks.workunit.client.0.smithi026.stdout:7/173: dwrite dd/d1d/d1e/f24 [0,4194304] 0 2024-04-23T10:17:46.621 INFO:tasks.workunit.client.0.smithi026.stdout:0/316: dread d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:46.622 INFO:tasks.workunit.client.0.smithi026.stdout:9/272: chown l1 538848 1 2024-04-23T10:17:46.623 INFO:tasks.workunit.client.0.smithi026.stdout:4/130: dwrite d4/d1b/f20 [0,4194304] 0 2024-04-23T10:17:46.626 INFO:tasks.workunit.client.0.smithi026.stdout:6/292: mknod d6/c59 0 2024-04-23T10:17:46.626 INFO:tasks.workunit.client.0.smithi026.stdout:4/131: write d4/d7/d19/f21 [534358,91431] 0 2024-04-23T10:17:46.628 INFO:tasks.workunit.client.0.smithi026.stdout:4/132: truncate d4/d7/f1f 872337 0 2024-04-23T10:17:46.630 INFO:tasks.workunit.client.0.smithi026.stdout:9/273: dread d13/f1c [0,4194304] 0 2024-04-23T10:17:46.632 INFO:tasks.workunit.client.0.smithi026.stdout:3/255: mknod d0/d1e/d30/d43/d29/d39/c66 0 2024-04-23T10:17:46.633 INFO:tasks.workunit.client.0.smithi026.stdout:7/174: readlink dd/d1d/d1e/l29 0 2024-04-23T10:17:46.633 INFO:tasks.workunit.client.0.smithi026.stdout:8/197: fdatasync d5/f23 0 2024-04-23T10:17:46.633 INFO:tasks.workunit.client.0.smithi026.stdout:0/317: rmdir d7/d8/d1e/d1d/d2f/d6c 39 2024-04-23T10:17:46.634 INFO:tasks.workunit.client.0.smithi026.stdout:7/175: chown dd/c17 1239169 1 2024-04-23T10:17:46.635 INFO:tasks.workunit.client.0.smithi026.stdout:4/133: mknod d4/d1b/c27 0 2024-04-23T10:17:46.637 INFO:tasks.workunit.client.0.smithi026.stdout:7/176: write dd/f2f [650683,111272] 0 2024-04-23T10:17:46.639 INFO:tasks.workunit.client.0.smithi026.stdout:1/174: link dd/d1a/l3c dd/d1a/l3e 0 2024-04-23T10:17:46.640 INFO:tasks.workunit.client.0.smithi026.stdout:0/318: rmdir d7/d8/d1e/d1d 39 2024-04-23T10:17:46.643 INFO:tasks.workunit.client.0.smithi026.stdout:3/256: creat d0/d4c/f67 x:0 0 0 2024-04-23T10:17:46.644 INFO:tasks.workunit.client.0.smithi026.stdout:4/134: symlink d4/d22/l28 0 2024-04-23T10:17:46.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/175: read dd/f17 [4437921,113477] 0 2024-04-23T10:17:46.647 INFO:tasks.workunit.client.0.smithi026.stdout:3/257: stat d0/d1e/d30/d43/c9 0 2024-04-23T10:17:46.647 INFO:tasks.workunit.client.0.smithi026.stdout:9/274: dwrite d13/f1c [4194304,4194304] 0 2024-04-23T10:17:46.649 INFO:tasks.workunit.client.0.smithi026.stdout:3/258: chown d0/d1e/f37 7 1 2024-04-23T10:17:46.649 INFO:tasks.workunit.client.0.smithi026.stdout:0/319: fdatasync d7/d8/d1e/d1d/d2f/f44 0 2024-04-23T10:17:46.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/275: write d13/d3e/f41 [275028,64998] 0 2024-04-23T10:17:46.651 INFO:tasks.workunit.client.0.smithi026.stdout:9/276: chown d13 248725 1 2024-04-23T10:17:46.652 INFO:tasks.workunit.client.0.smithi026.stdout:7/177: creat dd/f34 x:0 0 0 2024-04-23T10:17:46.652 INFO:tasks.workunit.client.0.smithi026.stdout:8/198: getdents d5/d24/d3a/d33 0 2024-04-23T10:17:46.652 INFO:tasks.workunit.client.0.smithi026.stdout:5/94: write d0/f2 [991833,77338] 0 2024-04-23T10:17:46.652 INFO:tasks.workunit.client.0.smithi026.stdout:0/320: write d7/f39 [848159,82686] 0 2024-04-23T10:17:46.654 INFO:tasks.workunit.client.0.smithi026.stdout:1/176: mkdir dd/d1a/d23/d3f 0 2024-04-23T10:17:46.654 INFO:tasks.workunit.client.0.smithi026.stdout:3/259: write d0/d1e/d23/d52/f61 [878188,80771] 0 2024-04-23T10:17:46.655 INFO:tasks.workunit.client.0.smithi026.stdout:2/186: truncate d3/f8 947764 0 2024-04-23T10:17:46.658 INFO:tasks.workunit.client.0.smithi026.stdout:5/95: truncate d0/f2 3220235 0 2024-04-23T10:17:46.659 INFO:tasks.workunit.client.0.smithi026.stdout:6/293: truncate d6/d21/d2f/d37/f39 3543413 0 2024-04-23T10:17:46.662 INFO:tasks.workunit.client.0.smithi026.stdout:5/96: chown d0/ld 180 1 2024-04-23T10:17:46.664 INFO:tasks.workunit.client.0.smithi026.stdout:9/277: symlink d13/d3b/d4e/l51 0 2024-04-23T10:17:46.664 INFO:tasks.workunit.client.0.smithi026.stdout:2/187: creat d3/dd/f43 x:0 0 0 2024-04-23T10:17:46.666 INFO:tasks.workunit.client.0.smithi026.stdout:5/97: chown d0/f10 5332 1 2024-04-23T10:17:46.667 INFO:tasks.workunit.client.0.smithi026.stdout:2/188: mknod d3/d19/d21/c44 0 2024-04-23T10:17:46.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/178: dread dd/d1d/d1e/f23 [0,4194304] 0 2024-04-23T10:17:46.669 INFO:tasks.workunit.client.0.smithi026.stdout:2/189: fdatasync d3/dd/f18 0 2024-04-23T10:17:46.671 INFO:tasks.workunit.client.0.smithi026.stdout:6/294: creat d6/f5a x:0 0 0 2024-04-23T10:17:46.674 INFO:tasks.workunit.client.0.smithi026.stdout:2/190: chown d3/d19/d21/d23/d3a/d3c 871 1 2024-04-23T10:17:46.674 INFO:tasks.workunit.client.0.smithi026.stdout:6/295: stat d6/d21/d2f/d31 0 2024-04-23T10:17:46.677 INFO:tasks.workunit.client.0.smithi026.stdout:0/321: dwrite d7/d8/d1e/d2a/f55 [0,4194304] 0 2024-04-23T10:17:46.677 INFO:tasks.workunit.client.0.smithi026.stdout:7/179: creat dd/f35 x:0 0 0 2024-04-23T10:17:46.678 INFO:tasks.workunit.client.0.smithi026.stdout:8/199: dread d5/f2a [0,4194304] 0 2024-04-23T10:17:46.681 INFO:tasks.workunit.client.0.smithi026.stdout:8/200: chown d5/d9/f10 15286 1 2024-04-23T10:17:46.682 INFO:tasks.workunit.client.0.smithi026.stdout:6/296: creat d6/d13/d49/f5b x:0 0 0 2024-04-23T10:17:46.682 INFO:tasks.workunit.client.0.smithi026.stdout:9/278: dwrite d13/d2a/d45/d3a/f4a [0,4194304] 0 2024-04-23T10:17:46.684 INFO:tasks.workunit.client.0.smithi026.stdout:0/322: write d7/d8/d1e/f51 [193015,115833] 0 2024-04-23T10:17:46.686 INFO:tasks.workunit.client.0.smithi026.stdout:5/98: dread d0/d12/f1b [4194304,4194304] 0 2024-04-23T10:17:46.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/279: chown d13/f17 20 1 2024-04-23T10:17:46.689 INFO:tasks.workunit.client.0.smithi026.stdout:9/280: fdatasync d13/f17 0 2024-04-23T10:17:46.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/323: mknod d7/d8/d2d/d60/c80 0 2024-04-23T10:17:46.692 INFO:tasks.workunit.client.0.smithi026.stdout:2/191: dwrite d3/d19/d31/f38 [0,4194304] 0 2024-04-23T10:17:46.694 INFO:tasks.workunit.client.0.smithi026.stdout:6/297: dread f3 [0,4194304] 0 2024-04-23T10:17:46.694 INFO:tasks.workunit.client.0.smithi026.stdout:9/281: mknod d13/d2a/c52 0 2024-04-23T10:17:46.695 INFO:tasks.workunit.client.0.smithi026.stdout:5/99: mknod d0/c20 0 2024-04-23T10:17:46.695 INFO:tasks.workunit.client.0.smithi026.stdout:5/100: stat d0/fe 0 2024-04-23T10:17:46.696 INFO:tasks.workunit.client.0.smithi026.stdout:5/101: fsync d0/f2 0 2024-04-23T10:17:46.697 INFO:tasks.workunit.client.0.smithi026.stdout:7/180: creat dd/f36 x:0 0 0 2024-04-23T10:17:46.698 INFO:tasks.workunit.client.0.smithi026.stdout:0/324: creat d7/d43/f81 x:0 0 0 2024-04-23T10:17:46.701 INFO:tasks.workunit.client.0.smithi026.stdout:5/102: rmdir d0 39 2024-04-23T10:17:46.702 INFO:tasks.workunit.client.0.smithi026.stdout:7/181: creat dd/d1d/f37 x:0 0 0 2024-04-23T10:17:46.702 INFO:tasks.workunit.client.0.smithi026.stdout:2/192: mknod d3/d19/d21/d23/d3a/d3c/c45 0 2024-04-23T10:17:46.703 INFO:tasks.workunit.client.0.smithi026.stdout:6/298: write d6/d33/f2c [10086303,52208] 0 2024-04-23T10:17:46.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/282: dwrite d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:46.708 INFO:tasks.workunit.client.0.smithi026.stdout:7/182: chown dd/f2f 6267280 1 2024-04-23T10:17:46.715 INFO:tasks.workunit.client.0.smithi026.stdout:7/183: mkdir dd/d1d/d1e/d38 0 2024-04-23T10:17:46.717 INFO:tasks.workunit.client.0.smithi026.stdout:2/193: unlink d3/d19/d21/l28 0 2024-04-23T10:17:46.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/184: read dd/ff [3331578,25202] 0 2024-04-23T10:17:46.720 INFO:tasks.workunit.client.0.smithi026.stdout:2/194: readlink d3/dd/l10 0 2024-04-23T10:17:46.722 INFO:tasks.workunit.client.0.smithi026.stdout:6/299: truncate d6/f10 229222 0 2024-04-23T10:17:46.723 INFO:tasks.workunit.client.0.smithi026.stdout:9/283: truncate d13/f25 3444277 0 2024-04-23T10:17:46.723 INFO:tasks.workunit.client.0.smithi026.stdout:6/300: chown d6/d21/d2f/d37/f3a 9898570 1 2024-04-23T10:17:46.725 INFO:tasks.workunit.client.0.smithi026.stdout:2/195: unlink d3/c34 0 2024-04-23T10:17:46.726 INFO:tasks.workunit.client.0.smithi026.stdout:5/103: rename d0/ff to d0/f21 0 2024-04-23T10:17:46.727 INFO:tasks.workunit.client.0.smithi026.stdout:7/185: symlink dd/d1d/d1e/d38/l39 0 2024-04-23T10:17:46.728 INFO:tasks.workunit.client.0.smithi026.stdout:9/284: rmdir d13/d3b 39 2024-04-23T10:17:46.730 INFO:tasks.workunit.client.0.smithi026.stdout:2/196: rename d3/d19/d21/d23/d3a/d3c/c45 to d3/d19/d31/c46 0 2024-04-23T10:17:46.732 INFO:tasks.workunit.client.0.smithi026.stdout:7/186: symlink dd/d1d/l3a 0 2024-04-23T10:17:46.733 INFO:tasks.workunit.client.0.smithi026.stdout:9/285: creat d13/d31/f53 x:0 0 0 2024-04-23T10:17:46.736 INFO:tasks.workunit.client.0.smithi026.stdout:6/301: creat d6/f5c x:0 0 0 2024-04-23T10:17:46.737 INFO:tasks.workunit.client.0.smithi026.stdout:9/286: symlink d13/d1b/d2b/l54 0 2024-04-23T10:17:46.738 INFO:tasks.workunit.client.0.smithi026.stdout:6/302: read d6/d13/f17 [3935062,46663] 0 2024-04-23T10:17:46.739 INFO:tasks.workunit.client.0.smithi026.stdout:2/197: getdents d3/d19/d21/d23 0 2024-04-23T10:17:46.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/104: dread d0/f2 [0,4194304] 0 2024-04-23T10:17:46.741 INFO:tasks.workunit.client.0.smithi026.stdout:5/105: stat d0/c11 0 2024-04-23T10:17:46.743 INFO:tasks.workunit.client.0.smithi026.stdout:6/303: unlink d6/f12 0 2024-04-23T10:17:46.746 INFO:tasks.workunit.client.0.smithi026.stdout:2/198: creat d3/d19/d21/d23/d3a/d3c/f47 x:0 0 0 2024-04-23T10:17:46.747 INFO:tasks.workunit.client.0.smithi026.stdout:0/325: dwrite d7/d43/f53 [0,4194304] 0 2024-04-23T10:17:46.748 INFO:tasks.workunit.client.0.smithi026.stdout:2/199: fsync d3/d19/d31/f38 0 2024-04-23T10:17:46.753 INFO:tasks.workunit.client.0.smithi026.stdout:2/200: rmdir d3 39 2024-04-23T10:17:46.755 INFO:tasks.workunit.client.0.smithi026.stdout:7/187: write dd/f13 [6368858,69261] 0 2024-04-23T10:17:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:6/304: dread d6/fc [0,4194304] 0 2024-04-23T10:17:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:9/287: write d13/d2a/f35 [229403,24778] 0 2024-04-23T10:17:46.757 INFO:tasks.workunit.client.0.smithi026.stdout:5/106: write d0/f1a [997039,43293] 0 2024-04-23T10:17:46.764 INFO:tasks.workunit.client.0.smithi026.stdout:2/201: mknod d3/d19/d21/d23/d3a/c48 0 2024-04-23T10:17:46.765 INFO:tasks.workunit.client.0.smithi026.stdout:7/188: creat dd/d1d/d1e/f3b x:0 0 0 2024-04-23T10:17:46.769 INFO:tasks.workunit.client.0.smithi026.stdout:0/326: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:46.769 INFO:tasks.workunit.client.0.smithi026.stdout:2/202: mkdir d3/d19/d1d/d49 0 2024-04-23T10:17:46.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/189: truncate dd/f36 741783 0 2024-04-23T10:17:46.771 INFO:tasks.workunit.client.0.smithi026.stdout:5/107: rename d0/d13/l15 to d0/d13/l22 0 2024-04-23T10:17:46.774 INFO:tasks.workunit.client.0.smithi026.stdout:7/190: mkdir dd/d1d/d3c 0 2024-04-23T10:17:46.774 INFO:tasks.workunit.client.0.smithi026.stdout:9/288: dread d13/d2a/d45/d3a/f4a [0,4194304] 0 2024-04-23T10:17:46.776 INFO:tasks.workunit.client.0.smithi026.stdout:6/305: dwrite d6/d13/d15/f4c [0,4194304] 0 2024-04-23T10:17:46.776 INFO:tasks.workunit.client.0.smithi026.stdout:2/203: symlink d3/d19/d1d/d49/l4a 0 2024-04-23T10:17:46.776 INFO:tasks.workunit.client.0.smithi026.stdout:7/191: dread - dd/f34 zero size 2024-04-23T10:17:46.777 INFO:tasks.workunit.client.0.smithi026.stdout:5/108: write d0/d12/f1f [709106,9237] 0 2024-04-23T10:17:46.777 INFO:tasks.workunit.client.0.smithi026.stdout:9/289: chown d13/d2a/f2f 1180672 1 2024-04-23T10:17:46.778 INFO:tasks.workunit.client.0.smithi026.stdout:6/306: read d6/fc [578222,62884] 0 2024-04-23T10:17:46.779 INFO:tasks.workunit.client.0.smithi026.stdout:2/204: chown d3/d19/d21/d23/d3a/d3c/f47 122480822 1 2024-04-23T10:17:46.784 INFO:tasks.workunit.client.0.smithi026.stdout:2/205: mkdir d3/dd/d4b 0 2024-04-23T10:17:46.784 INFO:tasks.workunit.client.0.smithi026.stdout:6/307: write f3 [406101,50471] 0 2024-04-23T10:17:46.785 INFO:tasks.workunit.client.0.smithi026.stdout:9/290: unlink d13/l46 0 2024-04-23T10:17:46.793 INFO:tasks.workunit.client.0.smithi026.stdout:7/192: dread dd/f1b [4194304,4194304] 0 2024-04-23T10:17:46.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/193: write dd/d1d/f37 [715212,125743] 0 2024-04-23T10:17:46.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/194: chown dd/d1d/d1e/c27 122233 1 2024-04-23T10:17:46.796 INFO:tasks.workunit.client.0.smithi026.stdout:7/195: truncate dd/f35 41047 0 2024-04-23T10:17:46.796 INFO:tasks.workunit.client.0.smithi026.stdout:7/196: chown l8 227 1 2024-04-23T10:17:46.796 INFO:tasks.workunit.client.0.smithi026.stdout:7/197: fdatasync dd/f34 0 2024-04-23T10:17:46.799 INFO:tasks.workunit.client.0.smithi026.stdout:7/198: unlink dd/d1d/d1e/c27 0 2024-04-23T10:17:46.802 INFO:tasks.workunit.client.0.smithi026.stdout:7/199: creat dd/d1d/d1e/d38/f3d x:0 0 0 2024-04-23T10:17:46.806 INFO:tasks.workunit.client.0.smithi026.stdout:0/327: dwrite d7/d8/d1e/d1d/d2f/f48 [0,4194304] 0 2024-04-23T10:17:46.809 INFO:tasks.workunit.client.0.smithi026.stdout:5/109: dread d0/d12/f1f [0,4194304] 0 2024-04-23T10:17:46.809 INFO:tasks.workunit.client.0.smithi026.stdout:9/291: dread d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:46.809 INFO:tasks.workunit.client.0.smithi026.stdout:2/206: truncate d3/f13 1584604 0 2024-04-23T10:17:46.810 INFO:tasks.workunit.client.0.smithi026.stdout:2/207: chown d3/dd/l1a 32 1 2024-04-23T10:17:46.811 INFO:tasks.workunit.client.0.smithi026.stdout:0/328: creat d7/d8/f82 x:0 0 0 2024-04-23T10:17:46.812 INFO:tasks.workunit.client.0.smithi026.stdout:2/208: read d3/d19/d31/f3b [3494186,63747] 0 2024-04-23T10:17:46.813 INFO:tasks.workunit.client.0.smithi026.stdout:5/110: rename d0/cb to d0/d13/c23 0 2024-04-23T10:17:46.816 INFO:tasks.workunit.client.0.smithi026.stdout:6/308: truncate d6/d13/f4e 4086302 0 2024-04-23T10:17:46.816 INFO:tasks.workunit.client.0.smithi026.stdout:5/111: chown d0/c20 4 1 2024-04-23T10:17:46.816 INFO:tasks.workunit.client.0.smithi026.stdout:6/309: dread - d6/d21/d2f/d32/d53/f54 zero size 2024-04-23T10:17:46.816 INFO:tasks.workunit.client.0.smithi026.stdout:0/329: mknod d7/d5b/c83 0 2024-04-23T10:17:46.817 INFO:tasks.workunit.client.0.smithi026.stdout:9/292: creat d13/d2a/d45/d3a/d48/f55 x:0 0 0 2024-04-23T10:17:46.819 INFO:tasks.workunit.client.0.smithi026.stdout:6/310: dread - d6/d21/d2f/d32/d53/f54 zero size 2024-04-23T10:17:46.819 INFO:tasks.workunit.client.0.smithi026.stdout:7/200: getdents dd/d1d/d1e 0 2024-04-23T10:17:46.820 INFO:tasks.workunit.client.0.smithi026.stdout:5/112: mknod d0/c24 0 2024-04-23T10:17:46.823 INFO:tasks.workunit.client.0.smithi026.stdout:0/330: unlink d7/d8/d2d/f50 0 2024-04-23T10:17:46.823 INFO:tasks.workunit.client.0.smithi026.stdout:6/311: read d6/d13/d15/f2e [3343042,88707] 0 2024-04-23T10:17:46.825 INFO:tasks.workunit.client.0.smithi026.stdout:2/209: dwrite d3/d19/d31/f38 [0,4194304] 0 2024-04-23T10:17:46.828 INFO:tasks.workunit.client.0.smithi026.stdout:7/201: rename dd/c32 to dd/c3e 0 2024-04-23T10:17:46.832 INFO:tasks.workunit.client.0.smithi026.stdout:7/202: rmdir dd/d1d/d1e/d38 39 2024-04-23T10:17:46.834 INFO:tasks.workunit.client.0.smithi026.stdout:0/331: unlink d7/d8/d1e/d1d/d2f/d6c/l7d 0 2024-04-23T10:17:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:0/332: readlink d7/d8/d1e/d1d/l54 0 2024-04-23T10:17:46.835 INFO:tasks.workunit.client.0.smithi026.stdout:5/113: getdents d0/d13 0 2024-04-23T10:17:46.839 INFO:tasks.workunit.client.0.smithi026.stdout:9/293: dread d13/f17 [0,4194304] 0 2024-04-23T10:17:46.842 INFO:tasks.workunit.client.0.smithi026.stdout:5/114: rmdir d0 39 2024-04-23T10:17:46.842 INFO:tasks.workunit.client.0.smithi026.stdout:6/312: link d6/d21/c35 d6/d21/d2f/c5d 0 2024-04-23T10:17:46.843 INFO:tasks.workunit.client.0.smithi026.stdout:2/210: getdents d3/dd 0 2024-04-23T10:17:46.844 INFO:tasks.workunit.client.0.smithi026.stdout:9/294: creat d13/d2a/d45/d3a/f56 x:0 0 0 2024-04-23T10:17:46.848 INFO:tasks.workunit.client.0.smithi026.stdout:2/211: truncate d3/d19/d21/d23/d3a/d3c/f47 148066 0 2024-04-23T10:17:46.850 INFO:tasks.workunit.client.0.smithi026.stdout:6/313: symlink d6/d21/d2f/d31/d52/l5e 0 2024-04-23T10:17:46.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/314: stat d6/d13/d15/l24 0 2024-04-23T10:17:46.854 INFO:tasks.workunit.client.0.smithi026.stdout:5/115: creat d0/f25 x:0 0 0 2024-04-23T10:17:46.856 INFO:tasks.workunit.client.0.smithi026.stdout:3/260: dread d0/f20 [0,4194304] 0 2024-04-23T10:17:46.858 INFO:tasks.workunit.client.0.smithi026.stdout:2/212: mkdir d3/d35/d4c 0 2024-04-23T10:17:46.859 INFO:tasks.workunit.client.0.smithi026.stdout:9/295: dwrite d13/d2a/d45/d3a/f4a [0,4194304] 0 2024-04-23T10:17:46.860 INFO:tasks.workunit.client.0.smithi026.stdout:3/261: rmdir d0/d51 39 2024-04-23T10:17:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:5/116: truncate d0/f3 800297 0 2024-04-23T10:17:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:6/315: read d6/f10 [60606,64558] 0 2024-04-23T10:17:46.863 INFO:tasks.workunit.client.0.smithi026.stdout:2/213: mkdir d3/d19/d4d 0 2024-04-23T10:17:46.865 INFO:tasks.workunit.client.0.smithi026.stdout:9/296: rename d13/d1b/d26/l39 to d13/d2a/d45/d3a/d4f/l57 0 2024-04-23T10:17:46.868 INFO:tasks.workunit.client.0.smithi026.stdout:2/214: read d3/d19/d31/f3b [1156943,129979] 0 2024-04-23T10:17:46.869 INFO:tasks.workunit.client.0.smithi026.stdout:0/333: dread f4 [0,4194304] 0 2024-04-23T10:17:46.870 INFO:tasks.workunit.client.0.smithi026.stdout:9/297: creat d13/d1b/d26/f58 x:0 0 0 2024-04-23T10:17:46.873 INFO:tasks.workunit.client.0.smithi026.stdout:3/262: creat d0/d51/d5e/f68 x:0 0 0 2024-04-23T10:17:46.881 INFO:tasks.workunit.client.0.smithi026.stdout:6/316: dwrite d6/d21/d2f/d37/f3a [0,4194304] 0 2024-04-23T10:17:46.886 INFO:tasks.workunit.client.0.smithi026.stdout:5/117: dwrite d0/d13/f14 [4194304,4194304] 0 2024-04-23T10:17:46.892 INFO:tasks.workunit.client.0.smithi026.stdout:6/317: mknod d6/d21/c5f 0 2024-04-23T10:17:46.894 INFO:tasks.workunit.client.0.smithi026.stdout:2/215: dwrite d3/dd/f18 [0,4194304] 0 2024-04-23T10:17:46.896 INFO:tasks.workunit.client.0.smithi026.stdout:3/263: dwrite d0/d1e/d30/f4f [0,4194304] 0 2024-04-23T10:17:46.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/298: dwrite d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:46.898 INFO:tasks.workunit.client.0.smithi026.stdout:9/299: chown d13/d3e 2 1 2024-04-23T10:17:46.898 INFO:tasks.workunit.client.0.smithi026.stdout:3/264: fsync d0/d1e/d30/d43/d29/f34 0 2024-04-23T10:17:46.901 INFO:tasks.workunit.client.0.smithi026.stdout:9/300: truncate d13/d1b/d26/f58 224906 0 2024-04-23T10:17:46.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/334: rename d7/d8/d1e/d1d/f20 to d7/f84 0 2024-04-23T10:17:46.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/265: dread d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:46.912 INFO:tasks.workunit.client.0.smithi026.stdout:2/216: rename d3/dd/l12 to d3/d35/d4c/l4e 0 2024-04-23T10:17:46.915 INFO:tasks.workunit.client.0.smithi026.stdout:9/301: creat d13/d2a/d45/d3a/d4f/f59 x:0 0 0 2024-04-23T10:17:46.915 INFO:tasks.workunit.client.0.smithi026.stdout:0/335: mknod d7/d8/d2d/d60/c85 0 2024-04-23T10:17:46.915 INFO:tasks.workunit.client.0.smithi026.stdout:9/302: truncate d13/d1b/d26/f58 559847 0 2024-04-23T10:17:46.915 INFO:tasks.workunit.client.0.smithi026.stdout:6/318: link d6/d13/d15/l24 d6/d21/d2f/d31/d52/l60 0 2024-04-23T10:17:46.917 INFO:tasks.workunit.client.0.smithi026.stdout:5/118: truncate d0/d12/f1b 8062979 0 2024-04-23T10:17:46.919 INFO:tasks.workunit.client.0.smithi026.stdout:9/303: read d13/d1b/f33 [11619502,110022] 0 2024-04-23T10:17:46.921 INFO:tasks.workunit.client.0.smithi026.stdout:9/304: stat d13/d3e 0 2024-04-23T10:17:46.922 INFO:tasks.workunit.client.0.smithi026.stdout:2/217: mknod d3/d19/d1d/d49/c4f 0 2024-04-23T10:17:46.922 INFO:tasks.workunit.client.0.smithi026.stdout:3/266: symlink d0/d1e/d30/d43/df/d1f/d64/l69 0 2024-04-23T10:17:46.924 INFO:tasks.workunit.client.0.smithi026.stdout:2/218: write d3/f2a [1909527,55437] 0 2024-04-23T10:17:46.926 INFO:tasks.workunit.client.0.smithi026.stdout:9/305: mknod d13/d36/c5a 0 2024-04-23T10:17:46.927 INFO:tasks.workunit.client.0.smithi026.stdout:6/319: dwrite d6/d21/d2f/d37/f3a [0,4194304] 0 2024-04-23T10:17:46.930 INFO:tasks.workunit.client.0.smithi026.stdout:9/306: fdatasync d13/d31/f53 0 2024-04-23T10:17:46.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/267: dread - d0/d1e/d30/d43/df/d17/f46 zero size 2024-04-23T10:17:46.940 INFO:tasks.workunit.client.0.smithi026.stdout:9/307: dwrite d13/f17 [0,4194304] 0 2024-04-23T10:17:46.941 INFO:tasks.workunit.client.0.smithi026.stdout:9/308: stat d13/f1c 0 2024-04-23T10:17:46.943 INFO:tasks.workunit.client.0.smithi026.stdout:3/268: write d0/d51/d5e/f68 [939522,111032] 0 2024-04-23T10:17:46.945 INFO:tasks.workunit.client.0.smithi026.stdout:9/309: write d13/d2a/d45/d3a/f4a [1695926,91760] 0 2024-04-23T10:17:46.947 INFO:tasks.workunit.client.0.smithi026.stdout:5/119: dread d0/d13/f14 [4194304,4194304] 0 2024-04-23T10:17:46.949 INFO:tasks.workunit.client.0.smithi026.stdout:5/120: readlink d0/d12/l1d 0 2024-04-23T10:17:46.951 INFO:tasks.workunit.client.0.smithi026.stdout:6/320: dwrite d6/d21/d2f/d37/f3f [4194304,4194304] 0 2024-04-23T10:17:46.951 INFO:tasks.workunit.client.0.smithi026.stdout:5/121: write d0/f25 [72888,1180] 0 2024-04-23T10:17:46.953 INFO:tasks.workunit.client.0.smithi026.stdout:6/321: stat d6/c59 0 2024-04-23T10:17:46.954 INFO:tasks.workunit.client.0.smithi026.stdout:6/322: fsync d6/d13/d15/f1c 0 2024-04-23T10:17:46.955 INFO:tasks.workunit.client.0.smithi026.stdout:3/269: dread d0/d1e/d30/d43/f38 [0,4194304] 0 2024-04-23T10:17:46.965 INFO:tasks.workunit.client.0.smithi026.stdout:0/336: dread d7/d8/d1e/d1d/f28 [0,4194304] 0 2024-04-23T10:17:46.966 INFO:tasks.workunit.client.0.smithi026.stdout:6/323: rmdir d6/d13/d15 39 2024-04-23T10:17:46.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/219: dread d3/f8 [0,4194304] 0 2024-04-23T10:17:46.970 INFO:tasks.workunit.client.0.smithi026.stdout:3/270: write d0/d1e/d30/d43/df/f4b [1038836,97973] 0 2024-04-23T10:17:46.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/271: write d0/d1e/d30/d43/df/d17/f32 [927740,62615] 0 2024-04-23T10:17:46.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/272: stat d0/d4c/f67 0 2024-04-23T10:17:46.978 INFO:tasks.workunit.client.0.smithi026.stdout:0/337: dread d7/d8/d1e/d2a/f2e [0,4194304] 0 2024-04-23T10:17:46.980 INFO:tasks.workunit.client.0.smithi026.stdout:2/220: symlink d3/l50 0 2024-04-23T10:17:46.982 INFO:tasks.workunit.client.0.smithi026.stdout:9/310: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:46.984 INFO:tasks.workunit.client.0.smithi026.stdout:6/324: dwrite d6/f3b [4194304,4194304] 0 2024-04-23T10:17:46.984 INFO:tasks.workunit.client.0.smithi026.stdout:0/338: rename d7/d5b/c83 to d7/d43/c86 0 2024-04-23T10:17:46.984 INFO:tasks.workunit.client.0.smithi026.stdout:9/311: chown d13/d1b/d26/f30 3251 1 2024-04-23T10:17:46.985 INFO:tasks.workunit.client.0.smithi026.stdout:3/273: creat d0/f6a x:0 0 0 2024-04-23T10:17:46.986 INFO:tasks.workunit.client.0.smithi026.stdout:2/221: mknod d3/d19/d21/d23/d3a/c51 0 2024-04-23T10:17:46.986 INFO:tasks.workunit.client.0.smithi026.stdout:0/339: write d7/d8/d1e/d57/f5e [118987,111029] 0 2024-04-23T10:17:46.990 INFO:tasks.workunit.client.0.smithi026.stdout:5/122: dread d0/d12/f1b [0,4194304] 0 2024-04-23T10:17:46.990 INFO:tasks.workunit.client.0.smithi026.stdout:9/312: mkdir d13/d3b/d5b 0 2024-04-23T10:17:46.991 INFO:tasks.workunit.client.0.smithi026.stdout:2/222: unlink d3/d19/d31/f38 0 2024-04-23T10:17:46.994 INFO:tasks.workunit.client.0.smithi026.stdout:9/313: chown d13/d2a/d45/d3a/f4a 6723 1 2024-04-23T10:17:46.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/325: dwrite d6/fc [4194304,4194304] 0 2024-04-23T10:17:46.998 INFO:tasks.workunit.client.0.smithi026.stdout:3/274: dread d0/d1e/d30/d43/df/f1a [0,4194304] 0 2024-04-23T10:17:46.998 INFO:tasks.workunit.client.0.smithi026.stdout:5/123: read d0/f3 [240865,69612] 0 2024-04-23T10:17:47.003 INFO:tasks.workunit.client.0.smithi026.stdout:2/223: dread d3/d19/d31/f3b [0,4194304] 0 2024-04-23T10:17:47.003 INFO:tasks.workunit.client.0.smithi026.stdout:0/340: write d7/d8/d1e/d1d/f28 [884426,45178] 0 2024-04-23T10:17:47.006 INFO:tasks.workunit.client.0.smithi026.stdout:5/124: creat d0/f26 x:0 0 0 2024-04-23T10:17:47.010 INFO:tasks.workunit.client.0.smithi026.stdout:5/125: chown d0/d12/c18 1930 1 2024-04-23T10:17:47.012 INFO:tasks.workunit.client.0.smithi026.stdout:5/126: readlink d0/d12/l1d 0 2024-04-23T10:17:47.016 INFO:tasks.workunit.client.0.smithi026.stdout:3/275: dwrite d0/d1e/d30/d43/df/d1f/f45 [0,4194304] 0 2024-04-23T10:17:47.017 INFO:tasks.workunit.client.0.smithi026.stdout:5/127: chown d0/ld 56 1 2024-04-23T10:17:47.020 INFO:tasks.workunit.client.0.smithi026.stdout:6/326: dwrite d6/d13/f17 [0,4194304] 0 2024-04-23T10:17:47.021 INFO:tasks.workunit.client.0.smithi026.stdout:2/224: dwrite d3/dd/f30 [0,4194304] 0 2024-04-23T10:17:47.023 INFO:tasks.workunit.client.0.smithi026.stdout:6/327: read - d6/d21/d2f/f57 zero size 2024-04-23T10:17:47.023 INFO:tasks.workunit.client.0.smithi026.stdout:0/341: dwrite f4 [0,4194304] 0 2024-04-23T10:17:47.024 INFO:tasks.workunit.client.0.smithi026.stdout:0/342: dread - d7/d43/f81 zero size 2024-04-23T10:17:47.026 INFO:tasks.workunit.client.0.smithi026.stdout:0/343: truncate d7/d5b/f76 919210 0 2024-04-23T10:17:47.028 INFO:tasks.workunit.client.0.smithi026.stdout:0/344: readlink d7/d8/d1e/d2a/l64 0 2024-04-23T10:17:47.028 INFO:tasks.workunit.client.0.smithi026.stdout:0/345: fsync d7/d8/d1e/d2a/d6a/f6b 0 2024-04-23T10:17:47.032 INFO:tasks.workunit.client.0.smithi026.stdout:3/276: mknod d0/d1e/d30/d43/df/d1f/c6b 0 2024-04-23T10:17:47.033 INFO:tasks.workunit.client.0.smithi026.stdout:2/225: rmdir d3 39 2024-04-23T10:17:47.033 INFO:tasks.workunit.client.0.smithi026.stdout:6/328: creat d6/d21/d2f/d32/d53/f61 x:0 0 0 2024-04-23T10:17:47.034 INFO:tasks.workunit.client.0.smithi026.stdout:9/314: write d13/d36/f4c [3058702,104234] 0 2024-04-23T10:17:47.040 INFO:tasks.workunit.client.0.smithi026.stdout:2/226: fsync d3/f2a 0 2024-04-23T10:17:47.044 INFO:tasks.workunit.client.0.smithi026.stdout:6/329: dread d6/d13/f4d [0,4194304] 0 2024-04-23T10:17:47.045 INFO:tasks.workunit.client.0.smithi026.stdout:3/277: dwrite d0/d1e/d30/d43/d29/f34 [0,4194304] 0 2024-04-23T10:17:47.046 INFO:tasks.workunit.client.0.smithi026.stdout:0/346: creat d7/d8/d1e/d1d/d2f/d6c/d7f/f87 x:0 0 0 2024-04-23T10:17:47.048 INFO:tasks.workunit.client.0.smithi026.stdout:3/278: chown d0/d1e/d30/d43/df/f44 52343106 1 2024-04-23T10:17:47.049 INFO:tasks.workunit.client.0.smithi026.stdout:2/227: symlink d3/d19/d4d/l52 0 2024-04-23T10:17:47.051 INFO:tasks.workunit.client.0.smithi026.stdout:0/347: rmdir d7/d8/d1e/d2a/d6a 39 2024-04-23T10:17:47.051 INFO:tasks.workunit.client.0.smithi026.stdout:6/330: creat d6/d21/d2f/d32/d53/f62 x:0 0 0 2024-04-23T10:17:47.051 INFO:tasks.workunit.client.0.smithi026.stdout:5/128: write d0/d13/f19 [870775,45811] 0 2024-04-23T10:17:47.054 INFO:tasks.workunit.client.0.smithi026.stdout:2/228: mknod d3/d35/c53 0 2024-04-23T10:17:47.054 INFO:tasks.workunit.client.0.smithi026.stdout:5/129: chown d0/c11 128307114 1 2024-04-23T10:17:47.055 INFO:tasks.workunit.client.0.smithi026.stdout:6/331: write d6/fe [3094434,46588] 0 2024-04-23T10:17:47.062 INFO:tasks.workunit.client.0.smithi026.stdout:4/135: sync 2024-04-23T10:17:47.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/348: write d7/d8/d1e/d1d/f73 [4251140,7154] 0 2024-04-23T10:17:47.068 INFO:tasks.workunit.client.0.smithi026.stdout:3/279: dwrite d0/d1e/d30/d43/f2d [0,4194304] 0 2024-04-23T10:17:47.068 INFO:tasks.workunit.client.0.smithi026.stdout:0/349: chown f4 15 1 2024-04-23T10:17:47.070 INFO:tasks.workunit.client.0.smithi026.stdout:9/315: write d13/f1e [1620934,72916] 0 2024-04-23T10:17:47.071 INFO:tasks.workunit.client.0.smithi026.stdout:2/229: dwrite d3/d19/d21/d23/f3e [0,4194304] 0 2024-04-23T10:17:47.075 INFO:tasks.workunit.client.0.smithi026.stdout:5/130: dwrite d0/f26 [0,4194304] 0 2024-04-23T10:17:47.081 INFO:tasks.workunit.client.0.smithi026.stdout:5/131: readlink d0/d13/l22 0 2024-04-23T10:17:47.082 INFO:tasks.workunit.client.0.smithi026.stdout:5/132: fdatasync d0/f25 0 2024-04-23T10:17:47.082 INFO:tasks.workunit.client.0.smithi026.stdout:0/350: symlink d7/l88 0 2024-04-23T10:17:47.083 INFO:tasks.workunit.client.0.smithi026.stdout:9/316: creat d13/f5c x:0 0 0 2024-04-23T10:17:47.089 INFO:tasks.workunit.client.0.smithi026.stdout:9/317: symlink d13/d3e/l5d 0 2024-04-23T10:17:47.092 INFO:tasks.workunit.client.0.smithi026.stdout:0/351: creat d7/d8/d2d/d60/d62/f89 x:0 0 0 2024-04-23T10:17:47.094 INFO:tasks.workunit.client.0.smithi026.stdout:2/230: dwrite d3/dd/f15 [0,4194304] 0 2024-04-23T10:17:47.095 INFO:tasks.workunit.client.0.smithi026.stdout:5/133: dread d0/f2 [0,4194304] 0 2024-04-23T10:17:47.097 INFO:tasks.workunit.client.0.smithi026.stdout:4/136: dwrite d4/d14/f25 [0,4194304] 0 2024-04-23T10:17:47.098 INFO:tasks.workunit.client.0.smithi026.stdout:9/318: write d13/d3e/f44 [207501,48914] 0 2024-04-23T10:17:47.099 INFO:tasks.workunit.client.0.smithi026.stdout:2/231: readlink d3/d19/d21/l39 0 2024-04-23T10:17:47.100 INFO:tasks.workunit.client.0.smithi026.stdout:6/332: dwrite d6/d13/d15/f4c [0,4194304] 0 2024-04-23T10:17:47.103 INFO:tasks.workunit.client.0.smithi026.stdout:9/319: fdatasync d13/f5c 0 2024-04-23T10:17:47.111 INFO:tasks.workunit.client.0.smithi026.stdout:2/232: creat d3/d19/d21/f54 x:0 0 0 2024-04-23T10:17:47.113 INFO:tasks.workunit.client.0.smithi026.stdout:0/352: dread d7/d8/d1e/d1d/d2f/f48 [0,4194304] 0 2024-04-23T10:17:47.114 INFO:tasks.workunit.client.0.smithi026.stdout:9/320: read d13/d2a/f2f [586621,69431] 0 2024-04-23T10:17:47.117 INFO:tasks.workunit.client.0.smithi026.stdout:5/134: creat d0/d12/f27 x:0 0 0 2024-04-23T10:17:47.120 INFO:tasks.workunit.client.0.smithi026.stdout:4/137: truncate d4/f5 4045033 0 2024-04-23T10:17:47.123 INFO:tasks.workunit.client.0.smithi026.stdout:2/233: link d3/d19/f1c d3/d19/f55 0 2024-04-23T10:17:47.124 INFO:tasks.workunit.client.0.smithi026.stdout:4/138: creat d4/d22/f29 x:0 0 0 2024-04-23T10:17:47.126 INFO:tasks.workunit.client.0.smithi026.stdout:9/321: dwrite d13/d36/f4c [4194304,4194304] 0 2024-04-23T10:17:47.128 INFO:tasks.workunit.client.0.smithi026.stdout:5/135: dread d0/f26 [0,4194304] 0 2024-04-23T10:17:47.130 INFO:tasks.workunit.client.0.smithi026.stdout:5/136: write d0/f2 [617428,57414] 0 2024-04-23T10:17:47.131 INFO:tasks.workunit.client.0.smithi026.stdout:6/333: dwrite d6/f1d [4194304,4194304] 0 2024-04-23T10:17:47.132 INFO:tasks.workunit.client.0.smithi026.stdout:5/137: write d0/f16 [654493,81853] 0 2024-04-23T10:17:47.137 INFO:tasks.workunit.client.0.smithi026.stdout:9/322: rmdir d13/d2a/d45 39 2024-04-23T10:17:47.139 INFO:tasks.workunit.client.0.smithi026.stdout:0/353: creat d7/d8/d1e/d1d/d2f/f8a x:0 0 0 2024-04-23T10:17:47.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/334: unlink d6/f3b 0 2024-04-23T10:17:47.146 INFO:tasks.workunit.client.0.smithi026.stdout:9/323: unlink d13/d1b/c38 0 2024-04-23T10:17:47.146 INFO:tasks.workunit.client.0.smithi026.stdout:5/138: creat d0/d12/f28 x:0 0 0 2024-04-23T10:17:47.150 INFO:tasks.workunit.client.0.smithi026.stdout:9/324: creat d13/d3e/f5e x:0 0 0 2024-04-23T10:17:47.154 INFO:tasks.workunit.client.0.smithi026.stdout:0/354: unlink d7/d8/d1e/d1d/d2f/f4d 0 2024-04-23T10:17:47.154 INFO:tasks.workunit.client.0.smithi026.stdout:6/335: dwrite d6/f1d [0,4194304] 0 2024-04-23T10:17:47.156 INFO:tasks.workunit.client.0.smithi026.stdout:6/336: write d6/d21/d2f/d32/f55 [232181,73006] 0 2024-04-23T10:17:47.159 INFO:tasks.workunit.client.0.smithi026.stdout:0/355: dread - d7/d8/d1e/d1d/f69 zero size 2024-04-23T10:17:47.161 INFO:tasks.workunit.client.0.smithi026.stdout:9/325: mknod d13/d3b/d5b/c5f 0 2024-04-23T10:17:47.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/337: symlink d6/d21/d2f/d31/l63 0 2024-04-23T10:17:47.166 INFO:tasks.workunit.client.0.smithi026.stdout:0/356: symlink d7/d8/d1e/d57/l8b 0 2024-04-23T10:17:47.169 INFO:tasks.workunit.client.0.smithi026.stdout:4/139: dwrite d4/d7/f13 [0,4194304] 0 2024-04-23T10:17:47.169 INFO:tasks.workunit.client.0.smithi026.stdout:5/139: truncate d0/f9 3090150 0 2024-04-23T10:17:47.170 INFO:tasks.workunit.client.0.smithi026.stdout:0/357: chown d7/d8/d1e/f18 24488321 1 2024-04-23T10:17:47.172 INFO:tasks.workunit.client.0.smithi026.stdout:9/326: symlink d13/d31/l60 0 2024-04-23T10:17:47.174 INFO:tasks.workunit.client.0.smithi026.stdout:6/338: dwrite d6/f5a [0,4194304] 0 2024-04-23T10:17:47.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/140: rename d0/f10 to d0/d13/f29 0 2024-04-23T10:17:47.182 INFO:tasks.workunit.client.0.smithi026.stdout:6/339: mkdir d6/d13/d49/d64 0 2024-04-23T10:17:47.183 INFO:tasks.workunit.client.0.smithi026.stdout:6/340: write d6/d13/f17 [525236,66495] 0 2024-04-23T10:17:47.185 INFO:tasks.workunit.client.0.smithi026.stdout:9/327: mkdir d13/d2a/d45/d3a/d4f/d61 0 2024-04-23T10:17:47.185 INFO:tasks.workunit.client.0.smithi026.stdout:9/328: chown d13/f22 384 1 2024-04-23T10:17:47.186 INFO:tasks.workunit.client.0.smithi026.stdout:0/358: creat d7/d8/d2d/f8c x:0 0 0 2024-04-23T10:17:47.189 INFO:tasks.workunit.client.0.smithi026.stdout:6/341: dread f3 [0,4194304] 0 2024-04-23T10:17:47.190 INFO:tasks.workunit.client.0.smithi026.stdout:0/359: read d7/f6f [489602,79363] 0 2024-04-23T10:17:47.194 INFO:tasks.workunit.client.0.smithi026.stdout:5/141: read d0/f21 [490775,73746] 0 2024-04-23T10:17:47.196 INFO:tasks.workunit.client.0.smithi026.stdout:6/342: dwrite d6/f5a [0,4194304] 0 2024-04-23T10:17:47.197 INFO:tasks.workunit.client.0.smithi026.stdout:6/343: chown d6/d13/l28 169565 1 2024-04-23T10:17:47.202 INFO:tasks.workunit.client.0.smithi026.stdout:6/344: symlink d6/d21/d2f/d31/d52/l65 0 2024-04-23T10:17:47.203 INFO:tasks.workunit.client.0.smithi026.stdout:5/142: truncate d0/f9 1224134 0 2024-04-23T10:17:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:5/143: chown d0/d12/f1b 557177943 1 2024-04-23T10:17:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:0/360: getdents d7/d43 0 2024-04-23T10:17:47.204 INFO:tasks.workunit.client.0.smithi026.stdout:5/144: stat d0/fe 0 2024-04-23T10:17:47.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/345: getdents d6/d21/d2f/d37/d4f 0 2024-04-23T10:17:47.206 INFO:tasks.workunit.client.0.smithi026.stdout:0/361: creat d7/d43/f8d x:0 0 0 2024-04-23T10:17:47.274 INFO:tasks.workunit.client.0.smithi026.stdout:1/177: sync 2024-04-23T10:17:47.280 INFO:tasks.workunit.client.0.smithi026.stdout:5/145: dread d0/f26 [0,4194304] 0 2024-04-23T10:17:47.282 INFO:tasks.workunit.client.0.smithi026.stdout:6/346: dread d6/d21/d2f/d37/f3a [0,4194304] 0 2024-04-23T10:17:47.286 INFO:tasks.workunit.client.0.smithi026.stdout:6/347: write d6/d13/d49/f5b [488432,102667] 0 2024-04-23T10:17:47.288 INFO:tasks.workunit.client.0.smithi026.stdout:5/146: creat d0/f2a x:0 0 0 2024-04-23T10:17:47.291 INFO:tasks.workunit.client.0.smithi026.stdout:5/147: chown d0/d12/f1b 1985 1 2024-04-23T10:17:47.292 INFO:tasks.workunit.client.0.smithi026.stdout:1/178: dread dd/d1a/d20/d25/f38 [0,4194304] 0 2024-04-23T10:17:47.292 INFO:tasks.workunit.client.0.smithi026.stdout:7/203: dread dd/d1d/d1e/f2e [0,4194304] 0 2024-04-23T10:17:47.301 INFO:tasks.workunit.client.0.smithi026.stdout:7/204: unlink dd/d1d/d1e/l29 0 2024-04-23T10:17:47.303 INFO:tasks.workunit.client.0.smithi026.stdout:6/348: dread f3 [0,4194304] 0 2024-04-23T10:17:47.304 INFO:tasks.workunit.client.0.smithi026.stdout:7/205: write dd/f36 [439256,48316] 0 2024-04-23T10:17:47.305 INFO:tasks.workunit.client.0.smithi026.stdout:1/179: rename dd/f17 to dd/d1a/d23/f40 0 2024-04-23T10:17:47.309 INFO:tasks.workunit.client.0.smithi026.stdout:6/349: write d6/d21/d2f/d32/d53/f61 [90605,22898] 0 2024-04-23T10:17:47.314 INFO:tasks.workunit.client.0.smithi026.stdout:1/180: creat dd/d1a/f41 x:0 0 0 2024-04-23T10:17:47.314 INFO:tasks.workunit.client.0.smithi026.stdout:6/350: read d6/fc [2356045,112178] 0 2024-04-23T10:17:47.322 INFO:tasks.workunit.client.0.smithi026.stdout:7/206: dwrite dd/d1d/d1e/f3b [0,4194304] 0 2024-04-23T10:17:47.323 INFO:tasks.workunit.client.0.smithi026.stdout:1/181: rename f3 to dd/d15/f42 0 2024-04-23T10:17:47.331 INFO:tasks.workunit.client.0.smithi026.stdout:1/182: chown dd/d1a/l3c 3 1 2024-04-23T10:17:47.334 INFO:tasks.workunit.client.0.smithi026.stdout:6/351: rename d6/d21/d2f/d31/l63 to d6/d21/d2f/d32/l66 0 2024-04-23T10:17:47.336 INFO:tasks.workunit.client.0.smithi026.stdout:7/207: mkdir dd/d3f 0 2024-04-23T10:17:47.343 INFO:tasks.workunit.client.0.smithi026.stdout:1/183: truncate dd/d1a/d23/f16 779925 0 2024-04-23T10:17:47.347 INFO:tasks.workunit.client.0.smithi026.stdout:7/208: mknod dd/d1d/d1e/c40 0 2024-04-23T10:17:47.349 INFO:tasks.workunit.client.0.smithi026.stdout:7/209: write dd/d1d/f31 [2361246,116702] 0 2024-04-23T10:17:47.352 INFO:tasks.workunit.client.0.smithi026.stdout:7/210: truncate dd/d1d/f37 1402760 0 2024-04-23T10:17:47.356 INFO:tasks.workunit.client.0.smithi026.stdout:7/211: chown dd/d1d/d1e/d38/l39 864 1 2024-04-23T10:17:47.358 INFO:tasks.workunit.client.0.smithi026.stdout:7/212: fdatasync dd/d1d/d1e/f26 0 2024-04-23T10:17:47.360 INFO:tasks.workunit.client.0.smithi026.stdout:7/213: rmdir dd 39 2024-04-23T10:17:47.365 INFO:tasks.workunit.client.0.smithi026.stdout:7/214: read dd/f35 [1310,46408] 0 2024-04-23T10:17:47.375 INFO:tasks.workunit.client.0.smithi026.stdout:7/215: write dd/d1d/d1e/f23 [87599,130460] 0 2024-04-23T10:17:47.384 INFO:tasks.workunit.client.0.smithi026.stdout:7/216: dread dd/f1b [4194304,4194304] 0 2024-04-23T10:17:47.386 INFO:tasks.workunit.client.0.smithi026.stdout:7/217: write dd/d1d/f31 [3260856,108915] 0 2024-04-23T10:17:47.389 INFO:tasks.workunit.client.0.smithi026.stdout:7/218: rmdir dd/d1d/d1e/d38 39 2024-04-23T10:17:47.404 INFO:tasks.workunit.client.0.smithi026.stdout:7/219: dwrite dd/f13 [4194304,4194304] 0 2024-04-23T10:17:47.410 INFO:tasks.workunit.client.0.smithi026.stdout:7/220: creat dd/f41 x:0 0 0 2024-04-23T10:17:47.419 INFO:tasks.workunit.client.0.smithi026.stdout:8/201: sync 2024-04-23T10:17:47.421 INFO:tasks.workunit.client.0.smithi026.stdout:7/221: dread dd/d1d/d1e/f23 [0,4194304] 0 2024-04-23T10:17:47.422 INFO:tasks.workunit.client.0.smithi026.stdout:8/202: mknod d5/d24/c3b 0 2024-04-23T10:17:47.435 INFO:tasks.workunit.client.0.smithi026.stdout:7/222: dwrite dd/f2f [0,4194304] 0 2024-04-23T10:17:47.437 INFO:tasks.workunit.client.0.smithi026.stdout:7/223: truncate dd/f34 952997 0 2024-04-23T10:17:47.439 INFO:tasks.workunit.client.0.smithi026.stdout:7/224: write dd/f36 [213340,28545] 0 2024-04-23T10:17:47.448 INFO:tasks.workunit.client.0.smithi026.stdout:7/225: rename dd/c3e to dd/d2c/c42 0 2024-04-23T10:17:47.449 INFO:tasks.workunit.client.0.smithi026.stdout:7/226: chown dd/d1d/d1e 0 1 2024-04-23T10:17:47.457 INFO:tasks.workunit.client.0.smithi026.stdout:7/227: mknod dd/d3f/c43 0 2024-04-23T10:17:47.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/228: chown dd/d1d/d1e/d38 53830 1 2024-04-23T10:17:47.460 INFO:tasks.workunit.client.0.smithi026.stdout:7/229: dread - dd/f41 zero size 2024-04-23T10:17:47.461 INFO:tasks.workunit.client.0.smithi026.stdout:7/230: chown lc 19045 1 2024-04-23T10:17:47.466 INFO:tasks.workunit.client.0.smithi026.stdout:7/231: rename dd/d1d/d1e to dd/d44 0 2024-04-23T10:17:47.487 INFO:tasks.workunit.client.0.smithi026.stdout:7/232: dread dd/f11 [0,4194304] 0 2024-04-23T10:17:47.491 INFO:tasks.workunit.client.0.smithi026.stdout:7/233: unlink c2 0 2024-04-23T10:17:47.491 INFO:tasks.workunit.client.0.smithi026.stdout:7/234: readlink l9 0 2024-04-23T10:17:47.492 INFO:tasks.workunit.client.0.smithi026.stdout:7/235: dread - dd/d44/d38/f3d zero size 2024-04-23T10:17:47.494 INFO:tasks.workunit.client.0.smithi026.stdout:7/236: write dd/d1d/f31 [6051,56871] 0 2024-04-23T10:17:47.496 INFO:tasks.workunit.client.0.smithi026.stdout:7/237: readlink dd/l15 0 2024-04-23T10:17:47.501 INFO:tasks.workunit.client.0.smithi026.stdout:7/238: mkdir dd/d45 0 2024-04-23T10:17:47.514 INFO:tasks.workunit.client.0.smithi026.stdout:7/239: dread dd/d1d/f37 [0,4194304] 0 2024-04-23T10:17:47.520 INFO:tasks.workunit.client.0.smithi026.stdout:7/240: mkdir dd/d46 0 2024-04-23T10:17:47.523 INFO:tasks.workunit.client.0.smithi026.stdout:7/241: mkdir dd/d3f/d47 0 2024-04-23T10:17:47.543 INFO:tasks.workunit.client.0.smithi026.stdout:7/242: dwrite dd/d44/f24 [0,4194304] 0 2024-04-23T10:17:47.550 INFO:tasks.workunit.client.0.smithi026.stdout:7/243: mkdir dd/d2c/d48 0 2024-04-23T10:17:47.550 INFO:tasks.workunit.client.0.smithi026.stdout:7/244: chown dd/c1a 62 1 2024-04-23T10:17:47.552 INFO:tasks.workunit.client.0.smithi026.stdout:7/245: chown dd/c17 57519 1 2024-04-23T10:17:47.552 INFO:tasks.workunit.client.0.smithi026.stdout:7/246: chown dd/d2c/d48 1 1 2024-04-23T10:17:47.559 INFO:tasks.workunit.client.0.smithi026.stdout:7/247: mknod dd/d1d/d3c/c49 0 2024-04-23T10:17:47.565 INFO:tasks.workunit.client.0.smithi026.stdout:7/248: creat dd/d1d/d3c/f4a x:0 0 0 2024-04-23T10:17:47.574 INFO:tasks.workunit.client.0.smithi026.stdout:7/249: link l9 dd/l4b 0 2024-04-23T10:17:47.585 INFO:tasks.workunit.client.0.smithi026.stdout:7/250: rename dd/d1d/d3c to dd/d3f/d47/d4c 0 2024-04-23T10:17:47.587 INFO:tasks.workunit.client.0.smithi026.stdout:7/251: write dd/d44/d38/f3d [408433,114853] 0 2024-04-23T10:17:47.591 INFO:tasks.workunit.client.0.smithi026.stdout:7/252: symlink dd/d44/d38/l4d 0 2024-04-23T10:17:47.603 INFO:tasks.workunit.client.0.smithi026.stdout:7/253: truncate dd/d1d/f31 3545552 0 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:3/280: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:8/203: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:9/329: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:2/234: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:5/148: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:0/362: sync 2024-04-23T10:17:47.605 INFO:tasks.workunit.client.0.smithi026.stdout:6/352: sync 2024-04-23T10:17:47.606 INFO:tasks.workunit.client.0.smithi026.stdout:1/184: sync 2024-04-23T10:17:47.607 INFO:tasks.workunit.client.0.smithi026.stdout:0/363: dread - d7/d8/d1e/d2a/f47 zero size 2024-04-23T10:17:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:7/254: creat dd/d44/d38/f4e x:0 0 0 2024-04-23T10:17:47.609 INFO:tasks.workunit.client.0.smithi026.stdout:0/364: fsync d7/d8/d1e/d2a/f47 0 2024-04-23T10:17:47.610 INFO:tasks.workunit.client.0.smithi026.stdout:8/204: fsync d5/d9/fb 0 2024-04-23T10:17:47.610 INFO:tasks.workunit.client.0.smithi026.stdout:3/281: truncate d0/d1e/d30/d43/df/f44 193361 0 2024-04-23T10:17:47.611 INFO:tasks.workunit.client.0.smithi026.stdout:0/365: write d7/d5b/f65 [1789940,114277] 0 2024-04-23T10:17:47.612 INFO:tasks.workunit.client.0.smithi026.stdout:5/149: creat d0/d12/f2b x:0 0 0 2024-04-23T10:17:47.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/282: write d0/d1e/d30/f57 [732446,96991] 0 2024-04-23T10:17:47.613 INFO:tasks.workunit.client.0.smithi026.stdout:2/235: creat d3/dd/f56 x:0 0 0 2024-04-23T10:17:47.613 INFO:tasks.workunit.client.0.smithi026.stdout:4/140: dread d4/d14/f12 [0,4194304] 0 2024-04-23T10:17:47.615 INFO:tasks.workunit.client.0.smithi026.stdout:8/205: read d5/f23 [377701,24265] 0 2024-04-23T10:17:47.615 INFO:tasks.workunit.client.0.smithi026.stdout:6/353: creat d6/d33/f67 x:0 0 0 2024-04-23T10:17:47.616 INFO:tasks.workunit.client.0.smithi026.stdout:6/354: stat d6/d13/f17 0 2024-04-23T10:17:47.617 INFO:tasks.workunit.client.0.smithi026.stdout:6/355: chown d6/d21/d2f/d32/f55 3212115 1 2024-04-23T10:17:47.619 INFO:tasks.workunit.client.0.smithi026.stdout:1/185: mkdir dd/d1a/d20/d25/d35/d43 0 2024-04-23T10:17:47.623 INFO:tasks.workunit.client.0.smithi026.stdout:2/236: dwrite d3/d19/d21/f54 [0,4194304] 0 2024-04-23T10:17:47.626 INFO:tasks.workunit.client.0.smithi026.stdout:5/150: mknod d0/d12/c2c 0 2024-04-23T10:17:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:4/141: fsync d4/d7/f1f 0 2024-04-23T10:17:47.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/283: dread d0/f3c [0,4194304] 0 2024-04-23T10:17:47.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/356: mkdir d6/d21/d2f/d37/d68 0 2024-04-23T10:17:47.631 INFO:tasks.workunit.client.0.smithi026.stdout:6/357: fsync d6/d21/d2f/d37/f3f 0 2024-04-23T10:17:47.633 INFO:tasks.workunit.client.0.smithi026.stdout:1/186: creat dd/d1a/d23/f44 x:0 0 0 2024-04-23T10:17:47.635 INFO:tasks.workunit.client.0.smithi026.stdout:2/237: dwrite d3/dd/f30 [0,4194304] 0 2024-04-23T10:17:47.641 INFO:tasks.workunit.client.0.smithi026.stdout:8/206: symlink d5/d9/l3c 0 2024-04-23T10:17:47.642 INFO:tasks.workunit.client.0.smithi026.stdout:5/151: write d0/f26 [517613,17607] 0 2024-04-23T10:17:47.644 INFO:tasks.workunit.client.0.smithi026.stdout:3/284: dwrite d0/d1e/d23/d52/f61 [0,4194304] 0 2024-04-23T10:17:47.657 INFO:tasks.workunit.client.0.smithi026.stdout:3/285: dread d0/d1e/d30/d43/d29/f34 [0,4194304] 0 2024-04-23T10:17:47.657 INFO:tasks.workunit.client.0.smithi026.stdout:6/358: write d6/d21/d2f/d32/f41 [901775,49482] 0 2024-04-23T10:17:47.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/187: truncate f7 948015 0 2024-04-23T10:17:47.664 INFO:tasks.workunit.client.0.smithi026.stdout:2/238: mknod d3/d19/d1d/c57 0 2024-04-23T10:17:47.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/207: mkdir d5/d3d 0 2024-04-23T10:17:47.670 INFO:tasks.workunit.client.0.smithi026.stdout:0/366: dread d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:47.672 INFO:tasks.workunit.client.0.smithi026.stdout:1/188: dread dd/d1a/f26 [0,4194304] 0 2024-04-23T10:17:47.672 INFO:tasks.workunit.client.0.smithi026.stdout:6/359: fsync f3 0 2024-04-23T10:17:47.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/142: creat d4/d7/f2a x:0 0 0 2024-04-23T10:17:47.678 INFO:tasks.workunit.client.0.smithi026.stdout:2/239: symlink d3/d19/d4d/l58 0 2024-04-23T10:17:47.680 INFO:tasks.workunit.client.0.smithi026.stdout:3/286: mkdir d0/d1e/d30/d43/d6c 0 2024-04-23T10:17:47.683 INFO:tasks.workunit.client.0.smithi026.stdout:6/360: write d6/d33/f2c [13239429,12085] 0 2024-04-23T10:17:47.684 INFO:tasks.workunit.client.0.smithi026.stdout:2/240: creat d3/d19/d21/d23/d3a/d3c/f59 x:0 0 0 2024-04-23T10:17:47.686 INFO:tasks.workunit.client.0.smithi026.stdout:3/287: dread d0/f3c [0,4194304] 0 2024-04-23T10:17:47.687 INFO:tasks.workunit.client.0.smithi026.stdout:5/152: getdents d0/d13 0 2024-04-23T10:17:47.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/241: fdatasync d3/f8 0 2024-04-23T10:17:47.689 INFO:tasks.workunit.client.0.smithi026.stdout:0/367: link d7/d5b/f65 d7/d8/d1e/d2a/d6a/d70/f8e 0 2024-04-23T10:17:47.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/189: rename dd/d1a/d23/c19 to dd/c45 0 2024-04-23T10:17:47.692 INFO:tasks.workunit.client.0.smithi026.stdout:8/208: getdents d5/d24/d3a 0 2024-04-23T10:17:47.694 INFO:tasks.workunit.client.0.smithi026.stdout:0/368: dread d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:47.695 INFO:tasks.workunit.client.0.smithi026.stdout:2/242: creat d3/d19/f5a x:0 0 0 2024-04-23T10:17:47.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/361: rename d6/d21/c26 to d6/d33/c69 0 2024-04-23T10:17:47.698 INFO:tasks.workunit.client.0.smithi026.stdout:1/190: mknod dd/d1a/d23/c46 0 2024-04-23T10:17:47.702 INFO:tasks.workunit.client.0.smithi026.stdout:8/209: mkdir d5/d3d/d3e 0 2024-04-23T10:17:47.702 INFO:tasks.workunit.client.0.smithi026.stdout:0/369: dwrite d7/d8/d1e/d57/f5e [0,4194304] 0 2024-04-23T10:17:47.704 INFO:tasks.workunit.client.0.smithi026.stdout:0/370: write d7/d8/d1e/d57/f5e [2544532,84333] 0 2024-04-23T10:17:47.704 INFO:tasks.workunit.client.0.smithi026.stdout:5/153: link d0/d13/f14 d0/f2d 0 2024-04-23T10:17:47.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/371: readlink d7/d8/d1e/l4c 0 2024-04-23T10:17:47.706 INFO:tasks.workunit.client.0.smithi026.stdout:0/372: chown d7/d8/d2d/d60/d77 99 1 2024-04-23T10:17:47.706 INFO:tasks.workunit.client.0.smithi026.stdout:0/373: chown d7/d8/d1e/d57 201702615 1 2024-04-23T10:17:47.709 INFO:tasks.workunit.client.0.smithi026.stdout:5/154: symlink d0/d13/l2e 0 2024-04-23T10:17:47.714 INFO:tasks.workunit.client.0.smithi026.stdout:1/191: dread dd/d1a/d23/f16 [0,4194304] 0 2024-04-23T10:17:47.714 INFO:tasks.workunit.client.0.smithi026.stdout:3/288: truncate d0/d1e/d30/d43/df/f44 156784 0 2024-04-23T10:17:47.718 INFO:tasks.workunit.client.0.smithi026.stdout:3/289: readlink d0/d1e/d30/d43/d29/l4e 0 2024-04-23T10:17:47.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/155: dread d0/d12/f1b [0,4194304] 0 2024-04-23T10:17:47.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/156: readlink d0/l1 0 2024-04-23T10:17:47.718 INFO:tasks.workunit.client.0.smithi026.stdout:2/243: getdents d3/d35/d4c 0 2024-04-23T10:17:47.718 INFO:tasks.workunit.client.0.smithi026.stdout:1/192: chown f7 440535308 1 2024-04-23T10:17:47.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/362: getdents d6/d21/d2f/d31 0 2024-04-23T10:17:47.721 INFO:tasks.workunit.client.0.smithi026.stdout:0/374: symlink d7/l8f 0 2024-04-23T10:17:47.723 INFO:tasks.workunit.client.0.smithi026.stdout:3/290: symlink d0/d1e/d30/d43/df/d63/l6d 0 2024-04-23T10:17:47.725 INFO:tasks.workunit.client.0.smithi026.stdout:5/157: fsync d0/f3 0 2024-04-23T10:17:47.725 INFO:tasks.workunit.client.0.smithi026.stdout:2/244: mknod d3/d19/d1d/d49/c5b 0 2024-04-23T10:17:47.727 INFO:tasks.workunit.client.0.smithi026.stdout:3/291: chown d0/d1e/d30/d43/df/d17/f46 31857 1 2024-04-23T10:17:47.728 INFO:tasks.workunit.client.0.smithi026.stdout:6/363: dread d6/f1d [4194304,4194304] 0 2024-04-23T10:17:47.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/292: dread - d0/f6a zero size 2024-04-23T10:17:47.731 INFO:tasks.workunit.client.0.smithi026.stdout:2/245: creat d3/d19/d31/f5c x:0 0 0 2024-04-23T10:17:47.733 INFO:tasks.workunit.client.0.smithi026.stdout:0/375: dread d7/f14 [0,4194304] 0 2024-04-23T10:17:47.736 INFO:tasks.workunit.client.0.smithi026.stdout:6/364: dread d6/d13/f4d [0,4194304] 0 2024-04-23T10:17:47.737 INFO:tasks.workunit.client.0.smithi026.stdout:2/246: getdents d3/d35/d4c 0 2024-04-23T10:17:47.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/158: dwrite d0/d12/f1b [0,4194304] 0 2024-04-23T10:17:47.740 INFO:tasks.workunit.client.0.smithi026.stdout:7/255: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:47.741 INFO:tasks.workunit.client.0.smithi026.stdout:5/159: write d0/d12/f2b [117842,3830] 0 2024-04-23T10:17:47.742 INFO:tasks.workunit.client.0.smithi026.stdout:0/376: creat d7/d8/d2d/d60/f90 x:0 0 0 2024-04-23T10:17:47.743 INFO:tasks.workunit.client.0.smithi026.stdout:0/377: fsync d7/d8/d2d/d60/d62/f5c 0 2024-04-23T10:17:47.744 INFO:tasks.workunit.client.0.smithi026.stdout:2/247: mkdir d3/d19/d21/d23/d3a/d3c/d5d 0 2024-04-23T10:17:47.748 INFO:tasks.workunit.client.0.smithi026.stdout:3/293: getdents d0/d1e/d30/d43/d29/d39 0 2024-04-23T10:17:47.749 INFO:tasks.workunit.client.0.smithi026.stdout:7/256: rename dd/d3f/d47/d4c/c49 to dd/d1d/c4f 0 2024-04-23T10:17:47.752 INFO:tasks.workunit.client.0.smithi026.stdout:5/160: dwrite d0/f26 [0,4194304] 0 2024-04-23T10:17:47.754 INFO:tasks.workunit.client.0.smithi026.stdout:7/257: rmdir dd/d3f/d47 39 2024-04-23T10:17:47.755 INFO:tasks.workunit.client.0.smithi026.stdout:0/378: dwrite d7/d8/d1e/f41 [0,4194304] 0 2024-04-23T10:17:47.762 INFO:tasks.workunit.client.0.smithi026.stdout:0/379: mkdir d7/d43/d91 0 2024-04-23T10:17:47.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/294: rename d0/d1e/l60 to d0/d1e/d23/l6e 0 2024-04-23T10:17:47.763 INFO:tasks.workunit.client.0.smithi026.stdout:5/161: dread d0/d12/f1b [0,4194304] 0 2024-04-23T10:17:47.765 INFO:tasks.workunit.client.0.smithi026.stdout:0/380: write d7/d43/f8d [174526,75745] 0 2024-04-23T10:17:47.768 INFO:tasks.workunit.client.0.smithi026.stdout:2/248: dwrite d3/f22 [0,4194304] 0 2024-04-23T10:17:47.769 INFO:tasks.workunit.client.0.smithi026.stdout:2/249: read d3/f8 [116446,79620] 0 2024-04-23T10:17:47.789 INFO:tasks.workunit.client.0.smithi026.stdout:7/258: dread dd/f1b [0,4194304] 0 2024-04-23T10:17:47.791 INFO:tasks.workunit.client.0.smithi026.stdout:2/250: mknod d3/d19/c5e 0 2024-04-23T10:17:47.793 INFO:tasks.workunit.client.0.smithi026.stdout:7/259: rmdir dd 39 2024-04-23T10:17:47.795 INFO:tasks.workunit.client.0.smithi026.stdout:3/295: symlink d0/d1e/d30/l6f 0 2024-04-23T10:17:47.796 INFO:tasks.workunit.client.0.smithi026.stdout:0/381: dread d7/f6f [0,4194304] 0 2024-04-23T10:17:47.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/251: creat d3/d19/d21/d23/d3a/d3c/f5f x:0 0 0 2024-04-23T10:17:47.800 INFO:tasks.workunit.client.0.smithi026.stdout:3/296: mkdir d0/d1e/d30/d43/df/d1f/d64/d70 0 2024-04-23T10:17:47.809 INFO:tasks.workunit.client.0.smithi026.stdout:3/297: dwrite d0/d1e/d30/d43/df/d63/f65 [0,4194304] 0 2024-04-23T10:17:47.811 INFO:tasks.workunit.client.0.smithi026.stdout:9/330: sync 2024-04-23T10:17:47.813 INFO:tasks.workunit.client.0.smithi026.stdout:0/382: rename d7/d5b/f5f to d7/d8/d1e/d1d/f92 0 2024-04-23T10:17:47.814 INFO:tasks.workunit.client.0.smithi026.stdout:0/383: readlink d7/d5b/l5d 0 2024-04-23T10:17:47.816 INFO:tasks.workunit.client.0.smithi026.stdout:3/298: mknod d0/d1e/d30/d43/d29/d39/c71 0 2024-04-23T10:17:47.819 INFO:tasks.workunit.client.0.smithi026.stdout:9/331: dwrite d13/f17 [0,4194304] 0 2024-04-23T10:17:47.819 INFO:tasks.workunit.client.0.smithi026.stdout:2/252: rename d3/d35/d4c/l4e to d3/d19/d31/l60 0 2024-04-23T10:17:47.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/253: chown d3/dd/f15 491874321 1 2024-04-23T10:17:47.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/254: chown d3/dd 22 1 2024-04-23T10:17:47.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/260: getdents dd/d44/d38 0 2024-04-23T10:17:47.824 INFO:tasks.workunit.client.0.smithi026.stdout:0/384: write d7/d8/f31 [1338575,43109] 0 2024-04-23T10:17:47.825 INFO:tasks.workunit.client.0.smithi026.stdout:7/261: mkdir dd/d1d/d50 0 2024-04-23T10:17:47.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/332: mkdir d13/d2a/d62 0 2024-04-23T10:17:47.829 INFO:tasks.workunit.client.0.smithi026.stdout:2/255: creat d3/dd/d4b/f61 x:0 0 0 2024-04-23T10:17:47.832 INFO:tasks.workunit.client.0.smithi026.stdout:9/333: creat d13/d3b/d5b/f63 x:0 0 0 2024-04-23T10:17:47.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/256: creat d3/d19/f62 x:0 0 0 2024-04-23T10:17:47.834 INFO:tasks.workunit.client.0.smithi026.stdout:0/385: symlink d7/d8/d2d/l93 0 2024-04-23T10:17:47.835 INFO:tasks.workunit.client.0.smithi026.stdout:0/386: chown d7/d8/d2d/d60/c85 150 1 2024-04-23T10:17:47.836 INFO:tasks.workunit.client.0.smithi026.stdout:0/387: chown d7/f84 11042774 1 2024-04-23T10:17:47.836 INFO:tasks.workunit.client.0.smithi026.stdout:0/388: chown d7 112534073 1 2024-04-23T10:17:47.837 INFO:tasks.workunit.client.0.smithi026.stdout:0/389: write d7/d43/f53 [561497,21935] 0 2024-04-23T10:17:47.837 INFO:tasks.workunit.client.0.smithi026.stdout:7/262: rename dd/f2f to dd/f51 0 2024-04-23T10:17:47.840 INFO:tasks.workunit.client.0.smithi026.stdout:2/257: rename d3/d19/d21/d23/f3e to d3/d19/d21/d23/d3a/d3c/f63 0 2024-04-23T10:17:47.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/258: fsync d3/dd/f30 0 2024-04-23T10:17:47.842 INFO:tasks.workunit.client.0.smithi026.stdout:2/259: write d3/dd/f2d [1701391,59669] 0 2024-04-23T10:17:47.843 INFO:tasks.workunit.client.0.smithi026.stdout:2/260: fsync d3/d19/d21/d23/f33 0 2024-04-23T10:17:47.845 INFO:tasks.workunit.client.0.smithi026.stdout:7/263: fdatasync dd/d3f/d47/d4c/f4a 0 2024-04-23T10:17:47.847 INFO:tasks.workunit.client.0.smithi026.stdout:0/390: symlink d7/d8/d2d/d60/d62/l94 0 2024-04-23T10:17:47.857 INFO:tasks.workunit.client.0.smithi026.stdout:9/334: write d13/f1e [1914685,129328] 0 2024-04-23T10:17:47.861 INFO:tasks.workunit.client.0.smithi026.stdout:2/261: truncate d3/dd/f30 2657460 0 2024-04-23T10:17:47.862 INFO:tasks.workunit.client.0.smithi026.stdout:7/264: write dd/d1d/f37 [129481,74030] 0 2024-04-23T10:17:47.863 INFO:tasks.workunit.client.0.smithi026.stdout:9/335: write d13/d3e/f41 [217903,80801] 0 2024-04-23T10:17:47.864 INFO:tasks.workunit.client.0.smithi026.stdout:2/262: creat d3/dd/d4b/f64 x:0 0 0 2024-04-23T10:17:47.865 INFO:tasks.workunit.client.0.smithi026.stdout:1/193: dread dd/d1a/f24 [0,4194304] 0 2024-04-23T10:17:47.865 INFO:tasks.workunit.client.0.smithi026.stdout:9/336: truncate d13/f5c 54482 0 2024-04-23T10:17:47.866 INFO:tasks.workunit.client.0.smithi026.stdout:1/194: read dd/d1a/f24 [1551195,40210] 0 2024-04-23T10:17:47.869 INFO:tasks.workunit.client.0.smithi026.stdout:7/265: symlink dd/d1d/l52 0 2024-04-23T10:17:47.869 INFO:tasks.workunit.client.0.smithi026.stdout:2/263: truncate d3/d19/d31/f3b 1539847 0 2024-04-23T10:17:47.870 INFO:tasks.workunit.client.0.smithi026.stdout:0/391: getdents d7/d8/d1e/d2a/d6a 0 2024-04-23T10:17:47.870 INFO:tasks.workunit.client.0.smithi026.stdout:2/264: fsync d3/d19/d21/f54 0 2024-04-23T10:17:47.872 INFO:tasks.workunit.client.0.smithi026.stdout:1/195: rename dd/d1a/l3c to dd/d1a/d20/l47 0 2024-04-23T10:17:47.872 INFO:tasks.workunit.client.0.smithi026.stdout:2/265: write d3/d19/d31/f5c [141496,108536] 0 2024-04-23T10:17:47.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/266: symlink dd/d2c/d48/l53 0 2024-04-23T10:17:47.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/266: rmdir d3/dd/d4b 39 2024-04-23T10:17:47.875 INFO:tasks.workunit.client.0.smithi026.stdout:1/196: dread dd/f12 [0,4194304] 0 2024-04-23T10:17:47.877 INFO:tasks.workunit.client.0.smithi026.stdout:2/267: chown d3/d19/d1d/c26 350400 1 2024-04-23T10:17:47.877 INFO:tasks.workunit.client.0.smithi026.stdout:0/392: creat d7/d8/d2d/d60/d77/f95 x:0 0 0 2024-04-23T10:17:47.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/267: creat dd/d45/f54 x:0 0 0 2024-04-23T10:17:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:2/268: mkdir d3/d19/d21/d23/d3a/d65 0 2024-04-23T10:17:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:2/269: stat d3/d19/c5e 0 2024-04-23T10:17:47.884 INFO:tasks.workunit.client.0.smithi026.stdout:0/393: mkdir d7/d8/d2d/d60/d62/d96 0 2024-04-23T10:17:47.886 INFO:tasks.workunit.client.0.smithi026.stdout:1/197: mkdir dd/d48 0 2024-04-23T10:17:47.886 INFO:tasks.workunit.client.0.smithi026.stdout:7/268: readlink l9 0 2024-04-23T10:17:47.887 INFO:tasks.workunit.client.0.smithi026.stdout:7/269: write dd/d44/d38/f4e [1046291,128033] 0 2024-04-23T10:17:47.888 INFO:tasks.workunit.client.0.smithi026.stdout:2/270: creat d3/d19/d31/f66 x:0 0 0 2024-04-23T10:17:47.890 INFO:tasks.workunit.client.0.smithi026.stdout:0/394: unlink d7/d8/f31 0 2024-04-23T10:17:47.891 INFO:tasks.workunit.client.0.smithi026.stdout:1/198: creat dd/d1a/f49 x:0 0 0 2024-04-23T10:17:47.894 INFO:tasks.workunit.client.0.smithi026.stdout:7/270: creat dd/d1d/d50/f55 x:0 0 0 2024-04-23T10:17:47.895 INFO:tasks.workunit.client.0.smithi026.stdout:1/199: unlink dd/d1a/f24 0 2024-04-23T10:17:47.895 INFO:tasks.workunit.client.0.smithi026.stdout:2/271: creat d3/d19/d21/d23/d3a/d3c/d5d/f67 x:0 0 0 2024-04-23T10:17:47.899 INFO:tasks.workunit.client.0.smithi026.stdout:7/271: mkdir dd/d1d/d50/d56 0 2024-04-23T10:17:47.900 INFO:tasks.workunit.client.0.smithi026.stdout:7/272: chown dd/d44/f23 38 1 2024-04-23T10:17:47.900 INFO:tasks.workunit.client.0.smithi026.stdout:7/273: fdatasync dd/d44/f26 0 2024-04-23T10:17:47.902 INFO:tasks.workunit.client.0.smithi026.stdout:1/200: chown dd/d1a/d20/l47 509539 1 2024-04-23T10:17:47.909 INFO:tasks.workunit.client.0.smithi026.stdout:0/395: dwrite d7/d8/d1e/d1d/f6d [0,4194304] 0 2024-04-23T10:17:47.912 INFO:tasks.workunit.client.0.smithi026.stdout:1/201: creat dd/d1a/d20/d25/f4a x:0 0 0 2024-04-23T10:17:47.913 INFO:tasks.workunit.client.0.smithi026.stdout:1/202: chown f7 47693585 1 2024-04-23T10:17:47.915 INFO:tasks.workunit.client.0.smithi026.stdout:7/274: dwrite dd/f11 [0,4194304] 0 2024-04-23T10:17:47.919 INFO:tasks.workunit.client.0.smithi026.stdout:1/203: mknod dd/d15/c4b 0 2024-04-23T10:17:47.921 INFO:tasks.workunit.client.0.smithi026.stdout:7/275: creat dd/d3f/d47/f57 x:0 0 0 2024-04-23T10:17:47.924 INFO:tasks.workunit.client.0.smithi026.stdout:0/396: symlink d7/d43/d91/l97 0 2024-04-23T10:17:47.929 INFO:tasks.workunit.client.0.smithi026.stdout:1/204: fdatasync f1 0 2024-04-23T10:17:47.935 INFO:tasks.workunit.client.0.smithi026.stdout:0/397: unlink d7/d8/d1e/d1d/d2f/f26 0 2024-04-23T10:17:47.935 INFO:tasks.workunit.client.0.smithi026.stdout:0/398: fsync d7/d8/d1e/d1d/f73 0 2024-04-23T10:17:47.936 INFO:tasks.workunit.client.0.smithi026.stdout:1/205: creat dd/d1a/d20/d25/d35/d43/f4c x:0 0 0 2024-04-23T10:17:47.936 INFO:tasks.workunit.client.0.smithi026.stdout:1/206: stat dd 0 2024-04-23T10:17:47.937 INFO:tasks.workunit.client.0.smithi026.stdout:7/276: getdents dd/d3f 0 2024-04-23T10:17:47.940 INFO:tasks.workunit.client.0.smithi026.stdout:1/207: creat dd/d1a/d20/f4d x:0 0 0 2024-04-23T10:17:47.948 INFO:tasks.workunit.client.0.smithi026.stdout:7/277: dwrite dd/f51 [0,4194304] 0 2024-04-23T10:17:47.958 INFO:tasks.workunit.client.0.smithi026.stdout:7/278: dwrite dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:47.964 INFO:tasks.workunit.client.0.smithi026.stdout:0/399: dread d7/d8/d1e/d1d/d2f/f34 [0,4194304] 0 2024-04-23T10:17:47.966 INFO:tasks.workunit.client.0.smithi026.stdout:1/208: symlink dd/d48/l4e 0 2024-04-23T10:17:47.967 INFO:tasks.workunit.client.0.smithi026.stdout:7/279: mkdir dd/d1d/d50/d58 0 2024-04-23T10:17:47.968 INFO:tasks.workunit.client.0.smithi026.stdout:7/280: stat dd/f13 0 2024-04-23T10:17:47.969 INFO:tasks.workunit.client.0.smithi026.stdout:7/281: truncate dd/d44/f26 5464725 0 2024-04-23T10:17:47.971 INFO:tasks.workunit.client.0.smithi026.stdout:0/400: creat d7/d8/d2d/d60/f98 x:0 0 0 2024-04-23T10:17:47.974 INFO:tasks.workunit.client.0.smithi026.stdout:7/282: creat dd/d2c/d48/f59 x:0 0 0 2024-04-23T10:17:47.974 INFO:tasks.workunit.client.0.smithi026.stdout:7/283: chown dd/f35 1844 1 2024-04-23T10:17:47.974 INFO:tasks.workunit.client.0.smithi026.stdout:4/143: sync 2024-04-23T10:17:47.976 INFO:tasks.workunit.client.0.smithi026.stdout:4/144: chown d4/d1b/f20 123425 1 2024-04-23T10:17:47.978 INFO:tasks.workunit.client.0.smithi026.stdout:0/401: dwrite d7/d43/f8d [0,4194304] 0 2024-04-23T10:17:47.986 INFO:tasks.workunit.client.0.smithi026.stdout:1/209: write f9 [565713,5234] 0 2024-04-23T10:17:47.992 INFO:tasks.workunit.client.0.smithi026.stdout:7/284: dwrite dd/d44/f2e [0,4194304] 0 2024-04-23T10:17:47.995 INFO:tasks.workunit.client.0.smithi026.stdout:7/285: write dd/d3f/d47/d4c/f4a [207679,48372] 0 2024-04-23T10:17:47.997 INFO:tasks.workunit.client.0.smithi026.stdout:1/210: truncate dd/d1a/d23/f16 570190 0 2024-04-23T10:17:47.997 INFO:tasks.workunit.client.0.smithi026.stdout:1/211: dread - dd/d1a/f49 zero size 2024-04-23T10:17:48.002 INFO:tasks.workunit.client.0.smithi026.stdout:0/402: dread d7/f38 [0,4194304] 0 2024-04-23T10:17:48.011 INFO:tasks.workunit.client.0.smithi026.stdout:1/212: creat dd/d15/f4f x:0 0 0 2024-04-23T10:17:48.011 INFO:tasks.workunit.client.0.smithi026.stdout:1/213: dread - dd/d1a/d23/f44 zero size 2024-04-23T10:17:48.015 INFO:tasks.workunit.client.0.smithi026.stdout:4/145: creat d4/f2b x:0 0 0 2024-04-23T10:17:48.017 INFO:tasks.workunit.client.0.smithi026.stdout:7/286: dwrite dd/f35 [0,4194304] 0 2024-04-23T10:17:48.018 INFO:tasks.workunit.client.0.smithi026.stdout:1/214: creat dd/d1a/d20/d25/d35/d43/f50 x:0 0 0 2024-04-23T10:17:48.019 INFO:tasks.workunit.client.0.smithi026.stdout:1/215: dread - dd/d1a/d20/d25/d35/d43/f50 zero size 2024-04-23T10:17:48.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/216: creat dd/d1a/d20/d25/d35/d43/f51 x:0 0 0 2024-04-23T10:17:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:4/146: mknod d4/c2c 0 2024-04-23T10:17:48.114 INFO:tasks.workunit.client.0.smithi026.stdout:7/287: mkdir dd/d44/d5a 0 2024-04-23T10:17:48.159 INFO:tasks.workunit.client.0.smithi026.stdout:8/210: sync 2024-04-23T10:17:48.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/365: sync 2024-04-23T10:17:48.167 INFO:tasks.workunit.client.0.smithi026.stdout:0/403: rename d7/d8/d1e/d1d/d2f/l45 to d7/d8/d1e/d1d/l99 0 2024-04-23T10:17:48.172 INFO:tasks.workunit.client.0.smithi026.stdout:7/288: rmdir dd/d44/d38 39 2024-04-23T10:17:48.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/404: rmdir d7/d8/d1e/d2a/d6a 39 2024-04-23T10:17:48.178 INFO:tasks.workunit.client.0.smithi026.stdout:0/405: truncate f4 9074786 0 2024-04-23T10:17:48.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/366: creat d6/d21/d2f/d37/d68/f6a x:0 0 0 2024-04-23T10:17:48.194 INFO:tasks.workunit.client.0.smithi026.stdout:7/289: unlink dd/d1d/l2d 0 2024-04-23T10:17:48.201 INFO:tasks.workunit.client.0.smithi026.stdout:1/217: rename f4 to dd/d1a/d23/d3f/f52 0 2024-04-23T10:17:48.208 INFO:tasks.workunit.client.0.smithi026.stdout:6/367: chown d6/c1e 27 1 2024-04-23T10:17:48.209 INFO:tasks.workunit.client.0.smithi026.stdout:6/368: write d6/f5a [1169701,34229] 0 2024-04-23T10:17:48.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/218: creat dd/d1a/d20/d25/d35/f53 x:0 0 0 2024-04-23T10:17:48.215 INFO:tasks.workunit.client.0.smithi026.stdout:1/219: stat dd/d1a/d23/d3f 0 2024-04-23T10:17:48.218 INFO:tasks.workunit.client.0.smithi026.stdout:6/369: dread f3 [0,4194304] 0 2024-04-23T10:17:48.219 INFO:tasks.workunit.client.0.smithi026.stdout:6/370: chown d6/d21/d58 95 1 2024-04-23T10:17:48.221 INFO:tasks.workunit.client.0.smithi026.stdout:4/147: link d4/d7/f15 d4/d7/d19/f2d 0 2024-04-23T10:17:48.222 INFO:tasks.workunit.client.0.smithi026.stdout:4/148: chown d4/cf 1 1 2024-04-23T10:17:48.224 INFO:tasks.workunit.client.0.smithi026.stdout:4/149: write d4/d14/f12 [317621,13628] 0 2024-04-23T10:17:48.228 INFO:tasks.workunit.client.0.smithi026.stdout:7/290: getdents dd/d1d/d50/d58 0 2024-04-23T10:17:48.230 INFO:tasks.workunit.client.0.smithi026.stdout:0/406: truncate d7/d8/d1e/d1d/d2f/f48 519304 0 2024-04-23T10:17:48.230 INFO:tasks.workunit.client.0.smithi026.stdout:7/291: dread - dd/d45/f54 zero size 2024-04-23T10:17:48.235 INFO:tasks.workunit.client.0.smithi026.stdout:1/220: dread dd/d1a/d23/f29 [0,4194304] 0 2024-04-23T10:17:48.240 INFO:tasks.workunit.client.0.smithi026.stdout:4/150: mkdir d4/d22/d2e 0 2024-04-23T10:17:48.241 INFO:tasks.workunit.client.0.smithi026.stdout:3/299: sync 2024-04-23T10:17:48.241 INFO:tasks.workunit.client.0.smithi026.stdout:9/337: sync 2024-04-23T10:17:48.243 INFO:tasks.workunit.client.0.smithi026.stdout:0/407: creat d7/d43/d91/f9a x:0 0 0 2024-04-23T10:17:48.244 INFO:tasks.workunit.client.0.smithi026.stdout:5/162: sync 2024-04-23T10:17:48.246 INFO:tasks.workunit.client.0.smithi026.stdout:1/221: mknod dd/d15/c54 0 2024-04-23T10:17:48.250 INFO:tasks.workunit.client.0.smithi026.stdout:9/338: read d13/d2a/d45/d3a/f4a [2168548,103339] 0 2024-04-23T10:17:48.259 INFO:tasks.workunit.client.0.smithi026.stdout:7/292: link dd/d45/f54 dd/d2c/d48/f5b 0 2024-04-23T10:17:48.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/151: dwrite d4/d7/d19/f21 [0,4194304] 0 2024-04-23T10:17:48.261 INFO:tasks.workunit.client.0.smithi026.stdout:5/163: dread d0/f3 [0,4194304] 0 2024-04-23T10:17:48.262 INFO:tasks.workunit.client.0.smithi026.stdout:5/164: chown d0/f26 150 1 2024-04-23T10:17:48.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/211: sync 2024-04-23T10:17:48.264 INFO:tasks.workunit.client.0.smithi026.stdout:2/272: sync 2024-04-23T10:17:48.265 INFO:tasks.workunit.client.0.smithi026.stdout:1/222: unlink dd/d15/f42 0 2024-04-23T10:17:48.266 INFO:tasks.workunit.client.0.smithi026.stdout:3/300: mkdir d0/d1e/d30/d43/df/d72 0 2024-04-23T10:17:48.268 INFO:tasks.workunit.client.0.smithi026.stdout:9/339: creat d13/d3e/f64 x:0 0 0 2024-04-23T10:17:48.269 INFO:tasks.workunit.client.0.smithi026.stdout:6/371: getdents d6/d33 0 2024-04-23T10:17:48.272 INFO:tasks.workunit.client.0.smithi026.stdout:7/293: creat dd/d1d/d50/f5c x:0 0 0 2024-04-23T10:17:48.274 INFO:tasks.workunit.client.0.smithi026.stdout:4/152: creat d4/d14/f2f x:0 0 0 2024-04-23T10:17:48.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/223: creat dd/d1a/f55 x:0 0 0 2024-04-23T10:17:48.278 INFO:tasks.workunit.client.0.smithi026.stdout:8/212: rmdir d5/d24/d3a/d15 39 2024-04-23T10:17:48.279 INFO:tasks.workunit.client.0.smithi026.stdout:2/273: dwrite d3/d19/d21/d23/d3a/d3c/f5f [0,4194304] 0 2024-04-23T10:17:48.280 INFO:tasks.workunit.client.0.smithi026.stdout:2/274: read - d3/dd/f43 zero size 2024-04-23T10:17:48.281 INFO:tasks.workunit.client.0.smithi026.stdout:3/301: unlink d0/d1e/d30/d43/df/l16 0 2024-04-23T10:17:48.283 INFO:tasks.workunit.client.0.smithi026.stdout:2/275: truncate d3/d19/d21/d23/f33 947398 0 2024-04-23T10:17:48.284 INFO:tasks.workunit.client.0.smithi026.stdout:0/408: dread d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:48.284 INFO:tasks.workunit.client.0.smithi026.stdout:2/276: write d3/d19/d21/f54 [1588947,8258] 0 2024-04-23T10:17:48.285 INFO:tasks.workunit.client.0.smithi026.stdout:9/340: rmdir d13/d1b 39 2024-04-23T10:17:48.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/277: dread - d3/d19/f62 zero size 2024-04-23T10:17:48.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/278: dread - d3/d19/f62 zero size 2024-04-23T10:17:48.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/372: symlink d6/d13/d49/l6b 0 2024-04-23T10:17:48.288 INFO:tasks.workunit.client.0.smithi026.stdout:2/279: read d3/d19/d1d/f25 [107505,127849] 0 2024-04-23T10:17:48.292 INFO:tasks.workunit.client.0.smithi026.stdout:4/153: fdatasync d4/d7/f1f 0 2024-04-23T10:17:48.296 INFO:tasks.workunit.client.0.smithi026.stdout:3/302: mkdir d0/d1e/d30/d43/df/d1f/d73 0 2024-04-23T10:17:48.298 INFO:tasks.workunit.client.0.smithi026.stdout:3/303: chown d0/c3 1223628 1 2024-04-23T10:17:48.303 INFO:tasks.workunit.client.0.smithi026.stdout:7/294: dwrite dd/d2c/d48/f5b [0,4194304] 0 2024-04-23T10:17:48.317 INFO:tasks.workunit.client.0.smithi026.stdout:9/341: symlink d13/l65 0 2024-04-23T10:17:48.320 INFO:tasks.workunit.client.0.smithi026.stdout:9/342: fsync d13/d2a/d45/d3a/d4f/f59 0 2024-04-23T10:17:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:0/409: symlink d7/d8/d1e/d2a/l9b 0 2024-04-23T10:17:48.412 INFO:tasks.workunit.client.0.smithi026.stdout:0/410: stat d7/d8/d2d/d60/f98 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:8/213: dread d5/d24/d3a/d15/f18 [0,4194304] 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:8/214: fdatasync d5/d9/fc 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:6/373: link d6/fe d6/d21/d2f/d31/f6c 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:7/295: write dd/f13 [3378270,60729] 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:5/165: link d0/c5 d0/c2f 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:5/166: chown d0/f1a 2972 1 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:1/224: rename dd/d1a/d23/l30 to dd/l56 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:9/343: mkdir d13/d36/d66 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:6/374: creat d6/d21/d2f/d37/f6d x:0 0 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:7/296: unlink dd/d44/f24 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:3/304: dread d0/d1e/d30/d43/f3b [0,4194304] 0 2024-04-23T10:17:48.413 INFO:tasks.workunit.client.0.smithi026.stdout:5/167: write d0/f2d [2086752,84006] 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/280: rename d3/d19/d1d/c26 to d3/d35/c68 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:9/344: dwrite d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:9/345: dread - d13/d3e/f5e zero size 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/281: dread - d3/d19/d31/f66 zero size 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:8/215: mkdir d5/d24/d3a/d3f 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:3/305: creat d0/d1e/d23/f74 x:0 0 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:1/225: truncate dd/f2c 4198359 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/168: symlink d0/d13/l30 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:4/154: getdents d4/d7/d19 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/282: rmdir d3/d19/d21/d23 39 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:0/411: truncate d7/f38 1836829 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/169: rename d0/d13/l30 to d0/d13/l31 0 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:5/170: dread - d0/d13/f29 zero size 2024-04-23T10:17:48.414 INFO:tasks.workunit.client.0.smithi026.stdout:3/306: dread d0/d1e/d30/d43/df/f1b [0,4194304] 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:4/155: mkdir d4/d14/d30 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:4/156: fsync d4/d7/f1f 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:2/283: read - d3/d19/d21/d23/d3a/d3c/d5d/f67 zero size 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:2/284: write d3/d19/f62 [298178,13291] 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:8/216: unlink d5/d9/l2d 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/297: rmdir dd/d1d/d50/d56 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/298: truncate dd/d44/f26 5813873 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:4/157: rmdir d4/d14 39 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:9/346: rename d13/d2a/d62 to d13/d2a/d45/d67 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:1/226: dwrite dd/d1a/f26 [0,4194304] 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:0/412: symlink d7/d8/d1e/l9c 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:5/171: unlink d0/c5 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:0/413: dread d7/d8/d2d/d60/d62/f5c [0,4194304] 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:3/307: getdents d0/d1e/d30/d43/df/d72 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:8/217: write d5/d9/f2e [931061,36838] 0 2024-04-23T10:17:48.415 INFO:tasks.workunit.client.0.smithi026.stdout:4/158: chown d4/d14/f2f 133498265 1 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:1/227: fdatasync f7 0 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:7/299: dwrite dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:5/172: write d0/f2d [4319208,115278] 0 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:1/228: chown dd/d1a/d23/f29 137340 1 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:7/300: write dd/d44/f26 [5965064,104636] 0 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:4/159: chown d4/d7/d19/c1a 92 1 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:7/301: dread - dd/d1d/d50/f5c zero size 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:9/347: getdents d13/d36/d66 0 2024-04-23T10:17:48.416 INFO:tasks.workunit.client.0.smithi026.stdout:1/229: symlink dd/d1a/d20/d25/l57 0 2024-04-23T10:17:48.417 INFO:tasks.workunit.client.0.smithi026.stdout:0/414: write d7/d8/d1e/d1d/f69 [981336,81759] 0 2024-04-23T10:17:48.417 INFO:tasks.workunit.client.0.smithi026.stdout:8/218: write d5/d24/d3a/d15/f18 [4729157,24534] 0 2024-04-23T10:17:48.417 INFO:tasks.workunit.client.0.smithi026.stdout:2/285: getdents d3/d19/d31 0 2024-04-23T10:17:48.418 INFO:tasks.workunit.client.0.smithi026.stdout:1/230: dread - dd/d1a/f49 zero size 2024-04-23T10:17:48.420 INFO:tasks.workunit.client.0.smithi026.stdout:9/348: rmdir d13/d2a/d45 39 2024-04-23T10:17:48.420 INFO:tasks.workunit.client.0.smithi026.stdout:7/302: rmdir dd/d44/d38 39 2024-04-23T10:17:48.423 INFO:tasks.workunit.client.0.smithi026.stdout:1/231: rmdir dd/d1a/d20/d25/d35 39 2024-04-23T10:17:48.424 INFO:tasks.workunit.client.0.smithi026.stdout:3/308: dwrite d0/d1e/d30/d43/fa [0,4194304] 0 2024-04-23T10:17:48.427 INFO:tasks.workunit.client.0.smithi026.stdout:4/160: truncate d4/d7/f1d 1506753 0 2024-04-23T10:17:48.433 INFO:tasks.workunit.client.0.smithi026.stdout:4/161: write d4/d14/f2f [136712,4037] 0 2024-04-23T10:17:48.437 INFO:tasks.workunit.client.0.smithi026.stdout:8/219: dwrite d5/f28 [0,4194304] 0 2024-04-23T10:17:48.437 INFO:tasks.workunit.client.0.smithi026.stdout:5/173: dwrite d0/f9 [0,4194304] 0 2024-04-23T10:17:48.440 INFO:tasks.workunit.client.0.smithi026.stdout:9/349: getdents d13/d31 0 2024-04-23T10:17:48.440 INFO:tasks.workunit.client.0.smithi026.stdout:7/303: rmdir dd/d44/d5a 0 2024-04-23T10:17:48.443 INFO:tasks.workunit.client.0.smithi026.stdout:0/415: dwrite d7/d8/d1e/d1d/d2f/d6c/d7f/f87 [0,4194304] 0 2024-04-23T10:17:48.444 INFO:tasks.workunit.client.0.smithi026.stdout:1/232: link dd/d1a/d23/f29 dd/d1a/d23/d3f/f58 0 2024-04-23T10:17:48.445 INFO:tasks.workunit.client.0.smithi026.stdout:4/162: mknod d4/c31 0 2024-04-23T10:17:48.446 INFO:tasks.workunit.client.0.smithi026.stdout:7/304: mknod dd/d2c/c5d 0 2024-04-23T10:17:48.448 INFO:tasks.workunit.client.0.smithi026.stdout:8/220: unlink d5/d24/d3a/l19 0 2024-04-23T10:17:48.453 INFO:tasks.workunit.client.0.smithi026.stdout:3/309: dwrite d0/d1e/d23/f74 [0,4194304] 0 2024-04-23T10:17:48.455 INFO:tasks.workunit.client.0.smithi026.stdout:9/350: readlink d13/d1b/d26/l28 0 2024-04-23T10:17:48.456 INFO:tasks.workunit.client.0.smithi026.stdout:3/310: write d0/d4c/f67 [178860,54502] 0 2024-04-23T10:17:48.456 INFO:tasks.workunit.client.0.smithi026.stdout:4/163: chown d4/d7/f8 61542 1 2024-04-23T10:17:48.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/233: mknod dd/d1a/d23/c59 0 2024-04-23T10:17:48.460 INFO:tasks.workunit.client.0.smithi026.stdout:3/311: readlink d0/d1e/l53 0 2024-04-23T10:17:48.462 INFO:tasks.workunit.client.0.smithi026.stdout:5/174: dread d0/d13/f14 [4194304,4194304] 0 2024-04-23T10:17:48.469 INFO:tasks.workunit.client.0.smithi026.stdout:3/312: rename d0/d1e/d30/d43/df/d1f/d64/d70 to d0/d1e/d23/d52/d75 0 2024-04-23T10:17:48.471 INFO:tasks.workunit.client.0.smithi026.stdout:0/416: link d7/c13 d7/d8/d1e/d1d/d2f/d6c/c9d 0 2024-04-23T10:17:48.471 INFO:tasks.workunit.client.0.smithi026.stdout:3/313: stat d0/d1e/d30/d43/d29/l59 0 2024-04-23T10:17:48.472 INFO:tasks.workunit.client.0.smithi026.stdout:4/164: creat d4/d22/d2e/f32 x:0 0 0 2024-04-23T10:17:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:7/305: creat dd/d44/f5e x:0 0 0 2024-04-23T10:17:48.474 INFO:tasks.workunit.client.0.smithi026.stdout:8/221: dread d5/d9/fc [0,4194304] 0 2024-04-23T10:17:48.475 INFO:tasks.workunit.client.0.smithi026.stdout:5/175: rmdir d0/d12 39 2024-04-23T10:17:48.477 INFO:tasks.workunit.client.0.smithi026.stdout:7/306: write dd/f41 [376920,37441] 0 2024-04-23T10:17:48.478 INFO:tasks.workunit.client.0.smithi026.stdout:9/351: dwrite d13/d2a/d45/d3a/d48/f55 [0,4194304] 0 2024-04-23T10:17:48.479 INFO:tasks.workunit.client.0.smithi026.stdout:9/352: read - d13/d2a/d45/d3a/f56 zero size 2024-04-23T10:17:48.480 INFO:tasks.workunit.client.0.smithi026.stdout:0/417: symlink d7/d8/d1e/d1d/d2f/d6c/l9e 0 2024-04-23T10:17:48.482 INFO:tasks.workunit.client.0.smithi026.stdout:4/165: rename d4/d1b/c27 to d4/d1b/c33 0 2024-04-23T10:17:48.483 INFO:tasks.workunit.client.0.smithi026.stdout:1/234: write dd/d1a/d23/d3f/f52 [1150566,77899] 0 2024-04-23T10:17:48.485 INFO:tasks.workunit.client.0.smithi026.stdout:1/235: chown dd/d1a/d23/c46 58 1 2024-04-23T10:17:48.486 INFO:tasks.workunit.client.0.smithi026.stdout:9/353: dread d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:48.488 INFO:tasks.workunit.client.0.smithi026.stdout:0/418: mknod d7/d5b/c9f 0 2024-04-23T10:17:48.489 INFO:tasks.workunit.client.0.smithi026.stdout:5/176: creat d0/d12/f32 x:0 0 0 2024-04-23T10:17:48.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/236: symlink dd/d1a/d23/d3f/l5a 0 2024-04-23T10:17:48.493 INFO:tasks.workunit.client.0.smithi026.stdout:9/354: mkdir d13/d3b/d68 0 2024-04-23T10:17:48.494 INFO:tasks.workunit.client.0.smithi026.stdout:5/177: mknod d0/d12/c33 0 2024-04-23T10:17:48.494 INFO:tasks.workunit.client.0.smithi026.stdout:3/314: link d0/d1e/d30/d43/d29/d39/l3d d0/d4c/l76 0 2024-04-23T10:17:48.495 INFO:tasks.workunit.client.0.smithi026.stdout:4/166: mkdir d4/d7/d34 0 2024-04-23T10:17:48.497 INFO:tasks.workunit.client.0.smithi026.stdout:1/237: truncate dd/d1a/d20/f39 845377 0 2024-04-23T10:17:48.497 INFO:tasks.workunit.client.0.smithi026.stdout:0/419: dwrite d7/d8/d1e/f7a [0,4194304] 0 2024-04-23T10:17:48.499 INFO:tasks.workunit.client.0.smithi026.stdout:9/355: symlink d13/d3b/d4e/l69 0 2024-04-23T10:17:48.500 INFO:tasks.workunit.client.0.smithi026.stdout:7/307: truncate dd/f34 731986 0 2024-04-23T10:17:48.500 INFO:tasks.workunit.client.0.smithi026.stdout:3/315: rmdir d0/d51 39 2024-04-23T10:17:48.501 INFO:tasks.workunit.client.0.smithi026.stdout:5/178: mknod d0/c34 0 2024-04-23T10:17:48.502 INFO:tasks.workunit.client.0.smithi026.stdout:3/316: write d0/d1e/d30/d43/d29/f3f [789446,33679] 0 2024-04-23T10:17:48.502 INFO:tasks.workunit.client.0.smithi026.stdout:1/238: creat dd/d1a/d23/d3f/f5b x:0 0 0 2024-04-23T10:17:48.503 INFO:tasks.workunit.client.0.smithi026.stdout:7/308: write dd/d2c/d48/f5b [2587713,68833] 0 2024-04-23T10:17:48.508 INFO:tasks.workunit.client.0.smithi026.stdout:3/317: truncate d0/d1e/d30/d43/df/f1a 935492 0 2024-04-23T10:17:48.509 INFO:tasks.workunit.client.0.smithi026.stdout:5/179: dread d0/f25 [0,4194304] 0 2024-04-23T10:17:48.510 INFO:tasks.workunit.client.0.smithi026.stdout:8/222: dread d5/d9/fb [0,4194304] 0 2024-04-23T10:17:48.513 INFO:tasks.workunit.client.0.smithi026.stdout:0/420: link d7/d8/d1e/d1d/d2f/c5a d7/d43/d91/ca0 0 2024-04-23T10:17:48.515 INFO:tasks.workunit.client.0.smithi026.stdout:1/239: dread dd/d1a/d23/f29 [0,4194304] 0 2024-04-23T10:17:48.516 INFO:tasks.workunit.client.0.smithi026.stdout:4/167: getdents d4/d14 0 2024-04-23T10:17:48.518 INFO:tasks.workunit.client.0.smithi026.stdout:5/180: write d0/f16 [857872,103901] 0 2024-04-23T10:17:48.518 INFO:tasks.workunit.client.0.smithi026.stdout:1/240: chown dd/d1a/d23/l34 1794335 1 2024-04-23T10:17:48.521 INFO:tasks.workunit.client.0.smithi026.stdout:1/241: chown dd/d15/l1d 0 1 2024-04-23T10:17:48.521 INFO:tasks.workunit.client.0.smithi026.stdout:8/223: write d5/f23 [732188,91181] 0 2024-04-23T10:17:48.522 INFO:tasks.workunit.client.0.smithi026.stdout:5/181: truncate d0/d13/f14 9091568 0 2024-04-23T10:17:48.525 INFO:tasks.workunit.client.0.smithi026.stdout:3/318: dwrite d0/d1e/d30/d43/df/d17/f32 [0,4194304] 0 2024-04-23T10:17:48.527 INFO:tasks.workunit.client.0.smithi026.stdout:0/421: getdents d7/d8/d1e/d57 0 2024-04-23T10:17:48.529 INFO:tasks.workunit.client.0.smithi026.stdout:1/242: write dd/d15/f32 [3355029,91777] 0 2024-04-23T10:17:48.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/168: link f3 d4/f35 0 2024-04-23T10:17:48.535 INFO:tasks.workunit.client.0.smithi026.stdout:3/319: mkdir d0/d1e/d30/d77 0 2024-04-23T10:17:48.536 INFO:tasks.workunit.client.0.smithi026.stdout:0/422: mkdir d7/da1 0 2024-04-23T10:17:48.538 INFO:tasks.workunit.client.0.smithi026.stdout:4/169: mkdir d4/d7/d34/d36 0 2024-04-23T10:17:48.539 INFO:tasks.workunit.client.0.smithi026.stdout:8/224: dread d5/d9/d22/f36 [0,4194304] 0 2024-04-23T10:17:48.539 INFO:tasks.workunit.client.0.smithi026.stdout:5/182: getdents d0/d13 0 2024-04-23T10:17:48.540 INFO:tasks.workunit.client.0.smithi026.stdout:4/170: dread d4/d7/f1f [0,4194304] 0 2024-04-23T10:17:48.541 INFO:tasks.workunit.client.0.smithi026.stdout:1/243: creat dd/d1a/d20/d25/f5c x:0 0 0 2024-04-23T10:17:48.542 INFO:tasks.workunit.client.0.smithi026.stdout:5/183: mknod d0/d13/c35 0 2024-04-23T10:17:48.545 INFO:tasks.workunit.client.0.smithi026.stdout:4/171: rename d4/d1b/f20 to d4/d7/d34/f37 0 2024-04-23T10:17:48.545 INFO:tasks.workunit.client.0.smithi026.stdout:8/225: creat d5/d9/f40 x:0 0 0 2024-04-23T10:17:48.546 INFO:tasks.workunit.client.0.smithi026.stdout:6/375: sync 2024-04-23T10:17:48.546 INFO:tasks.workunit.client.0.smithi026.stdout:6/376: readlink d6/d21/l40 0 2024-04-23T10:17:48.547 INFO:tasks.workunit.client.0.smithi026.stdout:1/244: symlink dd/d1a/d20/d25/d35/d43/l5d 0 2024-04-23T10:17:48.548 INFO:tasks.workunit.client.0.smithi026.stdout:1/245: chown dd/d15/f32 3448 1 2024-04-23T10:17:48.549 INFO:tasks.workunit.client.0.smithi026.stdout:8/226: rmdir d5/d24/d3a 39 2024-04-23T10:17:48.550 INFO:tasks.workunit.client.0.smithi026.stdout:0/423: write d7/d8/d1e/d1d/f28 [3199063,25638] 0 2024-04-23T10:17:48.551 INFO:tasks.workunit.client.0.smithi026.stdout:4/172: mkdir d4/d7/d34/d36/d38 0 2024-04-23T10:17:48.552 INFO:tasks.workunit.client.0.smithi026.stdout:5/184: dread d0/f26 [0,4194304] 0 2024-04-23T10:17:48.554 INFO:tasks.workunit.client.0.smithi026.stdout:4/173: chown d4/l6 130659317 1 2024-04-23T10:17:48.556 INFO:tasks.workunit.client.0.smithi026.stdout:1/246: rename dd/d1a/d23/f16 to dd/d1a/f5e 0 2024-04-23T10:17:48.559 INFO:tasks.workunit.client.0.smithi026.stdout:8/227: mknod d5/d3d/d3e/c41 0 2024-04-23T10:17:48.562 INFO:tasks.workunit.client.0.smithi026.stdout:1/247: creat dd/d1a/d20/f5f x:0 0 0 2024-04-23T10:17:48.562 INFO:tasks.workunit.client.0.smithi026.stdout:5/185: dread d0/d13/f14 [4194304,4194304] 0 2024-04-23T10:17:48.564 INFO:tasks.workunit.client.0.smithi026.stdout:0/424: dwrite d7/d8/d2d/d60/d77/f95 [0,4194304] 0 2024-04-23T10:17:48.564 INFO:tasks.workunit.client.0.smithi026.stdout:1/248: dread - dd/d1a/d20/d25/d35/d43/f4c zero size 2024-04-23T10:17:48.565 INFO:tasks.workunit.client.0.smithi026.stdout:6/377: dread d6/fe [4194304,4194304] 0 2024-04-23T10:17:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:4/174: symlink d4/d7/d34/d36/d38/l39 0 2024-04-23T10:17:48.566 INFO:tasks.workunit.client.0.smithi026.stdout:4/175: readlink d4/d22/l28 0 2024-04-23T10:17:48.567 INFO:tasks.workunit.client.0.smithi026.stdout:8/228: unlink d5/d3d/d3e/c41 0 2024-04-23T10:17:48.567 INFO:tasks.workunit.client.0.smithi026.stdout:5/186: symlink d0/d12/l36 0 2024-04-23T10:17:48.568 INFO:tasks.workunit.client.0.smithi026.stdout:1/249: symlink dd/d15/l60 0 2024-04-23T10:17:48.568 INFO:tasks.workunit.client.0.smithi026.stdout:0/425: mkdir d7/d8/d2d/d60/d62/da2 0 2024-04-23T10:17:48.569 INFO:tasks.workunit.client.0.smithi026.stdout:1/250: readlink dd/d1a/d20/l47 0 2024-04-23T10:17:48.569 INFO:tasks.workunit.client.0.smithi026.stdout:4/176: mknod d4/d7/d19/c3a 0 2024-04-23T10:17:48.570 INFO:tasks.workunit.client.0.smithi026.stdout:4/177: fsync d4/d7/d19/f21 0 2024-04-23T10:17:48.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/251: write dd/d1a/d20/d25/f5c [827858,131010] 0 2024-04-23T10:17:48.572 INFO:tasks.workunit.client.0.smithi026.stdout:1/252: fsync dd/d15/f4f 0 2024-04-23T10:17:48.574 INFO:tasks.workunit.client.0.smithi026.stdout:5/187: rename d0/d13/l2e to d0/d12/l37 0 2024-04-23T10:17:48.575 INFO:tasks.workunit.client.0.smithi026.stdout:8/229: rmdir d5/d24/d3a/d33 39 2024-04-23T10:17:48.577 INFO:tasks.workunit.client.0.smithi026.stdout:4/178: truncate d4/d7/d34/f37 1234718 0 2024-04-23T10:17:48.577 INFO:tasks.workunit.client.0.smithi026.stdout:5/188: write d0/d13/f19 [1022879,70208] 0 2024-04-23T10:17:48.578 INFO:tasks.workunit.client.0.smithi026.stdout:4/179: chown d4/d1b/c1e 233580011 1 2024-04-23T10:17:48.579 INFO:tasks.workunit.client.0.smithi026.stdout:4/180: fsync d4/d7/d19/f21 0 2024-04-23T10:17:48.582 INFO:tasks.workunit.client.0.smithi026.stdout:5/189: mknod d0/d13/c38 0 2024-04-23T10:17:48.583 INFO:tasks.workunit.client.0.smithi026.stdout:4/181: symlink d4/d14/l3b 0 2024-04-23T10:17:48.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/230: symlink d5/d24/d3a/d3f/l42 0 2024-04-23T10:17:48.585 INFO:tasks.workunit.client.0.smithi026.stdout:1/253: link dd/d1a/d20/c31 dd/d15/c61 0 2024-04-23T10:17:48.588 INFO:tasks.workunit.client.0.smithi026.stdout:5/190: creat d0/f39 x:0 0 0 2024-04-23T10:17:48.589 INFO:tasks.workunit.client.0.smithi026.stdout:4/182: creat d4/d7/f3c x:0 0 0 2024-04-23T10:17:48.593 INFO:tasks.workunit.client.0.smithi026.stdout:5/191: mkdir d0/d13/d3a 0 2024-04-23T10:17:48.593 INFO:tasks.workunit.client.0.smithi026.stdout:1/254: dwrite dd/f3b [0,4194304] 0 2024-04-23T10:17:48.595 INFO:tasks.workunit.client.0.smithi026.stdout:1/255: write dd/d1a/d23/d3f/f5b [514064,122684] 0 2024-04-23T10:17:48.595 INFO:tasks.workunit.client.0.smithi026.stdout:4/183: mkdir d4/d14/d3d 0 2024-04-23T10:17:48.596 INFO:tasks.workunit.client.0.smithi026.stdout:8/231: truncate d5/d24/d3a/d15/f34 24107 0 2024-04-23T10:17:48.599 INFO:tasks.workunit.client.0.smithi026.stdout:1/256: truncate dd/d1a/d23/d3f/f5b 1041272 0 2024-04-23T10:17:48.599 INFO:tasks.workunit.client.0.smithi026.stdout:8/232: fsync d5/d9/f10 0 2024-04-23T10:17:48.604 INFO:tasks.workunit.client.0.smithi026.stdout:5/192: truncate d0/d13/f19 263830 0 2024-04-23T10:17:48.611 INFO:tasks.workunit.client.0.smithi026.stdout:8/233: dwrite d5/d9/fa [0,4194304] 0 2024-04-23T10:17:48.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/257: dwrite dd/d1a/d23/f40 [0,4194304] 0 2024-04-23T10:17:48.614 INFO:tasks.workunit.client.0.smithi026.stdout:5/193: getdents d0/d12 0 2024-04-23T10:17:48.615 INFO:tasks.workunit.client.0.smithi026.stdout:1/258: write dd/d1a/d23/f44 [972407,89195] 0 2024-04-23T10:17:48.617 INFO:tasks.workunit.client.0.smithi026.stdout:8/234: mknod d5/d24/d3a/c43 0 2024-04-23T10:17:48.623 INFO:tasks.workunit.client.0.smithi026.stdout:5/194: mknod d0/d13/d3a/c3b 0 2024-04-23T10:17:48.623 INFO:tasks.workunit.client.0.smithi026.stdout:8/235: fdatasync d5/d24/d3a/f1f 0 2024-04-23T10:17:48.624 INFO:tasks.workunit.client.0.smithi026.stdout:4/184: dwrite d4/d7/d34/f37 [0,4194304] 0 2024-04-23T10:17:48.625 INFO:tasks.workunit.client.0.smithi026.stdout:5/195: rmdir d0 39 2024-04-23T10:17:48.630 INFO:tasks.workunit.client.0.smithi026.stdout:4/185: rmdir d4/d1b 39 2024-04-23T10:17:48.631 INFO:tasks.workunit.client.0.smithi026.stdout:8/236: creat d5/d24/d3a/d33/f44 x:0 0 0 2024-04-23T10:17:48.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/259: dwrite dd/d15/f4f [0,4194304] 0 2024-04-23T10:17:48.632 INFO:tasks.workunit.client.0.smithi026.stdout:5/196: truncate d0/f39 876962 0 2024-04-23T10:17:48.634 INFO:tasks.workunit.client.0.smithi026.stdout:4/186: write d4/d7/f8 [421556,35129] 0 2024-04-23T10:17:48.634 INFO:tasks.workunit.client.0.smithi026.stdout:5/197: truncate d0/d12/f27 1043544 0 2024-04-23T10:17:48.638 INFO:tasks.workunit.client.0.smithi026.stdout:8/237: mknod d5/d9/c45 0 2024-04-23T10:17:48.642 INFO:tasks.workunit.client.0.smithi026.stdout:5/198: mkdir d0/d3c 0 2024-04-23T10:17:48.643 INFO:tasks.workunit.client.0.smithi026.stdout:4/187: dwrite d4/d7/f13 [0,4194304] 0 2024-04-23T10:17:48.644 INFO:tasks.workunit.client.0.smithi026.stdout:1/260: symlink dd/d1a/d20/d25/l62 0 2024-04-23T10:17:48.644 INFO:tasks.workunit.client.0.smithi026.stdout:4/188: stat d4/d22/l28 0 2024-04-23T10:17:48.646 INFO:tasks.workunit.client.0.smithi026.stdout:1/261: fdatasync dd/d1a/f5e 0 2024-04-23T10:17:48.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/262: fsync dd/d1a/d23/f28 0 2024-04-23T10:17:48.648 INFO:tasks.workunit.client.0.smithi026.stdout:8/238: rename d5/l1d to d5/d3d/l46 0 2024-04-23T10:17:48.649 INFO:tasks.workunit.client.0.smithi026.stdout:5/199: link d0/f39 d0/d3c/f3d 0 2024-04-23T10:17:48.651 INFO:tasks.workunit.client.0.smithi026.stdout:5/200: mknod d0/d12/c3e 0 2024-04-23T10:17:48.653 INFO:tasks.workunit.client.0.smithi026.stdout:4/189: creat d4/d7/f3e x:0 0 0 2024-04-23T10:17:48.653 INFO:tasks.workunit.client.0.smithi026.stdout:4/190: stat d4/f35 0 2024-04-23T10:17:48.654 INFO:tasks.workunit.client.0.smithi026.stdout:5/201: creat d0/d12/f3f x:0 0 0 2024-04-23T10:17:48.657 INFO:tasks.workunit.client.0.smithi026.stdout:4/191: creat d4/d22/f3f x:0 0 0 2024-04-23T10:17:48.658 INFO:tasks.workunit.client.0.smithi026.stdout:5/202: chown d0/f2d 395308914 1 2024-04-23T10:17:48.660 INFO:tasks.workunit.client.0.smithi026.stdout:4/192: chown d4/d7/l16 0 1 2024-04-23T10:17:48.661 INFO:tasks.workunit.client.0.smithi026.stdout:4/193: creat d4/d14/f40 x:0 0 0 2024-04-23T10:17:48.663 INFO:tasks.workunit.client.0.smithi026.stdout:5/203: rename d0/cc to d0/d12/c40 0 2024-04-23T10:17:48.664 INFO:tasks.workunit.client.0.smithi026.stdout:4/194: getdents d4/d14/d3d 0 2024-04-23T10:17:48.667 INFO:tasks.workunit.client.0.smithi026.stdout:5/204: link d0/d12/f27 d0/d3c/f41 0 2024-04-23T10:17:48.668 INFO:tasks.workunit.client.0.smithi026.stdout:4/195: rename d4/d22/f3f to d4/d7/d34/f41 0 2024-04-23T10:17:48.668 INFO:tasks.workunit.client.0.smithi026.stdout:5/205: chown d0/d13/d3a/c3b 52899805 1 2024-04-23T10:17:48.669 INFO:tasks.workunit.client.0.smithi026.stdout:5/206: stat d0/d13/f14 0 2024-04-23T10:17:48.673 INFO:tasks.workunit.client.0.smithi026.stdout:5/207: getdents d0/d13 0 2024-04-23T10:17:48.675 INFO:tasks.workunit.client.0.smithi026.stdout:8/239: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:48.676 INFO:tasks.workunit.client.0.smithi026.stdout:8/240: fsync d5/f13 0 2024-04-23T10:17:48.677 INFO:tasks.workunit.client.0.smithi026.stdout:5/208: dread d0/d12/f27 [0,4194304] 0 2024-04-23T10:17:48.678 INFO:tasks.workunit.client.0.smithi026.stdout:4/196: dwrite d4/d22/d2e/f32 [0,4194304] 0 2024-04-23T10:17:48.678 INFO:tasks.workunit.client.0.smithi026.stdout:1/263: dread dd/f2c [0,4194304] 0 2024-04-23T10:17:48.682 INFO:tasks.workunit.client.0.smithi026.stdout:8/241: mkdir d5/d24/d3a/d47 0 2024-04-23T10:17:48.688 INFO:tasks.workunit.client.0.smithi026.stdout:5/209: creat d0/f42 x:0 0 0 2024-04-23T10:17:48.691 INFO:tasks.workunit.client.0.smithi026.stdout:8/242: link d5/d9/fa d5/d24/d3a/d47/f48 0 2024-04-23T10:17:48.693 INFO:tasks.workunit.client.0.smithi026.stdout:5/210: mknod d0/d13/c43 0 2024-04-23T10:17:48.693 INFO:tasks.workunit.client.0.smithi026.stdout:4/197: dread d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:48.695 INFO:tasks.workunit.client.0.smithi026.stdout:4/198: fsync d4/d7/f1d 0 2024-04-23T10:17:48.698 INFO:tasks.workunit.client.0.smithi026.stdout:4/199: mkdir d4/d42 0 2024-04-23T10:17:48.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/200: stat d4/c2c 0 2024-04-23T10:17:48.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/264: dread dd/d15/f32 [0,4194304] 0 2024-04-23T10:17:48.701 INFO:tasks.workunit.client.0.smithi026.stdout:4/201: mknod d4/d7/c43 0 2024-04-23T10:17:48.701 INFO:tasks.workunit.client.0.smithi026.stdout:1/265: creat dd/d48/f63 x:0 0 0 2024-04-23T10:17:48.702 INFO:tasks.workunit.client.0.smithi026.stdout:1/266: chown dd/d15 23654 1 2024-04-23T10:17:48.702 INFO:tasks.workunit.client.0.smithi026.stdout:4/202: mknod d4/d22/d2e/c44 0 2024-04-23T10:17:48.703 INFO:tasks.workunit.client.0.smithi026.stdout:4/203: stat d4/d7/f2a 0 2024-04-23T10:17:48.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/243: dread d5/f2a [0,4194304] 0 2024-04-23T10:17:48.704 INFO:tasks.workunit.client.0.smithi026.stdout:1/267: rename dd/d1a/d23/l33 to dd/d1a/d20/l64 0 2024-04-23T10:17:48.705 INFO:tasks.workunit.client.0.smithi026.stdout:4/204: mknod d4/d7/d34/c45 0 2024-04-23T10:17:48.705 INFO:tasks.workunit.client.0.smithi026.stdout:1/268: write dd/d1a/d20/f5f [633946,75693] 0 2024-04-23T10:17:48.706 INFO:tasks.workunit.client.0.smithi026.stdout:8/244: unlink d5/f13 0 2024-04-23T10:17:48.707 INFO:tasks.workunit.client.0.smithi026.stdout:4/205: creat d4/d14/f46 x:0 0 0 2024-04-23T10:17:48.708 INFO:tasks.workunit.client.0.smithi026.stdout:4/206: chown d4/d7/d19/f21 7 1 2024-04-23T10:17:48.709 INFO:tasks.workunit.client.0.smithi026.stdout:1/269: dread dd/d1a/d23/f18 [0,4194304] 0 2024-04-23T10:17:48.710 INFO:tasks.workunit.client.0.smithi026.stdout:1/270: write f2 [2158068,47651] 0 2024-04-23T10:17:48.710 INFO:tasks.workunit.client.0.smithi026.stdout:8/245: fdatasync d5/d24/d3a/f1f 0 2024-04-23T10:17:48.712 INFO:tasks.workunit.client.0.smithi026.stdout:4/207: creat d4/d22/f47 x:0 0 0 2024-04-23T10:17:48.714 INFO:tasks.workunit.client.0.smithi026.stdout:1/271: mknod dd/d1a/d23/c65 0 2024-04-23T10:17:48.715 INFO:tasks.workunit.client.0.smithi026.stdout:8/246: symlink d5/d24/d3a/d15/l49 0 2024-04-23T10:17:48.716 INFO:tasks.workunit.client.0.smithi026.stdout:8/247: read - d5/d9/f40 zero size 2024-04-23T10:17:48.716 INFO:tasks.workunit.client.0.smithi026.stdout:4/208: rmdir d4/d7/d19 39 2024-04-23T10:17:48.717 INFO:tasks.workunit.client.0.smithi026.stdout:1/272: rename dd/d1a/d23/c2a to dd/d1a/d20/d25/d35/c66 0 2024-04-23T10:17:48.718 INFO:tasks.workunit.client.0.smithi026.stdout:1/273: stat dd/d1a/d20/d25/f4a 0 2024-04-23T10:17:48.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/274: chown dd/d1a/d20/d25/d35/f53 765 1 2024-04-23T10:17:48.720 INFO:tasks.workunit.client.0.smithi026.stdout:1/275: write dd/d1a/d23/f40 [1145243,37319] 0 2024-04-23T10:17:48.720 INFO:tasks.workunit.client.0.smithi026.stdout:4/209: mknod d4/d22/c48 0 2024-04-23T10:17:48.721 INFO:tasks.workunit.client.0.smithi026.stdout:4/210: write d4/d7/f3e [555075,53906] 0 2024-04-23T10:17:48.722 INFO:tasks.workunit.client.0.smithi026.stdout:8/248: rename d5/d9/d22/l2f to d5/d24/d3a/d47/l4a 0 2024-04-23T10:17:48.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/249: readlink d5/l2b 0 2024-04-23T10:17:48.726 INFO:tasks.workunit.client.0.smithi026.stdout:1/276: link dd/d15/f4f dd/d1a/d23/f67 0 2024-04-23T10:17:48.727 INFO:tasks.workunit.client.0.smithi026.stdout:8/250: symlink d5/d24/d3a/d47/l4b 0 2024-04-23T10:17:48.728 INFO:tasks.workunit.client.0.smithi026.stdout:4/211: creat d4/f49 x:0 0 0 2024-04-23T10:17:48.728 INFO:tasks.workunit.client.0.smithi026.stdout:1/277: creat dd/d15/f68 x:0 0 0 2024-04-23T10:17:48.729 INFO:tasks.workunit.client.0.smithi026.stdout:8/251: write d5/d9/f2e [3854764,12133] 0 2024-04-23T10:17:48.731 INFO:tasks.workunit.client.0.smithi026.stdout:1/278: mkdir dd/d1a/d23/d69 0 2024-04-23T10:17:48.731 INFO:tasks.workunit.client.0.smithi026.stdout:4/212: creat d4/d14/d3d/f4a x:0 0 0 2024-04-23T10:17:48.734 INFO:tasks.workunit.client.0.smithi026.stdout:4/213: symlink d4/d7/d34/d36/l4b 0 2024-04-23T10:17:48.737 INFO:tasks.workunit.client.0.smithi026.stdout:2/286: sync 2024-04-23T10:17:48.738 INFO:tasks.workunit.client.0.smithi026.stdout:5/211: write d0/f3 [265329,125124] 0 2024-04-23T10:17:48.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/252: dwrite d5/d24/d3a/f1c [0,4194304] 0 2024-04-23T10:17:48.740 INFO:tasks.workunit.client.0.smithi026.stdout:4/214: link d4/d7/d34/f37 d4/d22/f4c 0 2024-04-23T10:17:48.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/212: fsync d0/d3c/f3d 0 2024-04-23T10:17:48.741 INFO:tasks.workunit.client.0.smithi026.stdout:4/215: write d4/d7/f3c [998167,94501] 0 2024-04-23T10:17:48.742 INFO:tasks.workunit.client.0.smithi026.stdout:8/253: unlink d5/d9/c45 0 2024-04-23T10:17:48.745 INFO:tasks.workunit.client.0.smithi026.stdout:2/287: truncate d3/dd/f32 135686 0 2024-04-23T10:17:48.746 INFO:tasks.workunit.client.0.smithi026.stdout:4/216: mkdir d4/d7/d34/d4d 0 2024-04-23T10:17:48.748 INFO:tasks.workunit.client.0.smithi026.stdout:8/254: symlink d5/d3d/d3e/l4c 0 2024-04-23T10:17:48.748 INFO:tasks.workunit.client.0.smithi026.stdout:2/288: truncate d3/d19/f5a 152996 0 2024-04-23T10:17:48.749 INFO:tasks.workunit.client.0.smithi026.stdout:8/255: chown d5/d24/d3a/f1f 3942353 1 2024-04-23T10:17:48.751 INFO:tasks.workunit.client.0.smithi026.stdout:2/289: creat d3/d19/d21/d23/d3a/f69 x:0 0 0 2024-04-23T10:17:48.752 INFO:tasks.workunit.client.0.smithi026.stdout:2/290: fdatasync d3/d19/d21/d23/f24 0 2024-04-23T10:17:48.754 INFO:tasks.workunit.client.0.smithi026.stdout:5/213: getdents d0/d3c 0 2024-04-23T10:17:48.755 INFO:tasks.workunit.client.0.smithi026.stdout:5/214: stat d0/d12/l1d 0 2024-04-23T10:17:48.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/291: link d3/d19/d21/d23/d3a/d3c/f59 d3/d35/d4c/f6a 0 2024-04-23T10:17:48.761 INFO:tasks.workunit.client.0.smithi026.stdout:1/279: truncate dd/d1a/d23/d3f/f5b 507185 0 2024-04-23T10:17:48.762 INFO:tasks.workunit.client.0.smithi026.stdout:2/292: mknod d3/d19/d21/d23/d3a/d65/c6b 0 2024-04-23T10:17:48.764 INFO:tasks.workunit.client.0.smithi026.stdout:1/280: unlink dd/l56 0 2024-04-23T10:17:48.765 INFO:tasks.workunit.client.0.smithi026.stdout:1/281: write dd/f3b [1365649,98317] 0 2024-04-23T10:17:48.765 INFO:tasks.workunit.client.0.smithi026.stdout:2/293: creat d3/d19/d21/d23/d3a/d3c/f6c x:0 0 0 2024-04-23T10:17:48.771 INFO:tasks.workunit.client.0.smithi026.stdout:2/294: link d3/d19/d1d/d49/c4f d3/d19/d21/d23/d3a/d3c/c6d 0 2024-04-23T10:17:48.771 INFO:tasks.workunit.client.0.smithi026.stdout:2/295: fsync d3/d19/d31/f66 0 2024-04-23T10:17:48.772 INFO:tasks.workunit.client.0.smithi026.stdout:8/256: rename d5/d3d to d5/d24/d3a/d3f/d4d 0 2024-04-23T10:17:48.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/257: truncate d5/d24/d3a/d15/f31 120254 0 2024-04-23T10:17:48.774 INFO:tasks.workunit.client.0.smithi026.stdout:2/296: truncate d3/d19/d1d/f25 857677 0 2024-04-23T10:17:48.777 INFO:tasks.workunit.client.0.smithi026.stdout:8/258: creat d5/d24/d3a/d33/f4e x:0 0 0 2024-04-23T10:17:48.778 INFO:tasks.workunit.client.0.smithi026.stdout:5/215: dwrite d0/d12/f27 [0,4194304] 0 2024-04-23T10:17:48.781 INFO:tasks.workunit.client.0.smithi026.stdout:8/259: creat d5/d24/d3a/d47/f4f x:0 0 0 2024-04-23T10:17:48.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/216: dread d0/d3c/f3d [0,4194304] 0 2024-04-23T10:17:48.782 INFO:tasks.workunit.client.0.smithi026.stdout:2/297: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:48.783 INFO:tasks.workunit.client.0.smithi026.stdout:5/217: write d0/f26 [3931879,116012] 0 2024-04-23T10:17:48.785 INFO:tasks.workunit.client.0.smithi026.stdout:5/218: fsync d0/f2d 0 2024-04-23T10:17:48.788 INFO:tasks.workunit.client.0.smithi026.stdout:2/298: creat d3/d19/d21/d23/d3a/d3c/f6e x:0 0 0 2024-04-23T10:17:48.790 INFO:tasks.workunit.client.0.smithi026.stdout:2/299: read - d3/d19/d21/d23/d3a/d3c/f6e zero size 2024-04-23T10:17:48.792 INFO:tasks.workunit.client.0.smithi026.stdout:5/219: mknod d0/d12/c44 0 2024-04-23T10:17:48.801 INFO:tasks.workunit.client.0.smithi026.stdout:8/260: getdents d5/d24/d3a/d3f 0 2024-04-23T10:17:48.802 INFO:tasks.workunit.client.0.smithi026.stdout:8/261: readlink d5/d24/l32 0 2024-04-23T10:17:48.803 INFO:tasks.workunit.client.0.smithi026.stdout:5/220: mkdir d0/d13/d45 0 2024-04-23T10:17:48.808 INFO:tasks.workunit.client.0.smithi026.stdout:5/221: fdatasync d0/f2a 0 2024-04-23T10:17:48.810 INFO:tasks.workunit.client.0.smithi026.stdout:8/262: dwrite d5/d24/d3a/d15/f31 [0,4194304] 0 2024-04-23T10:17:48.816 INFO:tasks.workunit.client.0.smithi026.stdout:2/300: dread d3/dd/f18 [0,4194304] 0 2024-04-23T10:17:48.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/222: dwrite d0/f16 [0,4194304] 0 2024-04-23T10:17:48.817 INFO:tasks.workunit.client.0.smithi026.stdout:2/301: stat d3/d19/d21/d23/f24 0 2024-04-23T10:17:48.818 INFO:tasks.workunit.client.0.smithi026.stdout:8/263: chown d5/d9/d22/c37 16692836 1 2024-04-23T10:17:48.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/302: read d3/f8 [544926,55520] 0 2024-04-23T10:17:48.826 INFO:tasks.workunit.client.0.smithi026.stdout:8/264: mkdir d5/d50 0 2024-04-23T10:17:48.828 INFO:tasks.workunit.client.0.smithi026.stdout:5/223: dwrite d0/d3c/f41 [4194304,4194304] 0 2024-04-23T10:17:48.831 INFO:tasks.workunit.client.0.smithi026.stdout:2/303: mknod d3/dd/d4b/c6f 0 2024-04-23T10:17:48.833 INFO:tasks.workunit.client.0.smithi026.stdout:2/304: write d3/dd/d4b/f61 [857772,102277] 0 2024-04-23T10:17:48.836 INFO:tasks.workunit.client.0.smithi026.stdout:8/265: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:48.836 INFO:tasks.workunit.client.0.smithi026.stdout:5/224: symlink d0/d3c/l46 0 2024-04-23T10:17:48.840 INFO:tasks.workunit.client.0.smithi026.stdout:8/266: rename d5/d24/d3a/d47/l4b to d5/d24/d3a/d3f/l51 0 2024-04-23T10:17:48.842 INFO:tasks.workunit.client.0.smithi026.stdout:8/267: dread - d5/d24/d3a/d47/f4f zero size 2024-04-23T10:17:48.849 INFO:tasks.workunit.client.0.smithi026.stdout:8/268: symlink d5/d24/d3a/d47/l52 0 2024-04-23T10:17:48.851 INFO:tasks.workunit.client.0.smithi026.stdout:5/225: rmdir d0/d13/d45 0 2024-04-23T10:17:48.852 INFO:tasks.workunit.client.0.smithi026.stdout:5/226: truncate d0/f25 957507 0 2024-04-23T10:17:48.852 INFO:tasks.workunit.client.0.smithi026.stdout:5/227: fdatasync d0/f2a 0 2024-04-23T10:17:48.853 INFO:tasks.workunit.client.0.smithi026.stdout:8/269: creat d5/d24/d3a/d47/f53 x:0 0 0 2024-04-23T10:17:48.859 INFO:tasks.workunit.client.0.smithi026.stdout:2/305: write d3/dd/f18 [9318982,115901] 0 2024-04-23T10:17:48.942 INFO:tasks.workunit.client.0.smithi026.stdout:9/356: sync 2024-04-23T10:17:49.065 INFO:tasks.workunit.client.0.smithi026.stdout:7/309: sync 2024-04-23T10:17:49.065 INFO:tasks.workunit.client.0.smithi026.stdout:3/320: sync 2024-04-23T10:17:49.068 INFO:tasks.workunit.client.0.smithi026.stdout:9/357: symlink d13/d2a/d45/d3a/d48/l6a 0 2024-04-23T10:17:49.070 INFO:tasks.workunit.client.0.smithi026.stdout:2/306: dread d3/f2a [8388608,4194304] 0 2024-04-23T10:17:49.073 INFO:tasks.workunit.client.0.smithi026.stdout:7/310: dread dd/f35 [0,4194304] 0 2024-04-23T10:17:49.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/358: dwrite d13/d36/f4c [8388608,4194304] 0 2024-04-23T10:17:49.087 INFO:tasks.workunit.client.0.smithi026.stdout:9/359: dread - d13/d3e/f64 zero size 2024-04-23T10:17:49.099 INFO:tasks.workunit.client.0.smithi026.stdout:5/228: dwrite d0/d3c/f3d [0,4194304] 0 2024-04-23T10:17:49.105 INFO:tasks.workunit.client.0.smithi026.stdout:5/229: symlink d0/d12/l47 0 2024-04-23T10:17:49.112 INFO:tasks.workunit.client.0.smithi026.stdout:2/307: getdents d3/d35 0 2024-04-23T10:17:49.112 INFO:tasks.workunit.client.0.smithi026.stdout:8/270: dwrite d5/d24/d3a/d47/f48 [0,4194304] 0 2024-04-23T10:17:49.124 INFO:tasks.workunit.client.0.smithi026.stdout:5/230: unlink d0/f2d 0 2024-04-23T10:17:49.135 INFO:tasks.workunit.client.0.smithi026.stdout:8/271: rename d5/l2b to d5/d24/d3a/d3f/l54 0 2024-04-23T10:17:49.136 INFO:tasks.workunit.client.0.smithi026.stdout:2/308: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:49.136 INFO:tasks.workunit.client.0.smithi026.stdout:8/272: fsync d5/d24/d3a/d15/f18 0 2024-04-23T10:17:49.138 INFO:tasks.workunit.client.0.smithi026.stdout:5/231: rmdir d0/d13/d3a 39 2024-04-23T10:17:49.139 INFO:tasks.workunit.client.0.smithi026.stdout:5/232: write d0/f16 [2445765,48928] 0 2024-04-23T10:17:49.140 INFO:tasks.workunit.client.0.smithi026.stdout:8/273: rmdir d5/d9/d22 39 2024-04-23T10:17:49.141 INFO:tasks.workunit.client.0.smithi026.stdout:5/233: truncate d0/d12/f2b 198793 0 2024-04-23T10:17:49.141 INFO:tasks.workunit.client.0.smithi026.stdout:2/309: rmdir d3/d19/d1d/d49 39 2024-04-23T10:17:49.146 INFO:tasks.workunit.client.0.smithi026.stdout:5/234: write d0/d12/f32 [673240,82279] 0 2024-04-23T10:17:49.151 INFO:tasks.workunit.client.0.smithi026.stdout:9/360: rename d13/d2a/d45/d3a/d48 to d13/d2a/d45/d3a/d6b 0 2024-04-23T10:17:49.153 INFO:tasks.workunit.client.0.smithi026.stdout:8/274: stat d5/d24/l26 0 2024-04-23T10:17:49.154 INFO:tasks.workunit.client.0.smithi026.stdout:8/275: write d5/f28 [3783048,3191] 0 2024-04-23T10:17:49.156 INFO:tasks.workunit.client.0.smithi026.stdout:0/426: sync 2024-04-23T10:17:49.156 INFO:tasks.workunit.client.0.smithi026.stdout:4/217: sync 2024-04-23T10:17:49.156 INFO:tasks.workunit.client.0.smithi026.stdout:6/378: sync 2024-04-23T10:17:49.156 INFO:tasks.workunit.client.0.smithi026.stdout:1/282: sync 2024-04-23T10:17:49.157 INFO:tasks.workunit.client.0.smithi026.stdout:4/218: fdatasync d4/d7/f13 0 2024-04-23T10:17:49.159 INFO:tasks.workunit.client.0.smithi026.stdout:0/427: dread - d7/d43/d91/f9a zero size 2024-04-23T10:17:49.159 INFO:tasks.workunit.client.0.smithi026.stdout:1/283: fsync dd/d1a/d20/f4d 0 2024-04-23T10:17:49.159 INFO:tasks.workunit.client.0.smithi026.stdout:4/219: chown d4/d22/d2e 4 1 2024-04-23T10:17:49.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/276: mknod d5/d24/d3a/d47/c55 0 2024-04-23T10:17:49.163 INFO:tasks.workunit.client.0.smithi026.stdout:2/310: mknod d3/d19/d21/c70 0 2024-04-23T10:17:49.164 INFO:tasks.workunit.client.0.smithi026.stdout:4/220: read d4/d14/f25 [94940,104758] 0 2024-04-23T10:17:49.167 INFO:tasks.workunit.client.0.smithi026.stdout:8/277: dread d5/f28 [0,4194304] 0 2024-04-23T10:17:49.167 INFO:tasks.workunit.client.0.smithi026.stdout:8/278: write d5/d9/fa [447974,39107] 0 2024-04-23T10:17:49.168 INFO:tasks.workunit.client.0.smithi026.stdout:6/379: unlink d6/d13/f17 0 2024-04-23T10:17:49.169 INFO:tasks.workunit.client.0.smithi026.stdout:9/361: mkdir d13/d19/d6c 0 2024-04-23T10:17:49.173 INFO:tasks.workunit.client.0.smithi026.stdout:0/428: symlink d7/d43/d91/la3 0 2024-04-23T10:17:49.174 INFO:tasks.workunit.client.0.smithi026.stdout:7/311: sync 2024-04-23T10:17:49.175 INFO:tasks.workunit.client.0.smithi026.stdout:7/312: chown dd/c17 207 1 2024-04-23T10:17:49.176 INFO:tasks.workunit.client.0.smithi026.stdout:7/313: fsync dd/d45/f54 0 2024-04-23T10:17:49.177 INFO:tasks.workunit.client.0.smithi026.stdout:7/314: chown dd/d1d/d50 27187458 1 2024-04-23T10:17:49.178 INFO:tasks.workunit.client.0.smithi026.stdout:9/362: dwrite d13/d2a/d45/d3a/d4f/f59 [0,4194304] 0 2024-04-23T10:17:49.180 INFO:tasks.workunit.client.0.smithi026.stdout:5/235: rename d0/d12/c2c to d0/d13/c48 0 2024-04-23T10:17:49.181 INFO:tasks.workunit.client.0.smithi026.stdout:5/236: chown d0/d13/c38 117 1 2024-04-23T10:17:49.184 INFO:tasks.workunit.client.0.smithi026.stdout:9/363: read d13/f25 [2014219,23893] 0 2024-04-23T10:17:49.184 INFO:tasks.workunit.client.0.smithi026.stdout:4/221: unlink d4/d14/f2f 0 2024-04-23T10:17:49.200 INFO:tasks.workunit.client.0.smithi026.stdout:5/237: write d0/d13/f29 [290670,32114] 0 2024-04-23T10:17:49.203 INFO:tasks.workunit.client.0.smithi026.stdout:8/279: rename d5/d24/d3a to d5/d56 0 2024-04-23T10:17:49.205 INFO:tasks.workunit.client.0.smithi026.stdout:4/222: mkdir d4/d22/d4e 0 2024-04-23T10:17:49.215 INFO:tasks.workunit.client.0.smithi026.stdout:5/238: mkdir d0/d12/d49 0 2024-04-23T10:17:49.217 INFO:tasks.workunit.client.0.smithi026.stdout:1/284: dwrite dd/f12 [0,4194304] 0 2024-04-23T10:17:49.217 INFO:tasks.workunit.client.0.smithi026.stdout:1/285: readlink dd/d1a/d20/l47 0 2024-04-23T10:17:49.218 INFO:tasks.workunit.client.0.smithi026.stdout:4/223: creat d4/d7/d34/f4f x:0 0 0 2024-04-23T10:17:49.220 INFO:tasks.workunit.client.0.smithi026.stdout:9/364: mkdir d13/d2a/d45/d6d 0 2024-04-23T10:17:49.223 INFO:tasks.workunit.client.0.smithi026.stdout:0/429: creat d7/fa4 x:0 0 0 2024-04-23T10:17:49.224 INFO:tasks.workunit.client.0.smithi026.stdout:8/280: dwrite d5/f28 [0,4194304] 0 2024-04-23T10:17:49.231 INFO:tasks.workunit.client.0.smithi026.stdout:4/224: mknod d4/d14/c50 0 2024-04-23T10:17:49.233 INFO:tasks.workunit.client.0.smithi026.stdout:0/430: mkdir d7/d5b/da5 0 2024-04-23T10:17:49.234 INFO:tasks.workunit.client.0.smithi026.stdout:8/281: stat d5/d9/fb 0 2024-04-23T10:17:49.237 INFO:tasks.workunit.client.0.smithi026.stdout:7/315: getdents dd/d2c/d48 0 2024-04-23T10:17:49.238 INFO:tasks.workunit.client.0.smithi026.stdout:7/316: write dd/d1d/d50/f5c [868813,4015] 0 2024-04-23T10:17:49.243 INFO:tasks.workunit.client.0.smithi026.stdout:0/431: rename d7/d5b/c9f to d7/d8/d2d/d60/d77/ca6 0 2024-04-23T10:17:49.245 INFO:tasks.workunit.client.0.smithi026.stdout:8/282: creat d5/d56/d3f/f57 x:0 0 0 2024-04-23T10:17:49.248 INFO:tasks.workunit.client.0.smithi026.stdout:2/311: link d3/d19/d1d/d49/c4f d3/d19/d1d/c71 0 2024-04-23T10:17:49.248 INFO:tasks.workunit.client.0.smithi026.stdout:7/317: mknod dd/d2c/d48/c5f 0 2024-04-23T10:17:49.248 INFO:tasks.workunit.client.0.smithi026.stdout:9/365: creat d13/d1b/f6e x:0 0 0 2024-04-23T10:17:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:2/312: chown d3/d19/d31/l60 3834 1 2024-04-23T10:17:49.249 INFO:tasks.workunit.client.0.smithi026.stdout:4/225: mkdir d4/d7/d51 0 2024-04-23T10:17:49.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/432: creat d7/d5b/fa7 x:0 0 0 2024-04-23T10:17:49.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/433: dread - d7/d8/d2d/d60/d62/f40 zero size 2024-04-23T10:17:49.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/283: creat d5/d56/d33/f58 x:0 0 0 2024-04-23T10:17:49.252 INFO:tasks.workunit.client.0.smithi026.stdout:0/434: stat d7/f6f 0 2024-04-23T10:17:49.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/318: mkdir dd/d3f/d47/d4c/d60 0 2024-04-23T10:17:49.255 INFO:tasks.workunit.client.0.smithi026.stdout:2/313: rename d3 to d3/d72 22 2024-04-23T10:17:49.256 INFO:tasks.workunit.client.0.smithi026.stdout:7/319: truncate dd/d1d/f37 1800454 0 2024-04-23T10:17:49.259 INFO:tasks.workunit.client.0.smithi026.stdout:4/226: mkdir d4/d14/d30/d52 0 2024-04-23T10:17:49.259 INFO:tasks.workunit.client.0.smithi026.stdout:7/320: read dd/f51 [2225365,78922] 0 2024-04-23T10:17:49.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/284: symlink d5/d9/l59 0 2024-04-23T10:17:49.264 INFO:tasks.workunit.client.0.smithi026.stdout:0/435: creat d7/d8/d1e/d1d/fa8 x:0 0 0 2024-04-23T10:17:49.265 INFO:tasks.workunit.client.0.smithi026.stdout:2/314: dwrite d3/d19/d21/d23/d3a/d3c/f5f [0,4194304] 0 2024-04-23T10:17:49.268 INFO:tasks.workunit.client.0.smithi026.stdout:6/380: truncate d6/d33/f2c 3654438 0 2024-04-23T10:17:49.269 INFO:tasks.workunit.client.0.smithi026.stdout:4/227: creat d4/d7/d19/f53 x:0 0 0 2024-04-23T10:17:49.270 INFO:tasks.workunit.client.0.smithi026.stdout:7/321: mknod dd/d46/c61 0 2024-04-23T10:17:49.272 INFO:tasks.workunit.client.0.smithi026.stdout:0/436: mkdir d7/d8/d1e/d57/da9 0 2024-04-23T10:17:49.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/366: dread d13/d36/f4c [4194304,4194304] 0 2024-04-23T10:17:49.273 INFO:tasks.workunit.client.0.smithi026.stdout:0/437: write d7/d8/d2d/f4e [532369,76637] 0 2024-04-23T10:17:49.274 INFO:tasks.workunit.client.0.smithi026.stdout:8/285: dread d5/d56/d15/f34 [0,4194304] 0 2024-04-23T10:17:49.274 INFO:tasks.workunit.client.0.smithi026.stdout:2/315: creat d3/d19/d1d/d49/f73 x:0 0 0 2024-04-23T10:17:49.274 INFO:tasks.workunit.client.0.smithi026.stdout:9/367: readlink d13/d1b/l29 0 2024-04-23T10:17:49.280 INFO:tasks.workunit.client.0.smithi026.stdout:6/381: mknod d6/d21/d2f/d31/d52/c6e 0 2024-04-23T10:17:49.281 INFO:tasks.workunit.client.0.smithi026.stdout:7/322: creat dd/d1d/d50/f62 x:0 0 0 2024-04-23T10:17:49.283 INFO:tasks.workunit.client.0.smithi026.stdout:5/239: truncate d0/f3 609238 0 2024-04-23T10:17:49.283 INFO:tasks.workunit.client.0.smithi026.stdout:7/323: write dd/d45/f54 [3324416,8813] 0 2024-04-23T10:17:49.285 INFO:tasks.workunit.client.0.smithi026.stdout:9/368: unlink d13/f17 0 2024-04-23T10:17:49.285 INFO:tasks.workunit.client.0.smithi026.stdout:5/240: write d0/f16 [3110592,125804] 0 2024-04-23T10:17:49.286 INFO:tasks.workunit.client.0.smithi026.stdout:5/241: chown d0/f16 452 1 2024-04-23T10:17:49.290 INFO:tasks.workunit.client.0.smithi026.stdout:2/316: creat d3/d19/d21/d23/d3a/d65/f74 x:0 0 0 2024-04-23T10:17:49.291 INFO:tasks.workunit.client.0.smithi026.stdout:4/228: rename d4/d1b/c1e to d4/d42/c54 0 2024-04-23T10:17:49.291 INFO:tasks.workunit.client.0.smithi026.stdout:9/369: read d13/f1e [1954557,90046] 0 2024-04-23T10:17:49.292 INFO:tasks.workunit.client.0.smithi026.stdout:0/438: truncate d7/d8/f25 395742 0 2024-04-23T10:17:49.293 INFO:tasks.workunit.client.0.smithi026.stdout:4/229: write d4/f2b [1037769,106703] 0 2024-04-23T10:17:49.293 INFO:tasks.workunit.client.0.smithi026.stdout:9/370: dread - d13/d31/f53 zero size 2024-04-23T10:17:49.294 INFO:tasks.workunit.client.0.smithi026.stdout:3/321: dread d0/d1e/d30/d43/d29/f35 [0,4194304] 0 2024-04-23T10:17:49.298 INFO:tasks.workunit.client.0.smithi026.stdout:7/324: dwrite dd/d1d/d50/f5c [0,4194304] 0 2024-04-23T10:17:49.300 INFO:tasks.workunit.client.0.smithi026.stdout:2/317: symlink d3/d19/d21/d23/d3a/d65/l75 0 2024-04-23T10:17:49.301 INFO:tasks.workunit.client.0.smithi026.stdout:4/230: fsync d4/f2b 0 2024-04-23T10:17:49.301 INFO:tasks.workunit.client.0.smithi026.stdout:2/318: chown d3/d19/d21/d23/d3a/d3c/d5d/f67 0 1 2024-04-23T10:17:49.301 INFO:tasks.workunit.client.0.smithi026.stdout:4/231: chown d4/d14/f40 0 1 2024-04-23T10:17:49.303 INFO:tasks.workunit.client.0.smithi026.stdout:9/371: creat d13/d1b/d2b/f6f x:0 0 0 2024-04-23T10:17:49.305 INFO:tasks.workunit.client.0.smithi026.stdout:5/242: symlink d0/d12/d49/l4a 0 2024-04-23T10:17:49.306 INFO:tasks.workunit.client.0.smithi026.stdout:3/322: mknod d0/d1e/d30/d43/df/d63/c78 0 2024-04-23T10:17:49.307 INFO:tasks.workunit.client.0.smithi026.stdout:5/243: chown d0/d12/l47 31 1 2024-04-23T10:17:49.313 INFO:tasks.workunit.client.0.smithi026.stdout:4/232: rmdir d4/d7/d19 39 2024-04-23T10:17:49.316 INFO:tasks.workunit.client.0.smithi026.stdout:9/372: write d13/d2a/f2f [4272525,80775] 0 2024-04-23T10:17:49.317 INFO:tasks.workunit.client.0.smithi026.stdout:4/233: write d4/d14/f40 [824258,20266] 0 2024-04-23T10:17:49.319 INFO:tasks.workunit.client.0.smithi026.stdout:8/286: write d5/d56/f1f [423542,84109] 0 2024-04-23T10:17:49.320 INFO:tasks.workunit.client.0.smithi026.stdout:4/234: readlink d4/d7/d34/d36/d38/l39 0 2024-04-23T10:17:49.323 INFO:tasks.workunit.client.0.smithi026.stdout:8/287: truncate d5/d56/d47/f53 538006 0 2024-04-23T10:17:49.323 INFO:tasks.workunit.client.0.smithi026.stdout:6/382: dread f3 [0,4194304] 0 2024-04-23T10:17:49.326 INFO:tasks.workunit.client.0.smithi026.stdout:8/288: write d5/d56/d15/f18 [4247621,69878] 0 2024-04-23T10:17:49.327 INFO:tasks.workunit.client.0.smithi026.stdout:4/235: unlink d4/d14/f12 0 2024-04-23T10:17:49.330 INFO:tasks.workunit.client.0.smithi026.stdout:2/319: write d3/d35/d4c/f6a [533472,17592] 0 2024-04-23T10:17:49.332 INFO:tasks.workunit.client.0.smithi026.stdout:8/289: creat d5/d56/d3f/d4d/f5a x:0 0 0 2024-04-23T10:17:49.335 INFO:tasks.workunit.client.0.smithi026.stdout:9/373: dwrite d13/d1b/f33 [12582912,4194304] 0 2024-04-23T10:17:49.335 INFO:tasks.workunit.client.0.smithi026.stdout:3/323: truncate d0/d1e/d30/d43/fa 976656 0 2024-04-23T10:17:49.337 INFO:tasks.workunit.client.0.smithi026.stdout:0/439: dread d7/d8/d1e/d57/f5e [0,4194304] 0 2024-04-23T10:17:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:3/324: fsync d0/f6a 0 2024-04-23T10:17:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/290: write d5/d56/f1c [3281996,31204] 0 2024-04-23T10:17:49.338 INFO:tasks.workunit.client.0.smithi026.stdout:2/320: write d3/dd/f18 [3085920,41820] 0 2024-04-23T10:17:49.339 INFO:tasks.workunit.client.0.smithi026.stdout:6/383: fdatasync d6/d33/f2c 0 2024-04-23T10:17:49.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/321: stat d3/d19/d21/c40 0 2024-04-23T10:17:49.343 INFO:tasks.workunit.client.0.smithi026.stdout:7/325: dread dd/f51 [0,4194304] 0 2024-04-23T10:17:49.346 INFO:tasks.workunit.client.0.smithi026.stdout:4/236: dread f3 [0,4194304] 0 2024-04-23T10:17:49.347 INFO:tasks.workunit.client.0.smithi026.stdout:2/322: creat d3/d35/d4c/f76 x:0 0 0 2024-04-23T10:17:49.353 INFO:tasks.workunit.client.0.smithi026.stdout:3/325: chown d0/d1e/d30/d43/l2a 27079676 1 2024-04-23T10:17:49.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/374: dwrite d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:49.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/323: dread - d3/d19/d21/d23/d3a/d65/f74 zero size 2024-04-23T10:17:49.355 INFO:tasks.workunit.client.0.smithi026.stdout:6/384: mknod d6/c6f 0 2024-04-23T10:17:49.355 INFO:tasks.workunit.client.0.smithi026.stdout:3/326: chown d0/d1e/f37 440324 1 2024-04-23T10:17:49.356 INFO:tasks.workunit.client.0.smithi026.stdout:2/324: dread - d3/d19/d1d/d49/f73 zero size 2024-04-23T10:17:49.356 INFO:tasks.workunit.client.0.smithi026.stdout:6/385: stat d6/d21/d2f/l43 0 2024-04-23T10:17:49.357 INFO:tasks.workunit.client.0.smithi026.stdout:2/325: fsync d3/f2a 0 2024-04-23T10:17:49.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/326: dread dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:49.360 INFO:tasks.workunit.client.0.smithi026.stdout:0/440: mknod d7/d8/d2d/d60/d62/da2/caa 0 2024-04-23T10:17:49.364 INFO:tasks.workunit.client.0.smithi026.stdout:5/244: link d0/f3 d0/d13/f4b 0 2024-04-23T10:17:49.366 INFO:tasks.workunit.client.0.smithi026.stdout:0/441: write d7/d8/d2d/d60/d62/f89 [686105,125901] 0 2024-04-23T10:17:49.369 INFO:tasks.workunit.client.0.smithi026.stdout:5/245: dread - d0/d12/f3f zero size 2024-04-23T10:17:49.369 INFO:tasks.workunit.client.0.smithi026.stdout:3/327: rename d0/d1e/d30/d43/df/d1f to d0/d1e/d30/d43/d6c/d79 0 2024-04-23T10:17:49.371 INFO:tasks.workunit.client.0.smithi026.stdout:1/286: dread dd/d1a/d20/d25/f2f [0,4194304] 0 2024-04-23T10:17:49.371 INFO:tasks.workunit.client.0.smithi026.stdout:8/291: dread d5/d24/f27 [0,4194304] 0 2024-04-23T10:17:49.372 INFO:tasks.workunit.client.0.smithi026.stdout:9/375: creat d13/d3b/d68/f70 x:0 0 0 2024-04-23T10:17:49.373 INFO:tasks.workunit.client.0.smithi026.stdout:2/326: creat d3/d19/d31/f77 x:0 0 0 2024-04-23T10:17:49.375 INFO:tasks.workunit.client.0.smithi026.stdout:9/376: dread - d13/d3b/d68/f70 zero size 2024-04-23T10:17:49.377 INFO:tasks.workunit.client.0.smithi026.stdout:6/386: rename d6/d13/c30 to d6/d21/d2f/d31/c70 0 2024-04-23T10:17:49.379 INFO:tasks.workunit.client.0.smithi026.stdout:1/287: unlink dd/d1a/d20/d25/l62 0 2024-04-23T10:17:49.380 INFO:tasks.workunit.client.0.smithi026.stdout:3/328: mknod d0/d1e/d30/d43/df/d63/c7a 0 2024-04-23T10:17:49.381 INFO:tasks.workunit.client.0.smithi026.stdout:5/246: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:17:49.381 INFO:tasks.workunit.client.0.smithi026.stdout:2/327: rmdir d3/d19/d21/d23/d3a/d65 39 2024-04-23T10:17:49.382 INFO:tasks.workunit.client.0.smithi026.stdout:3/329: write d0/fc [186260,44869] 0 2024-04-23T10:17:49.383 INFO:tasks.workunit.client.0.smithi026.stdout:1/288: chown dd/d1a/d23/c59 160 1 2024-04-23T10:17:49.386 INFO:tasks.workunit.client.0.smithi026.stdout:5/247: rmdir d0/d3c 39 2024-04-23T10:17:49.386 INFO:tasks.workunit.client.0.smithi026.stdout:7/327: dread dd/d44/f23 [0,4194304] 0 2024-04-23T10:17:49.386 INFO:tasks.workunit.client.0.smithi026.stdout:5/248: stat d0/f2a 0 2024-04-23T10:17:49.387 INFO:tasks.workunit.client.0.smithi026.stdout:8/292: creat d5/d9/f5b x:0 0 0 2024-04-23T10:17:49.388 INFO:tasks.workunit.client.0.smithi026.stdout:7/328: dread - dd/d1d/d50/f55 zero size 2024-04-23T10:17:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:4/237: dread d4/f2b [0,4194304] 0 2024-04-23T10:17:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:9/377: creat d13/d2a/d45/d6d/f71 x:0 0 0 2024-04-23T10:17:49.389 INFO:tasks.workunit.client.0.smithi026.stdout:1/289: mkdir dd/d1a/d6a 0 2024-04-23T10:17:49.390 INFO:tasks.workunit.client.0.smithi026.stdout:8/293: write d5/d56/d47/f48 [1003628,86915] 0 2024-04-23T10:17:49.397 INFO:tasks.workunit.client.0.smithi026.stdout:6/387: dwrite d6/d21/d2f/d31/f6c [4194304,4194304] 0 2024-04-23T10:17:49.399 INFO:tasks.workunit.client.0.smithi026.stdout:5/249: dread d0/d12/f1b [4194304,4194304] 0 2024-04-23T10:17:49.401 INFO:tasks.workunit.client.0.smithi026.stdout:8/294: read d5/d9/f10 [4821220,60388] 0 2024-04-23T10:17:49.402 INFO:tasks.workunit.client.0.smithi026.stdout:7/329: dwrite dd/f35 [4194304,4194304] 0 2024-04-23T10:17:49.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/295: fdatasync d5/d56/d47/f53 0 2024-04-23T10:17:49.405 INFO:tasks.workunit.client.0.smithi026.stdout:7/330: fsync dd/f13 0 2024-04-23T10:17:49.409 INFO:tasks.workunit.client.0.smithi026.stdout:6/388: dread d6/d13/d49/f5b [0,4194304] 0 2024-04-23T10:17:49.410 INFO:tasks.workunit.client.0.smithi026.stdout:9/378: mkdir d13/d36/d66/d72 0 2024-04-23T10:17:49.412 INFO:tasks.workunit.client.0.smithi026.stdout:9/379: chown d13/l23 3634376 1 2024-04-23T10:17:49.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/238: creat d4/d7/d34/d36/f55 x:0 0 0 2024-04-23T10:17:49.413 INFO:tasks.workunit.client.0.smithi026.stdout:2/328: truncate d3/f6 427567 0 2024-04-23T10:17:49.415 INFO:tasks.workunit.client.0.smithi026.stdout:3/330: truncate d0/d1e/d30/d43/d29/f35 540355 0 2024-04-23T10:17:49.418 INFO:tasks.workunit.client.0.smithi026.stdout:9/380: write d13/d3e/f5e [364042,64961] 0 2024-04-23T10:17:49.420 INFO:tasks.workunit.client.0.smithi026.stdout:5/250: creat d0/d13/d3a/f4c x:0 0 0 2024-04-23T10:17:49.424 INFO:tasks.workunit.client.0.smithi026.stdout:2/329: rmdir d3/d19 39 2024-04-23T10:17:49.424 INFO:tasks.workunit.client.0.smithi026.stdout:4/239: write d4/d7/f3e [1008875,16296] 0 2024-04-23T10:17:49.424 INFO:tasks.workunit.client.0.smithi026.stdout:7/331: dwrite dd/d44/f5e [0,4194304] 0 2024-04-23T10:17:49.425 INFO:tasks.workunit.client.0.smithi026.stdout:6/389: dwrite d6/f5a [0,4194304] 0 2024-04-23T10:17:49.429 INFO:tasks.workunit.client.0.smithi026.stdout:3/331: creat d0/d1e/d30/d43/df/d63/f7b x:0 0 0 2024-04-23T10:17:49.432 INFO:tasks.workunit.client.0.smithi026.stdout:9/381: creat d13/d3b/d68/f73 x:0 0 0 2024-04-23T10:17:49.432 INFO:tasks.workunit.client.0.smithi026.stdout:8/296: dread d5/d9/f10 [0,4194304] 0 2024-04-23T10:17:49.432 INFO:tasks.workunit.client.0.smithi026.stdout:5/251: mkdir d0/d12/d49/d4d 0 2024-04-23T10:17:49.435 INFO:tasks.workunit.client.0.smithi026.stdout:4/240: write d4/d7/d34/f37 [4563249,99597] 0 2024-04-23T10:17:49.435 INFO:tasks.workunit.client.0.smithi026.stdout:6/390: rmdir d6/d21/d2f/d31 39 2024-04-23T10:17:49.437 INFO:tasks.workunit.client.0.smithi026.stdout:3/332: mknod d0/d1e/d23/d52/d75/c7c 0 2024-04-23T10:17:49.439 INFO:tasks.workunit.client.0.smithi026.stdout:6/391: write d6/d21/d2f/d32/d53/f54 [977962,129651] 0 2024-04-23T10:17:49.440 INFO:tasks.workunit.client.0.smithi026.stdout:5/252: symlink d0/d13/d3a/l4e 0 2024-04-23T10:17:49.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/332: dwrite dd/d1d/d50/f55 [0,4194304] 0 2024-04-23T10:17:49.445 INFO:tasks.workunit.client.0.smithi026.stdout:7/333: fdatasync dd/d2c/d48/f59 0 2024-04-23T10:17:49.484 INFO:tasks.workunit.client.0.smithi026.stdout:1/290: dread dd/d1a/d20/d25/f38 [0,4194304] 0 2024-04-23T10:17:49.484 INFO:tasks.workunit.client.0.smithi026.stdout:6/392: creat d6/d13/d15/f71 x:0 0 0 2024-04-23T10:17:49.484 INFO:tasks.workunit.client.0.smithi026.stdout:5/253: unlink d0/d12/f27 0 2024-04-23T10:17:49.485 INFO:tasks.workunit.client.0.smithi026.stdout:8/297: dread d5/d56/d15/f31 [0,4194304] 0 2024-04-23T10:17:49.486 INFO:tasks.workunit.client.0.smithi026.stdout:2/330: write d3/dd/f30 [164273,98663] 0 2024-04-23T10:17:49.487 INFO:tasks.workunit.client.0.smithi026.stdout:6/393: write d6/d21/d2f/d32/f55 [695731,16679] 0 2024-04-23T10:17:49.488 INFO:tasks.workunit.client.0.smithi026.stdout:7/334: read dd/f41 [147408,52619] 0 2024-04-23T10:17:49.489 INFO:tasks.workunit.client.0.smithi026.stdout:5/254: creat d0/d12/f4f x:0 0 0 2024-04-23T10:17:49.490 INFO:tasks.workunit.client.0.smithi026.stdout:9/382: getdents d13/d2a/d45/d6d 0 2024-04-23T10:17:49.490 INFO:tasks.workunit.client.0.smithi026.stdout:8/298: stat d5/d9/d22/c25 0 2024-04-23T10:17:49.490 INFO:tasks.workunit.client.0.smithi026.stdout:7/335: read dd/f35 [3584062,116861] 0 2024-04-23T10:17:49.491 INFO:tasks.workunit.client.0.smithi026.stdout:7/336: chown dd/d44 34 1 2024-04-23T10:17:49.491 INFO:tasks.workunit.client.0.smithi026.stdout:7/337: chown dd/d46 120 1 2024-04-23T10:17:49.492 INFO:tasks.workunit.client.0.smithi026.stdout:6/394: creat d6/d21/f72 x:0 0 0 2024-04-23T10:17:49.496 INFO:tasks.workunit.client.0.smithi026.stdout:6/395: truncate d6/d33/f2c 4074688 0 2024-04-23T10:17:49.496 INFO:tasks.workunit.client.0.smithi026.stdout:8/299: symlink d5/l5c 0 2024-04-23T10:17:49.497 INFO:tasks.workunit.client.0.smithi026.stdout:0/442: dread d7/f38 [0,4194304] 0 2024-04-23T10:17:49.499 INFO:tasks.workunit.client.0.smithi026.stdout:2/331: dwrite d3/d35/d4c/f6a [0,4194304] 0 2024-04-23T10:17:49.502 INFO:tasks.workunit.client.0.smithi026.stdout:5/255: rmdir d0/d12/d49/d4d 0 2024-04-23T10:17:49.504 INFO:tasks.workunit.client.0.smithi026.stdout:9/383: link d13/d3b/d4e/l51 d13/d2a/d45/d3a/l74 0 2024-04-23T10:17:49.506 INFO:tasks.workunit.client.0.smithi026.stdout:0/443: creat d7/d8/d2d/fab x:0 0 0 2024-04-23T10:17:49.507 INFO:tasks.workunit.client.0.smithi026.stdout:7/338: dwrite dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:49.509 INFO:tasks.workunit.client.0.smithi026.stdout:9/384: write d13/d2a/d45/d3a/d6b/f55 [5058643,14074] 0 2024-04-23T10:17:49.509 INFO:tasks.workunit.client.0.smithi026.stdout:2/332: creat d3/d19/d4d/f78 x:0 0 0 2024-04-23T10:17:49.509 INFO:tasks.workunit.client.0.smithi026.stdout:6/396: link d6/c1e d6/d13/c73 0 2024-04-23T10:17:49.509 INFO:tasks.workunit.client.0.smithi026.stdout:8/300: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:49.510 INFO:tasks.workunit.client.0.smithi026.stdout:7/339: chown dd/d1d/l2a 27217 1 2024-04-23T10:17:49.510 INFO:tasks.workunit.client.0.smithi026.stdout:6/397: chown d6/d21/d58 77457550 1 2024-04-23T10:17:49.511 INFO:tasks.workunit.client.0.smithi026.stdout:8/301: fsync d5/d56/d3f/f57 0 2024-04-23T10:17:49.512 INFO:tasks.workunit.client.0.smithi026.stdout:6/398: read d6/f5a [2363755,109013] 0 2024-04-23T10:17:49.512 INFO:tasks.workunit.client.0.smithi026.stdout:9/385: truncate d13/d1b/f6e 1043575 0 2024-04-23T10:17:49.513 INFO:tasks.workunit.client.0.smithi026.stdout:5/256: rename d0/d13/l22 to d0/d3c/l50 0 2024-04-23T10:17:49.515 INFO:tasks.workunit.client.0.smithi026.stdout:5/257: write d0/f39 [4374347,30283] 0 2024-04-23T10:17:49.517 INFO:tasks.workunit.client.0.smithi026.stdout:7/340: rmdir dd/d3f/d47/d4c 39 2024-04-23T10:17:49.519 INFO:tasks.workunit.client.0.smithi026.stdout:7/341: read - dd/d1d/d50/f62 zero size 2024-04-23T10:17:49.519 INFO:tasks.workunit.client.0.smithi026.stdout:0/444: dwrite d7/d8/d1e/d2a/f47 [0,4194304] 0 2024-04-23T10:17:49.523 INFO:tasks.workunit.client.0.smithi026.stdout:8/302: dwrite d5/d56/d33/f44 [0,4194304] 0 2024-04-23T10:17:49.524 INFO:tasks.workunit.client.0.smithi026.stdout:0/445: truncate d7/d8/d2d/d60/d62/f40 927331 0 2024-04-23T10:17:49.525 INFO:tasks.workunit.client.0.smithi026.stdout:8/303: readlink d5/d56/d3f/d4d/d3e/l4c 0 2024-04-23T10:17:49.533 INFO:tasks.workunit.client.0.smithi026.stdout:0/446: stat d7/c13 0 2024-04-23T10:17:49.544 INFO:tasks.workunit.client.0.smithi026.stdout:8/304: creat d5/d56/d15/f5d x:0 0 0 2024-04-23T10:17:49.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/333: read d3/d19/f5a [84930,47138] 0 2024-04-23T10:17:49.546 INFO:tasks.workunit.client.0.smithi026.stdout:7/342: rename dd/f34 to dd/d1d/d50/f63 0 2024-04-23T10:17:49.548 INFO:tasks.workunit.client.0.smithi026.stdout:8/305: symlink d5/l5e 0 2024-04-23T10:17:49.551 INFO:tasks.workunit.client.0.smithi026.stdout:8/306: write d5/d56/f1f [340914,15735] 0 2024-04-23T10:17:49.551 INFO:tasks.workunit.client.0.smithi026.stdout:2/334: creat d3/dd/d4b/f79 x:0 0 0 2024-04-23T10:17:49.552 INFO:tasks.workunit.client.0.smithi026.stdout:6/399: rename d6/d21/d2f/d32/d53/f54 to d6/d21/d2f/d31/f74 0 2024-04-23T10:17:49.555 INFO:tasks.workunit.client.0.smithi026.stdout:0/447: dwrite d7/d8/d1e/d1d/f73 [0,4194304] 0 2024-04-23T10:17:49.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/335: truncate d3/d35/d4c/f76 118227 0 2024-04-23T10:17:49.556 INFO:tasks.workunit.client.0.smithi026.stdout:8/307: truncate d5/d56/d33/f44 4754787 0 2024-04-23T10:17:49.563 INFO:tasks.workunit.client.0.smithi026.stdout:0/448: fsync d7/f38 0 2024-04-23T10:17:49.564 INFO:tasks.workunit.client.0.smithi026.stdout:2/336: creat d3/dd/d4b/f7a x:0 0 0 2024-04-23T10:17:49.565 INFO:tasks.workunit.client.0.smithi026.stdout:8/308: mknod d5/d56/d47/c5f 0 2024-04-23T10:17:49.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/258: creat d0/d3c/f51 x:0 0 0 2024-04-23T10:17:49.566 INFO:tasks.workunit.client.0.smithi026.stdout:0/449: dread - d7/d8/d1e/f72 zero size 2024-04-23T10:17:49.573 INFO:tasks.workunit.client.0.smithi026.stdout:7/343: creat dd/d3f/d47/d4c/f64 x:0 0 0 2024-04-23T10:17:49.573 INFO:tasks.workunit.client.0.smithi026.stdout:6/400: creat d6/d21/d58/f75 x:0 0 0 2024-04-23T10:17:49.573 INFO:tasks.workunit.client.0.smithi026.stdout:6/401: write d6/fe [5410889,77077] 0 2024-04-23T10:17:49.574 INFO:tasks.workunit.client.0.smithi026.stdout:2/337: creat d3/d19/d21/d23/d3a/d3c/d5d/f7b x:0 0 0 2024-04-23T10:17:49.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/309: dwrite d5/d56/f1c [0,4194304] 0 2024-04-23T10:17:49.576 INFO:tasks.workunit.client.0.smithi026.stdout:6/402: dread - d6/d21/d2f/f57 zero size 2024-04-23T10:17:49.576 INFO:tasks.workunit.client.0.smithi026.stdout:2/338: readlink d3/d19/d21/l39 0 2024-04-23T10:17:49.577 INFO:tasks.workunit.client.0.smithi026.stdout:2/339: dread - d3/d19/d21/d23/f29 zero size 2024-04-23T10:17:49.578 INFO:tasks.workunit.client.0.smithi026.stdout:2/340: fdatasync d3/d19/d21/d23/d3a/d3c/d5d/f67 0 2024-04-23T10:17:49.580 INFO:tasks.workunit.client.0.smithi026.stdout:5/259: symlink d0/d3c/l52 0 2024-04-23T10:17:49.581 INFO:tasks.workunit.client.0.smithi026.stdout:5/260: chown d0/d13/c38 2 1 2024-04-23T10:17:49.583 INFO:tasks.workunit.client.0.smithi026.stdout:5/261: truncate d0/d13/d3a/f4c 365495 0 2024-04-23T10:17:49.583 INFO:tasks.workunit.client.0.smithi026.stdout:7/344: write dd/f35 [1242688,101689] 0 2024-04-23T10:17:49.587 INFO:tasks.workunit.client.0.smithi026.stdout:0/450: truncate d7/d8/d1e/f41 1850981 0 2024-04-23T10:17:49.589 INFO:tasks.workunit.client.0.smithi026.stdout:6/403: symlink d6/d21/d2f/d31/l76 0 2024-04-23T10:17:49.589 INFO:tasks.workunit.client.0.smithi026.stdout:8/310: write d5/d56/d15/f31 [3557992,20608] 0 2024-04-23T10:17:49.595 INFO:tasks.workunit.client.0.smithi026.stdout:8/311: creat d5/d9/d22/f60 x:0 0 0 2024-04-23T10:17:49.597 INFO:tasks.workunit.client.0.smithi026.stdout:0/451: mknod d7/d8/d1e/cac 0 2024-04-23T10:17:49.598 INFO:tasks.workunit.client.0.smithi026.stdout:8/312: dread d5/d56/d47/f53 [0,4194304] 0 2024-04-23T10:17:49.602 INFO:tasks.workunit.client.0.smithi026.stdout:9/386: dread d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:49.604 INFO:tasks.workunit.client.0.smithi026.stdout:9/387: dread - d13/d3b/d5b/f63 zero size 2024-04-23T10:17:49.606 INFO:tasks.workunit.client.0.smithi026.stdout:8/313: mknod d5/d56/d15/c61 0 2024-04-23T10:17:49.606 INFO:tasks.workunit.client.0.smithi026.stdout:6/404: dwrite d6/f5a [4194304,4194304] 0 2024-04-23T10:17:49.606 INFO:tasks.workunit.client.0.smithi026.stdout:7/345: dread dd/f11 [0,4194304] 0 2024-04-23T10:17:49.608 INFO:tasks.workunit.client.0.smithi026.stdout:5/262: rename d0/c11 to d0/d13/c53 0 2024-04-23T10:17:49.608 INFO:tasks.workunit.client.0.smithi026.stdout:9/388: truncate d13/f2d 1478089 0 2024-04-23T10:17:49.609 INFO:tasks.workunit.client.0.smithi026.stdout:8/314: symlink d5/d56/d3f/d4d/l62 0 2024-04-23T10:17:49.609 INFO:tasks.workunit.client.0.smithi026.stdout:5/263: truncate d0/f16 4222437 0 2024-04-23T10:17:49.610 INFO:tasks.workunit.client.0.smithi026.stdout:0/452: rename d7/d8/d1e/d1d to d7/d8/d1e/d1d/d2f/d6c/dad 22 2024-04-23T10:17:49.612 INFO:tasks.workunit.client.0.smithi026.stdout:9/389: write d13/d2a/d45/d3a/d4f/f59 [10760,63960] 0 2024-04-23T10:17:49.613 INFO:tasks.workunit.client.0.smithi026.stdout:8/315: symlink d5/d56/d15/l63 0 2024-04-23T10:17:49.617 INFO:tasks.workunit.client.0.smithi026.stdout:5/264: write d0/d3c/f3d [5319999,104785] 0 2024-04-23T10:17:49.617 INFO:tasks.workunit.client.0.smithi026.stdout:8/316: read d5/d24/f27 [1169665,117340] 0 2024-04-23T10:17:49.618 INFO:tasks.workunit.client.0.smithi026.stdout:9/390: read d13/d1b/f6e [210614,108040] 0 2024-04-23T10:17:49.618 INFO:tasks.workunit.client.0.smithi026.stdout:7/346: dread dd/f11 [0,4194304] 0 2024-04-23T10:17:49.620 INFO:tasks.workunit.client.0.smithi026.stdout:6/405: dwrite d6/d21/d2f/d31/f6c [4194304,4194304] 0 2024-04-23T10:17:49.625 INFO:tasks.workunit.client.0.smithi026.stdout:7/347: write dd/d44/f5e [1334880,67594] 0 2024-04-23T10:17:49.627 INFO:tasks.workunit.client.0.smithi026.stdout:5/265: write d0/d12/f2b [3014395,18391] 0 2024-04-23T10:17:49.627 INFO:tasks.workunit.client.0.smithi026.stdout:0/453: link d7/d8/d1e/l1b d7/d8/d1e/d57/lae 0 2024-04-23T10:17:49.631 INFO:tasks.workunit.client.0.smithi026.stdout:8/317: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:49.632 INFO:tasks.workunit.client.0.smithi026.stdout:5/266: dread d0/d13/d3a/f4c [0,4194304] 0 2024-04-23T10:17:49.634 INFO:tasks.workunit.client.0.smithi026.stdout:8/318: chown d5/ce 3714 1 2024-04-23T10:17:49.634 INFO:tasks.workunit.client.0.smithi026.stdout:5/267: chown d0/d12/l47 9629 1 2024-04-23T10:17:49.635 INFO:tasks.workunit.client.0.smithi026.stdout:9/391: dwrite d13/d1b/d26/f30 [0,4194304] 0 2024-04-23T10:17:49.637 INFO:tasks.workunit.client.0.smithi026.stdout:9/392: fsync d13/d3b/d5b/f63 0 2024-04-23T10:17:49.638 INFO:tasks.workunit.client.0.smithi026.stdout:7/348: rename dd/d2c/c42 to dd/d46/c65 0 2024-04-23T10:17:49.638 INFO:tasks.workunit.client.0.smithi026.stdout:6/406: link d6/d33/l34 d6/d21/d2f/d32/l77 0 2024-04-23T10:17:49.639 INFO:tasks.workunit.client.0.smithi026.stdout:0/454: creat d7/da1/faf x:0 0 0 2024-04-23T10:17:49.641 INFO:tasks.workunit.client.0.smithi026.stdout:9/393: rmdir d13 39 2024-04-23T10:17:49.641 INFO:tasks.workunit.client.0.smithi026.stdout:0/455: read d7/d8/f9 [2322084,18841] 0 2024-04-23T10:17:49.642 INFO:tasks.workunit.client.0.smithi026.stdout:0/456: chown d7/d8/d1e/d1d/f92 2 1 2024-04-23T10:17:49.642 INFO:tasks.workunit.client.0.smithi026.stdout:6/407: creat d6/d21/d58/f78 x:0 0 0 2024-04-23T10:17:49.644 INFO:tasks.workunit.client.0.smithi026.stdout:8/319: mkdir d5/d9/d64 0 2024-04-23T10:17:49.645 INFO:tasks.workunit.client.0.smithi026.stdout:7/349: symlink dd/d1d/d50/d58/l66 0 2024-04-23T10:17:49.646 INFO:tasks.workunit.client.0.smithi026.stdout:0/457: symlink d7/d8/d1e/d1d/d2f/d6c/lb0 0 2024-04-23T10:17:49.647 INFO:tasks.workunit.client.0.smithi026.stdout:7/350: fsync dd/d1d/d50/f5c 0 2024-04-23T10:17:49.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/268: creat d0/f54 x:0 0 0 2024-04-23T10:17:49.649 INFO:tasks.workunit.client.0.smithi026.stdout:8/320: mkdir d5/d9/d22/d65 0 2024-04-23T10:17:49.650 INFO:tasks.workunit.client.0.smithi026.stdout:7/351: write dd/d44/f26 [13337,114609] 0 2024-04-23T10:17:49.651 INFO:tasks.workunit.client.0.smithi026.stdout:9/394: rename d13/d36/f4c to d13/d3b/d68/f75 0 2024-04-23T10:17:49.654 INFO:tasks.workunit.client.0.smithi026.stdout:6/408: dwrite d6/d13/d15/f4c [0,4194304] 0 2024-04-23T10:17:49.657 INFO:tasks.workunit.client.0.smithi026.stdout:7/352: read dd/d1d/d50/f63 [151714,70753] 0 2024-04-23T10:17:49.658 INFO:tasks.workunit.client.0.smithi026.stdout:9/395: mkdir d13/d3b/d4e/d76 0 2024-04-23T10:17:49.659 INFO:tasks.workunit.client.0.smithi026.stdout:9/396: fsync d13/d2a/f2f 0 2024-04-23T10:17:49.659 INFO:tasks.workunit.client.0.smithi026.stdout:7/353: truncate dd/d44/f5e 4880094 0 2024-04-23T10:17:49.661 INFO:tasks.workunit.client.0.smithi026.stdout:0/458: dread d7/f6f [0,4194304] 0 2024-04-23T10:17:49.662 INFO:tasks.workunit.client.0.smithi026.stdout:0/459: stat d7/d8/d2d/d60/d62/da2 0 2024-04-23T10:17:49.663 INFO:tasks.workunit.client.0.smithi026.stdout:0/460: write d7/d8/d2d/d60/d62/f40 [781362,50721] 0 2024-04-23T10:17:49.664 INFO:tasks.workunit.client.0.smithi026.stdout:5/269: rename d0/d12/l47 to d0/d3c/l55 0 2024-04-23T10:17:49.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/321: creat d5/d24/f66 x:0 0 0 2024-04-23T10:17:49.666 INFO:tasks.workunit.client.0.smithi026.stdout:7/354: dread dd/f36 [0,4194304] 0 2024-04-23T10:17:49.670 INFO:tasks.workunit.client.0.smithi026.stdout:6/409: link d6/d21/d2f/f57 d6/d21/d2f/d31/f79 0 2024-04-23T10:17:49.671 INFO:tasks.workunit.client.0.smithi026.stdout:5/270: dwrite d0/f39 [0,4194304] 0 2024-04-23T10:17:49.674 INFO:tasks.workunit.client.0.smithi026.stdout:8/322: mknod d5/d56/d33/c67 0 2024-04-23T10:17:49.674 INFO:tasks.workunit.client.0.smithi026.stdout:7/355: write dd/d44/d38/f4e [483998,125577] 0 2024-04-23T10:17:49.676 INFO:tasks.workunit.client.0.smithi026.stdout:5/271: chown d0/d3c/l46 11450 1 2024-04-23T10:17:49.680 INFO:tasks.workunit.client.0.smithi026.stdout:6/410: symlink d6/d13/l7a 0 2024-04-23T10:17:49.680 INFO:tasks.workunit.client.0.smithi026.stdout:9/397: rename d13/d2a/d45/d3a/f4a to d13/d1b/f77 0 2024-04-23T10:17:49.682 INFO:tasks.workunit.client.0.smithi026.stdout:6/411: write d6/d13/d15/f4c [2749379,58065] 0 2024-04-23T10:17:49.686 INFO:tasks.workunit.client.0.smithi026.stdout:7/356: creat dd/f67 x:0 0 0 2024-04-23T10:17:49.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/357: chown dd/f67 167951 1 2024-04-23T10:17:49.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/398: fdatasync d13/f2d 0 2024-04-23T10:17:49.688 INFO:tasks.workunit.client.0.smithi026.stdout:9/399: chown d13/d2a/d45/d3a/d4f/d61 412810 1 2024-04-23T10:17:49.691 INFO:tasks.workunit.client.0.smithi026.stdout:6/412: creat d6/d21/d2f/d37/d4f/f7b x:0 0 0 2024-04-23T10:17:49.694 INFO:tasks.workunit.client.0.smithi026.stdout:8/323: rename d5/f23 to d5/d9/f68 0 2024-04-23T10:17:49.695 INFO:tasks.workunit.client.0.smithi026.stdout:9/400: unlink d13/d3b/d68/f73 0 2024-04-23T10:17:49.695 INFO:tasks.workunit.client.0.smithi026.stdout:5/272: write d0/d13/f14 [8626713,54894] 0 2024-04-23T10:17:49.697 INFO:tasks.workunit.client.0.smithi026.stdout:6/413: creat d6/d13/d15/f7c x:0 0 0 2024-04-23T10:17:49.698 INFO:tasks.workunit.client.0.smithi026.stdout:6/414: rename d6/d13/d49 to d6/d13/d49/d64/d7d 22 2024-04-23T10:17:49.699 INFO:tasks.workunit.client.0.smithi026.stdout:6/415: chown d6/d21/d2f/d31/f74 841 1 2024-04-23T10:17:49.701 INFO:tasks.workunit.client.0.smithi026.stdout:7/358: getdents dd/d44 0 2024-04-23T10:17:49.701 INFO:tasks.workunit.client.0.smithi026.stdout:6/416: rmdir d6/d21/d58 39 2024-04-23T10:17:49.702 INFO:tasks.workunit.client.0.smithi026.stdout:9/401: truncate d13/f2d 2275961 0 2024-04-23T10:17:49.703 INFO:tasks.workunit.client.0.smithi026.stdout:8/324: creat d5/d56/f69 x:0 0 0 2024-04-23T10:17:49.703 INFO:tasks.workunit.client.0.smithi026.stdout:5/273: dwrite d0/f25 [0,4194304] 0 2024-04-23T10:17:49.703 INFO:tasks.workunit.client.0.smithi026.stdout:7/359: write dd/f67 [203510,93796] 0 2024-04-23T10:17:49.705 INFO:tasks.workunit.client.0.smithi026.stdout:7/360: dread - dd/d2c/d48/f59 zero size 2024-04-23T10:17:49.706 INFO:tasks.workunit.client.0.smithi026.stdout:9/402: mkdir d13/d36/d66/d78 0 2024-04-23T10:17:49.709 INFO:tasks.workunit.client.0.smithi026.stdout:5/274: write d0/f2 [1769234,106040] 0 2024-04-23T10:17:49.709 INFO:tasks.workunit.client.0.smithi026.stdout:7/361: fdatasync dd/ff 0 2024-04-23T10:17:49.714 INFO:tasks.workunit.client.0.smithi026.stdout:6/417: dwrite d6/d21/d2f/d37/f6d [0,4194304] 0 2024-04-23T10:17:49.715 INFO:tasks.workunit.client.0.smithi026.stdout:5/275: unlink d0/f2 0 2024-04-23T10:17:49.715 INFO:tasks.workunit.client.0.smithi026.stdout:9/403: mkdir d13/d1b/d79 0 2024-04-23T10:17:49.717 INFO:tasks.workunit.client.0.smithi026.stdout:8/325: link d5/d56/d47/c5f d5/d56/d33/c6a 0 2024-04-23T10:17:49.719 INFO:tasks.workunit.client.0.smithi026.stdout:9/404: read d13/d1b/d26/f2e [3870851,15102] 0 2024-04-23T10:17:49.720 INFO:tasks.workunit.client.0.smithi026.stdout:5/276: creat d0/d12/f56 x:0 0 0 2024-04-23T10:17:49.720 INFO:tasks.workunit.client.0.smithi026.stdout:9/405: write d13/d3e/f5e [1300786,23770] 0 2024-04-23T10:17:49.721 INFO:tasks.workunit.client.0.smithi026.stdout:6/418: mknod d6/d21/d2f/d37/d4f/c7e 0 2024-04-23T10:17:49.723 INFO:tasks.workunit.client.0.smithi026.stdout:7/362: write dd/f51 [264576,56949] 0 2024-04-23T10:17:49.725 INFO:tasks.workunit.client.0.smithi026.stdout:8/326: rename d5/d56/f69 to d5/d56/d3f/f6b 0 2024-04-23T10:17:49.727 INFO:tasks.workunit.client.0.smithi026.stdout:9/406: dread d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:49.727 INFO:tasks.workunit.client.0.smithi026.stdout:7/363: symlink dd/d2c/l68 0 2024-04-23T10:17:49.728 INFO:tasks.workunit.client.0.smithi026.stdout:5/277: mkdir d0/d3c/d57 0 2024-04-23T10:17:49.729 INFO:tasks.workunit.client.0.smithi026.stdout:6/419: mknod d6/d13/d49/d64/c7f 0 2024-04-23T10:17:49.732 INFO:tasks.workunit.client.0.smithi026.stdout:6/420: creat d6/d13/d49/f80 x:0 0 0 2024-04-23T10:17:49.734 INFO:tasks.workunit.client.0.smithi026.stdout:9/407: dwrite d13/d1b/d2b/f6f [0,4194304] 0 2024-04-23T10:17:49.741 INFO:tasks.workunit.client.0.smithi026.stdout:7/364: truncate dd/d44/f5e 2554319 0 2024-04-23T10:17:49.744 INFO:tasks.workunit.client.0.smithi026.stdout:9/408: creat d13/d3b/f7a x:0 0 0 2024-04-23T10:17:49.744 INFO:tasks.workunit.client.0.smithi026.stdout:7/365: truncate dd/f36 1142212 0 2024-04-23T10:17:49.744 INFO:tasks.workunit.client.0.smithi026.stdout:5/278: dwrite d0/f21 [0,4194304] 0 2024-04-23T10:17:49.745 INFO:tasks.workunit.client.0.smithi026.stdout:7/366: write dd/d1d/f37 [916293,55884] 0 2024-04-23T10:17:49.748 INFO:tasks.workunit.client.0.smithi026.stdout:5/279: creat d0/d13/d3a/f58 x:0 0 0 2024-04-23T10:17:49.752 INFO:tasks.workunit.client.0.smithi026.stdout:7/367: chown dd/d46/c65 131 1 2024-04-23T10:17:49.753 INFO:tasks.workunit.client.0.smithi026.stdout:5/280: creat d0/d12/f59 x:0 0 0 2024-04-23T10:17:49.760 INFO:tasks.workunit.client.0.smithi026.stdout:5/281: creat d0/d3c/d57/f5a x:0 0 0 2024-04-23T10:17:49.761 INFO:tasks.workunit.client.0.smithi026.stdout:5/282: mknod d0/d13/c5b 0 2024-04-23T10:17:49.772 INFO:tasks.workunit.client.0.smithi026.stdout:5/283: dwrite d0/f3 [0,4194304] 0 2024-04-23T10:17:49.776 INFO:tasks.workunit.client.0.smithi026.stdout:5/284: dread d0/f25 [0,4194304] 0 2024-04-23T10:17:49.783 INFO:tasks.workunit.client.0.smithi026.stdout:5/285: dwrite d0/d12/f28 [0,4194304] 0 2024-04-23T10:17:49.784 INFO:tasks.workunit.client.0.smithi026.stdout:5/286: dread - d0/d3c/f51 zero size 2024-04-23T10:17:49.791 INFO:tasks.workunit.client.0.smithi026.stdout:5/287: dwrite d0/f42 [0,4194304] 0 2024-04-23T10:17:49.882 INFO:tasks.workunit.client.0.smithi026.stdout:7/368: fsync dd/f51 0 2024-04-23T10:17:49.901 INFO:tasks.workunit.client.0.smithi026.stdout:0/461: dread f4 [0,4194304] 0 2024-04-23T10:17:49.905 INFO:tasks.workunit.client.0.smithi026.stdout:0/462: creat d7/d5b/fb1 x:0 0 0 2024-04-23T10:17:49.906 INFO:tasks.workunit.client.0.smithi026.stdout:0/463: chown d7/d43/f8d 12398860 1 2024-04-23T10:17:49.936 INFO:tasks.workunit.client.0.smithi026.stdout:0/464: dread d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:49.942 INFO:tasks.workunit.client.0.smithi026.stdout:4/241: sync 2024-04-23T10:17:49.948 INFO:tasks.workunit.client.0.smithi026.stdout:4/242: creat d4/d7/d51/f56 x:0 0 0 2024-04-23T10:17:49.952 INFO:tasks.workunit.client.0.smithi026.stdout:0/465: dwrite d7/f38 [0,4194304] 0 2024-04-23T10:17:49.954 INFO:tasks.workunit.client.0.smithi026.stdout:4/243: mkdir d4/d22/d4e/d57 0 2024-04-23T10:17:49.955 INFO:tasks.workunit.client.0.smithi026.stdout:4/244: write d4/f2b [77361,24402] 0 2024-04-23T10:17:49.966 INFO:tasks.workunit.client.0.smithi026.stdout:0/466: getdents d7/d8/d2d/d60 0 2024-04-23T10:17:49.971 INFO:tasks.workunit.client.0.smithi026.stdout:0/467: unlink d7/f6f 0 2024-04-23T10:17:49.976 INFO:tasks.workunit.client.0.smithi026.stdout:0/468: getdents d7/d8/d2d/d60/d62/d96 0 2024-04-23T10:17:49.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/245: write d4/d7/f1d [2384976,67258] 0 2024-04-23T10:17:49.977 INFO:tasks.workunit.client.0.smithi026.stdout:0/469: fsync d7/d8/d1e/f51 0 2024-04-23T10:17:49.978 INFO:tasks.workunit.client.0.smithi026.stdout:4/246: read - d4/d7/d34/f4f zero size 2024-04-23T10:17:49.980 INFO:tasks.workunit.client.0.smithi026.stdout:0/470: mkdir d7/d8/d2d/d60/d62/db2 0 2024-04-23T10:17:49.983 INFO:tasks.workunit.client.0.smithi026.stdout:4/247: readlink d4/d7/l23 0 2024-04-23T10:17:49.986 INFO:tasks.workunit.client.0.smithi026.stdout:4/248: dread - d4/d7/d19/f53 zero size 2024-04-23T10:17:49.989 INFO:tasks.workunit.client.0.smithi026.stdout:0/471: rmdir d7/d5b/da5 0 2024-04-23T10:17:49.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/249: creat d4/d7/d34/d36/d38/f58 x:0 0 0 2024-04-23T10:17:49.995 INFO:tasks.workunit.client.0.smithi026.stdout:4/250: write d4/d7/f8 [2421651,5547] 0 2024-04-23T10:17:49.995 INFO:tasks.workunit.client.0.smithi026.stdout:4/251: readlink d4/l18 0 2024-04-23T10:17:49.996 INFO:tasks.workunit.client.0.smithi026.stdout:0/472: creat d7/d8/d1e/d2a/d6a/fb3 x:0 0 0 2024-04-23T10:17:50.000 INFO:tasks.workunit.client.0.smithi026.stdout:4/252: unlink d4/d7/d19/f53 0 2024-04-23T10:17:50.002 INFO:tasks.workunit.client.0.smithi026.stdout:0/473: mkdir d7/d8/d2d/d60/d62/db2/db4 0 2024-04-23T10:17:50.004 INFO:tasks.workunit.client.0.smithi026.stdout:0/474: dread - d7/d8/d2d/f8c zero size 2024-04-23T10:17:50.004 INFO:tasks.workunit.client.0.smithi026.stdout:4/253: creat d4/d22/f59 x:0 0 0 2024-04-23T10:17:50.007 INFO:tasks.workunit.client.0.smithi026.stdout:4/254: symlink d4/d22/d4e/l5a 0 2024-04-23T10:17:50.008 INFO:tasks.workunit.client.0.smithi026.stdout:0/475: symlink d7/d8/d2d/d60/d77/lb5 0 2024-04-23T10:17:50.009 INFO:tasks.workunit.client.0.smithi026.stdout:4/255: truncate d4/d7/f8 4794652 0 2024-04-23T10:17:50.011 INFO:tasks.workunit.client.0.smithi026.stdout:0/476: symlink d7/d8/d1e/lb6 0 2024-04-23T10:17:50.012 INFO:tasks.workunit.client.0.smithi026.stdout:4/256: chown d4/d7/c43 169685191 1 2024-04-23T10:17:50.016 INFO:tasks.workunit.client.0.smithi026.stdout:4/257: mkdir d4/d5b 0 2024-04-23T10:17:50.018 INFO:tasks.workunit.client.0.smithi026.stdout:4/258: symlink d4/d7/d19/l5c 0 2024-04-23T10:17:50.024 INFO:tasks.workunit.client.0.smithi026.stdout:4/259: rename d4/d7/d19/c1a to d4/d7/d34/d4d/c5d 0 2024-04-23T10:17:50.027 INFO:tasks.workunit.client.0.smithi026.stdout:4/260: symlink d4/d22/l5e 0 2024-04-23T10:17:50.028 INFO:tasks.workunit.client.0.smithi026.stdout:4/261: stat d4/d7/d34/d36/d38 0 2024-04-23T10:17:50.030 INFO:tasks.workunit.client.0.smithi026.stdout:4/262: truncate d4/d22/f47 48665 0 2024-04-23T10:17:50.032 INFO:tasks.workunit.client.0.smithi026.stdout:4/263: read - d4/d7/d34/f41 zero size 2024-04-23T10:17:50.035 INFO:tasks.workunit.client.0.smithi026.stdout:4/264: mknod d4/d42/c5f 0 2024-04-23T10:17:50.038 INFO:tasks.workunit.client.0.smithi026.stdout:0/477: dwrite d7/d8/d1e/d1d/f67 [0,4194304] 0 2024-04-23T10:17:50.041 INFO:tasks.workunit.client.0.smithi026.stdout:4/265: rename d4/d14/f46 to d4/d5b/f60 0 2024-04-23T10:17:50.043 INFO:tasks.workunit.client.0.smithi026.stdout:0/478: read d7/d8/d1e/d1d/d2f/f10 [3210642,96854] 0 2024-04-23T10:17:50.043 INFO:tasks.workunit.client.0.smithi026.stdout:4/266: rmdir d4/d22/d4e 39 2024-04-23T10:17:50.051 INFO:tasks.workunit.client.0.smithi026.stdout:0/479: getdents d7/d8/d1e/d1d 0 2024-04-23T10:17:50.057 INFO:tasks.workunit.client.0.smithi026.stdout:0/480: write d7/d8/d1e/d2a/f2e [4077518,104243] 0 2024-04-23T10:17:50.060 INFO:tasks.workunit.client.0.smithi026.stdout:0/481: fdatasync d7/d8/d1e/d1d/f92 0 2024-04-23T10:17:50.060 INFO:tasks.workunit.client.0.smithi026.stdout:4/267: dwrite d4/d5b/f60 [0,4194304] 0 2024-04-23T10:17:50.065 INFO:tasks.workunit.client.0.smithi026.stdout:3/333: sync 2024-04-23T10:17:50.068 INFO:tasks.workunit.client.0.smithi026.stdout:3/334: stat d0/d1e/l22 0 2024-04-23T10:17:50.071 INFO:tasks.workunit.client.0.smithi026.stdout:0/482: rename d7/d43/d91/f9a to d7/d8/d1e/d1d/d2f/d6c/fb7 0 2024-04-23T10:17:50.079 INFO:tasks.workunit.client.0.smithi026.stdout:4/268: dwrite d4/d7/f8 [4194304,4194304] 0 2024-04-23T10:17:50.082 INFO:tasks.workunit.client.0.smithi026.stdout:4/269: dread - d4/d14/d3d/f4a zero size 2024-04-23T10:17:50.087 INFO:tasks.workunit.client.0.smithi026.stdout:4/270: mkdir d4/d7/d61 0 2024-04-23T10:17:50.087 INFO:tasks.workunit.client.0.smithi026.stdout:0/483: dwrite d7/d8/d1e/d2a/f71 [0,4194304] 0 2024-04-23T10:17:50.091 INFO:tasks.workunit.client.0.smithi026.stdout:0/484: getdents d7/d8/d1e/d2a/d6a/d70 0 2024-04-23T10:17:50.097 INFO:tasks.workunit.client.0.smithi026.stdout:0/485: link d7/cf d7/d8/d1e/d57/da9/cb8 0 2024-04-23T10:17:50.099 INFO:tasks.workunit.client.0.smithi026.stdout:0/486: write d7/d8/d1e/d2a/f2e [4099584,69866] 0 2024-04-23T10:17:50.108 INFO:tasks.workunit.client.0.smithi026.stdout:9/409: sync 2024-04-23T10:17:50.108 INFO:tasks.workunit.client.0.smithi026.stdout:7/369: sync 2024-04-23T10:17:50.108 INFO:tasks.workunit.client.0.smithi026.stdout:8/327: sync 2024-04-23T10:17:50.108 INFO:tasks.workunit.client.0.smithi026.stdout:2/341: sync 2024-04-23T10:17:50.109 INFO:tasks.workunit.client.0.smithi026.stdout:5/288: sync 2024-04-23T10:17:50.109 INFO:tasks.workunit.client.0.smithi026.stdout:6/421: sync 2024-04-23T10:17:50.110 INFO:tasks.workunit.client.0.smithi026.stdout:1/291: sync 2024-04-23T10:17:50.112 INFO:tasks.workunit.client.0.smithi026.stdout:7/370: unlink dd/d1d/l30 0 2024-04-23T10:17:50.113 INFO:tasks.workunit.client.0.smithi026.stdout:9/410: truncate d13/d3e/f64 438372 0 2024-04-23T10:17:50.113 INFO:tasks.workunit.client.0.smithi026.stdout:2/342: rmdir d3/d19/d21 39 2024-04-23T10:17:50.114 INFO:tasks.workunit.client.0.smithi026.stdout:9/411: stat d13/l50 0 2024-04-23T10:17:50.115 INFO:tasks.workunit.client.0.smithi026.stdout:7/371: fdatasync dd/d2c/d48/f59 0 2024-04-23T10:17:50.116 INFO:tasks.workunit.client.0.smithi026.stdout:6/422: chown d6/d21/d2f/d31/d52 21277377 1 2024-04-23T10:17:50.117 INFO:tasks.workunit.client.0.smithi026.stdout:5/289: dread d0/d13/d3a/f4c [0,4194304] 0 2024-04-23T10:17:50.117 INFO:tasks.workunit.client.0.smithi026.stdout:1/292: rename dd/d1a/d23/c46 to dd/d48/c6b 0 2024-04-23T10:17:50.117 INFO:tasks.workunit.client.0.smithi026.stdout:8/328: mknod d5/d9/d64/c6c 0 2024-04-23T10:17:50.119 INFO:tasks.workunit.client.0.smithi026.stdout:6/423: write d6/d13/d15/f1c [2548683,9082] 0 2024-04-23T10:17:50.120 INFO:tasks.workunit.client.0.smithi026.stdout:5/290: write d0/f26 [3743304,94583] 0 2024-04-23T10:17:50.122 INFO:tasks.workunit.client.0.smithi026.stdout:3/335: dread d0/d1e/d23/f41 [0,4194304] 0 2024-04-23T10:17:50.130 INFO:tasks.workunit.client.0.smithi026.stdout:6/424: unlink d6/f5a 0 2024-04-23T10:17:50.130 INFO:tasks.workunit.client.0.smithi026.stdout:5/291: dread - d0/d13/d3a/f58 zero size 2024-04-23T10:17:50.130 INFO:tasks.workunit.client.0.smithi026.stdout:8/329: rename d5/d9/l3c to d5/l6d 0 2024-04-23T10:17:50.131 INFO:tasks.workunit.client.0.smithi026.stdout:7/372: link dd/l25 dd/d46/l69 0 2024-04-23T10:17:50.135 INFO:tasks.workunit.client.0.smithi026.stdout:6/425: chown d6/d21/d2f/d32/f41 0 1 2024-04-23T10:17:50.136 INFO:tasks.workunit.client.0.smithi026.stdout:3/336: write d0/d1e/d30/d43/df/d63/f65 [2015107,9263] 0 2024-04-23T10:17:50.137 INFO:tasks.workunit.client.0.smithi026.stdout:2/343: dwrite d3/d19/f55 [8388608,4194304] 0 2024-04-23T10:17:50.140 INFO:tasks.workunit.client.0.smithi026.stdout:4/271: dread d4/d14/f25 [0,4194304] 0 2024-04-23T10:17:50.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/373: write dd/d3f/d47/d4c/f4a [55968,121519] 0 2024-04-23T10:17:50.141 INFO:tasks.workunit.client.0.smithi026.stdout:3/337: stat d0/d1e/d30/d43/d6c/d79/d64 0 2024-04-23T10:17:50.142 INFO:tasks.workunit.client.0.smithi026.stdout:1/293: dwrite dd/f2b [0,4194304] 0 2024-04-23T10:17:50.143 INFO:tasks.workunit.client.0.smithi026.stdout:6/426: creat d6/d13/d15/f81 x:0 0 0 2024-04-23T10:17:50.143 INFO:tasks.workunit.client.0.smithi026.stdout:9/412: dwrite d13/d3b/d5b/f63 [0,4194304] 0 2024-04-23T10:17:50.146 INFO:tasks.workunit.client.0.smithi026.stdout:2/344: write d3/d19/d31/f77 [185010,121478] 0 2024-04-23T10:17:50.149 INFO:tasks.workunit.client.0.smithi026.stdout:7/374: creat dd/d1d/d50/f6a x:0 0 0 2024-04-23T10:17:50.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/330: dwrite d5/d9/fb [4194304,4194304] 0 2024-04-23T10:17:50.154 INFO:tasks.workunit.client.0.smithi026.stdout:7/375: dread dd/f51 [0,4194304] 0 2024-04-23T10:17:50.166 INFO:tasks.workunit.client.0.smithi026.stdout:1/294: creat dd/d1a/f6c x:0 0 0 2024-04-23T10:17:50.166 INFO:tasks.workunit.client.0.smithi026.stdout:6/427: mkdir d6/d21/d2f/d31/d52/d82 0 2024-04-23T10:17:50.169 INFO:tasks.workunit.client.0.smithi026.stdout:3/338: mknod d0/d1e/d30/d43/d6c/d79/d64/c7d 0 2024-04-23T10:17:50.169 INFO:tasks.workunit.client.0.smithi026.stdout:9/413: rename d13/d2a/c52 to d13/d3b/c7b 0 2024-04-23T10:17:50.170 INFO:tasks.workunit.client.0.smithi026.stdout:5/292: write d0/d13/d3a/f4c [1381640,127013] 0 2024-04-23T10:17:50.171 INFO:tasks.workunit.client.0.smithi026.stdout:9/414: dread - d13/d3b/d68/f70 zero size 2024-04-23T10:17:50.174 INFO:tasks.workunit.client.0.smithi026.stdout:8/331: write d5/d9/f68 [1741896,130411] 0 2024-04-23T10:17:50.175 INFO:tasks.workunit.client.0.smithi026.stdout:2/345: creat d3/d19/d21/d23/d3a/d3c/f7c x:0 0 0 2024-04-23T10:17:50.176 INFO:tasks.workunit.client.0.smithi026.stdout:3/339: read d0/d1e/d30/f57 [603290,61483] 0 2024-04-23T10:17:50.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/332: chown d5/d9/fb 3202 1 2024-04-23T10:17:50.177 INFO:tasks.workunit.client.0.smithi026.stdout:2/346: read - d3/d19/d21/d23/d3a/d3c/f7c zero size 2024-04-23T10:17:50.177 INFO:tasks.workunit.client.0.smithi026.stdout:5/293: mknod d0/d3c/d57/c5c 0 2024-04-23T10:17:50.178 INFO:tasks.workunit.client.0.smithi026.stdout:1/295: mknod dd/d1a/d23/d69/c6d 0 2024-04-23T10:17:50.178 INFO:tasks.workunit.client.0.smithi026.stdout:8/333: read - d5/d56/d15/f5d zero size 2024-04-23T10:17:50.180 INFO:tasks.workunit.client.0.smithi026.stdout:6/428: getdents d6/d13/d49 0 2024-04-23T10:17:50.181 INFO:tasks.workunit.client.0.smithi026.stdout:2/347: symlink d3/d35/d4c/l7d 0 2024-04-23T10:17:50.181 INFO:tasks.workunit.client.0.smithi026.stdout:7/376: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:50.183 INFO:tasks.workunit.client.0.smithi026.stdout:8/334: mknod d5/d56/d15/c6e 0 2024-04-23T10:17:50.183 INFO:tasks.workunit.client.0.smithi026.stdout:7/377: chown dd/d2c/c5d 107497762 1 2024-04-23T10:17:50.184 INFO:tasks.workunit.client.0.smithi026.stdout:2/348: mknod d3/d35/c7e 0 2024-04-23T10:17:50.185 INFO:tasks.workunit.client.0.smithi026.stdout:6/429: truncate d6/d21/d2f/d37/d4f/f7b 600256 0 2024-04-23T10:17:50.188 INFO:tasks.workunit.client.0.smithi026.stdout:8/335: stat d5/d56/d3f/d4d/l46 0 2024-04-23T10:17:50.190 INFO:tasks.workunit.client.0.smithi026.stdout:8/336: fdatasync d5/d9/d22/f60 0 2024-04-23T10:17:50.192 INFO:tasks.workunit.client.0.smithi026.stdout:5/294: dwrite d0/d3c/f51 [0,4194304] 0 2024-04-23T10:17:50.192 INFO:tasks.workunit.client.0.smithi026.stdout:3/340: getdents d0/d1e/d30/d43/d6c/d79/d64 0 2024-04-23T10:17:50.193 INFO:tasks.workunit.client.0.smithi026.stdout:1/296: dwrite dd/d1a/d23/d3f/f52 [0,4194304] 0 2024-04-23T10:17:50.193 INFO:tasks.workunit.client.0.smithi026.stdout:6/430: truncate d6/d21/d58/f78 822483 0 2024-04-23T10:17:50.196 INFO:tasks.workunit.client.0.smithi026.stdout:8/337: chown d5/d56/d33/f58 6902 1 2024-04-23T10:17:50.197 INFO:tasks.workunit.client.0.smithi026.stdout:2/349: creat d3/d19/d1d/f7f x:0 0 0 2024-04-23T10:17:50.197 INFO:tasks.workunit.client.0.smithi026.stdout:7/378: link dd/d46/c61 dd/d3f/d47/d4c/c6b 0 2024-04-23T10:17:50.198 INFO:tasks.workunit.client.0.smithi026.stdout:1/297: write dd/d1a/f41 [615947,19948] 0 2024-04-23T10:17:50.204 INFO:tasks.workunit.client.0.smithi026.stdout:3/341: write d0/d1e/d30/d43/d29/f35 [1319640,77090] 0 2024-04-23T10:17:50.204 INFO:tasks.workunit.client.0.smithi026.stdout:5/295: read d0/d12/f1f [59336,82516] 0 2024-04-23T10:17:50.205 INFO:tasks.workunit.client.0.smithi026.stdout:1/298: rename dd/d1a/l3e to dd/d1a/d20/l6e 0 2024-04-23T10:17:50.208 INFO:tasks.workunit.client.0.smithi026.stdout:3/342: read d0/fc [2158373,43341] 0 2024-04-23T10:17:50.208 INFO:tasks.workunit.client.0.smithi026.stdout:8/338: dwrite d5/d9/f5b [0,4194304] 0 2024-04-23T10:17:50.209 INFO:tasks.workunit.client.0.smithi026.stdout:6/431: getdents d6/d21/d2f/d37 0 2024-04-23T10:17:50.209 INFO:tasks.workunit.client.0.smithi026.stdout:1/299: dread - dd/d1a/d20/d25/f4a zero size 2024-04-23T10:17:50.212 INFO:tasks.workunit.client.0.smithi026.stdout:2/350: getdents d3/d19/d21/d23/d3a/d3c/d5d 0 2024-04-23T10:17:50.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/343: unlink d0/l36 0 2024-04-23T10:17:50.214 INFO:tasks.workunit.client.0.smithi026.stdout:7/379: dwrite dd/f13 [0,4194304] 0 2024-04-23T10:17:50.215 INFO:tasks.workunit.client.0.smithi026.stdout:8/339: truncate d5/d9/d22/f60 696463 0 2024-04-23T10:17:50.216 INFO:tasks.workunit.client.0.smithi026.stdout:1/300: write dd/d1a/d23/d3f/f52 [2996253,7746] 0 2024-04-23T10:17:50.221 INFO:tasks.workunit.client.0.smithi026.stdout:6/432: rename d6/d21/d2f/d31/f74 to d6/d13/d49/d64/f83 0 2024-04-23T10:17:50.221 INFO:tasks.workunit.client.0.smithi026.stdout:7/380: mkdir dd/d6c 0 2024-04-23T10:17:50.221 INFO:tasks.workunit.client.0.smithi026.stdout:5/296: dwrite d0/d3c/d57/f5a [0,4194304] 0 2024-04-23T10:17:50.222 INFO:tasks.workunit.client.0.smithi026.stdout:3/344: rmdir d0/d1e/d30/d43/df 39 2024-04-23T10:17:50.224 INFO:tasks.workunit.client.0.smithi026.stdout:5/297: dread - d0/d12/f4f zero size 2024-04-23T10:17:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:1/301: mknod dd/d1a/d6a/c6f 0 2024-04-23T10:17:50.226 INFO:tasks.workunit.client.0.smithi026.stdout:6/433: write d6/d21/d2f/d37/d4f/f7b [1138037,28483] 0 2024-04-23T10:17:50.228 INFO:tasks.workunit.client.0.smithi026.stdout:8/340: dread d5/d9/f10 [0,4194304] 0 2024-04-23T10:17:50.232 INFO:tasks.workunit.client.0.smithi026.stdout:2/351: dwrite d3/d19/d21/d23/d3a/d3c/f47 [0,4194304] 0 2024-04-23T10:17:50.232 INFO:tasks.workunit.client.0.smithi026.stdout:7/381: rename dd/d46/l69 to dd/d3f/d47/d4c/d60/l6d 0 2024-04-23T10:17:50.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/302: truncate dd/d1a/d20/d25/d35/d43/f51 215966 0 2024-04-23T10:17:50.244 INFO:tasks.workunit.client.0.smithi026.stdout:2/352: mkdir d3/d19/d21/d23/d3a/d3c/d80 0 2024-04-23T10:17:50.244 INFO:tasks.workunit.client.0.smithi026.stdout:8/341: dwrite d5/d56/d3f/f57 [0,4194304] 0 2024-04-23T10:17:50.245 INFO:tasks.workunit.client.0.smithi026.stdout:3/345: dwrite d0/d1e/d30/d43/df/f1a [0,4194304] 0 2024-04-23T10:17:50.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/303: dwrite dd/d1a/f26 [4194304,4194304] 0 2024-04-23T10:17:50.253 INFO:tasks.workunit.client.0.smithi026.stdout:2/353: fsync d3/f8 0 2024-04-23T10:17:50.253 INFO:tasks.workunit.client.0.smithi026.stdout:1/304: rmdir dd 39 2024-04-23T10:17:50.255 INFO:tasks.workunit.client.0.smithi026.stdout:5/298: rename d0/d13 to d0/d3c/d5d 0 2024-04-23T10:17:50.256 INFO:tasks.workunit.client.0.smithi026.stdout:7/382: getdents dd/d3f 0 2024-04-23T10:17:50.257 INFO:tasks.workunit.client.0.smithi026.stdout:8/342: mknod d5/d50/c6f 0 2024-04-23T10:17:50.263 INFO:tasks.workunit.client.0.smithi026.stdout:8/343: symlink d5/d56/d3f/l70 0 2024-04-23T10:17:50.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/344: dread - d5/d56/d3f/d4d/f5a zero size 2024-04-23T10:17:50.265 INFO:tasks.workunit.client.0.smithi026.stdout:1/305: dread dd/d1a/d23/d3f/f52 [0,4194304] 0 2024-04-23T10:17:50.266 INFO:tasks.workunit.client.0.smithi026.stdout:3/346: creat d0/d1e/d30/d43/f7e x:0 0 0 2024-04-23T10:17:50.267 INFO:tasks.workunit.client.0.smithi026.stdout:6/434: truncate d6/fc 1300294 0 2024-04-23T10:17:50.269 INFO:tasks.workunit.client.0.smithi026.stdout:5/299: rename d0/d3c/d5d/c48 to d0/d3c/d57/c5e 0 2024-04-23T10:17:50.270 INFO:tasks.workunit.client.0.smithi026.stdout:7/383: mknod dd/d3f/d47/c6e 0 2024-04-23T10:17:50.271 INFO:tasks.workunit.client.0.smithi026.stdout:0/487: sync 2024-04-23T10:17:50.271 INFO:tasks.workunit.client.0.smithi026.stdout:1/306: rmdir dd/d15 39 2024-04-23T10:17:50.274 INFO:tasks.workunit.client.0.smithi026.stdout:8/345: mknod d5/d56/c71 0 2024-04-23T10:17:50.276 INFO:tasks.workunit.client.0.smithi026.stdout:5/300: rename d0/c34 to d0/d3c/c5f 0 2024-04-23T10:17:50.278 INFO:tasks.workunit.client.0.smithi026.stdout:7/384: dwrite dd/f35 [4194304,4194304] 0 2024-04-23T10:17:50.280 INFO:tasks.workunit.client.0.smithi026.stdout:5/301: write d0/d12/f59 [468950,13090] 0 2024-04-23T10:17:50.282 INFO:tasks.workunit.client.0.smithi026.stdout:8/346: creat d5/d24/f72 x:0 0 0 2024-04-23T10:17:50.283 INFO:tasks.workunit.client.0.smithi026.stdout:5/302: stat d0/d3c/d5d/d3a/c3b 0 2024-04-23T10:17:50.284 INFO:tasks.workunit.client.0.smithi026.stdout:1/307: dwrite dd/d1a/d20/d25/d35/d43/f51 [0,4194304] 0 2024-04-23T10:17:50.284 INFO:tasks.workunit.client.0.smithi026.stdout:7/385: write dd/f11 [3450989,45538] 0 2024-04-23T10:17:50.286 INFO:tasks.workunit.client.0.smithi026.stdout:7/386: readlink dd/l1c 0 2024-04-23T10:17:50.289 INFO:tasks.workunit.client.0.smithi026.stdout:8/347: creat d5/d24/f73 x:0 0 0 2024-04-23T10:17:50.291 INFO:tasks.workunit.client.0.smithi026.stdout:7/387: fsync dd/d1d/d50/f55 0 2024-04-23T10:17:50.295 INFO:tasks.workunit.client.0.smithi026.stdout:5/303: mknod d0/d3c/d5d/c60 0 2024-04-23T10:17:50.295 INFO:tasks.workunit.client.0.smithi026.stdout:6/435: dwrite d6/d21/d2f/d31/f79 [0,4194304] 0 2024-04-23T10:17:50.296 INFO:tasks.workunit.client.0.smithi026.stdout:8/348: mknod d5/d56/d47/c74 0 2024-04-23T10:17:50.296 INFO:tasks.workunit.client.0.smithi026.stdout:5/304: truncate d0/d12/f3f 345482 0 2024-04-23T10:17:50.298 INFO:tasks.workunit.client.0.smithi026.stdout:7/388: unlink l9 0 2024-04-23T10:17:50.298 INFO:tasks.workunit.client.0.smithi026.stdout:7/389: readlink dd/d2c/d48/l53 0 2024-04-23T10:17:50.300 INFO:tasks.workunit.client.0.smithi026.stdout:1/308: rename dd/d1a/d20/d25/d35/c66 to dd/d48/c70 0 2024-04-23T10:17:50.301 INFO:tasks.workunit.client.0.smithi026.stdout:6/436: creat d6/d13/d49/f84 x:0 0 0 2024-04-23T10:17:50.302 INFO:tasks.workunit.client.0.smithi026.stdout:8/349: mknod d5/d56/d15/c75 0 2024-04-23T10:17:50.302 INFO:tasks.workunit.client.0.smithi026.stdout:5/305: symlink d0/d3c/d5d/d3a/l61 0 2024-04-23T10:17:50.304 INFO:tasks.workunit.client.0.smithi026.stdout:7/390: rename dd/f51 to dd/d3f/d47/d4c/f6f 0 2024-04-23T10:17:50.304 INFO:tasks.workunit.client.0.smithi026.stdout:8/350: rmdir d5/d9/d22 39 2024-04-23T10:17:50.305 INFO:tasks.workunit.client.0.smithi026.stdout:8/351: dread - d5/d24/f66 zero size 2024-04-23T10:17:50.306 INFO:tasks.workunit.client.0.smithi026.stdout:8/352: truncate d5/d56/f1f 2045040 0 2024-04-23T10:17:50.307 INFO:tasks.workunit.client.0.smithi026.stdout:7/391: creat dd/d2c/f70 x:0 0 0 2024-04-23T10:17:50.310 INFO:tasks.workunit.client.0.smithi026.stdout:1/309: creat dd/d1a/d20/d25/f71 x:0 0 0 2024-04-23T10:17:50.310 INFO:tasks.workunit.client.0.smithi026.stdout:8/353: mkdir d5/d56/d15/d76 0 2024-04-23T10:17:50.310 INFO:tasks.workunit.client.0.smithi026.stdout:7/392: creat dd/d1d/f71 x:0 0 0 2024-04-23T10:17:50.311 INFO:tasks.workunit.client.0.smithi026.stdout:8/354: readlink d5/d56/d33/l38 0 2024-04-23T10:17:50.312 INFO:tasks.workunit.client.0.smithi026.stdout:6/437: dwrite d6/f1d [0,4194304] 0 2024-04-23T10:17:50.312 INFO:tasks.workunit.client.0.smithi026.stdout:8/355: write d5/d9/f40 [662664,114192] 0 2024-04-23T10:17:50.312 INFO:tasks.workunit.client.0.smithi026.stdout:7/393: mkdir dd/d6c/d72 0 2024-04-23T10:17:50.316 INFO:tasks.workunit.client.0.smithi026.stdout:7/394: unlink dd/l1c 0 2024-04-23T10:17:50.317 INFO:tasks.workunit.client.0.smithi026.stdout:6/438: creat d6/d21/d58/f85 x:0 0 0 2024-04-23T10:17:50.319 INFO:tasks.workunit.client.0.smithi026.stdout:6/439: write d6/d13/d15/f81 [55015,80219] 0 2024-04-23T10:17:50.320 INFO:tasks.workunit.client.0.smithi026.stdout:8/356: rename d5/d9/f68 to d5/d56/d15/f77 0 2024-04-23T10:17:50.320 INFO:tasks.workunit.client.0.smithi026.stdout:8/357: chown d5 424 1 2024-04-23T10:17:50.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/440: chown d6/d21/d58/f78 7 1 2024-04-23T10:17:50.322 INFO:tasks.workunit.client.0.smithi026.stdout:7/395: creat dd/d3f/f73 x:0 0 0 2024-04-23T10:17:50.322 INFO:tasks.workunit.client.0.smithi026.stdout:6/441: read d6/d21/d2f/d37/f6d [409280,88379] 0 2024-04-23T10:17:50.325 INFO:tasks.workunit.client.0.smithi026.stdout:8/358: unlink d5/d24/l26 0 2024-04-23T10:17:50.327 INFO:tasks.workunit.client.0.smithi026.stdout:8/359: dread - d5/d56/d3f/d4d/f5a zero size 2024-04-23T10:17:50.330 INFO:tasks.workunit.client.0.smithi026.stdout:7/396: write dd/d1d/f31 [3890489,67251] 0 2024-04-23T10:17:50.331 INFO:tasks.workunit.client.0.smithi026.stdout:6/442: dwrite d6/d21/d2f/d37/f6d [0,4194304] 0 2024-04-23T10:17:50.338 INFO:tasks.workunit.client.0.smithi026.stdout:5/306: dwrite d0/fe [0,4194304] 0 2024-04-23T10:17:50.338 INFO:tasks.workunit.client.0.smithi026.stdout:8/360: dwrite d5/d24/f66 [0,4194304] 0 2024-04-23T10:17:50.340 INFO:tasks.workunit.client.0.smithi026.stdout:8/361: read d5/d9/fb [8381210,4626] 0 2024-04-23T10:17:50.347 INFO:tasks.workunit.client.0.smithi026.stdout:7/397: fsync dd/d3f/d47/d4c/f4a 0 2024-04-23T10:17:50.347 INFO:tasks.workunit.client.0.smithi026.stdout:5/307: mknod d0/d3c/d5d/c62 0 2024-04-23T10:17:50.349 INFO:tasks.workunit.client.0.smithi026.stdout:8/362: dwrite d5/d9/f5b [0,4194304] 0 2024-04-23T10:17:50.354 INFO:tasks.workunit.client.0.smithi026.stdout:6/443: dread d6/fe [0,4194304] 0 2024-04-23T10:17:50.354 INFO:tasks.workunit.client.0.smithi026.stdout:8/363: dread d5/d9/f5b [0,4194304] 0 2024-04-23T10:17:50.354 INFO:tasks.workunit.client.0.smithi026.stdout:6/444: chown d6/d21/d2f/d31/d52/d82 27 1 2024-04-23T10:17:50.355 INFO:tasks.workunit.client.0.smithi026.stdout:5/308: truncate d0/f21 1565311 0 2024-04-23T10:17:50.356 INFO:tasks.workunit.client.0.smithi026.stdout:6/445: readlink d6/d13/l28 0 2024-04-23T10:17:50.357 INFO:tasks.workunit.client.0.smithi026.stdout:8/364: rmdir d5/d56/d3f/d4d/d3e 39 2024-04-23T10:17:50.359 INFO:tasks.workunit.client.0.smithi026.stdout:6/446: fsync d6/d13/d49/f5b 0 2024-04-23T10:17:50.363 INFO:tasks.workunit.client.0.smithi026.stdout:5/309: symlink d0/d3c/d5d/l63 0 2024-04-23T10:17:50.366 INFO:tasks.workunit.client.0.smithi026.stdout:8/365: rename d5/d56/d3f/d4d to d5/d9/d22/d65/d78 0 2024-04-23T10:17:50.367 INFO:tasks.workunit.client.0.smithi026.stdout:6/447: dread d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:50.368 INFO:tasks.workunit.client.0.smithi026.stdout:8/366: write d5/d56/d33/f44 [3327693,62950] 0 2024-04-23T10:17:50.370 INFO:tasks.workunit.client.0.smithi026.stdout:8/367: truncate d5/d56/d15/f34 391208 0 2024-04-23T10:17:50.372 INFO:tasks.workunit.client.0.smithi026.stdout:8/368: creat d5/d50/f79 x:0 0 0 2024-04-23T10:17:50.373 INFO:tasks.workunit.client.0.smithi026.stdout:8/369: stat d5/d56/d15/f77 0 2024-04-23T10:17:50.373 INFO:tasks.workunit.client.0.smithi026.stdout:8/370: readlink d5/d56/d3f/l54 0 2024-04-23T10:17:50.376 INFO:tasks.workunit.client.0.smithi026.stdout:8/371: creat d5/d50/f7a x:0 0 0 2024-04-23T10:17:50.378 INFO:tasks.workunit.client.0.smithi026.stdout:8/372: dread d5/d9/d22/f60 [0,4194304] 0 2024-04-23T10:17:50.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/373: creat d5/d9/d64/f7b x:0 0 0 2024-04-23T10:17:50.390 INFO:tasks.workunit.client.0.smithi026.stdout:8/374: dwrite d5/d50/f79 [0,4194304] 0 2024-04-23T10:17:50.393 INFO:tasks.workunit.client.0.smithi026.stdout:8/375: creat d5/d56/d15/d76/f7c x:0 0 0 2024-04-23T10:17:50.393 INFO:tasks.workunit.client.0.smithi026.stdout:5/310: dread d0/d3c/d5d/f14 [4194304,4194304] 0 2024-04-23T10:17:50.394 INFO:tasks.workunit.client.0.smithi026.stdout:5/311: symlink d0/l64 0 2024-04-23T10:17:50.395 INFO:tasks.workunit.client.0.smithi026.stdout:5/312: chown d0/d3c/l46 3643493 1 2024-04-23T10:17:50.396 INFO:tasks.workunit.client.0.smithi026.stdout:8/376: creat d5/d9/d22/d65/d78/f7d x:0 0 0 2024-04-23T10:17:50.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/377: mknod d5/d56/d47/c7e 0 2024-04-23T10:17:50.398 INFO:tasks.workunit.client.0.smithi026.stdout:8/378: chown d5/d50 94 1 2024-04-23T10:17:50.399 INFO:tasks.workunit.client.0.smithi026.stdout:5/313: creat d0/d3c/f65 x:0 0 0 2024-04-23T10:17:50.399 INFO:tasks.workunit.client.0.smithi026.stdout:8/379: dread - d5/d24/f73 zero size 2024-04-23T10:17:50.401 INFO:tasks.workunit.client.0.smithi026.stdout:8/380: rmdir d5/d9/d64 39 2024-04-23T10:17:50.402 INFO:tasks.workunit.client.0.smithi026.stdout:5/314: rename d0/c24 to d0/d12/c66 0 2024-04-23T10:17:50.403 INFO:tasks.workunit.client.0.smithi026.stdout:8/381: unlink d5/l5e 0 2024-04-23T10:17:50.404 INFO:tasks.workunit.client.0.smithi026.stdout:5/315: write d0/f25 [2685644,97197] 0 2024-04-23T10:17:50.405 INFO:tasks.workunit.client.0.smithi026.stdout:8/382: symlink d5/d9/l7f 0 2024-04-23T10:17:50.407 INFO:tasks.workunit.client.0.smithi026.stdout:8/383: write d5/d56/d15/f5d [952662,66645] 0 2024-04-23T10:17:50.407 INFO:tasks.workunit.client.0.smithi026.stdout:8/384: stat l1 0 2024-04-23T10:17:50.408 INFO:tasks.workunit.client.0.smithi026.stdout:5/316: link d0/d3c/d5d/c43 d0/d12/d49/c67 0 2024-04-23T10:17:50.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/317: mkdir d0/d68 0 2024-04-23T10:17:50.416 INFO:tasks.workunit.client.0.smithi026.stdout:5/318: read d0/d3c/d5d/f29 [244290,24989] 0 2024-04-23T10:17:50.419 INFO:tasks.workunit.client.0.smithi026.stdout:5/319: truncate d0/d3c/d5d/f19 481099 0 2024-04-23T10:17:50.419 INFO:tasks.workunit.client.0.smithi026.stdout:5/320: chown d0/d3c/d5d/d3a/f4c 1 1 2024-04-23T10:17:50.422 INFO:tasks.workunit.client.0.smithi026.stdout:5/321: mknod d0/c69 0 2024-04-23T10:17:50.424 INFO:tasks.workunit.client.0.smithi026.stdout:5/322: rename d0/d3c/d5d/d3a/c3b to d0/c6a 0 2024-04-23T10:17:50.428 INFO:tasks.workunit.client.0.smithi026.stdout:8/385: dread d5/d56/d33/f44 [0,4194304] 0 2024-04-23T10:17:50.430 INFO:tasks.workunit.client.0.smithi026.stdout:8/386: unlink d5/d9/fb 0 2024-04-23T10:17:50.431 INFO:tasks.workunit.client.0.smithi026.stdout:5/323: dwrite d0/f26 [0,4194304] 0 2024-04-23T10:17:50.432 INFO:tasks.workunit.client.0.smithi026.stdout:8/387: unlink d5/d56/c43 0 2024-04-23T10:17:50.434 INFO:tasks.workunit.client.0.smithi026.stdout:8/388: symlink d5/d24/l80 0 2024-04-23T10:17:50.435 INFO:tasks.workunit.client.0.smithi026.stdout:5/324: link d0/d12/f1f d0/d3c/d5d/f6b 0 2024-04-23T10:17:50.437 INFO:tasks.workunit.client.0.smithi026.stdout:8/389: unlink d5/d56/d33/c6a 0 2024-04-23T10:17:50.439 INFO:tasks.workunit.client.0.smithi026.stdout:5/325: write d0/d3c/d5d/f4b [4267465,129366] 0 2024-04-23T10:17:50.444 INFO:tasks.workunit.client.0.smithi026.stdout:8/390: fsync d5/d56/d15/f34 0 2024-04-23T10:17:50.448 INFO:tasks.workunit.client.0.smithi026.stdout:5/326: dwrite d0/f16 [4194304,4194304] 0 2024-04-23T10:17:50.455 INFO:tasks.workunit.client.0.smithi026.stdout:8/391: dwrite d5/d9/f40 [0,4194304] 0 2024-04-23T10:17:50.458 INFO:tasks.workunit.client.0.smithi026.stdout:5/327: dwrite d0/d12/f32 [0,4194304] 0 2024-04-23T10:17:50.464 INFO:tasks.workunit.client.0.smithi026.stdout:8/392: dwrite d5/d56/d33/f58 [0,4194304] 0 2024-04-23T10:17:50.465 INFO:tasks.workunit.client.0.smithi026.stdout:4/272: sync 2024-04-23T10:17:50.472 INFO:tasks.workunit.client.0.smithi026.stdout:5/328: dwrite d0/d3c/d5d/f29 [0,4194304] 0 2024-04-23T10:17:50.474 INFO:tasks.workunit.client.0.smithi026.stdout:8/393: dread d5/d9/f40 [0,4194304] 0 2024-04-23T10:17:50.478 INFO:tasks.workunit.client.0.smithi026.stdout:5/329: rename d0/d3c/d5d/c62 to d0/d3c/d57/c6c 0 2024-04-23T10:17:50.500 INFO:tasks.workunit.client.0.smithi026.stdout:8/394: truncate d5/d56/d33/f58 23277 0 2024-04-23T10:17:50.503 INFO:tasks.workunit.client.0.smithi026.stdout:8/395: rename d5/d56/d3f/l70 to d5/d56/d15/d76/l81 0 2024-04-23T10:17:50.509 INFO:tasks.workunit.client.0.smithi026.stdout:5/330: rename d0/d12/l17 to d0/d12/l6d 0 2024-04-23T10:17:50.510 INFO:tasks.workunit.client.0.smithi026.stdout:8/396: dwrite d5/d50/f7a [0,4194304] 0 2024-04-23T10:17:50.517 INFO:tasks.workunit.client.0.smithi026.stdout:5/331: dwrite d0/d3c/d5d/d3a/f4c [0,4194304] 0 2024-04-23T10:17:50.519 INFO:tasks.workunit.client.0.smithi026.stdout:5/332: write d0/d3c/f3d [5803346,106308] 0 2024-04-23T10:17:50.519 INFO:tasks.workunit.client.0.smithi026.stdout:8/397: creat d5/d56/d3f/f82 x:0 0 0 2024-04-23T10:17:50.523 INFO:tasks.workunit.client.0.smithi026.stdout:5/333: creat d0/d3c/d57/f6e x:0 0 0 2024-04-23T10:17:50.527 INFO:tasks.workunit.client.0.smithi026.stdout:5/334: stat d0/d3c/f51 0 2024-04-23T10:17:50.529 INFO:tasks.workunit.client.0.smithi026.stdout:5/335: fdatasync d0/d3c/d5d/d3a/f58 0 2024-04-23T10:17:50.536 INFO:tasks.workunit.client.0.smithi026.stdout:8/398: rmdir d5/d9/d22/d65/d78/d3e 39 2024-04-23T10:17:50.536 INFO:tasks.workunit.client.0.smithi026.stdout:8/399: chown d5/d56/d33/f4e 4030064 1 2024-04-23T10:17:50.537 INFO:tasks.workunit.client.0.smithi026.stdout:8/400: stat d5/d56/d33 0 2024-04-23T10:17:50.538 INFO:tasks.workunit.client.0.smithi026.stdout:5/336: mkdir d0/d6f 0 2024-04-23T10:17:50.545 INFO:tasks.workunit.client.0.smithi026.stdout:5/337: truncate d0/f16 6004579 0 2024-04-23T10:17:50.546 INFO:tasks.workunit.client.0.smithi026.stdout:5/338: truncate d0/d12/f3f 754471 0 2024-04-23T10:17:50.549 INFO:tasks.workunit.client.0.smithi026.stdout:8/401: dwrite d5/d24/f27 [0,4194304] 0 2024-04-23T10:17:50.552 INFO:tasks.workunit.client.0.smithi026.stdout:5/339: unlink d0/c6a 0 2024-04-23T10:17:50.553 INFO:tasks.workunit.client.0.smithi026.stdout:5/340: readlink d0/d12/d49/l4a 0 2024-04-23T10:17:50.554 INFO:tasks.workunit.client.0.smithi026.stdout:8/402: dread d5/d9/f40 [0,4194304] 0 2024-04-23T10:17:50.567 INFO:tasks.workunit.client.0.smithi026.stdout:8/403: dread d5/d9/fc [0,4194304] 0 2024-04-23T10:17:50.568 INFO:tasks.workunit.client.0.smithi026.stdout:8/404: truncate d5/d56/d33/f58 429560 0 2024-04-23T10:17:50.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/405: dread - d5/d56/d33/f4e zero size 2024-04-23T10:17:50.569 INFO:tasks.workunit.client.0.smithi026.stdout:9/415: sync 2024-04-23T10:17:50.572 INFO:tasks.workunit.client.0.smithi026.stdout:8/406: creat d5/d9/d22/d65/f83 x:0 0 0 2024-04-23T10:17:50.573 INFO:tasks.workunit.client.0.smithi026.stdout:5/341: creat d0/f70 x:0 0 0 2024-04-23T10:17:50.581 INFO:tasks.workunit.client.0.smithi026.stdout:5/342: dwrite d0/d12/f56 [0,4194304] 0 2024-04-23T10:17:50.582 INFO:tasks.workunit.client.0.smithi026.stdout:5/343: fdatasync d0/f42 0 2024-04-23T10:17:50.583 INFO:tasks.workunit.client.0.smithi026.stdout:9/416: dread d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:50.588 INFO:tasks.workunit.client.0.smithi026.stdout:4/273: dread d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:50.589 INFO:tasks.workunit.client.0.smithi026.stdout:8/407: dwrite d5/d56/d15/f77 [0,4194304] 0 2024-04-23T10:17:50.593 INFO:tasks.workunit.client.0.smithi026.stdout:8/408: creat d5/f84 x:0 0 0 2024-04-23T10:17:50.598 INFO:tasks.workunit.client.0.smithi026.stdout:5/344: rename d0/d3c/d57/c6c to d0/d3c/d5d/c71 0 2024-04-23T10:17:50.598 INFO:tasks.workunit.client.0.smithi026.stdout:8/409: creat d5/d56/d15/d76/f85 x:0 0 0 2024-04-23T10:17:50.600 INFO:tasks.workunit.client.0.smithi026.stdout:4/274: dwrite d4/d7/d34/d36/f55 [0,4194304] 0 2024-04-23T10:17:50.601 INFO:tasks.workunit.client.0.smithi026.stdout:5/345: stat d0/l7 0 2024-04-23T10:17:50.602 INFO:tasks.workunit.client.0.smithi026.stdout:4/275: fsync d4/d22/d2e/f32 0 2024-04-23T10:17:50.607 INFO:tasks.workunit.client.0.smithi026.stdout:4/276: truncate d4/d7/d51/f56 584059 0 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:0/488: sync 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/398: sync 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:6/448: sync 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/310: sync 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/347: sync 2024-04-23T10:17:50.612 INFO:tasks.workunit.client.0.smithi026.stdout:2/354: sync 2024-04-23T10:17:50.613 INFO:tasks.workunit.client.0.smithi026.stdout:9/417: dread d13/f1c [0,4194304] 0 2024-04-23T10:17:50.616 INFO:tasks.workunit.client.0.smithi026.stdout:8/410: dwrite d5/d56/d15/f18 [4194304,4194304] 0 2024-04-23T10:17:50.616 INFO:tasks.workunit.client.0.smithi026.stdout:4/277: rename d4/f49 to d4/d7/d61/f62 0 2024-04-23T10:17:50.618 INFO:tasks.workunit.client.0.smithi026.stdout:2/355: write d3/d19/f55 [3176451,108197] 0 2024-04-23T10:17:50.622 INFO:tasks.workunit.client.0.smithi026.stdout:4/278: readlink d4/d7/d34/d36/d38/l39 0 2024-04-23T10:17:50.622 INFO:tasks.workunit.client.0.smithi026.stdout:6/449: read d6/d21/d2f/d37/f39 [1463574,28871] 0 2024-04-23T10:17:50.622 INFO:tasks.workunit.client.0.smithi026.stdout:3/348: fdatasync d0/d1e/d30/d43/df/f18 0 2024-04-23T10:17:50.623 INFO:tasks.workunit.client.0.smithi026.stdout:8/411: fsync d5/d9/d22/d65/f83 0 2024-04-23T10:17:50.624 INFO:tasks.workunit.client.0.smithi026.stdout:9/418: creat d13/d2a/d45/d67/f7c x:0 0 0 2024-04-23T10:17:50.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/346: dwrite d0/d12/f59 [0,4194304] 0 2024-04-23T10:17:50.626 INFO:tasks.workunit.client.0.smithi026.stdout:7/399: creat dd/d44/f74 x:0 0 0 2024-04-23T10:17:50.627 INFO:tasks.workunit.client.0.smithi026.stdout:8/412: fsync d5/d56/d15/f31 0 2024-04-23T10:17:50.628 INFO:tasks.workunit.client.0.smithi026.stdout:9/419: fsync d13/d2a/d45/d3a/d6b/f55 0 2024-04-23T10:17:50.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/349: readlink d0/d1e/d30/d43/d6c/d79/l3a 0 2024-04-23T10:17:50.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/311: getdents dd/d1a/d20/d25/d35/d43 0 2024-04-23T10:17:50.636 INFO:tasks.workunit.client.0.smithi026.stdout:5/347: rename d0/d12/f56 to d0/d3c/d5d/d3a/f72 0 2024-04-23T10:17:50.639 INFO:tasks.workunit.client.0.smithi026.stdout:5/348: fdatasync d0/d12/f2b 0 2024-04-23T10:17:50.640 INFO:tasks.workunit.client.0.smithi026.stdout:3/350: fsync d0/d51/d5e/f68 0 2024-04-23T10:17:50.642 INFO:tasks.workunit.client.0.smithi026.stdout:4/279: dwrite d4/d22/d2e/f32 [4194304,4194304] 0 2024-04-23T10:17:50.643 INFO:tasks.workunit.client.0.smithi026.stdout:8/413: creat d5/d56/f86 x:0 0 0 2024-04-23T10:17:50.645 INFO:tasks.workunit.client.0.smithi026.stdout:2/356: dwrite d3/dd/d4b/f61 [0,4194304] 0 2024-04-23T10:17:50.650 INFO:tasks.workunit.client.0.smithi026.stdout:1/312: unlink dd/d15/l1d 0 2024-04-23T10:17:50.653 INFO:tasks.workunit.client.0.smithi026.stdout:9/420: dwrite d13/d3e/f44 [4194304,4194304] 0 2024-04-23T10:17:50.655 INFO:tasks.workunit.client.0.smithi026.stdout:4/280: write d4/d7/f3c [15502,1528] 0 2024-04-23T10:17:50.656 INFO:tasks.workunit.client.0.smithi026.stdout:8/414: creat d5/d9/d22/d65/f87 x:0 0 0 2024-04-23T10:17:50.656 INFO:tasks.workunit.client.0.smithi026.stdout:0/489: dread d7/d8/d1e/f18 [0,4194304] 0 2024-04-23T10:17:50.656 INFO:tasks.workunit.client.0.smithi026.stdout:6/450: link d6/d33/l34 d6/d13/l86 0 2024-04-23T10:17:50.660 INFO:tasks.workunit.client.0.smithi026.stdout:2/357: dwrite d3/d19/d21/d23/f29 [0,4194304] 0 2024-04-23T10:17:50.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/313: rename dd/d1a/f26 to dd/d48/f72 0 2024-04-23T10:17:50.662 INFO:tasks.workunit.client.0.smithi026.stdout:2/358: write d3/d19/d31/f77 [867022,116944] 0 2024-04-23T10:17:50.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/314: chown dd/c10 44 1 2024-04-23T10:17:50.664 INFO:tasks.workunit.client.0.smithi026.stdout:1/315: dread - dd/d1a/f55 zero size 2024-04-23T10:17:50.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/451: mkdir d6/d21/d2f/d32/d87 0 2024-04-23T10:17:50.668 INFO:tasks.workunit.client.0.smithi026.stdout:0/490: mkdir d7/d8/d2d/d60/d62/db9 0 2024-04-23T10:17:50.669 INFO:tasks.workunit.client.0.smithi026.stdout:3/351: creat d0/d1e/d30/d43/f7f x:0 0 0 2024-04-23T10:17:50.676 INFO:tasks.workunit.client.0.smithi026.stdout:8/415: mkdir d5/d9/d64/d88 0 2024-04-23T10:17:50.678 INFO:tasks.workunit.client.0.smithi026.stdout:2/359: creat d3/d35/d4c/f81 x:0 0 0 2024-04-23T10:17:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:3/352: rmdir d0/d1e/d23 39 2024-04-23T10:17:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:5/349: truncate d0/f9 3536366 0 2024-04-23T10:17:50.680 INFO:tasks.workunit.client.0.smithi026.stdout:2/360: chown d3/d19 15129701 1 2024-04-23T10:17:50.681 INFO:tasks.workunit.client.0.smithi026.stdout:2/361: fsync d3/d35/d4c/f76 0 2024-04-23T10:17:50.682 INFO:tasks.workunit.client.0.smithi026.stdout:0/491: symlink d7/d8/d1e/d1d/d2f/d6c/lba 0 2024-04-23T10:17:50.682 INFO:tasks.workunit.client.0.smithi026.stdout:3/353: write d0/d1e/d30/d43/d29/f5c [789268,82243] 0 2024-04-23T10:17:50.683 INFO:tasks.workunit.client.0.smithi026.stdout:8/416: rmdir d5/d9/d22/d65/d78 39 2024-04-23T10:17:50.684 INFO:tasks.workunit.client.0.smithi026.stdout:0/492: fsync d7/d8/d1e/d2a/f47 0 2024-04-23T10:17:50.685 INFO:tasks.workunit.client.0.smithi026.stdout:4/281: dread d4/d7/d19/f21 [0,4194304] 0 2024-04-23T10:17:50.686 INFO:tasks.workunit.client.0.smithi026.stdout:0/493: stat d7/d8/d1e/d2a/f2e 0 2024-04-23T10:17:50.686 INFO:tasks.workunit.client.0.smithi026.stdout:4/282: chown d4/f2b 24447855 1 2024-04-23T10:17:50.687 INFO:tasks.workunit.client.0.smithi026.stdout:5/350: mknod d0/d12/c73 0 2024-04-23T10:17:50.689 INFO:tasks.workunit.client.0.smithi026.stdout:0/494: write d7/d8/d1e/d1d/d2f/f8a [558398,87395] 0 2024-04-23T10:17:50.690 INFO:tasks.workunit.client.0.smithi026.stdout:5/351: read - d0/d3c/d5d/d3a/f58 zero size 2024-04-23T10:17:50.690 INFO:tasks.workunit.client.0.smithi026.stdout:1/316: write dd/d15/f4f [2239623,9941] 0 2024-04-23T10:17:50.696 INFO:tasks.workunit.client.0.smithi026.stdout:8/417: symlink d5/d56/d15/l89 0 2024-04-23T10:17:50.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/317: mkdir dd/d1a/d20/d25/d35/d73 0 2024-04-23T10:17:50.701 INFO:tasks.workunit.client.0.smithi026.stdout:9/421: dwrite d13/d19/f4d [4194304,4194304] 0 2024-04-23T10:17:50.702 INFO:tasks.workunit.client.0.smithi026.stdout:7/400: dread dd/d44/f2e [0,4194304] 0 2024-04-23T10:17:50.703 INFO:tasks.workunit.client.0.smithi026.stdout:5/352: creat d0/d3c/f74 x:0 0 0 2024-04-23T10:17:50.704 INFO:tasks.workunit.client.0.smithi026.stdout:3/354: dwrite d0/d1e/d30/f57 [0,4194304] 0 2024-04-23T10:17:50.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/495: rename d7/d8/d1e/f4a to d7/fbb 0 2024-04-23T10:17:50.708 INFO:tasks.workunit.client.0.smithi026.stdout:1/318: mkdir dd/d1a/d20/d25/d35/d74 0 2024-04-23T10:17:50.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/422: symlink d13/d3b/d68/l7d 0 2024-04-23T10:17:50.708 INFO:tasks.workunit.client.0.smithi026.stdout:0/496: readlink d7/d8/d1e/d1d/l54 0 2024-04-23T10:17:50.709 INFO:tasks.workunit.client.0.smithi026.stdout:5/353: mknod d0/d12/d49/c75 0 2024-04-23T10:17:50.711 INFO:tasks.workunit.client.0.smithi026.stdout:4/283: dread d4/d22/f4c [0,4194304] 0 2024-04-23T10:17:50.711 INFO:tasks.workunit.client.0.smithi026.stdout:3/355: chown d0/d1e/d23/d52/f61 20 1 2024-04-23T10:17:50.718 INFO:tasks.workunit.client.0.smithi026.stdout:7/401: mkdir dd/d3f/d47/d4c/d60/d75 0 2024-04-23T10:17:50.718 INFO:tasks.workunit.client.0.smithi026.stdout:8/418: rename d5/c8 to d5/d56/d33/c8a 0 2024-04-23T10:17:50.719 INFO:tasks.workunit.client.0.smithi026.stdout:0/497: creat d7/d43/fbc x:0 0 0 2024-04-23T10:17:50.720 INFO:tasks.workunit.client.0.smithi026.stdout:9/423: chown d13/d2a/d45/d3a/l74 518168619 1 2024-04-23T10:17:50.721 INFO:tasks.workunit.client.0.smithi026.stdout:4/284: mknod d4/d7/d61/c63 0 2024-04-23T10:17:50.722 INFO:tasks.workunit.client.0.smithi026.stdout:4/285: chown d4/le 4677374 1 2024-04-23T10:17:50.723 INFO:tasks.workunit.client.0.smithi026.stdout:8/419: mkdir d5/d56/d15/d8b 0 2024-04-23T10:17:50.723 INFO:tasks.workunit.client.0.smithi026.stdout:4/286: fsync d4/d14/f1c 0 2024-04-23T10:17:50.724 INFO:tasks.workunit.client.0.smithi026.stdout:5/354: creat d0/d68/f76 x:0 0 0 2024-04-23T10:17:50.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/356: symlink d0/d1e/d30/l80 0 2024-04-23T10:17:50.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/355: rmdir d0/d12 39 2024-04-23T10:17:50.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/420: dwrite d5/f28 [0,4194304] 0 2024-04-23T10:17:50.732 INFO:tasks.workunit.client.0.smithi026.stdout:7/402: creat dd/f76 x:0 0 0 2024-04-23T10:17:50.732 INFO:tasks.workunit.client.0.smithi026.stdout:3/357: truncate d0/f3c 59529 0 2024-04-23T10:17:50.733 INFO:tasks.workunit.client.0.smithi026.stdout:1/319: truncate dd/d1a/d23/f2d 6776 0 2024-04-23T10:17:50.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/358: write d0/d1e/d30/d43/d29/f5c [1202726,5153] 0 2024-04-23T10:17:50.740 INFO:tasks.workunit.client.0.smithi026.stdout:4/287: link d4/d22/f4c d4/d14/d30/d52/f64 0 2024-04-23T10:17:50.741 INFO:tasks.workunit.client.0.smithi026.stdout:0/498: dread d7/d43/f53 [0,4194304] 0 2024-04-23T10:17:50.743 INFO:tasks.workunit.client.0.smithi026.stdout:1/320: symlink dd/d1a/d20/d25/d35/d43/l75 0 2024-04-23T10:17:50.744 INFO:tasks.workunit.client.0.smithi026.stdout:5/356: symlink d0/d3c/d5d/l77 0 2024-04-23T10:17:50.744 INFO:tasks.workunit.client.0.smithi026.stdout:9/424: link d13/d2a/l3d d13/l7e 0 2024-04-23T10:17:50.746 INFO:tasks.workunit.client.0.smithi026.stdout:4/288: mknod d4/d7/d51/c65 0 2024-04-23T10:17:50.748 INFO:tasks.workunit.client.0.smithi026.stdout:0/499: symlink d7/d8/d2d/d60/d77/lbd 0 2024-04-23T10:17:50.750 INFO:tasks.workunit.client.0.smithi026.stdout:9/425: dread d13/d19/f4d [4194304,4194304] 0 2024-04-23T10:17:50.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/500: mknod d7/d5b/cbe 0 2024-04-23T10:17:50.757 INFO:tasks.workunit.client.0.smithi026.stdout:7/403: dwrite dd/d44/d38/f3d [0,4194304] 0 2024-04-23T10:17:50.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/359: dwrite d0/d1e/d23/d52/f61 [4194304,4194304] 0 2024-04-23T10:17:50.765 INFO:tasks.workunit.client.0.smithi026.stdout:8/421: getdents d5/d50 0 2024-04-23T10:17:50.771 INFO:tasks.workunit.client.0.smithi026.stdout:0/501: creat d7/d8/d2d/d60/d62/fbf x:0 0 0 2024-04-23T10:17:50.775 INFO:tasks.workunit.client.0.smithi026.stdout:0/502: write d7/d5b/f76 [1602707,84265] 0 2024-04-23T10:17:50.776 INFO:tasks.workunit.client.0.smithi026.stdout:5/357: dread d0/f1a [0,4194304] 0 2024-04-23T10:17:50.776 INFO:tasks.workunit.client.0.smithi026.stdout:1/321: dwrite dd/d1a/d23/f18 [0,4194304] 0 2024-04-23T10:17:50.781 INFO:tasks.workunit.client.0.smithi026.stdout:9/426: dread d13/d3b/d68/f75 [0,4194304] 0 2024-04-23T10:17:50.782 INFO:tasks.workunit.client.0.smithi026.stdout:4/289: truncate d4/d7/f1d 1718488 0 2024-04-23T10:17:50.785 INFO:tasks.workunit.client.0.smithi026.stdout:7/404: rename dd/d44/d38/f4e to dd/d46/f77 0 2024-04-23T10:17:50.787 INFO:tasks.workunit.client.0.smithi026.stdout:8/422: creat d5/d56/d33/f8c x:0 0 0 2024-04-23T10:17:50.787 INFO:tasks.workunit.client.0.smithi026.stdout:8/423: chown d5/d56/d47/f4f 208842 1 2024-04-23T10:17:50.788 INFO:tasks.workunit.client.0.smithi026.stdout:9/427: dread d13/d3e/f44 [4194304,4194304] 0 2024-04-23T10:17:50.789 INFO:tasks.workunit.client.0.smithi026.stdout:9/428: chown d13/d31/c3c 73639321 1 2024-04-23T10:17:50.797 INFO:tasks.workunit.client.0.smithi026.stdout:1/322: write dd/d1a/d20/d25/f38 [1443909,42533] 0 2024-04-23T10:17:50.798 INFO:tasks.workunit.client.0.smithi026.stdout:8/424: chown d5/d9/c21 1688410643 1 2024-04-23T10:17:50.799 INFO:tasks.workunit.client.0.smithi026.stdout:9/429: mknod d13/d2a/d45/d3a/d4f/c7f 0 2024-04-23T10:17:50.801 INFO:tasks.workunit.client.0.smithi026.stdout:5/358: write d0/d12/f1f [340593,51726] 0 2024-04-23T10:17:50.802 INFO:tasks.workunit.client.0.smithi026.stdout:0/503: link d7/d8/l79 d7/d8/d2d/d60/d62/db2/lc0 0 2024-04-23T10:17:50.804 INFO:tasks.workunit.client.0.smithi026.stdout:5/359: chown d0/d3c/d5d/l63 1359775 1 2024-04-23T10:17:50.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/504: write d7/d5b/f76 [1256210,76484] 0 2024-04-23T10:17:50.804 INFO:tasks.workunit.client.0.smithi026.stdout:1/323: readlink dd/d1a/d23/l37 0 2024-04-23T10:17:50.808 INFO:tasks.workunit.client.0.smithi026.stdout:4/290: dwrite d4/d14/d30/d52/f64 [4194304,4194304] 0 2024-04-23T10:17:50.809 INFO:tasks.workunit.client.0.smithi026.stdout:9/430: rename d13/d3b/d68/f70 to d13/d3e/f80 0 2024-04-23T10:17:50.810 INFO:tasks.workunit.client.0.smithi026.stdout:9/431: fdatasync d13/d3e/f5e 0 2024-04-23T10:17:50.811 INFO:tasks.workunit.client.0.smithi026.stdout:1/324: mknod dd/d1a/d23/d3f/c76 0 2024-04-23T10:17:50.812 INFO:tasks.workunit.client.0.smithi026.stdout:0/505: mknod d7/d8/d1e/d1d/cc1 0 2024-04-23T10:17:50.812 INFO:tasks.workunit.client.0.smithi026.stdout:5/360: dread d0/d3c/d5d/f29 [0,4194304] 0 2024-04-23T10:17:50.815 INFO:tasks.workunit.client.0.smithi026.stdout:4/291: mkdir d4/d14/d3d/d66 0 2024-04-23T10:17:50.820 INFO:tasks.workunit.client.0.smithi026.stdout:1/325: creat dd/d1a/d6a/f77 x:0 0 0 2024-04-23T10:17:50.824 INFO:tasks.workunit.client.0.smithi026.stdout:7/405: dread dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:50.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/292: unlink d4/d22/l5e 0 2024-04-23T10:17:50.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/432: mknod d13/d36/d66/d78/c81 0 2024-04-23T10:17:50.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/433: chown d13/d2a/d45/d6d 29410 1 2024-04-23T10:17:50.828 INFO:tasks.workunit.client.0.smithi026.stdout:1/326: mknod dd/d1a/d23/c78 0 2024-04-23T10:17:50.833 INFO:tasks.workunit.client.0.smithi026.stdout:4/293: creat d4/d1b/f67 x:0 0 0 2024-04-23T10:17:50.833 INFO:tasks.workunit.client.0.smithi026.stdout:5/361: write d0/f21 [1188868,85193] 0 2024-04-23T10:17:50.834 INFO:tasks.workunit.client.0.smithi026.stdout:1/327: rename dd/d1a/d23/d3f/l5a to dd/d1a/d23/d3f/l79 0 2024-04-23T10:17:50.837 INFO:tasks.workunit.client.0.smithi026.stdout:0/506: unlink d7/d8/d1e/d1d/f69 0 2024-04-23T10:17:50.838 INFO:tasks.workunit.client.0.smithi026.stdout:4/294: dread d4/d7/d34/f37 [0,4194304] 0 2024-04-23T10:17:50.839 INFO:tasks.workunit.client.0.smithi026.stdout:4/295: readlink d4/d22/l28 0 2024-04-23T10:17:50.839 INFO:tasks.workunit.client.0.smithi026.stdout:0/507: chown d7/d8/d2d/d60/d62/db2 44 1 2024-04-23T10:17:50.840 INFO:tasks.workunit.client.0.smithi026.stdout:4/296: fsync d4/d22/d2e/f32 0 2024-04-23T10:17:50.841 INFO:tasks.workunit.client.0.smithi026.stdout:1/328: symlink dd/d1a/d23/d3f/l7a 0 2024-04-23T10:17:50.844 INFO:tasks.workunit.client.0.smithi026.stdout:7/406: rename dd/d45 to dd/d1d/d78 0 2024-04-23T10:17:50.844 INFO:tasks.workunit.client.0.smithi026.stdout:0/508: read d7/d8/d1e/f32 [2952111,18453] 0 2024-04-23T10:17:50.846 INFO:tasks.workunit.client.0.smithi026.stdout:0/509: truncate d7/d8/d1e/f72 193939 0 2024-04-23T10:17:50.848 INFO:tasks.workunit.client.0.smithi026.stdout:1/329: dwrite dd/f2b [0,4194304] 0 2024-04-23T10:17:50.848 INFO:tasks.workunit.client.0.smithi026.stdout:5/362: dread d0/f3 [0,4194304] 0 2024-04-23T10:17:50.853 INFO:tasks.workunit.client.0.smithi026.stdout:1/330: mkdir dd/d1a/d20/d25/d35/d43/d7b 0 2024-04-23T10:17:51.009 INFO:tasks.workunit.client.0.smithi026.stdout:5/363: unlink d0/d12/c66 0 2024-04-23T10:17:51.019 INFO:tasks.workunit.client.0.smithi026.stdout:1/331: stat dd/d48/c70 0 2024-04-23T10:17:51.020 INFO:tasks.workunit.client.0.smithi026.stdout:4/297: dwrite d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:51.021 INFO:tasks.workunit.client.0.smithi026.stdout:1/332: chown dd/d1a/d23/f67 0 1 2024-04-23T10:17:51.022 INFO:tasks.workunit.client.0.smithi026.stdout:4/298: stat d4/d14 0 2024-04-23T10:17:51.023 INFO:tasks.workunit.client.0.smithi026.stdout:1/333: fdatasync dd/d15/f32 0 2024-04-23T10:17:51.023 INFO:tasks.workunit.client.0.smithi026.stdout:4/299: write d4/d5b/f60 [2430111,66875] 0 2024-04-23T10:17:51.025 INFO:tasks.workunit.client.0.smithi026.stdout:4/300: stat d4/d7/d34/f37 0 2024-04-23T10:17:51.027 INFO:tasks.workunit.client.0.smithi026.stdout:4/301: fsync d4/d14/f40 0 2024-04-23T10:17:51.031 INFO:tasks.workunit.client.0.smithi026.stdout:1/334: read f9 [370025,122972] 0 2024-04-23T10:17:51.034 INFO:tasks.workunit.client.0.smithi026.stdout:0/510: rename d7/d43/d91 to d7/dc2 0 2024-04-23T10:17:51.035 INFO:tasks.workunit.client.0.smithi026.stdout:0/511: fdatasync d7/da1/faf 0 2024-04-23T10:17:51.037 INFO:tasks.workunit.client.0.smithi026.stdout:0/512: chown d7/d8/d1e/l9c 3218109 1 2024-04-23T10:17:51.047 INFO:tasks.workunit.client.0.smithi026.stdout:0/513: dread d7/d8/d2d/f37 [0,4194304] 0 2024-04-23T10:17:51.052 INFO:tasks.workunit.client.0.smithi026.stdout:4/302: mkdir d4/d5b/d68 0 2024-04-23T10:17:51.052 INFO:tasks.workunit.client.0.smithi026.stdout:6/452: sync 2024-04-23T10:17:51.055 INFO:tasks.workunit.client.0.smithi026.stdout:1/335: fdatasync dd/d1a/f5e 0 2024-04-23T10:17:51.057 INFO:tasks.workunit.client.0.smithi026.stdout:1/336: chown dd/d1a/d23/d3f/l7a 14978 1 2024-04-23T10:17:51.073 INFO:tasks.workunit.client.0.smithi026.stdout:0/514: creat d7/d8/d2d/d60/d62/db2/db4/fc3 x:0 0 0 2024-04-23T10:17:51.073 INFO:tasks.workunit.client.0.smithi026.stdout:4/303: dwrite d4/d7/d61/f62 [0,4194304] 0 2024-04-23T10:17:51.074 INFO:tasks.workunit.client.0.smithi026.stdout:4/304: dread - d4/d22/f59 zero size 2024-04-23T10:17:51.080 INFO:tasks.workunit.client.0.smithi026.stdout:1/337: fsync dd/d1a/d23/d3f/f52 0 2024-04-23T10:17:51.089 INFO:tasks.workunit.client.0.smithi026.stdout:6/453: dread d6/d21/d2f/d31/f79 [0,4194304] 0 2024-04-23T10:17:51.097 INFO:tasks.workunit.client.0.smithi026.stdout:0/515: unlink d7/d8/d2d/d60/d62/l94 0 2024-04-23T10:17:51.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/305: dread d4/d7/f3c [0,4194304] 0 2024-04-23T10:17:51.112 INFO:tasks.workunit.client.0.smithi026.stdout:0/516: creat d7/d8/d2d/d60/d77/fc4 x:0 0 0 2024-04-23T10:17:51.114 INFO:tasks.workunit.client.0.smithi026.stdout:6/454: write d6/f10 [459166,31187] 0 2024-04-23T10:17:51.115 INFO:tasks.workunit.client.0.smithi026.stdout:1/338: truncate dd/d1a/d23/d3f/f5b 711356 0 2024-04-23T10:17:51.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/455: fdatasync d6/d21/d2f/d32/d53/f61 0 2024-04-23T10:17:51.119 INFO:tasks.workunit.client.0.smithi026.stdout:4/306: rmdir d4/d7/d61 39 2024-04-23T10:17:51.134 INFO:tasks.workunit.client.0.smithi026.stdout:1/339: dwrite dd/d1a/d20/d25/d35/d43/f51 [0,4194304] 0 2024-04-23T10:17:51.134 INFO:tasks.workunit.client.0.smithi026.stdout:0/517: creat d7/d8/d1e/d57/da9/fc5 x:0 0 0 2024-04-23T10:17:51.135 INFO:tasks.workunit.client.0.smithi026.stdout:6/456: mknod d6/d21/d2f/d32/d87/c88 0 2024-04-23T10:17:51.136 INFO:tasks.workunit.client.0.smithi026.stdout:6/457: fsync d6/f1d 0 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:8/425: sync 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:3/360: sync 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:9/434: sync 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:2/362: sync 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:7/407: sync 2024-04-23T10:17:51.138 INFO:tasks.workunit.client.0.smithi026.stdout:0/518: write d7/d8/f82 [728386,26539] 0 2024-04-23T10:17:51.141 INFO:tasks.workunit.client.0.smithi026.stdout:3/361: stat d0/d1e/d30/d77 0 2024-04-23T10:17:51.144 INFO:tasks.workunit.client.0.smithi026.stdout:2/363: truncate d3/dd/f56 711422 0 2024-04-23T10:17:51.146 INFO:tasks.workunit.client.0.smithi026.stdout:9/435: truncate d13/d2a/f35 813043 0 2024-04-23T10:17:51.147 INFO:tasks.workunit.client.0.smithi026.stdout:1/340: mkdir dd/d1a/d6a/d7c 0 2024-04-23T10:17:51.149 INFO:tasks.workunit.client.0.smithi026.stdout:8/426: creat d5/d56/d3f/f8d x:0 0 0 2024-04-23T10:17:51.149 INFO:tasks.workunit.client.0.smithi026.stdout:4/307: dread d4/d22/f4c [0,4194304] 0 2024-04-23T10:17:51.153 INFO:tasks.workunit.client.0.smithi026.stdout:1/341: fsync dd/d1a/d23/f28 0 2024-04-23T10:17:51.153 INFO:tasks.workunit.client.0.smithi026.stdout:8/427: truncate d5/d24/f73 457087 0 2024-04-23T10:17:51.154 INFO:tasks.workunit.client.0.smithi026.stdout:6/458: creat d6/d21/d2f/d32/f89 x:0 0 0 2024-04-23T10:17:51.157 INFO:tasks.workunit.client.0.smithi026.stdout:8/428: truncate d5/f2a 2250841 0 2024-04-23T10:17:51.159 INFO:tasks.workunit.client.0.smithi026.stdout:7/408: mknod dd/d6c/c79 0 2024-04-23T10:17:51.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/362: dwrite d0/d1e/d30/d43/df/f4b [0,4194304] 0 2024-04-23T10:17:51.161 INFO:tasks.workunit.client.0.smithi026.stdout:2/364: dread d3/dd/d4b/f61 [0,4194304] 0 2024-04-23T10:17:51.164 INFO:tasks.workunit.client.0.smithi026.stdout:1/342: mkdir dd/d15/d7d 0 2024-04-23T10:17:51.165 INFO:tasks.workunit.client.0.smithi026.stdout:6/459: creat d6/d13/d49/f8a x:0 0 0 2024-04-23T10:17:51.165 INFO:tasks.workunit.client.0.smithi026.stdout:9/436: dwrite d13/f5c [0,4194304] 0 2024-04-23T10:17:51.166 INFO:tasks.workunit.client.0.smithi026.stdout:2/365: fsync d3/d19/d21/d23/d3a/d3c/d5d/f67 0 2024-04-23T10:17:51.169 INFO:tasks.workunit.client.0.smithi026.stdout:4/308: dread d4/d14/d30/d52/f64 [4194304,4194304] 0 2024-04-23T10:17:51.172 INFO:tasks.workunit.client.0.smithi026.stdout:8/429: creat d5/d56/d47/f8e x:0 0 0 2024-04-23T10:17:51.179 INFO:tasks.workunit.client.0.smithi026.stdout:6/460: creat d6/d21/d2f/d32/d53/f8b x:0 0 0 2024-04-23T10:17:51.179 INFO:tasks.workunit.client.0.smithi026.stdout:1/343: dwrite dd/d1a/f6c [0,4194304] 0 2024-04-23T10:17:51.179 INFO:tasks.workunit.client.0.smithi026.stdout:1/344: chown dd/f2c 1747016 1 2024-04-23T10:17:51.182 INFO:tasks.workunit.client.0.smithi026.stdout:1/345: write dd/f12 [1171169,85016] 0 2024-04-23T10:17:51.183 INFO:tasks.workunit.client.0.smithi026.stdout:0/519: rename d7/d8/d1e/d1d/d2f/l1f to d7/d8/d1e/d57/da9/lc6 0 2024-04-23T10:17:51.183 INFO:tasks.workunit.client.0.smithi026.stdout:1/346: dread - dd/d1a/d20/f4d zero size 2024-04-23T10:17:51.188 INFO:tasks.workunit.client.0.smithi026.stdout:5/364: sync 2024-04-23T10:17:51.193 INFO:tasks.workunit.client.0.smithi026.stdout:7/409: dread dd/d1d/d50/f5c [0,4194304] 0 2024-04-23T10:17:51.194 INFO:tasks.workunit.client.0.smithi026.stdout:0/520: dwrite d7/d8/d1e/d2a/d6a/f6b [0,4194304] 0 2024-04-23T10:17:51.195 INFO:tasks.workunit.client.0.smithi026.stdout:7/410: stat dd/d1d/f71 0 2024-04-23T10:17:51.196 INFO:tasks.workunit.client.0.smithi026.stdout:5/365: dread d0/d3c/d5d/f4b [0,4194304] 0 2024-04-23T10:17:51.197 INFO:tasks.workunit.client.0.smithi026.stdout:2/366: link d3/d19/d21/d23/d3a/d3c/f5f d3/d19/d4d/f82 0 2024-04-23T10:17:51.200 INFO:tasks.workunit.client.0.smithi026.stdout:4/309: mknod d4/d7/c69 0 2024-04-23T10:17:51.201 INFO:tasks.workunit.client.0.smithi026.stdout:3/363: write d0/d1e/d30/d43/df/f33 [1228866,73436] 0 2024-04-23T10:17:51.202 INFO:tasks.workunit.client.0.smithi026.stdout:1/347: chown dd/d1a/d20/l6e 296031 1 2024-04-23T10:17:51.203 INFO:tasks.workunit.client.0.smithi026.stdout:0/521: dwrite d7/d43/f81 [0,4194304] 0 2024-04-23T10:17:51.207 INFO:tasks.workunit.client.0.smithi026.stdout:9/437: rmdir d13/d19/d6c 0 2024-04-23T10:17:51.207 INFO:tasks.workunit.client.0.smithi026.stdout:3/364: dread d0/d1e/d30/d43/df/f4b [0,4194304] 0 2024-04-23T10:17:51.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/438: dread d13/d3e/f64 [0,4194304] 0 2024-04-23T10:17:51.215 INFO:tasks.workunit.client.0.smithi026.stdout:2/367: mkdir d3/d19/d31/d83 0 2024-04-23T10:17:51.217 INFO:tasks.workunit.client.0.smithi026.stdout:6/461: truncate d6/d21/d2f/d32/f41 425434 0 2024-04-23T10:17:51.220 INFO:tasks.workunit.client.0.smithi026.stdout:8/430: creat d5/d9/f8f x:0 0 0 2024-04-23T10:17:51.222 INFO:tasks.workunit.client.0.smithi026.stdout:9/439: creat d13/d2a/d45/d67/f82 x:0 0 0 2024-04-23T10:17:51.225 INFO:tasks.workunit.client.0.smithi026.stdout:1/348: unlink dd/d1a/d23/f2d 0 2024-04-23T10:17:51.226 INFO:tasks.workunit.client.0.smithi026.stdout:4/310: dwrite d4/d7/f13 [0,4194304] 0 2024-04-23T10:17:51.228 INFO:tasks.workunit.client.0.smithi026.stdout:0/522: rename d7/d8/f25 to d7/d5b/fc7 0 2024-04-23T10:17:51.228 INFO:tasks.workunit.client.0.smithi026.stdout:4/311: rename d4/d7/d34 to d4/d7/d34/d36/d6a 22 2024-04-23T10:17:51.230 INFO:tasks.workunit.client.0.smithi026.stdout:7/411: creat dd/d3f/d47/d4c/d60/d75/f7a x:0 0 0 2024-04-23T10:17:51.230 INFO:tasks.workunit.client.0.smithi026.stdout:3/365: write d0/d1e/d30/d43/d6c/d79/f62 [5175881,27801] 0 2024-04-23T10:17:51.231 INFO:tasks.workunit.client.0.smithi026.stdout:4/312: dread - d4/d7/d34/f41 zero size 2024-04-23T10:17:51.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/440: dwrite d13/d2a/d45/d6d/f71 [0,4194304] 0 2024-04-23T10:17:51.238 INFO:tasks.workunit.client.0.smithi026.stdout:5/366: truncate d0/f3 2225918 0 2024-04-23T10:17:51.238 INFO:tasks.workunit.client.0.smithi026.stdout:1/349: creat dd/d1a/d23/f7e x:0 0 0 2024-04-23T10:17:51.239 INFO:tasks.workunit.client.0.smithi026.stdout:5/367: dread - d0/d3c/f65 zero size 2024-04-23T10:17:51.240 INFO:tasks.workunit.client.0.smithi026.stdout:5/368: truncate d0/d3c/f74 470461 0 2024-04-23T10:17:51.242 INFO:tasks.workunit.client.0.smithi026.stdout:5/369: write d0/d3c/f51 [2712221,15766] 0 2024-04-23T10:17:51.244 INFO:tasks.workunit.client.0.smithi026.stdout:0/523: rmdir d7/d8/d2d/d60/d62/da2 39 2024-04-23T10:17:51.245 INFO:tasks.workunit.client.0.smithi026.stdout:8/431: link d5/d56/d33/f58 d5/d56/d15/f90 0 2024-04-23T10:17:51.245 INFO:tasks.workunit.client.0.smithi026.stdout:2/368: creat d3/f84 x:0 0 0 2024-04-23T10:17:51.249 INFO:tasks.workunit.client.0.smithi026.stdout:7/412: write dd/d44/f3b [2426524,117535] 0 2024-04-23T10:17:51.251 INFO:tasks.workunit.client.0.smithi026.stdout:3/366: creat d0/d1e/d30/d43/df/d17/f81 x:0 0 0 2024-04-23T10:17:51.256 INFO:tasks.workunit.client.0.smithi026.stdout:6/462: link d6/d21/d2f/d31/c70 d6/d21/d2f/d32/d87/c8c 0 2024-04-23T10:17:51.258 INFO:tasks.workunit.client.0.smithi026.stdout:8/432: write d5/d9/d22/d65/d78/f7d [478999,130024] 0 2024-04-23T10:17:51.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/413: chown dd/d2c/d48/f59 1593 1 2024-04-23T10:17:51.262 INFO:tasks.workunit.client.0.smithi026.stdout:0/524: dwrite d7/d8/d1e/d1d/d2f/f48 [0,4194304] 0 2024-04-23T10:17:51.262 INFO:tasks.workunit.client.0.smithi026.stdout:2/369: write d3/d19/d21/d23/d3a/d3c/f63 [1434245,107278] 0 2024-04-23T10:17:51.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/433: truncate d5/d56/d33/f8c 868524 0 2024-04-23T10:17:51.265 INFO:tasks.workunit.client.0.smithi026.stdout:0/525: chown d7/l88 14165862 1 2024-04-23T10:17:51.265 INFO:tasks.workunit.client.0.smithi026.stdout:6/463: write d6/d13/d49/d64/f83 [1258155,62772] 0 2024-04-23T10:17:51.268 INFO:tasks.workunit.client.0.smithi026.stdout:9/441: dwrite d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:51.270 INFO:tasks.workunit.client.0.smithi026.stdout:3/367: mkdir d0/d1e/d30/d43/d82 0 2024-04-23T10:17:51.272 INFO:tasks.workunit.client.0.smithi026.stdout:2/370: write d3/d19/d21/d23/f29 [282535,71705] 0 2024-04-23T10:17:51.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/442: readlink d13/d3b/d68/l7d 0 2024-04-23T10:17:51.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/350: getdents dd/d1a/d20 0 2024-04-23T10:17:51.279 INFO:tasks.workunit.client.0.smithi026.stdout:8/434: dread d5/f28 [0,4194304] 0 2024-04-23T10:17:51.280 INFO:tasks.workunit.client.0.smithi026.stdout:3/368: creat d0/d51/f83 x:0 0 0 2024-04-23T10:17:51.281 INFO:tasks.workunit.client.0.smithi026.stdout:6/464: rename d6/d13/d49 to d6/d21/d58/d8d 0 2024-04-23T10:17:51.283 INFO:tasks.workunit.client.0.smithi026.stdout:7/414: symlink dd/d44/l7b 0 2024-04-23T10:17:51.285 INFO:tasks.workunit.client.0.smithi026.stdout:1/351: mkdir dd/d1a/d20/d25/d35/d7f 0 2024-04-23T10:17:51.286 INFO:tasks.workunit.client.0.smithi026.stdout:3/369: write d0/d1e/d30/d43/f3b [141768,86180] 0 2024-04-23T10:17:51.287 INFO:tasks.workunit.client.0.smithi026.stdout:9/443: dwrite d13/d3e/f41 [0,4194304] 0 2024-04-23T10:17:51.291 INFO:tasks.workunit.client.0.smithi026.stdout:7/415: rmdir dd/d1d/d50/d58 39 2024-04-23T10:17:51.292 INFO:tasks.workunit.client.0.smithi026.stdout:9/444: chown d13/d1b/d2b/c32 113891894 1 2024-04-23T10:17:51.293 INFO:tasks.workunit.client.0.smithi026.stdout:2/371: creat d3/d19/d21/f85 x:0 0 0 2024-04-23T10:17:51.295 INFO:tasks.workunit.client.0.smithi026.stdout:2/372: readlink d3/dd/l10 0 2024-04-23T10:17:51.297 INFO:tasks.workunit.client.0.smithi026.stdout:8/435: dwrite d5/d24/f27 [0,4194304] 0 2024-04-23T10:17:51.297 INFO:tasks.workunit.client.0.smithi026.stdout:4/313: dread d4/f5 [0,4194304] 0 2024-04-23T10:17:51.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/314: write d4/f2b [1500056,89035] 0 2024-04-23T10:17:51.302 INFO:tasks.workunit.client.0.smithi026.stdout:2/373: truncate d3/d19/d31/f77 1494045 0 2024-04-23T10:17:51.302 INFO:tasks.workunit.client.0.smithi026.stdout:4/315: chown d4/d7/d34/d36/d38/l39 1 1 2024-04-23T10:17:51.302 INFO:tasks.workunit.client.0.smithi026.stdout:6/465: unlink d6/d13/f4e 0 2024-04-23T10:17:51.304 INFO:tasks.workunit.client.0.smithi026.stdout:0/526: link d7/d8/d1e/d1d/f28 d7/d8/d2d/d60/d62/db2/db4/fc8 0 2024-04-23T10:17:51.305 INFO:tasks.workunit.client.0.smithi026.stdout:9/445: mknod d13/d3b/c83 0 2024-04-23T10:17:51.305 INFO:tasks.workunit.client.0.smithi026.stdout:4/316: fsync d4/d7/d34/d36/f55 0 2024-04-23T10:17:51.306 INFO:tasks.workunit.client.0.smithi026.stdout:3/370: rename d0/d1e/d30/d43/d6c/d79/f45 to d0/d1e/d30/d43/d29/f84 0 2024-04-23T10:17:51.306 INFO:tasks.workunit.client.0.smithi026.stdout:1/352: creat dd/d1a/d6a/d7c/f80 x:0 0 0 2024-04-23T10:17:51.311 INFO:tasks.workunit.client.0.smithi026.stdout:7/416: dwrite dd/d1d/d50/f55 [0,4194304] 0 2024-04-23T10:17:51.317 INFO:tasks.workunit.client.0.smithi026.stdout:8/436: dwrite d5/d24/f66 [0,4194304] 0 2024-04-23T10:17:51.318 INFO:tasks.workunit.client.0.smithi026.stdout:4/317: unlink f3 0 2024-04-23T10:17:51.320 INFO:tasks.workunit.client.0.smithi026.stdout:1/353: creat dd/d15/f81 x:0 0 0 2024-04-23T10:17:51.320 INFO:tasks.workunit.client.0.smithi026.stdout:9/446: mknod d13/d3b/d68/c84 0 2024-04-23T10:17:51.322 INFO:tasks.workunit.client.0.smithi026.stdout:2/374: creat d3/d19/d21/d23/d3a/d65/f86 x:0 0 0 2024-04-23T10:17:51.322 INFO:tasks.workunit.client.0.smithi026.stdout:0/527: mknod d7/d8/d2d/d60/d62/db2/cc9 0 2024-04-23T10:17:51.326 INFO:tasks.workunit.client.0.smithi026.stdout:8/437: chown d5/d56/d47/c5f 0 1 2024-04-23T10:17:51.327 INFO:tasks.workunit.client.0.smithi026.stdout:3/371: dwrite d0/d1e/d30/d43/d6c/d79/f62 [0,4194304] 0 2024-04-23T10:17:51.328 INFO:tasks.workunit.client.0.smithi026.stdout:9/447: mknod d13/d3b/c85 0 2024-04-23T10:17:51.330 INFO:tasks.workunit.client.0.smithi026.stdout:2/375: unlink d3/f8 0 2024-04-23T10:17:51.335 INFO:tasks.workunit.client.0.smithi026.stdout:0/528: dread d7/d43/f81 [0,4194304] 0 2024-04-23T10:17:51.337 INFO:tasks.workunit.client.0.smithi026.stdout:9/448: mknod d13/d2a/d45/d3a/c86 0 2024-04-23T10:17:51.338 INFO:tasks.workunit.client.0.smithi026.stdout:1/354: dwrite dd/d1a/d23/f40 [4194304,4194304] 0 2024-04-23T10:17:51.341 INFO:tasks.workunit.client.0.smithi026.stdout:6/466: dwrite d6/d13/d15/f2e [0,4194304] 0 2024-04-23T10:17:51.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/417: getdents dd 0 2024-04-23T10:17:51.346 INFO:tasks.workunit.client.0.smithi026.stdout:2/376: creat d3/d19/d21/d23/d3a/d65/f87 x:0 0 0 2024-04-23T10:17:51.346 INFO:tasks.workunit.client.0.smithi026.stdout:0/529: stat d7/d8/d1e/d1d/d2f/d6c/d7f/f87 0 2024-04-23T10:17:51.347 INFO:tasks.workunit.client.0.smithi026.stdout:8/438: read d5/d9/d22/f36 [144326,115972] 0 2024-04-23T10:17:51.348 INFO:tasks.workunit.client.0.smithi026.stdout:7/418: write dd/d3f/d47/d4c/f64 [864660,69422] 0 2024-04-23T10:17:51.349 INFO:tasks.workunit.client.0.smithi026.stdout:0/530: chown d7/d8/d1e/d1d/d2f/d6c/lba 0 1 2024-04-23T10:17:51.350 INFO:tasks.workunit.client.0.smithi026.stdout:8/439: write d5/d56/d3f/f8d [97532,93715] 0 2024-04-23T10:17:51.354 INFO:tasks.workunit.client.0.smithi026.stdout:0/531: readlink d7/d8/d1e/d57/l8b 0 2024-04-23T10:17:51.354 INFO:tasks.workunit.client.0.smithi026.stdout:1/355: symlink dd/d1a/d20/d25/d35/l82 0 2024-04-23T10:17:51.355 INFO:tasks.workunit.client.0.smithi026.stdout:9/449: getdents d13/d36/d66/d72 0 2024-04-23T10:17:51.356 INFO:tasks.workunit.client.0.smithi026.stdout:6/467: chown d6/d13/d15/l24 256 1 2024-04-23T10:17:51.356 INFO:tasks.workunit.client.0.smithi026.stdout:0/532: mkdir d7/d8/d2d/d60/d62/db2/dca 0 2024-04-23T10:17:51.359 INFO:tasks.workunit.client.0.smithi026.stdout:1/356: fdatasync dd/d1a/d20/d25/d35/d43/f4c 0 2024-04-23T10:17:51.360 INFO:tasks.workunit.client.0.smithi026.stdout:3/372: rename d0/d1e/d30/d43/f2d to d0/d1e/d30/d43/df/f85 0 2024-04-23T10:17:51.362 INFO:tasks.workunit.client.0.smithi026.stdout:9/450: write d13/d3e/f44 [7597829,41499] 0 2024-04-23T10:17:51.362 INFO:tasks.workunit.client.0.smithi026.stdout:4/318: dwrite d4/d7/f1f [0,4194304] 0 2024-04-23T10:17:51.362 INFO:tasks.workunit.client.0.smithi026.stdout:3/373: stat d0/d1e/d30/d43/d6c/d79 0 2024-04-23T10:17:51.365 INFO:tasks.workunit.client.0.smithi026.stdout:7/419: rename dd/d3f/d47/f57 to dd/d3f/d47/d4c/d60/d75/f7c 0 2024-04-23T10:17:51.366 INFO:tasks.workunit.client.0.smithi026.stdout:7/420: stat dd/d3f/d47/d4c/d60/d75/f7a 0 2024-04-23T10:17:51.368 INFO:tasks.workunit.client.0.smithi026.stdout:1/357: rename dd/d1a/f49 to dd/d1a/f83 0 2024-04-23T10:17:51.369 INFO:tasks.workunit.client.0.smithi026.stdout:9/451: mkdir d13/d31/d87 0 2024-04-23T10:17:51.370 INFO:tasks.workunit.client.0.smithi026.stdout:8/440: truncate d5/d9/fa 667065 0 2024-04-23T10:17:51.371 INFO:tasks.workunit.client.0.smithi026.stdout:1/358: read dd/d1a/d23/f40 [2040117,26194] 0 2024-04-23T10:17:51.372 INFO:tasks.workunit.client.0.smithi026.stdout:2/377: getdents d3/d19/d1d 0 2024-04-23T10:17:51.374 INFO:tasks.workunit.client.0.smithi026.stdout:0/533: symlink d7/d8/d2d/d60/d62/db9/lcb 0 2024-04-23T10:17:51.374 INFO:tasks.workunit.client.0.smithi026.stdout:3/374: chown d0/d1e/d30/d43/d29/d39/l3d 527 1 2024-04-23T10:17:51.376 INFO:tasks.workunit.client.0.smithi026.stdout:8/441: mknod d5/d56/d33/c91 0 2024-04-23T10:17:51.377 INFO:tasks.workunit.client.0.smithi026.stdout:1/359: truncate dd/f21 726840 0 2024-04-23T10:17:51.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/421: dwrite dd/d3f/d47/d4c/f4a [0,4194304] 0 2024-04-23T10:17:51.379 INFO:tasks.workunit.client.0.smithi026.stdout:0/534: mkdir d7/dc2/dcc 0 2024-04-23T10:17:51.384 INFO:tasks.workunit.client.0.smithi026.stdout:2/378: mkdir d3/d19/d21/d88 0 2024-04-23T10:17:51.385 INFO:tasks.workunit.client.0.smithi026.stdout:9/452: dread d13/d2a/f35 [0,4194304] 0 2024-04-23T10:17:51.390 INFO:tasks.workunit.client.0.smithi026.stdout:4/319: dwrite d4/d7/f1f [4194304,4194304] 0 2024-04-23T10:17:51.390 INFO:tasks.workunit.client.0.smithi026.stdout:8/442: fsync d5/d9/f5b 0 2024-04-23T10:17:51.390 INFO:tasks.workunit.client.0.smithi026.stdout:9/453: write d13/d2a/d45/d67/f7c [313777,4376] 0 2024-04-23T10:17:51.391 INFO:tasks.workunit.client.0.smithi026.stdout:3/375: mknod d0/c86 0 2024-04-23T10:17:51.392 INFO:tasks.workunit.client.0.smithi026.stdout:1/360: dwrite dd/d1a/d6a/f77 [0,4194304] 0 2024-04-23T10:17:51.398 INFO:tasks.workunit.client.0.smithi026.stdout:3/376: stat d0/d1e/d30/d43/d6c/d79/d64/l69 0 2024-04-23T10:17:51.398 INFO:tasks.workunit.client.0.smithi026.stdout:7/422: dwrite dd/d2c/d48/f5b [0,4194304] 0 2024-04-23T10:17:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:1/361: fdatasync dd/d1a/d23/f7e 0 2024-04-23T10:17:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:0/535: rename d7/d43/f81 to d7/d8/d1e/d2a/d6a/d70/fcd 0 2024-04-23T10:17:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:1/362: read - dd/d48/f63 zero size 2024-04-23T10:17:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:2/379: mknod d3/d19/d21/d23/d3a/d3c/d5d/c89 0 2024-04-23T10:17:51.399 INFO:tasks.workunit.client.0.smithi026.stdout:9/454: fdatasync d13/d1b/f6e 0 2024-04-23T10:17:51.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/320: write d4/d7/d34/f4f [766318,111548] 0 2024-04-23T10:17:51.408 INFO:tasks.workunit.client.0.smithi026.stdout:1/363: rename ca to dd/d15/c84 0 2024-04-23T10:17:51.408 INFO:tasks.workunit.client.0.smithi026.stdout:9/455: mkdir d13/d1b/d26/d88 0 2024-04-23T10:17:51.409 INFO:tasks.workunit.client.0.smithi026.stdout:0/536: write d7/d8/d2d/d60/f98 [363396,112052] 0 2024-04-23T10:17:51.412 INFO:tasks.workunit.client.0.smithi026.stdout:8/443: creat d5/d9/d22/d65/d78/d3e/f92 x:0 0 0 2024-04-23T10:17:51.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/380: read d3/d19/d21/d23/d3a/d3c/f47 [1663540,123023] 0 2024-04-23T10:17:51.414 INFO:tasks.workunit.client.0.smithi026.stdout:4/321: creat d4/d7/d34/f6b x:0 0 0 2024-04-23T10:17:51.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/423: write dd/d44/f23 [106373,81924] 0 2024-04-23T10:17:51.416 INFO:tasks.workunit.client.0.smithi026.stdout:1/364: mknod dd/d1a/d20/c85 0 2024-04-23T10:17:51.417 INFO:tasks.workunit.client.0.smithi026.stdout:9/456: creat d13/d3b/d4e/f89 x:0 0 0 2024-04-23T10:17:51.420 INFO:tasks.workunit.client.0.smithi026.stdout:2/381: write d3/dd/d4b/f64 [791875,68234] 0 2024-04-23T10:17:51.425 INFO:tasks.workunit.client.0.smithi026.stdout:7/424: mkdir dd/d1d/d7d 0 2024-04-23T10:17:51.426 INFO:tasks.workunit.client.0.smithi026.stdout:1/365: creat dd/d1a/d6a/f86 x:0 0 0 2024-04-23T10:17:51.428 INFO:tasks.workunit.client.0.smithi026.stdout:3/377: dwrite d0/d1e/d30/d43/d29/f34 [0,4194304] 0 2024-04-23T10:17:51.431 INFO:tasks.workunit.client.0.smithi026.stdout:1/366: creat dd/d1a/d23/d3f/f87 x:0 0 0 2024-04-23T10:17:51.434 INFO:tasks.workunit.client.0.smithi026.stdout:2/382: symlink d3/d19/l8a 0 2024-04-23T10:17:51.434 INFO:tasks.workunit.client.0.smithi026.stdout:7/425: dwrite dd/d1d/f37 [0,4194304] 0 2024-04-23T10:17:51.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/383: fsync d3/f22 0 2024-04-23T10:17:51.438 INFO:tasks.workunit.client.0.smithi026.stdout:3/378: mkdir d0/d1e/d23/d87 0 2024-04-23T10:17:51.438 INFO:tasks.workunit.client.0.smithi026.stdout:8/444: rename d5/ce to d5/d56/c93 0 2024-04-23T10:17:51.438 INFO:tasks.workunit.client.0.smithi026.stdout:9/457: write d13/d1b/f6e [1759942,64895] 0 2024-04-23T10:17:51.443 INFO:tasks.workunit.client.0.smithi026.stdout:7/426: unlink dd/f11 0 2024-04-23T10:17:51.445 INFO:tasks.workunit.client.0.smithi026.stdout:9/458: mknod d13/d36/d66/c8a 0 2024-04-23T10:17:51.446 INFO:tasks.workunit.client.0.smithi026.stdout:3/379: truncate d0/f11 112596 0 2024-04-23T10:17:51.449 INFO:tasks.workunit.client.0.smithi026.stdout:0/537: rename d7/d5b/fb1 to d7/d8/d2d/d60/d62/da2/fce 0 2024-04-23T10:17:51.449 INFO:tasks.workunit.client.0.smithi026.stdout:1/367: dwrite dd/d1a/d20/d25/f2f [4194304,4194304] 0 2024-04-23T10:17:51.449 INFO:tasks.workunit.client.0.smithi026.stdout:2/384: creat d3/d19/d31/d83/f8b x:0 0 0 2024-04-23T10:17:51.452 INFO:tasks.workunit.client.0.smithi026.stdout:2/385: readlink d3/d19/d4d/l58 0 2024-04-23T10:17:51.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/368: dwrite dd/d1a/d20/d25/f38 [0,4194304] 0 2024-04-23T10:17:51.462 INFO:tasks.workunit.client.0.smithi026.stdout:1/369: chown f2 2824 1 2024-04-23T10:17:51.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/445: write d5/d56/d33/f58 [880743,32544] 0 2024-04-23T10:17:51.463 INFO:tasks.workunit.client.0.smithi026.stdout:4/322: rename d4/d5b/d68 to d4/d7/d51/d6c 0 2024-04-23T10:17:51.466 INFO:tasks.workunit.client.0.smithi026.stdout:3/380: dwrite d0/d1e/d30/d43/df/d17/f81 [0,4194304] 0 2024-04-23T10:17:51.467 INFO:tasks.workunit.client.0.smithi026.stdout:2/386: dwrite d3/dd/d4b/f64 [0,4194304] 0 2024-04-23T10:17:51.468 INFO:tasks.workunit.client.0.smithi026.stdout:7/427: chown dd/d1d/d78 7319 1 2024-04-23T10:17:51.470 INFO:tasks.workunit.client.0.smithi026.stdout:0/538: rename d7/d8/c7c to d7/d8/d1e/d1d/d2f/d6c/d7f/ccf 0 2024-04-23T10:17:51.472 INFO:tasks.workunit.client.0.smithi026.stdout:1/370: unlink dd/d1a/d23/f18 0 2024-04-23T10:17:51.477 INFO:tasks.workunit.client.0.smithi026.stdout:0/539: readlink d7/d8/d1e/d57/lae 0 2024-04-23T10:17:51.485 INFO:tasks.workunit.client.0.smithi026.stdout:1/371: rename dd/d1a/d23/l37 to dd/d1a/d20/d25/d35/d74/l88 0 2024-04-23T10:17:51.486 INFO:tasks.workunit.client.0.smithi026.stdout:1/372: write dd/f3b [3646646,28817] 0 2024-04-23T10:17:51.488 INFO:tasks.workunit.client.0.smithi026.stdout:9/459: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:51.488 INFO:tasks.workunit.client.0.smithi026.stdout:1/373: write dd/d1a/d20/d25/d35/d43/f50 [48714,95861] 0 2024-04-23T10:17:51.490 INFO:tasks.workunit.client.0.smithi026.stdout:9/460: write d13/d2a/d45/d3a/d4f/f59 [4304553,98570] 0 2024-04-23T10:17:51.491 INFO:tasks.workunit.client.0.smithi026.stdout:2/387: creat d3/d19/d21/d23/d3a/f8c x:0 0 0 2024-04-23T10:17:51.497 INFO:tasks.workunit.client.0.smithi026.stdout:2/388: write d3/d19/d21/d23/d3a/d65/f74 [214239,79522] 0 2024-04-23T10:17:51.497 INFO:tasks.workunit.client.0.smithi026.stdout:3/381: truncate d0/fc 961634 0 2024-04-23T10:17:51.499 INFO:tasks.workunit.client.0.smithi026.stdout:7/428: dwrite dd/f36 [0,4194304] 0 2024-04-23T10:17:51.500 INFO:tasks.workunit.client.0.smithi026.stdout:4/323: truncate d4/d7/d61/f62 4008189 0 2024-04-23T10:17:51.505 INFO:tasks.workunit.client.0.smithi026.stdout:9/461: dwrite d13/d3b/d4e/f89 [0,4194304] 0 2024-04-23T10:17:51.507 INFO:tasks.workunit.client.0.smithi026.stdout:3/382: creat d0/d1e/d23/d52/d75/f88 x:0 0 0 2024-04-23T10:17:51.508 INFO:tasks.workunit.client.0.smithi026.stdout:0/540: getdents d7/d8/d2d/d60/d77 0 2024-04-23T10:17:51.510 INFO:tasks.workunit.client.0.smithi026.stdout:8/446: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:51.511 INFO:tasks.workunit.client.0.smithi026.stdout:8/447: stat d5/d9/d22/c35 0 2024-04-23T10:17:51.511 INFO:tasks.workunit.client.0.smithi026.stdout:8/448: readlink d5/d56/d15/l49 0 2024-04-23T10:17:51.515 INFO:tasks.workunit.client.0.smithi026.stdout:4/324: rename d4/d7/f9 to d4/d22/d2e/f6d 0 2024-04-23T10:17:51.518 INFO:tasks.workunit.client.0.smithi026.stdout:3/383: mknod d0/d1e/d30/d43/d6c/d79/c89 0 2024-04-23T10:17:51.520 INFO:tasks.workunit.client.0.smithi026.stdout:0/541: rename d7/d8/d1e/d1d/f28 to d7/d8/d1e/d2a/d6a/d70/fd0 0 2024-04-23T10:17:51.524 INFO:tasks.workunit.client.0.smithi026.stdout:8/449: symlink d5/d56/d15/d8b/l94 0 2024-04-23T10:17:51.525 INFO:tasks.workunit.client.0.smithi026.stdout:9/462: creat d13/d19/f8b x:0 0 0 2024-04-23T10:17:51.526 INFO:tasks.workunit.client.0.smithi026.stdout:0/542: read - d7/d8/d1e/d1d/d2f/f52 zero size 2024-04-23T10:17:51.534 INFO:tasks.workunit.client.0.smithi026.stdout:8/450: dwrite d5/d50/f79 [0,4194304] 0 2024-04-23T10:17:51.544 INFO:tasks.workunit.client.0.smithi026.stdout:3/384: creat d0/d1e/d30/f8a x:0 0 0 2024-04-23T10:17:51.545 INFO:tasks.workunit.client.0.smithi026.stdout:0/543: mkdir d7/d8/d1e/d1d/d2f/dd1 0 2024-04-23T10:17:51.550 INFO:tasks.workunit.client.0.smithi026.stdout:9/463: rmdir d13/d2a/d45/d3a/d4f/d61 0 2024-04-23T10:17:51.552 INFO:tasks.workunit.client.0.smithi026.stdout:8/451: link d5/d56/d47/c74 d5/d50/c95 0 2024-04-23T10:17:51.553 INFO:tasks.workunit.client.0.smithi026.stdout:0/544: dwrite d7/d8/d2d/d60/d62/f5c [0,4194304] 0 2024-04-23T10:17:51.555 INFO:tasks.workunit.client.0.smithi026.stdout:3/385: rename d0/d1e/f37 to d0/d1e/f8b 0 2024-04-23T10:17:51.561 INFO:tasks.workunit.client.0.smithi026.stdout:0/545: write d7/d43/f53 [4975087,129976] 0 2024-04-23T10:17:51.563 INFO:tasks.workunit.client.0.smithi026.stdout:9/464: truncate d13/d19/f4d 4808359 0 2024-04-23T10:17:51.564 INFO:tasks.workunit.client.0.smithi026.stdout:3/386: fdatasync d0/d1e/f8b 0 2024-04-23T10:17:51.567 INFO:tasks.workunit.client.0.smithi026.stdout:0/546: creat d7/d8/d1e/d1d/d2f/d6c/fd2 x:0 0 0 2024-04-23T10:17:51.567 INFO:tasks.workunit.client.0.smithi026.stdout:9/465: mknod d13/d36/d66/d78/c8c 0 2024-04-23T10:17:51.568 INFO:tasks.workunit.client.0.smithi026.stdout:0/547: chown d7/d8/d1e/d1d/d2f/d6c/d7f 260301 1 2024-04-23T10:17:51.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/452: creat d5/d9/f96 x:0 0 0 2024-04-23T10:17:51.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/453: chown d5/d24/l32 231406 1 2024-04-23T10:17:51.571 INFO:tasks.workunit.client.0.smithi026.stdout:3/387: mkdir d0/d1e/d30/d43/df/d72/d8c 0 2024-04-23T10:17:51.572 INFO:tasks.workunit.client.0.smithi026.stdout:9/466: dread d13/d3b/d4e/f89 [0,4194304] 0 2024-04-23T10:17:51.574 INFO:tasks.workunit.client.0.smithi026.stdout:9/467: read d13/f1c [5835543,53020] 0 2024-04-23T10:17:51.575 INFO:tasks.workunit.client.0.smithi026.stdout:0/548: mkdir d7/d8/d1e/dd3 0 2024-04-23T10:17:51.576 INFO:tasks.workunit.client.0.smithi026.stdout:9/468: write d13/d2a/d45/d67/f7c [686348,34571] 0 2024-04-23T10:17:51.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/454: fsync d5/f28 0 2024-04-23T10:17:51.576 INFO:tasks.workunit.client.0.smithi026.stdout:0/549: fsync d7/d8/d1e/d57/da9/fc5 0 2024-04-23T10:17:51.578 INFO:tasks.workunit.client.0.smithi026.stdout:8/455: truncate d5/d9/d22/f36 1084303 0 2024-04-23T10:17:51.579 INFO:tasks.workunit.client.0.smithi026.stdout:3/388: rename d0/d1e/d23/f74 to d0/d1e/d23/d87/f8d 0 2024-04-23T10:17:51.583 INFO:tasks.workunit.client.0.smithi026.stdout:0/550: unlink d7/d8/d2d/f75 0 2024-04-23T10:17:51.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/456: symlink d5/d56/d15/d76/l97 0 2024-04-23T10:17:51.585 INFO:tasks.workunit.client.0.smithi026.stdout:3/389: creat d0/d1e/d30/d43/d29/f8e x:0 0 0 2024-04-23T10:17:51.590 INFO:tasks.workunit.client.0.smithi026.stdout:0/551: dwrite d7/d8/f9 [0,4194304] 0 2024-04-23T10:17:51.593 INFO:tasks.workunit.client.0.smithi026.stdout:9/469: unlink d13/l24 0 2024-04-23T10:17:51.594 INFO:tasks.workunit.client.0.smithi026.stdout:3/390: dwrite d0/d1e/d30/d43/d29/f8e [0,4194304] 0 2024-04-23T10:17:51.595 INFO:tasks.workunit.client.0.smithi026.stdout:0/552: symlink d7/d8/d2d/d60/d62/db9/ld4 0 2024-04-23T10:17:51.598 INFO:tasks.workunit.client.0.smithi026.stdout:9/470: symlink d13/d2a/d45/d6d/l8d 0 2024-04-23T10:17:51.598 INFO:tasks.workunit.client.0.smithi026.stdout:3/391: read d0/d1e/d30/d43/df/d17/f32 [1920145,60377] 0 2024-04-23T10:17:51.607 INFO:tasks.workunit.client.0.smithi026.stdout:8/457: dread d5/d56/d15/f31 [0,4194304] 0 2024-04-23T10:17:51.609 INFO:tasks.workunit.client.0.smithi026.stdout:0/553: dwrite d7/d8/d1e/d57/f5e [0,4194304] 0 2024-04-23T10:17:51.609 INFO:tasks.workunit.client.0.smithi026.stdout:3/392: read d0/d1e/d30/d43/df/f85 [160309,40799] 0 2024-04-23T10:17:51.616 INFO:tasks.workunit.client.0.smithi026.stdout:9/471: dwrite d13/f25 [0,4194304] 0 2024-04-23T10:17:51.622 INFO:tasks.workunit.client.0.smithi026.stdout:9/472: symlink d13/d31/d87/l8e 0 2024-04-23T10:17:51.624 INFO:tasks.workunit.client.0.smithi026.stdout:0/554: dwrite d7/d8/d1e/f32 [0,4194304] 0 2024-04-23T10:17:51.626 INFO:tasks.workunit.client.0.smithi026.stdout:9/473: creat d13/d3b/d4e/d76/f8f x:0 0 0 2024-04-23T10:17:51.629 INFO:tasks.workunit.client.0.smithi026.stdout:3/393: dread d0/d1e/d30/d43/df/f85 [0,4194304] 0 2024-04-23T10:17:51.631 INFO:tasks.workunit.client.0.smithi026.stdout:9/474: creat d13/d3b/d5b/f90 x:0 0 0 2024-04-23T10:17:51.637 INFO:tasks.workunit.client.0.smithi026.stdout:0/555: creat d7/d8/d1e/d2a/fd5 x:0 0 0 2024-04-23T10:17:51.638 INFO:tasks.workunit.client.0.smithi026.stdout:9/475: creat d13/d3b/d4e/d76/f91 x:0 0 0 2024-04-23T10:17:51.638 INFO:tasks.workunit.client.0.smithi026.stdout:0/556: dread - d7/d8/d2d/f8c zero size 2024-04-23T10:17:51.639 INFO:tasks.workunit.client.0.smithi026.stdout:3/394: dwrite d0/d1e/f8b [0,4194304] 0 2024-04-23T10:17:51.640 INFO:tasks.workunit.client.0.smithi026.stdout:0/557: dread - d7/d8/d1e/d1d/d2f/f52 zero size 2024-04-23T10:17:51.642 INFO:tasks.workunit.client.0.smithi026.stdout:9/476: mknod d13/d3b/d4e/d76/c92 0 2024-04-23T10:17:51.642 INFO:tasks.workunit.client.0.smithi026.stdout:3/395: chown d0/d1e/d30/d43/d6c/d79/l3a 1235900650 1 2024-04-23T10:17:51.643 INFO:tasks.workunit.client.0.smithi026.stdout:9/477: read d13/d3b/d4e/f89 [3861259,21515] 0 2024-04-23T10:17:51.643 INFO:tasks.workunit.client.0.smithi026.stdout:8/458: dread d5/d50/f7a [0,4194304] 0 2024-04-23T10:17:51.644 INFO:tasks.workunit.client.0.smithi026.stdout:0/558: read d7/f39 [164733,66350] 0 2024-04-23T10:17:51.646 INFO:tasks.workunit.client.0.smithi026.stdout:9/478: unlink d13/d2a/d45/d6d/l8d 0 2024-04-23T10:17:51.648 INFO:tasks.workunit.client.0.smithi026.stdout:3/396: creat d0/d1e/d30/d43/d6c/d79/d73/f8f x:0 0 0 2024-04-23T10:17:51.648 INFO:tasks.workunit.client.0.smithi026.stdout:8/459: write d5/d9/f8f [545137,65098] 0 2024-04-23T10:17:51.650 INFO:tasks.workunit.client.0.smithi026.stdout:9/479: rename d13/d3b/f7a to d13/d36/d66/f93 0 2024-04-23T10:17:51.651 INFO:tasks.workunit.client.0.smithi026.stdout:3/397: mknod d0/d1e/d30/d43/d29/c90 0 2024-04-23T10:17:51.652 INFO:tasks.workunit.client.0.smithi026.stdout:8/460: mknod d5/d24/c98 0 2024-04-23T10:17:51.653 INFO:tasks.workunit.client.0.smithi026.stdout:9/480: mknod d13/c94 0 2024-04-23T10:17:51.662 INFO:tasks.workunit.client.0.smithi026.stdout:3/398: dwrite d0/d1e/d30/d43/f3b [4194304,4194304] 0 2024-04-23T10:17:51.664 INFO:tasks.workunit.client.0.smithi026.stdout:8/461: truncate d5/d50/f7a 1443822 0 2024-04-23T10:17:51.664 INFO:tasks.workunit.client.0.smithi026.stdout:9/481: truncate d13/d3b/d5b/f63 2006723 0 2024-04-23T10:17:51.665 INFO:tasks.workunit.client.0.smithi026.stdout:3/399: stat d0/d1e/d30/d43/df 0 2024-04-23T10:17:51.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/462: chown d5/d9/d22/d65/d78/d3e/f92 9 1 2024-04-23T10:17:51.667 INFO:tasks.workunit.client.0.smithi026.stdout:0/559: dread d7/d8/d1e/d2a/f47 [0,4194304] 0 2024-04-23T10:17:51.668 INFO:tasks.workunit.client.0.smithi026.stdout:8/463: write d5/d9/d22/d65/f83 [835986,114686] 0 2024-04-23T10:17:51.676 INFO:tasks.workunit.client.0.smithi026.stdout:9/482: truncate d13/d3e/f41 3474621 0 2024-04-23T10:17:51.727 INFO:tasks.workunit.client.0.smithi026.stdout:3/400: dwrite d0/d51/f83 [0,4194304] 0 2024-04-23T10:17:51.731 INFO:tasks.workunit.client.0.smithi026.stdout:3/401: truncate d0/f4 5374541 0 2024-04-23T10:17:51.733 INFO:tasks.workunit.client.0.smithi026.stdout:9/483: truncate d13/d36/d66/f93 719874 0 2024-04-23T10:17:51.733 INFO:tasks.workunit.client.0.smithi026.stdout:8/464: dwrite d5/d56/d15/f5d [0,4194304] 0 2024-04-23T10:17:51.737 INFO:tasks.workunit.client.0.smithi026.stdout:0/560: dwrite d7/d8/d1e/d1d/d2f/f44 [0,4194304] 0 2024-04-23T10:17:51.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/465: truncate d5/d56/d15/d76/f85 306540 0 2024-04-23T10:17:51.740 INFO:tasks.workunit.client.0.smithi026.stdout:9/484: creat d13/d2a/d45/d67/f95 x:0 0 0 2024-04-23T10:17:51.741 INFO:tasks.workunit.client.0.smithi026.stdout:9/485: chown d13/d3e/f5e 223 1 2024-04-23T10:17:51.742 INFO:tasks.workunit.client.0.smithi026.stdout:9/486: readlink d13/d31/l42 0 2024-04-23T10:17:51.743 INFO:tasks.workunit.client.0.smithi026.stdout:9/487: chown d13/f1c 3 1 2024-04-23T10:17:51.746 INFO:tasks.workunit.client.0.smithi026.stdout:0/561: mkdir d7/d8/d1e/d1d/d2f/dd1/dd6 0 2024-04-23T10:17:51.746 INFO:tasks.workunit.client.0.smithi026.stdout:3/402: creat d0/d1e/f91 x:0 0 0 2024-04-23T10:17:51.748 INFO:tasks.workunit.client.0.smithi026.stdout:9/488: creat d13/d2a/d45/d3a/d6b/f96 x:0 0 0 2024-04-23T10:17:51.750 INFO:tasks.workunit.client.0.smithi026.stdout:8/466: getdents d5/d56/d3f 0 2024-04-23T10:17:51.753 INFO:tasks.workunit.client.0.smithi026.stdout:0/562: creat d7/d8/d2d/fd7 x:0 0 0 2024-04-23T10:17:51.758 INFO:tasks.workunit.client.0.smithi026.stdout:8/467: mkdir d5/d56/d47/d99 0 2024-04-23T10:17:51.760 INFO:tasks.workunit.client.0.smithi026.stdout:0/563: chown d7/d8/d1e/d1d/l54 55977 1 2024-04-23T10:17:51.765 INFO:tasks.workunit.client.0.smithi026.stdout:8/468: read d5/d56/d3f/f57 [334635,13612] 0 2024-04-23T10:17:51.767 INFO:tasks.workunit.client.0.smithi026.stdout:9/489: link d13/d2a/d45/d3a/l74 d13/d3b/l97 0 2024-04-23T10:17:51.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/490: chown d13/d2a/d45/d67 15267 1 2024-04-23T10:17:51.768 INFO:tasks.workunit.client.0.smithi026.stdout:9/491: dread - d13/d2a/d45/d67/f95 zero size 2024-04-23T10:17:51.771 INFO:tasks.workunit.client.0.smithi026.stdout:0/564: rename d7/d8/d1e/d1d/d2f/c5a to d7/d8/d2d/d60/d62/d96/cd8 0 2024-04-23T10:17:51.773 INFO:tasks.workunit.client.0.smithi026.stdout:3/403: truncate d0/d1e/d23/d52/f61 4343025 0 2024-04-23T10:17:51.775 INFO:tasks.workunit.client.0.smithi026.stdout:8/469: rename d5/d9/d64/d88 to d5/d50/d9a 0 2024-04-23T10:17:51.778 INFO:tasks.workunit.client.0.smithi026.stdout:3/404: symlink d0/d1e/d30/d43/d6c/d79/d73/l92 0 2024-04-23T10:17:51.779 INFO:tasks.workunit.client.0.smithi026.stdout:8/470: symlink d5/d9/d64/l9b 0 2024-04-23T10:17:51.780 INFO:tasks.workunit.client.0.smithi026.stdout:9/492: rmdir d13/d1b/d79 0 2024-04-23T10:17:51.781 INFO:tasks.workunit.client.0.smithi026.stdout:9/493: stat d13/f1e 0 2024-04-23T10:17:51.781 INFO:tasks.workunit.client.0.smithi026.stdout:3/405: chown d0/d1e/d30/d43/df/f44 2 1 2024-04-23T10:17:51.784 INFO:tasks.workunit.client.0.smithi026.stdout:8/471: getdents d5/d56/d47 0 2024-04-23T10:17:51.785 INFO:tasks.workunit.client.0.smithi026.stdout:3/406: mkdir d0/d1e/d30/d43/d29/d39/d93 0 2024-04-23T10:17:51.787 INFO:tasks.workunit.client.0.smithi026.stdout:0/565: dwrite d7/d8/d1e/d1d/d2f/d6c/fb7 [0,4194304] 0 2024-04-23T10:17:51.793 INFO:tasks.workunit.client.0.smithi026.stdout:0/566: rmdir d7/d8/d1e/d1d/d2f/dd1 39 2024-04-23T10:17:51.795 INFO:tasks.workunit.client.0.smithi026.stdout:3/407: getdents d0/d1e/d30/d77 0 2024-04-23T10:17:51.796 INFO:tasks.workunit.client.0.smithi026.stdout:9/494: dwrite d13/f25 [4194304,4194304] 0 2024-04-23T10:17:51.796 INFO:tasks.workunit.client.0.smithi026.stdout:8/472: symlink d5/d9/d22/d65/d78/l9c 0 2024-04-23T10:17:51.798 INFO:tasks.workunit.client.0.smithi026.stdout:8/473: dread - d5/d9/d22/d65/f87 zero size 2024-04-23T10:17:51.799 INFO:tasks.workunit.client.0.smithi026.stdout:0/567: mkdir d7/d8/d2d/d60/d62/da2/dd9 0 2024-04-23T10:17:51.801 INFO:tasks.workunit.client.0.smithi026.stdout:3/408: creat d0/d1e/d23/d52/d75/f94 x:0 0 0 2024-04-23T10:17:51.802 INFO:tasks.workunit.client.0.smithi026.stdout:3/409: chown d0/d1e/d30/d43/d6c/d79/c89 160825 1 2024-04-23T10:17:51.803 INFO:tasks.workunit.client.0.smithi026.stdout:3/410: write d0/d1e/d30/d43/df/d17/f46 [76991,56773] 0 2024-04-23T10:17:51.804 INFO:tasks.workunit.client.0.smithi026.stdout:9/495: mkdir d13/d1b/d98 0 2024-04-23T10:17:51.807 INFO:tasks.workunit.client.0.smithi026.stdout:3/411: unlink d0/d1e/d30/f57 0 2024-04-23T10:17:51.809 INFO:tasks.workunit.client.0.smithi026.stdout:9/496: mkdir d13/d2a/d45/d6d/d99 0 2024-04-23T10:17:51.809 INFO:tasks.workunit.client.0.smithi026.stdout:0/568: link d7/dc2/l97 d7/d8/d2d/d60/d62/db2/db4/lda 0 2024-04-23T10:17:51.810 INFO:tasks.workunit.client.0.smithi026.stdout:0/569: read - d7/d8/d2d/f8c zero size 2024-04-23T10:17:51.810 INFO:tasks.workunit.client.0.smithi026.stdout:8/474: getdents d5/d56/d15/d8b 0 2024-04-23T10:17:51.811 INFO:tasks.workunit.client.0.smithi026.stdout:9/497: rmdir d13/d31/d87 39 2024-04-23T10:17:51.811 INFO:tasks.workunit.client.0.smithi026.stdout:9/498: dread - d13/d2a/d45/d3a/f56 zero size 2024-04-23T10:17:51.813 INFO:tasks.workunit.client.0.smithi026.stdout:9/499: fsync d13/d2a/d45/d3a/d4f/f59 0 2024-04-23T10:17:51.814 INFO:tasks.workunit.client.0.smithi026.stdout:0/570: chown d7/d8/d1e/d1d/d2f/c3f 66 1 2024-04-23T10:17:51.817 INFO:tasks.workunit.client.0.smithi026.stdout:0/571: creat d7/d8/d1e/d1d/d2f/d6c/d7f/fdb x:0 0 0 2024-04-23T10:17:51.818 INFO:tasks.workunit.client.0.smithi026.stdout:0/572: fdatasync d7/d8/d1e/d1d/d2f/d6c/d7f/fdb 0 2024-04-23T10:17:51.821 INFO:tasks.workunit.client.0.smithi026.stdout:0/573: rename d7/d8/d2d/d60/d62/db9/ld4 to d7/d8/d2d/d60/ldc 0 2024-04-23T10:17:51.823 INFO:tasks.workunit.client.0.smithi026.stdout:3/412: truncate d0/d1e/d23/f41 661044 0 2024-04-23T10:17:51.823 INFO:tasks.workunit.client.0.smithi026.stdout:8/475: write d5/d9/d22/f60 [1679504,52017] 0 2024-04-23T10:17:51.825 INFO:tasks.workunit.client.0.smithi026.stdout:8/476: write d5/d9/f8f [1074545,49377] 0 2024-04-23T10:17:51.827 INFO:tasks.workunit.client.0.smithi026.stdout:3/413: creat d0/d1e/d30/d43/df/d63/f95 x:0 0 0 2024-04-23T10:17:51.830 INFO:tasks.workunit.client.0.smithi026.stdout:9/500: dwrite d13/f2d [0,4194304] 0 2024-04-23T10:17:51.832 INFO:tasks.workunit.client.0.smithi026.stdout:3/414: creat d0/d1e/d30/d43/df/d63/f96 x:0 0 0 2024-04-23T10:17:51.833 INFO:tasks.workunit.client.0.smithi026.stdout:8/477: rename d5/d56/d15/d76/l97 to d5/d24/l9d 0 2024-04-23T10:17:51.833 INFO:tasks.workunit.client.0.smithi026.stdout:3/415: truncate d0/d1e/d30/d43/d29/f84 4237827 0 2024-04-23T10:17:51.834 INFO:tasks.workunit.client.0.smithi026.stdout:9/501: truncate d13/d3e/f64 1205573 0 2024-04-23T10:17:51.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/478: getdents d5/d56/d47/d99 0 2024-04-23T10:17:51.835 INFO:tasks.workunit.client.0.smithi026.stdout:9/502: chown d13/d3b/d5b 43 1 2024-04-23T10:17:51.835 INFO:tasks.workunit.client.0.smithi026.stdout:9/503: read d13/f2d [2584406,78955] 0 2024-04-23T10:17:51.836 INFO:tasks.workunit.client.0.smithi026.stdout:3/416: stat d0/d1e/d30/d43/df/d63/f95 0 2024-04-23T10:17:51.837 INFO:tasks.workunit.client.0.smithi026.stdout:8/479: symlink d5/d9/l9e 0 2024-04-23T10:17:51.837 INFO:tasks.workunit.client.0.smithi026.stdout:9/504: write d13/f1c [3120530,101951] 0 2024-04-23T10:17:51.839 INFO:tasks.workunit.client.0.smithi026.stdout:8/480: write d5/f2a [2789539,52340] 0 2024-04-23T10:17:51.840 INFO:tasks.workunit.client.0.smithi026.stdout:8/481: dread - d5/d24/f72 zero size 2024-04-23T10:17:51.842 INFO:tasks.workunit.client.0.smithi026.stdout:9/505: mknod d13/d2a/c9a 0 2024-04-23T10:17:51.846 INFO:tasks.workunit.client.0.smithi026.stdout:8/482: mknod d5/d9/d22/d65/d78/c9f 0 2024-04-23T10:17:51.849 INFO:tasks.workunit.client.0.smithi026.stdout:8/483: creat d5/d56/d47/fa0 x:0 0 0 2024-04-23T10:17:51.854 INFO:tasks.workunit.client.0.smithi026.stdout:8/484: mkdir d5/d9/d22/d65/d78/d3e/da1 0 2024-04-23T10:17:51.855 INFO:tasks.workunit.client.0.smithi026.stdout:8/485: truncate d5/f2a 2843421 0 2024-04-23T10:17:51.855 INFO:tasks.workunit.client.0.smithi026.stdout:8/486: stat d5/d50/d9a 0 2024-04-23T10:17:51.860 INFO:tasks.workunit.client.0.smithi026.stdout:8/487: creat d5/d9/d22/d65/d78/fa2 x:0 0 0 2024-04-23T10:17:51.860 INFO:tasks.workunit.client.0.smithi026.stdout:9/506: dread d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:51.862 INFO:tasks.workunit.client.0.smithi026.stdout:3/417: dwrite d0/d1e/d30/d43/df/d17/f32 [4194304,4194304] 0 2024-04-23T10:17:51.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/418: chown d0/d1e/d30/d43/d6c/d79/c89 905920477 1 2024-04-23T10:17:51.864 INFO:tasks.workunit.client.0.smithi026.stdout:8/488: creat d5/d56/d47/d99/fa3 x:0 0 0 2024-04-23T10:17:51.867 INFO:tasks.workunit.client.0.smithi026.stdout:3/419: mkdir d0/d1e/d23/d52/d75/d97 0 2024-04-23T10:17:51.870 INFO:tasks.workunit.client.0.smithi026.stdout:9/507: dwrite d13/d36/d66/f93 [0,4194304] 0 2024-04-23T10:17:51.874 INFO:tasks.workunit.client.0.smithi026.stdout:9/508: creat d13/d3b/d68/f9b x:0 0 0 2024-04-23T10:17:51.875 INFO:tasks.workunit.client.0.smithi026.stdout:8/489: dwrite d5/d56/f1f [0,4194304] 0 2024-04-23T10:17:51.876 INFO:tasks.workunit.client.0.smithi026.stdout:8/490: stat d5/d56/d33/l38 0 2024-04-23T10:17:51.878 INFO:tasks.workunit.client.0.smithi026.stdout:8/491: dread - d5/d9/d22/d65/d78/d3e/f92 zero size 2024-04-23T10:17:51.879 INFO:tasks.workunit.client.0.smithi026.stdout:9/509: symlink d13/d2a/d45/d6d/l9c 0 2024-04-23T10:17:51.886 INFO:tasks.workunit.client.0.smithi026.stdout:3/420: dwrite d0/d1e/d30/f4f [4194304,4194304] 0 2024-04-23T10:17:51.887 INFO:tasks.workunit.client.0.smithi026.stdout:9/510: truncate d13/f25 95484 0 2024-04-23T10:17:51.889 INFO:tasks.workunit.client.0.smithi026.stdout:9/511: fdatasync d13/d3b/d4e/d76/f8f 0 2024-04-23T10:17:51.889 INFO:tasks.workunit.client.0.smithi026.stdout:3/421: chown d0/d1e/d30/d43/d29/f35 1711 1 2024-04-23T10:17:51.890 INFO:tasks.workunit.client.0.smithi026.stdout:3/422: readlink d0/d1e/d30/d43/d29/d39/l3d 0 2024-04-23T10:17:51.907 INFO:tasks.workunit.client.0.smithi026.stdout:9/512: dread d13/f1c [4194304,4194304] 0 2024-04-23T10:17:51.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/423: dwrite d0/d1e/d30/d43/df/f44 [0,4194304] 0 2024-04-23T10:17:51.910 INFO:tasks.workunit.client.0.smithi026.stdout:3/424: write d0/d1e/d30/d43/d6c/d79/d73/f8f [480605,127486] 0 2024-04-23T10:17:51.915 INFO:tasks.workunit.client.0.smithi026.stdout:3/425: truncate d0/f20 5829718 0 2024-04-23T10:17:51.916 INFO:tasks.workunit.client.0.smithi026.stdout:9/513: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:51.918 INFO:tasks.workunit.client.0.smithi026.stdout:9/514: truncate d13/d3b/d5b/f90 703432 0 2024-04-23T10:17:51.918 INFO:tasks.workunit.client.0.smithi026.stdout:3/426: getdents d0/d4c 0 2024-04-23T10:17:51.919 INFO:tasks.workunit.client.0.smithi026.stdout:9/515: rmdir d13/d2a 39 2024-04-23T10:17:51.919 INFO:tasks.workunit.client.0.smithi026.stdout:9/516: read - d13/d19/f8b zero size 2024-04-23T10:17:51.921 INFO:tasks.workunit.client.0.smithi026.stdout:9/517: write d13/d1b/f6e [2312197,95805] 0 2024-04-23T10:17:51.923 INFO:tasks.workunit.client.0.smithi026.stdout:8/492: read d5/d9/d22/d65/f83 [309933,9367] 0 2024-04-23T10:17:51.926 INFO:tasks.workunit.client.0.smithi026.stdout:9/518: rename d13/d1b/d2b/l54 to d13/d2a/d45/d3a/d4f/l9d 0 2024-04-23T10:17:51.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/519: stat d13/d36/d66/d78/c8c 0 2024-04-23T10:17:51.928 INFO:tasks.workunit.client.0.smithi026.stdout:5/370: sync 2024-04-23T10:17:51.928 INFO:tasks.workunit.client.0.smithi026.stdout:6/468: sync 2024-04-23T10:17:51.929 INFO:tasks.workunit.client.0.smithi026.stdout:3/427: dwrite d0/d1e/d30/d43/df/d17/f46 [0,4194304] 0 2024-04-23T10:17:51.931 INFO:tasks.workunit.client.0.smithi026.stdout:3/428: chown d0/d1e/d30/d43/df/c5a 0 1 2024-04-23T10:17:51.936 INFO:tasks.workunit.client.0.smithi026.stdout:3/429: creat d0/d1e/d30/d43/d6c/d79/d64/f98 x:0 0 0 2024-04-23T10:17:51.937 INFO:tasks.workunit.client.0.smithi026.stdout:9/520: chown d13/d2a/d45/d3a/d4f/l9d 3550 1 2024-04-23T10:17:51.938 INFO:tasks.workunit.client.0.smithi026.stdout:5/371: dwrite d0/d3c/f65 [0,4194304] 0 2024-04-23T10:17:51.939 INFO:tasks.workunit.client.0.smithi026.stdout:9/521: readlink d13/d31/l60 0 2024-04-23T10:17:51.941 INFO:tasks.workunit.client.0.smithi026.stdout:9/522: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:51.943 INFO:tasks.workunit.client.0.smithi026.stdout:5/372: creat d0/d3c/d5d/d3a/f78 x:0 0 0 2024-04-23T10:17:51.945 INFO:tasks.workunit.client.0.smithi026.stdout:5/373: chown d0/f1a 271 1 2024-04-23T10:17:51.945 INFO:tasks.workunit.client.0.smithi026.stdout:6/469: dwrite d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:51.947 INFO:tasks.workunit.client.0.smithi026.stdout:6/470: truncate d6/d21/d58/d8d/f84 192163 0 2024-04-23T10:17:51.948 INFO:tasks.workunit.client.0.smithi026.stdout:6/471: write d6/d21/d58/d8d/d64/f83 [2242784,9291] 0 2024-04-23T10:17:51.950 INFO:tasks.workunit.client.0.smithi026.stdout:3/430: write d0/f3c [181857,38577] 0 2024-04-23T10:17:51.956 INFO:tasks.workunit.client.0.smithi026.stdout:9/523: getdents d13/d1b 0 2024-04-23T10:17:51.958 INFO:tasks.workunit.client.0.smithi026.stdout:9/524: mknod d13/d3b/d4e/d76/c9e 0 2024-04-23T10:17:51.960 INFO:tasks.workunit.client.0.smithi026.stdout:9/525: dread - d13/d2a/d45/d67/f82 zero size 2024-04-23T10:17:51.961 INFO:tasks.workunit.client.0.smithi026.stdout:6/472: dwrite d6/d21/d2f/d31/f79 [0,4194304] 0 2024-04-23T10:17:51.966 INFO:tasks.workunit.client.0.smithi026.stdout:9/526: link d13/d3b/d4e/d76/c92 d13/d3b/d4e/c9f 0 2024-04-23T10:17:51.970 INFO:tasks.workunit.client.0.smithi026.stdout:5/374: dwrite d0/d3c/d5d/f4b [0,4194304] 0 2024-04-23T10:17:51.972 INFO:tasks.workunit.client.0.smithi026.stdout:5/375: write d0/f25 [149453,48682] 0 2024-04-23T10:17:51.975 INFO:tasks.workunit.client.0.smithi026.stdout:9/527: dwrite d13/f1e [4194304,4194304] 0 2024-04-23T10:17:51.977 INFO:tasks.workunit.client.0.smithi026.stdout:9/528: write d13/d2a/f2f [5944483,64233] 0 2024-04-23T10:17:51.985 INFO:tasks.workunit.client.0.smithi026.stdout:9/529: getdents d13/d36/d66 0 2024-04-23T10:17:51.987 INFO:tasks.workunit.client.0.smithi026.stdout:9/530: mknod d13/d3b/d68/ca0 0 2024-04-23T10:17:51.990 INFO:tasks.workunit.client.0.smithi026.stdout:9/531: creat d13/d2a/fa1 x:0 0 0 2024-04-23T10:17:51.993 INFO:tasks.workunit.client.0.smithi026.stdout:9/532: read d13/d2a/d45/d3a/d6b/f55 [1683045,66007] 0 2024-04-23T10:17:51.995 INFO:tasks.workunit.client.0.smithi026.stdout:9/533: rmdir d13/d19 39 2024-04-23T10:17:52.001 INFO:tasks.workunit.client.0.smithi026.stdout:9/534: dwrite d13/d31/f53 [0,4194304] 0 2024-04-23T10:17:52.004 INFO:tasks.workunit.client.0.smithi026.stdout:9/535: write d13/d3e/f44 [5339397,20012] 0 2024-04-23T10:17:52.005 INFO:tasks.workunit.client.0.smithi026.stdout:9/536: truncate d13/d2a/d45/d67/f82 351332 0 2024-04-23T10:17:52.007 INFO:tasks.workunit.client.0.smithi026.stdout:9/537: rename d13/c49 to d13/d2a/d45/d6d/ca2 0 2024-04-23T10:17:52.018 INFO:tasks.workunit.client.0.smithi026.stdout:9/538: fdatasync d13/d31/f53 0 2024-04-23T10:17:52.020 INFO:tasks.workunit.client.0.smithi026.stdout:9/539: chown d13/d3b/c7b 7081460 1 2024-04-23T10:17:52.021 INFO:tasks.workunit.client.0.smithi026.stdout:9/540: mknod d13/d2a/ca3 0 2024-04-23T10:17:52.036 INFO:tasks.workunit.client.0.smithi026.stdout:9/541: dread d13/d2a/d45/d3a/d4f/f59 [0,4194304] 0 2024-04-23T10:17:52.042 INFO:tasks.workunit.client.0.smithi026.stdout:9/542: dread d13/f22 [0,4194304] 0 2024-04-23T10:17:52.043 INFO:tasks.workunit.client.0.smithi026.stdout:9/543: stat d13/f1e 0 2024-04-23T10:17:52.046 INFO:tasks.workunit.client.0.smithi026.stdout:9/544: dread d13/d36/d66/f93 [0,4194304] 0 2024-04-23T10:17:52.047 INFO:tasks.workunit.client.0.smithi026.stdout:9/545: chown d13/l50 674197641 1 2024-04-23T10:17:52.047 INFO:tasks.workunit.client.0.smithi026.stdout:9/546: readlink d13/d31/l34 0 2024-04-23T10:17:52.048 INFO:tasks.workunit.client.0.smithi026.stdout:9/547: symlink d13/d3b/d4e/la4 0 2024-04-23T10:17:52.050 INFO:tasks.workunit.client.0.smithi026.stdout:9/548: creat d13/d2a/d45/d6d/fa5 x:0 0 0 2024-04-23T10:17:52.051 INFO:tasks.workunit.client.0.smithi026.stdout:9/549: fdatasync d13/f1c 0 2024-04-23T10:17:52.051 INFO:tasks.workunit.client.0.smithi026.stdout:9/550: write d13/d2a/f2f [3072232,12953] 0 2024-04-23T10:17:52.059 INFO:tasks.workunit.client.0.smithi026.stdout:9/551: dwrite d13/d2a/d45/d67/f82 [0,4194304] 0 2024-04-23T10:17:52.061 INFO:tasks.workunit.client.0.smithi026.stdout:9/552: symlink d13/d3b/d68/la6 0 2024-04-23T10:17:52.062 INFO:tasks.workunit.client.0.smithi026.stdout:9/553: rmdir d13/d2a/d45/d67 39 2024-04-23T10:17:52.070 INFO:tasks.workunit.client.0.smithi026.stdout:9/554: dwrite d13/d3b/d5b/f90 [0,4194304] 0 2024-04-23T10:17:52.071 INFO:tasks.workunit.client.0.smithi026.stdout:9/555: chown d13/d3b/l97 2752700 1 2024-04-23T10:17:52.112 INFO:tasks.workunit.client.0.smithi026.stdout:1/374: sync 2024-04-23T10:17:52.132 INFO:tasks.workunit.client.0.smithi026.stdout:9/556: stat d13/d2a/d45 0 2024-04-23T10:17:52.151 INFO:tasks.workunit.client.0.smithi026.stdout:1/375: creat dd/d1a/d23/f89 x:0 0 0 2024-04-23T10:17:52.253 INFO:tasks.workunit.client.0.smithi026.stdout:9/557: mkdir d13/d19/da7 0 2024-04-23T10:17:52.255 INFO:tasks.workunit.client.0.smithi026.stdout:1/376: dread f7 [0,4194304] 0 2024-04-23T10:17:52.260 INFO:tasks.workunit.client.0.smithi026.stdout:1/377: creat dd/d1a/d6a/d7c/f8a x:0 0 0 2024-04-23T10:17:52.263 INFO:tasks.workunit.client.0.smithi026.stdout:1/378: read dd/d1a/d23/d3f/f58 [591501,24372] 0 2024-04-23T10:17:52.267 INFO:tasks.workunit.client.0.smithi026.stdout:1/379: symlink dd/l8b 0 2024-04-23T10:17:52.268 INFO:tasks.workunit.client.0.smithi026.stdout:1/380: chown dd/d1a/d20/f39 9 1 2024-04-23T10:17:52.271 INFO:tasks.workunit.client.0.smithi026.stdout:1/381: symlink dd/d1a/d23/l8c 0 2024-04-23T10:17:52.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/382: link f9 dd/d1a/d20/d25/d35/d7f/f8d 0 2024-04-23T10:17:52.288 INFO:tasks.workunit.client.0.smithi026.stdout:1/383: dread dd/d1a/d20/f5f [0,4194304] 0 2024-04-23T10:17:52.293 INFO:tasks.workunit.client.0.smithi026.stdout:1/384: creat dd/d1a/d20/d25/d35/d73/f8e x:0 0 0 2024-04-23T10:17:52.296 INFO:tasks.workunit.client.0.smithi026.stdout:1/385: mknod dd/d1a/d23/c8f 0 2024-04-23T10:17:52.299 INFO:tasks.workunit.client.0.smithi026.stdout:1/386: rmdir dd/d1a/d20/d25/d35/d73 39 2024-04-23T10:17:52.302 INFO:tasks.workunit.client.0.smithi026.stdout:1/387: unlink f1 0 2024-04-23T10:17:52.303 INFO:tasks.workunit.client.0.smithi026.stdout:1/388: fdatasync dd/d1a/d6a/f86 0 2024-04-23T10:17:52.306 INFO:tasks.workunit.client.0.smithi026.stdout:2/389: sync 2024-04-23T10:17:52.308 INFO:tasks.workunit.client.0.smithi026.stdout:2/390: dread - d3/d19/d31/f66 zero size 2024-04-23T10:17:52.310 INFO:tasks.workunit.client.0.smithi026.stdout:1/389: getdents dd/d1a/d20/d25/d35 0 2024-04-23T10:17:52.312 INFO:tasks.workunit.client.0.smithi026.stdout:2/391: dread d3/d19/f5a [0,4194304] 0 2024-04-23T10:17:52.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/392: readlink d3/dd/l10 0 2024-04-23T10:17:52.317 INFO:tasks.workunit.client.0.smithi026.stdout:2/393: mknod d3/d35/d4c/c8d 0 2024-04-23T10:17:52.322 INFO:tasks.workunit.client.0.smithi026.stdout:2/394: mknod d3/d19/d21/d23/d3a/d3c/d5d/c8e 0 2024-04-23T10:17:52.324 INFO:tasks.workunit.client.0.smithi026.stdout:2/395: write d3/dd/f43 [171224,31846] 0 2024-04-23T10:17:52.331 INFO:tasks.workunit.client.0.smithi026.stdout:2/396: truncate d3/d19/d1d/f25 769857 0 2024-04-23T10:17:52.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/397: rename d3/d19/l8a to d3/d19/d1d/l8f 0 2024-04-23T10:17:52.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/398: write d3/d19/d21/d23/f33 [155035,95416] 0 2024-04-23T10:17:52.350 INFO:tasks.workunit.client.0.smithi026.stdout:2/399: creat d3/d19/d21/d23/d3a/d65/f90 x:0 0 0 2024-04-23T10:17:52.358 INFO:tasks.workunit.client.0.smithi026.stdout:2/400: rename d3/dd/d4b/f79 to d3/d19/d31/f91 0 2024-04-23T10:17:52.364 INFO:tasks.workunit.client.0.smithi026.stdout:2/401: fsync d3/f13 0 2024-04-23T10:17:52.370 INFO:tasks.workunit.client.0.smithi026.stdout:1/390: dread dd/d1a/d23/f29 [0,4194304] 0 2024-04-23T10:17:52.375 INFO:tasks.workunit.client.0.smithi026.stdout:1/391: truncate dd/d1a/d20/d25/d35/d73/f8e 508712 0 2024-04-23T10:17:52.379 INFO:tasks.workunit.client.0.smithi026.stdout:1/392: truncate dd/d1a/d23/f40 178607 0 2024-04-23T10:17:52.381 INFO:tasks.workunit.client.0.smithi026.stdout:1/393: write dd/d15/f81 [18001,125791] 0 2024-04-23T10:17:52.389 INFO:tasks.workunit.client.0.smithi026.stdout:1/394: creat dd/f90 x:0 0 0 2024-04-23T10:17:52.393 INFO:tasks.workunit.client.0.smithi026.stdout:1/395: creat dd/d1a/d20/d25/f91 x:0 0 0 2024-04-23T10:17:52.433 INFO:tasks.workunit.client.0.smithi026.stdout:7/429: sync 2024-04-23T10:17:52.433 INFO:tasks.workunit.client.0.smithi026.stdout:4/325: sync 2024-04-23T10:17:52.447 INFO:tasks.workunit.client.0.smithi026.stdout:4/326: truncate d4/d22/d2e/f32 3781502 0 2024-04-23T10:17:52.449 INFO:tasks.workunit.client.0.smithi026.stdout:4/327: fsync d4/d14/d3d/f4a 0 2024-04-23T10:17:52.478 INFO:tasks.workunit.client.0.smithi026.stdout:1/396: dwrite dd/d1a/d23/d3f/f58 [0,4194304] 0 2024-04-23T10:17:52.481 INFO:tasks.workunit.client.0.smithi026.stdout:7/430: dread dd/f13 [0,4194304] 0 2024-04-23T10:17:52.485 INFO:tasks.workunit.client.0.smithi026.stdout:1/397: truncate dd/d15/f68 590825 0 2024-04-23T10:17:52.486 INFO:tasks.workunit.client.0.smithi026.stdout:7/431: write dd/d1d/d50/f62 [917735,104364] 0 2024-04-23T10:17:52.489 INFO:tasks.workunit.client.0.smithi026.stdout:1/398: stat dd/d48/c6b 0 2024-04-23T10:17:52.494 INFO:tasks.workunit.client.0.smithi026.stdout:1/399: chown dd/d1a/d20/f39 1 1 2024-04-23T10:17:52.497 INFO:tasks.workunit.client.0.smithi026.stdout:1/400: dread - dd/d1a/d6a/d7c/f8a zero size 2024-04-23T10:17:52.513 INFO:tasks.workunit.client.0.smithi026.stdout:7/432: dwrite dd/d2c/f70 [0,4194304] 0 2024-04-23T10:17:52.515 INFO:tasks.workunit.client.0.smithi026.stdout:7/433: write dd/f36 [1116397,96454] 0 2024-04-23T10:17:52.517 INFO:tasks.workunit.client.0.smithi026.stdout:1/401: dread dd/d1a/d23/d3f/f5b [0,4194304] 0 2024-04-23T10:17:52.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/434: mkdir dd/d2c/d48/d7e 0 2024-04-23T10:17:52.529 INFO:tasks.workunit.client.0.smithi026.stdout:1/402: truncate dd/d1a/d20/d25/d35/d7f/f8d 533794 0 2024-04-23T10:17:52.535 INFO:tasks.workunit.client.0.smithi026.stdout:7/435: creat dd/d1d/d50/f7f x:0 0 0 2024-04-23T10:17:52.537 INFO:tasks.workunit.client.0.smithi026.stdout:1/403: mkdir dd/d1a/d23/d92 0 2024-04-23T10:17:52.537 INFO:tasks.workunit.client.0.smithi026.stdout:7/436: read dd/f13 [7977946,95568] 0 2024-04-23T10:17:52.541 INFO:tasks.workunit.client.0.smithi026.stdout:0/574: sync 2024-04-23T10:17:52.541 INFO:tasks.workunit.client.0.smithi026.stdout:8/493: sync 2024-04-23T10:17:52.553 INFO:tasks.workunit.client.0.smithi026.stdout:0/575: creat d7/d8/d1e/d57/da9/fdd x:0 0 0 2024-04-23T10:17:52.555 INFO:tasks.workunit.client.0.smithi026.stdout:8/494: creat d5/d56/fa4 x:0 0 0 2024-04-23T10:17:52.562 INFO:tasks.workunit.client.0.smithi026.stdout:0/576: rename d7/l8f to d7/d8/d2d/d60/d62/db2/dca/lde 0 2024-04-23T10:17:52.564 INFO:tasks.workunit.client.0.smithi026.stdout:0/577: write d7/d8/d1e/d2a/f2e [1258650,22788] 0 2024-04-23T10:17:52.566 INFO:tasks.workunit.client.0.smithi026.stdout:8/495: link d5/d9/d22/d65/d78/d3e/f92 d5/d56/d15/d8b/fa5 0 2024-04-23T10:17:52.568 INFO:tasks.workunit.client.0.smithi026.stdout:8/496: chown d5/d56/d47/c7e 2 1 2024-04-23T10:17:52.569 INFO:tasks.workunit.client.0.smithi026.stdout:1/404: write dd/f2c [2312441,30142] 0 2024-04-23T10:17:52.572 INFO:tasks.workunit.client.0.smithi026.stdout:8/497: write d5/d9/fc [901140,115391] 0 2024-04-23T10:17:52.573 INFO:tasks.workunit.client.0.smithi026.stdout:7/437: truncate dd/f1b 6883806 0 2024-04-23T10:17:52.574 INFO:tasks.workunit.client.0.smithi026.stdout:8/498: chown d5/d9/d22 141 1 2024-04-23T10:17:52.576 INFO:tasks.workunit.client.0.smithi026.stdout:1/405: mkdir dd/d1a/d20/d25/d35/d74/d93 0 2024-04-23T10:17:52.579 INFO:tasks.workunit.client.0.smithi026.stdout:7/438: write dd/f76 [989269,15476] 0 2024-04-23T10:17:52.579 INFO:tasks.workunit.client.0.smithi026.stdout:8/499: mknod d5/d9/d22/ca6 0 2024-04-23T10:17:52.580 INFO:tasks.workunit.client.0.smithi026.stdout:0/578: write d7/d8/d2d/d60/f66 [381703,56341] 0 2024-04-23T10:17:52.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/406: read dd/d1a/d20/d25/d35/d73/f8e [109554,97640] 0 2024-04-23T10:17:52.588 INFO:tasks.workunit.client.0.smithi026.stdout:1/407: creat dd/d1a/d6a/d7c/f94 x:0 0 0 2024-04-23T10:17:52.589 INFO:tasks.workunit.client.0.smithi026.stdout:0/579: getdents d7/d8/d2d/d60/d77 0 2024-04-23T10:17:52.592 INFO:tasks.workunit.client.0.smithi026.stdout:8/500: getdents d5/d9/d22/d65 0 2024-04-23T10:17:52.597 INFO:tasks.workunit.client.0.smithi026.stdout:8/501: write d5/d24/f27 [1383889,42427] 0 2024-04-23T10:17:52.599 INFO:tasks.workunit.client.0.smithi026.stdout:1/408: rename dd/d1a/f6c to dd/f95 0 2024-04-23T10:17:52.602 INFO:tasks.workunit.client.0.smithi026.stdout:0/580: creat d7/d8/d1e/d1d/d2f/dd1/dd6/fdf x:0 0 0 2024-04-23T10:17:52.603 INFO:tasks.workunit.client.0.smithi026.stdout:8/502: mknod d5/d56/d3f/ca7 0 2024-04-23T10:17:52.607 INFO:tasks.workunit.client.0.smithi026.stdout:7/439: dwrite dd/d44/d38/f3d [0,4194304] 0 2024-04-23T10:17:52.611 INFO:tasks.workunit.client.0.smithi026.stdout:8/503: write d5/d9/d22/d65/f83 [1115543,75107] 0 2024-04-23T10:17:52.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/440: chown dd/ff 2 1 2024-04-23T10:17:52.615 INFO:tasks.workunit.client.0.smithi026.stdout:8/504: chown d5/d56/d3f/l54 156 1 2024-04-23T10:17:52.621 INFO:tasks.workunit.client.0.smithi026.stdout:8/505: unlink d5/d56/d15/f77 0 2024-04-23T10:17:52.625 INFO:tasks.workunit.client.0.smithi026.stdout:0/581: dwrite d7/d8/d1e/d1d/d2f/dd1/dd6/fdf [0,4194304] 0 2024-04-23T10:17:52.625 INFO:tasks.workunit.client.0.smithi026.stdout:1/409: dread dd/d1a/d20/d25/f5c [0,4194304] 0 2024-04-23T10:17:52.625 INFO:tasks.workunit.client.0.smithi026.stdout:7/441: creat dd/d6c/d72/f80 x:0 0 0 2024-04-23T10:17:52.629 INFO:tasks.workunit.client.0.smithi026.stdout:1/410: unlink dd/d1a/d20/d25/d35/l3d 0 2024-04-23T10:17:52.632 INFO:tasks.workunit.client.0.smithi026.stdout:1/411: symlink dd/d1a/d6a/d7c/l96 0 2024-04-23T10:17:52.645 INFO:tasks.workunit.client.0.smithi026.stdout:1/412: dwrite dd/d1a/d6a/d7c/f80 [0,4194304] 0 2024-04-23T10:17:52.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/413: mkdir dd/d1a/d97 0 2024-04-23T10:17:52.649 INFO:tasks.workunit.client.0.smithi026.stdout:1/414: read - dd/d1a/d20/d25/f91 zero size 2024-04-23T10:17:52.650 INFO:tasks.workunit.client.0.smithi026.stdout:8/506: dread d5/d9/f5b [0,4194304] 0 2024-04-23T10:17:52.651 INFO:tasks.workunit.client.0.smithi026.stdout:7/442: dread dd/d44/f3b [0,4194304] 0 2024-04-23T10:17:52.651 INFO:tasks.workunit.client.0.smithi026.stdout:1/415: dread dd/d15/f68 [0,4194304] 0 2024-04-23T10:17:52.652 INFO:tasks.workunit.client.0.smithi026.stdout:7/443: write dd/d1d/d50/f5c [3762829,46262] 0 2024-04-23T10:17:52.653 INFO:tasks.workunit.client.0.smithi026.stdout:8/507: mkdir d5/d9/d22/d65/d78/d3e/da1/da8 0 2024-04-23T10:17:52.655 INFO:tasks.workunit.client.0.smithi026.stdout:7/444: fsync dd/d3f/d47/d4c/f64 0 2024-04-23T10:17:52.655 INFO:tasks.workunit.client.0.smithi026.stdout:6/473: sync 2024-04-23T10:17:52.655 INFO:tasks.workunit.client.0.smithi026.stdout:3/431: sync 2024-04-23T10:17:52.658 INFO:tasks.workunit.client.0.smithi026.stdout:6/474: write d6/d13/d15/f71 [268197,100504] 0 2024-04-23T10:17:52.658 INFO:tasks.workunit.client.0.smithi026.stdout:8/508: rename d5/d56/f1f to d5/d56/d15/d8b/fa9 0 2024-04-23T10:17:52.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/432: getdents d0/d1e/d30/d77 0 2024-04-23T10:17:52.661 INFO:tasks.workunit.client.0.smithi026.stdout:6/475: write d6/d21/d2f/d32/f89 [901657,13244] 0 2024-04-23T10:17:52.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/509: fsync d5/d56/d15/f34 0 2024-04-23T10:17:52.665 INFO:tasks.workunit.client.0.smithi026.stdout:7/445: truncate dd/d3f/d47/d4c/d60/d75/f7c 586066 0 2024-04-23T10:17:52.666 INFO:tasks.workunit.client.0.smithi026.stdout:3/433: mkdir d0/d1e/d30/d43/d6c/d79/d73/d99 0 2024-04-23T10:17:52.669 INFO:tasks.workunit.client.0.smithi026.stdout:6/476: mkdir d6/d21/d2f/d32/d87/d8e 0 2024-04-23T10:17:52.671 INFO:tasks.workunit.client.0.smithi026.stdout:8/510: creat d5/d56/d33/faa x:0 0 0 2024-04-23T10:17:52.673 INFO:tasks.workunit.client.0.smithi026.stdout:3/434: mknod d0/d1e/d30/d43/df/d17/c9a 0 2024-04-23T10:17:52.673 INFO:tasks.workunit.client.0.smithi026.stdout:8/511: write d5/d9/d22/d65/d78/f7d [669025,24280] 0 2024-04-23T10:17:52.674 INFO:tasks.workunit.client.0.smithi026.stdout:7/446: symlink dd/d1d/d50/l81 0 2024-04-23T10:17:52.675 INFO:tasks.workunit.client.0.smithi026.stdout:8/512: dread - d5/d56/d3f/f82 zero size 2024-04-23T10:17:52.675 INFO:tasks.workunit.client.0.smithi026.stdout:6/477: dread d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:52.676 INFO:tasks.workunit.client.0.smithi026.stdout:3/435: read d0/d1e/d30/d43/f3b [4031970,6247] 0 2024-04-23T10:17:52.679 INFO:tasks.workunit.client.0.smithi026.stdout:1/416: dread dd/d48/f72 [0,4194304] 0 2024-04-23T10:17:52.679 INFO:tasks.workunit.client.0.smithi026.stdout:3/436: write d0/d1e/d30/d43/df/d17/f81 [3457459,76491] 0 2024-04-23T10:17:52.681 INFO:tasks.workunit.client.0.smithi026.stdout:8/513: fsync d5/d56/d3f/f6b 0 2024-04-23T10:17:52.685 INFO:tasks.workunit.client.0.smithi026.stdout:3/437: creat d0/d4c/f9b x:0 0 0 2024-04-23T10:17:52.686 INFO:tasks.workunit.client.0.smithi026.stdout:1/417: write dd/d1a/d20/d25/f5c [222815,126239] 0 2024-04-23T10:17:52.687 INFO:tasks.workunit.client.0.smithi026.stdout:8/514: mkdir d5/dab 0 2024-04-23T10:17:52.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/447: dwrite dd/d1d/d50/f55 [0,4194304] 0 2024-04-23T10:17:52.688 INFO:tasks.workunit.client.0.smithi026.stdout:6/478: creat d6/d21/d2f/f8f x:0 0 0 2024-04-23T10:17:52.689 INFO:tasks.workunit.client.0.smithi026.stdout:8/515: write d5/d9/f10 [6149300,74463] 0 2024-04-23T10:17:52.693 INFO:tasks.workunit.client.0.smithi026.stdout:6/479: mkdir d6/d21/d58/d8d/d90 0 2024-04-23T10:17:52.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/418: readlink dd/d1a/d20/d25/d35/d74/l88 0 2024-04-23T10:17:52.698 INFO:tasks.workunit.client.0.smithi026.stdout:8/516: dwrite d5/f84 [0,4194304] 0 2024-04-23T10:17:52.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/419: mkdir dd/d15/d7d/d98 0 2024-04-23T10:17:52.704 INFO:tasks.workunit.client.0.smithi026.stdout:1/420: write dd/d1a/d23/f28 [256357,3837] 0 2024-04-23T10:17:52.707 INFO:tasks.workunit.client.0.smithi026.stdout:1/421: mknod dd/d15/c99 0 2024-04-23T10:17:52.709 INFO:tasks.workunit.client.0.smithi026.stdout:6/480: getdents d6/d21/d2f 0 2024-04-23T10:17:52.711 INFO:tasks.workunit.client.0.smithi026.stdout:8/517: dwrite d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:52.713 INFO:tasks.workunit.client.0.smithi026.stdout:1/422: rename dd/d1a/d97 to dd/d1a/d23/d3f/d9a 0 2024-04-23T10:17:52.715 INFO:tasks.workunit.client.0.smithi026.stdout:1/423: write dd/d48/f63 [873464,97104] 0 2024-04-23T10:17:52.717 INFO:tasks.workunit.client.0.smithi026.stdout:8/518: mkdir d5/d9/dac 0 2024-04-23T10:17:52.722 INFO:tasks.workunit.client.0.smithi026.stdout:1/424: rename dd/d1a/d6a/f77 to dd/d15/d7d/d98/f9b 0 2024-04-23T10:17:52.723 INFO:tasks.workunit.client.0.smithi026.stdout:7/448: dread dd/f67 [0,4194304] 0 2024-04-23T10:17:52.725 INFO:tasks.workunit.client.0.smithi026.stdout:7/449: write dd/d2c/d48/f59 [949228,82441] 0 2024-04-23T10:17:52.727 INFO:tasks.workunit.client.0.smithi026.stdout:7/450: readlink dd/d1d/l2a 0 2024-04-23T10:17:52.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/519: dwrite d5/d56/d47/d99/fa3 [0,4194304] 0 2024-04-23T10:17:52.730 INFO:tasks.workunit.client.0.smithi026.stdout:7/451: symlink dd/d1d/l82 0 2024-04-23T10:17:52.733 INFO:tasks.workunit.client.0.smithi026.stdout:8/520: dread - d5/d9/f96 zero size 2024-04-23T10:17:52.734 INFO:tasks.workunit.client.0.smithi026.stdout:1/425: creat dd/d1a/d20/d25/f9c x:0 0 0 2024-04-23T10:17:52.736 INFO:tasks.workunit.client.0.smithi026.stdout:1/426: mkdir dd/d1a/d23/d69/d9d 0 2024-04-23T10:17:52.737 INFO:tasks.workunit.client.0.smithi026.stdout:7/452: link dd/f76 dd/d3f/d47/f83 0 2024-04-23T10:17:52.738 INFO:tasks.workunit.client.0.smithi026.stdout:1/427: mkdir dd/d1a/d23/d3f/d9a/d9e 0 2024-04-23T10:17:52.740 INFO:tasks.workunit.client.0.smithi026.stdout:8/521: rename d5/d56/d15/f18 to d5/d56/fad 0 2024-04-23T10:17:52.742 INFO:tasks.workunit.client.0.smithi026.stdout:6/481: dread d6/d21/d58/d8d/d64/f83 [0,4194304] 0 2024-04-23T10:17:52.743 INFO:tasks.workunit.client.0.smithi026.stdout:7/453: chown dd/d46/c61 60317 1 2024-04-23T10:17:52.747 INFO:tasks.workunit.client.0.smithi026.stdout:6/482: creat d6/d21/d2f/d32/f91 x:0 0 0 2024-04-23T10:17:52.749 INFO:tasks.workunit.client.0.smithi026.stdout:1/428: dwrite dd/d1a/d23/f29 [4194304,4194304] 0 2024-04-23T10:17:52.749 INFO:tasks.workunit.client.0.smithi026.stdout:6/483: write d6/d21/d2f/d32/f91 [542073,125251] 0 2024-04-23T10:17:52.759 INFO:tasks.workunit.client.0.smithi026.stdout:8/522: truncate d5/d56/d3f/f8d 124006 0 2024-04-23T10:17:52.762 INFO:tasks.workunit.client.0.smithi026.stdout:8/523: write d5/d50/f79 [3835256,44441] 0 2024-04-23T10:17:52.762 INFO:tasks.workunit.client.0.smithi026.stdout:1/429: symlink dd/d1a/d20/d25/d35/d74/d93/l9f 0 2024-04-23T10:17:52.763 INFO:tasks.workunit.client.0.smithi026.stdout:1/430: fsync dd/d1a/d23/f28 0 2024-04-23T10:17:52.764 INFO:tasks.workunit.client.0.smithi026.stdout:6/484: creat d6/d21/d58/d8d/f92 x:0 0 0 2024-04-23T10:17:52.767 INFO:tasks.workunit.client.0.smithi026.stdout:8/524: rename d5/d9/f40 to d5/d9/dac/fae 0 2024-04-23T10:17:52.767 INFO:tasks.workunit.client.0.smithi026.stdout:6/485: write d6/d13/d15/f1c [4552098,17524] 0 2024-04-23T10:17:52.768 INFO:tasks.workunit.client.0.smithi026.stdout:1/431: creat dd/d15/d7d/d98/fa0 x:0 0 0 2024-04-23T10:17:52.768 INFO:tasks.workunit.client.0.smithi026.stdout:6/486: write d6/d13/d15/f4c [2868628,87011] 0 2024-04-23T10:17:52.769 INFO:tasks.workunit.client.0.smithi026.stdout:8/525: creat d5/d9/dac/faf x:0 0 0 2024-04-23T10:17:52.770 INFO:tasks.workunit.client.0.smithi026.stdout:1/432: chown dd/d1a/d20/d25/l57 107653 1 2024-04-23T10:17:52.774 INFO:tasks.workunit.client.0.smithi026.stdout:8/526: rename d5/d24/l30 to d5/d50/d9a/lb0 0 2024-04-23T10:17:52.775 INFO:tasks.workunit.client.0.smithi026.stdout:1/433: dread f2 [4194304,4194304] 0 2024-04-23T10:17:52.776 INFO:tasks.workunit.client.0.smithi026.stdout:1/434: fsync dd/d1a/d20/d25/f4a 0 2024-04-23T10:17:52.776 INFO:tasks.workunit.client.0.smithi026.stdout:6/487: dread d6/d13/d15/f81 [0,4194304] 0 2024-04-23T10:17:52.777 INFO:tasks.workunit.client.0.smithi026.stdout:6/488: chown d6/d21/d58/f75 69 1 2024-04-23T10:17:52.779 INFO:tasks.workunit.client.0.smithi026.stdout:6/489: truncate d6/d21/d58/d8d/f8a 294392 0 2024-04-23T10:17:52.780 INFO:tasks.workunit.client.0.smithi026.stdout:6/490: stat d6/d21/d58/f78 0 2024-04-23T10:17:52.782 INFO:tasks.workunit.client.0.smithi026.stdout:8/527: dwrite d5/d9/f5b [4194304,4194304] 0 2024-04-23T10:17:52.784 INFO:tasks.workunit.client.0.smithi026.stdout:6/491: symlink d6/d21/d2f/d31/d52/d82/l93 0 2024-04-23T10:17:52.788 INFO:tasks.workunit.client.0.smithi026.stdout:8/528: rename d5/d9/fa to d5/d9/d22/d65/d78/d3e/da1/fb1 0 2024-04-23T10:17:52.788 INFO:tasks.workunit.client.0.smithi026.stdout:6/492: fsync d6/d21/d58/d8d/f92 0 2024-04-23T10:17:52.789 INFO:tasks.workunit.client.0.smithi026.stdout:6/493: dread - d6/d21/d58/d8d/f92 zero size 2024-04-23T10:17:52.791 INFO:tasks.workunit.client.0.smithi026.stdout:8/529: symlink d5/d9/d22/lb2 0 2024-04-23T10:17:52.794 INFO:tasks.workunit.client.0.smithi026.stdout:6/494: creat d6/d21/d58/f94 x:0 0 0 2024-04-23T10:17:52.796 INFO:tasks.workunit.client.0.smithi026.stdout:1/435: dread dd/f2b [0,4194304] 0 2024-04-23T10:17:52.797 INFO:tasks.workunit.client.0.smithi026.stdout:6/495: creat d6/d21/d58/d8d/d64/f95 x:0 0 0 2024-04-23T10:17:52.798 INFO:tasks.workunit.client.0.smithi026.stdout:1/436: chown dd/d1a/d20/d25/d35/d74 4473 1 2024-04-23T10:17:52.800 INFO:tasks.workunit.client.0.smithi026.stdout:1/437: mkdir dd/d15/d7d/da1 0 2024-04-23T10:17:52.801 INFO:tasks.workunit.client.0.smithi026.stdout:8/530: link d5/d56/d33/c91 d5/d9/d22/d65/d78/cb3 0 2024-04-23T10:17:52.801 INFO:tasks.workunit.client.0.smithi026.stdout:8/531: chown d5/d24/c3b 36 1 2024-04-23T10:17:52.809 INFO:tasks.workunit.client.0.smithi026.stdout:8/532: dwrite d5/d9/d22/d65/f87 [0,4194304] 0 2024-04-23T10:17:52.810 INFO:tasks.workunit.client.0.smithi026.stdout:8/533: chown d5/d9/fc 105246 1 2024-04-23T10:17:52.818 INFO:tasks.workunit.client.0.smithi026.stdout:8/534: dwrite d5/d24/f66 [0,4194304] 0 2024-04-23T10:17:52.819 INFO:tasks.workunit.client.0.smithi026.stdout:6/496: dread d6/fc [0,4194304] 0 2024-04-23T10:17:52.820 INFO:tasks.workunit.client.0.smithi026.stdout:8/535: dread - d5/d56/d47/f8e zero size 2024-04-23T10:17:52.825 INFO:tasks.workunit.client.0.smithi026.stdout:6/497: getdents d6/d21/d58 0 2024-04-23T10:17:52.828 INFO:tasks.workunit.client.0.smithi026.stdout:5/376: sync 2024-04-23T10:17:52.828 INFO:tasks.workunit.client.0.smithi026.stdout:9/558: sync 2024-04-23T10:17:52.828 INFO:tasks.workunit.client.0.smithi026.stdout:2/402: sync 2024-04-23T10:17:52.829 INFO:tasks.workunit.client.0.smithi026.stdout:4/328: sync 2024-04-23T10:17:52.833 INFO:tasks.workunit.client.0.smithi026.stdout:8/536: dwrite d5/d50/f7a [0,4194304] 0 2024-04-23T10:17:52.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/403: mknod d3/dd/d4b/c92 0 2024-04-23T10:17:52.836 INFO:tasks.workunit.client.0.smithi026.stdout:5/377: read d0/d12/f28 [1671381,85494] 0 2024-04-23T10:17:52.838 INFO:tasks.workunit.client.0.smithi026.stdout:8/537: write d5/d56/d15/f5d [1929005,39242] 0 2024-04-23T10:17:52.841 INFO:tasks.workunit.client.0.smithi026.stdout:2/404: write d3/d19/d21/d23/d3a/f8c [890700,61296] 0 2024-04-23T10:17:52.841 INFO:tasks.workunit.client.0.smithi026.stdout:4/329: dread d4/d7/d34/f4f [0,4194304] 0 2024-04-23T10:17:52.842 INFO:tasks.workunit.client.0.smithi026.stdout:5/378: symlink d0/l79 0 2024-04-23T10:17:52.844 INFO:tasks.workunit.client.0.smithi026.stdout:2/405: fdatasync d3/d19/d21/f54 0 2024-04-23T10:17:52.845 INFO:tasks.workunit.client.0.smithi026.stdout:4/330: unlink d4/le 0 2024-04-23T10:17:52.848 INFO:tasks.workunit.client.0.smithi026.stdout:9/559: dwrite d13/d2a/d45/d3a/d4f/f59 [0,4194304] 0 2024-04-23T10:17:52.850 INFO:tasks.workunit.client.0.smithi026.stdout:8/538: dread d5/d56/d15/f34 [0,4194304] 0 2024-04-23T10:17:52.853 INFO:tasks.workunit.client.0.smithi026.stdout:6/498: dwrite d6/d21/d2f/d32/d53/f62 [0,4194304] 0 2024-04-23T10:17:52.854 INFO:tasks.workunit.client.0.smithi026.stdout:2/406: unlink d3/d19/d31/d83/f8b 0 2024-04-23T10:17:52.862 INFO:tasks.workunit.client.0.smithi026.stdout:2/407: symlink d3/d19/d21/d23/d3a/d3c/d80/l93 0 2024-04-23T10:17:52.863 INFO:tasks.workunit.client.0.smithi026.stdout:4/331: write d4/f35 [6748646,110678] 0 2024-04-23T10:17:52.868 INFO:tasks.workunit.client.0.smithi026.stdout:9/560: dwrite d13/d2a/fa1 [0,4194304] 0 2024-04-23T10:17:52.873 INFO:tasks.workunit.client.0.smithi026.stdout:4/332: chown d4/d7/d19/c3a 1780 1 2024-04-23T10:17:52.873 INFO:tasks.workunit.client.0.smithi026.stdout:8/539: dwrite d5/d9/d22/d65/f83 [0,4194304] 0 2024-04-23T10:17:52.873 INFO:tasks.workunit.client.0.smithi026.stdout:2/408: creat d3/d19/d21/d23/f94 x:0 0 0 2024-04-23T10:17:52.876 INFO:tasks.workunit.client.0.smithi026.stdout:4/333: dread d4/d7/d19/f2d [0,4194304] 0 2024-04-23T10:17:52.877 INFO:tasks.workunit.client.0.smithi026.stdout:2/409: write d3/dd/d4b/f61 [1796299,112938] 0 2024-04-23T10:17:52.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/410: readlink d3/dd/l10 0 2024-04-23T10:17:52.878 INFO:tasks.workunit.client.0.smithi026.stdout:8/540: dread d5/d56/d3f/f8d [0,4194304] 0 2024-04-23T10:17:52.878 INFO:tasks.workunit.client.0.smithi026.stdout:6/499: truncate d6/d21/d2f/d37/f3a 321147 0 2024-04-23T10:17:52.879 INFO:tasks.workunit.client.0.smithi026.stdout:8/541: readlink d5/d56/d15/l63 0 2024-04-23T10:17:52.880 INFO:tasks.workunit.client.0.smithi026.stdout:4/334: creat d4/d14/f6e x:0 0 0 2024-04-23T10:17:52.880 INFO:tasks.workunit.client.0.smithi026.stdout:6/500: stat d6/d21/d58/d8d/f92 0 2024-04-23T10:17:52.881 INFO:tasks.workunit.client.0.smithi026.stdout:2/411: dread - d3/d19/d21/d23/d3a/d3c/d5d/f67 zero size 2024-04-23T10:17:52.882 INFO:tasks.workunit.client.0.smithi026.stdout:8/542: write d5/d56/d15/f90 [1302158,121156] 0 2024-04-23T10:17:52.883 INFO:tasks.workunit.client.0.smithi026.stdout:4/335: dread - d4/d7/d34/d36/d38/f58 zero size 2024-04-23T10:17:52.892 INFO:tasks.workunit.client.0.smithi026.stdout:9/561: mknod d13/d2a/d45/d67/ca8 0 2024-04-23T10:17:52.892 INFO:tasks.workunit.client.0.smithi026.stdout:2/412: rmdir d3 39 2024-04-23T10:17:52.897 INFO:tasks.workunit.client.0.smithi026.stdout:6/501: dwrite d6/d21/d2f/d32/d53/f8b [0,4194304] 0 2024-04-23T10:17:52.898 INFO:tasks.workunit.client.0.smithi026.stdout:4/336: mkdir d4/d7/d51/d6c/d6f 0 2024-04-23T10:17:52.901 INFO:tasks.workunit.client.0.smithi026.stdout:6/502: chown d6/d21/d2f/d37/d4f/f7b 37729 1 2024-04-23T10:17:52.901 INFO:tasks.workunit.client.0.smithi026.stdout:2/413: getdents d3/d19 0 2024-04-23T10:17:52.902 INFO:tasks.workunit.client.0.smithi026.stdout:4/337: write d4/d7/d51/f56 [1550622,39161] 0 2024-04-23T10:17:52.903 INFO:tasks.workunit.client.0.smithi026.stdout:6/503: chown d6/c59 357706418 1 2024-04-23T10:17:52.904 INFO:tasks.workunit.client.0.smithi026.stdout:9/562: dwrite d13/d2a/f2f [4194304,4194304] 0 2024-04-23T10:17:52.905 INFO:tasks.workunit.client.0.smithi026.stdout:8/543: dread d5/d56/d47/f48 [0,4194304] 0 2024-04-23T10:17:52.906 INFO:tasks.workunit.client.0.smithi026.stdout:6/504: creat d6/d21/d58/f96 x:0 0 0 2024-04-23T10:17:52.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/563: creat d13/d1b/fa9 x:0 0 0 2024-04-23T10:17:52.910 INFO:tasks.workunit.client.0.smithi026.stdout:8/544: truncate d5/d56/d15/d76/f85 405708 0 2024-04-23T10:17:52.912 INFO:tasks.workunit.client.0.smithi026.stdout:9/564: symlink d13/d36/d66/d78/laa 0 2024-04-23T10:17:52.917 INFO:tasks.workunit.client.0.smithi026.stdout:6/505: dwrite d6/d21/d2f/d32/d53/f62 [0,4194304] 0 2024-04-23T10:17:52.925 INFO:tasks.workunit.client.0.smithi026.stdout:9/565: link d13/l50 d13/d2a/d45/d67/lab 0 2024-04-23T10:17:52.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/566: write d13/d2a/d45/d67/f7c [82168,92753] 0 2024-04-23T10:17:52.931 INFO:tasks.workunit.client.0.smithi026.stdout:6/506: dwrite d6/d21/d2f/d32/d53/f8b [0,4194304] 0 2024-04-23T10:17:52.934 INFO:tasks.workunit.client.0.smithi026.stdout:6/507: fdatasync d6/d13/d15/f7c 0 2024-04-23T10:17:52.936 INFO:tasks.workunit.client.0.smithi026.stdout:6/508: readlink d6/d21/d2f/d32/l77 0 2024-04-23T10:17:52.940 INFO:tasks.workunit.client.0.smithi026.stdout:6/509: truncate d6/d21/d2f/d32/d53/f8b 4522853 0 2024-04-23T10:17:52.941 INFO:tasks.workunit.client.0.smithi026.stdout:9/567: dwrite d13/d3e/f80 [0,4194304] 0 2024-04-23T10:17:52.944 INFO:tasks.workunit.client.0.smithi026.stdout:6/510: creat d6/d21/d2f/d32/f97 x:0 0 0 2024-04-23T10:17:52.947 INFO:tasks.workunit.client.0.smithi026.stdout:9/568: rmdir d13/d2a/d45 39 2024-04-23T10:17:52.951 INFO:tasks.workunit.client.0.smithi026.stdout:6/511: mknod d6/d21/d2f/d32/d53/c98 0 2024-04-23T10:17:52.952 INFO:tasks.workunit.client.0.smithi026.stdout:6/512: fdatasync d6/fc 0 2024-04-23T10:17:52.954 INFO:tasks.workunit.client.0.smithi026.stdout:6/513: chown d6/fe 7048384 1 2024-04-23T10:17:52.954 INFO:tasks.workunit.client.0.smithi026.stdout:8/545: dread d5/d24/f27 [0,4194304] 0 2024-04-23T10:17:52.957 INFO:tasks.workunit.client.0.smithi026.stdout:9/569: creat d13/d2a/d45/fac x:0 0 0 2024-04-23T10:17:52.963 INFO:tasks.workunit.client.0.smithi026.stdout:6/514: dread d6/d21/d2f/d32/f91 [0,4194304] 0 2024-04-23T10:17:52.965 INFO:tasks.workunit.client.0.smithi026.stdout:8/546: dwrite d5/d56/d47/f8e [0,4194304] 0 2024-04-23T10:17:52.967 INFO:tasks.workunit.client.0.smithi026.stdout:8/547: fdatasync d5/d24/f72 0 2024-04-23T10:17:52.968 INFO:tasks.workunit.client.0.smithi026.stdout:6/515: read d6/d21/d2f/d37/f6d [3798985,104242] 0 2024-04-23T10:17:52.968 INFO:tasks.workunit.client.0.smithi026.stdout:2/414: dread d3/d19/f1c [8388608,4194304] 0 2024-04-23T10:17:52.969 INFO:tasks.workunit.client.0.smithi026.stdout:8/548: stat d5/d9/f96 0 2024-04-23T10:17:52.971 INFO:tasks.workunit.client.0.smithi026.stdout:6/516: read d6/f1d [2918482,128380] 0 2024-04-23T10:17:52.972 INFO:tasks.workunit.client.0.smithi026.stdout:2/415: dread - d3/d19/d1d/d49/f73 zero size 2024-04-23T10:17:52.974 INFO:tasks.workunit.client.0.smithi026.stdout:9/570: dwrite d13/d1b/f77 [0,4194304] 0 2024-04-23T10:17:52.974 INFO:tasks.workunit.client.0.smithi026.stdout:6/517: dread d6/d13/d15/f81 [0,4194304] 0 2024-04-23T10:17:52.976 INFO:tasks.workunit.client.0.smithi026.stdout:2/416: stat d3/d19/d31 0 2024-04-23T10:17:52.977 INFO:tasks.workunit.client.0.smithi026.stdout:8/549: write d5/d9/d22/d65/d78/d3e/f92 [1038108,12070] 0 2024-04-23T10:17:52.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/518: mknod d6/d13/d15/c99 0 2024-04-23T10:17:52.983 INFO:tasks.workunit.client.0.smithi026.stdout:6/519: mkdir d6/d21/d2f/d37/d9a 0 2024-04-23T10:17:52.984 INFO:tasks.workunit.client.0.smithi026.stdout:2/417: readlink d3/d19/d21/d23/d3a/d65/l75 0 2024-04-23T10:17:52.985 INFO:tasks.workunit.client.0.smithi026.stdout:2/418: fsync d3/d19/d31/f77 0 2024-04-23T10:17:52.987 INFO:tasks.workunit.client.0.smithi026.stdout:8/550: dread d5/d9/f2e [0,4194304] 0 2024-04-23T10:17:52.989 INFO:tasks.workunit.client.0.smithi026.stdout:9/571: mknod d13/d2a/d45/cad 0 2024-04-23T10:17:52.989 INFO:tasks.workunit.client.0.smithi026.stdout:6/520: dread - d6/d21/d2f/d32/f97 zero size 2024-04-23T10:17:52.991 INFO:tasks.workunit.client.0.smithi026.stdout:6/521: write d6/d21/f72 [764277,92300] 0 2024-04-23T10:17:52.991 INFO:tasks.workunit.client.0.smithi026.stdout:8/551: mknod d5/d9/d22/d65/d78/d3e/da1/cb4 0 2024-04-23T10:17:52.992 INFO:tasks.workunit.client.0.smithi026.stdout:8/552: chown d5/f28 74 1 2024-04-23T10:17:52.992 INFO:tasks.workunit.client.0.smithi026.stdout:6/522: write d6/d21/d58/f75 [560730,78601] 0 2024-04-23T10:17:52.993 INFO:tasks.workunit.client.0.smithi026.stdout:8/553: readlink d5/d56/d47/l4a 0 2024-04-23T10:17:52.994 INFO:tasks.workunit.client.0.smithi026.stdout:2/419: rename d3/d19/f1c to d3/d19/d21/d23/d3a/f95 0 2024-04-23T10:17:52.994 INFO:tasks.workunit.client.0.smithi026.stdout:0/582: sync 2024-04-23T10:17:52.994 INFO:tasks.workunit.client.0.smithi026.stdout:6/523: chown d6/d21/d2f/d31/d52/l5e 3956840 1 2024-04-23T10:17:52.995 INFO:tasks.workunit.client.0.smithi026.stdout:6/524: chown d6/f5c 1817213827 1 2024-04-23T10:17:52.995 INFO:tasks.workunit.client.0.smithi026.stdout:0/583: chown d7/d8/d2d/d60/d62/d96 78718 1 2024-04-23T10:17:52.996 INFO:tasks.workunit.client.0.smithi026.stdout:6/525: write d6/d33/f2c [1499097,23815] 0 2024-04-23T10:17:52.997 INFO:tasks.workunit.client.0.smithi026.stdout:6/526: fdatasync d6/d21/d2f/d37/d68/f6a 0 2024-04-23T10:17:53.000 INFO:tasks.workunit.client.0.smithi026.stdout:0/584: rename d7/d8/d1e/d2a/f6e to d7/d8/d1e/d1d/d2f/dd1/fe0 0 2024-04-23T10:17:53.001 INFO:tasks.workunit.client.0.smithi026.stdout:9/572: truncate d13/f2d 2947379 0 2024-04-23T10:17:53.042 INFO:tasks.workunit.client.0.smithi026.stdout:6/527: rmdir d6/d21/d2f/d32/d53 39 2024-04-23T10:17:53.043 INFO:tasks.workunit.client.0.smithi026.stdout:9/573: dread - d13/d2a/d45/d3a/d6b/f96 zero size 2024-04-23T10:17:53.043 INFO:tasks.workunit.client.0.smithi026.stdout:0/585: chown d7/fbb 1029098 1 2024-04-23T10:17:53.046 INFO:tasks.workunit.client.0.smithi026.stdout:2/420: mkdir d3/d19/d21/d23/d3a/d3c/d80/d96 0 2024-04-23T10:17:53.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/574: dwrite d13/d2a/fa1 [0,4194304] 0 2024-04-23T10:17:53.055 INFO:tasks.workunit.client.0.smithi026.stdout:0/586: dwrite d7/d8/d1e/d57/f5e [0,4194304] 0 2024-04-23T10:17:53.056 INFO:tasks.workunit.client.0.smithi026.stdout:9/575: chown d13/f22 0 1 2024-04-23T10:17:53.057 INFO:tasks.workunit.client.0.smithi026.stdout:6/528: dread d6/d21/d2f/d37/d4f/f7b [0,4194304] 0 2024-04-23T10:17:53.067 INFO:tasks.workunit.client.0.smithi026.stdout:0/587: write d7/d8/d2d/d60/d77/f95 [496975,13732] 0 2024-04-23T10:17:53.068 INFO:tasks.workunit.client.0.smithi026.stdout:2/421: link d3/d19/d21/d23/d3a/f69 d3/d19/d31/f97 0 2024-04-23T10:17:53.070 INFO:tasks.workunit.client.0.smithi026.stdout:2/422: chown d3/d19/d31/f3b 25 1 2024-04-23T10:17:53.070 INFO:tasks.workunit.client.0.smithi026.stdout:6/529: write d6/d21/d58/d8d/f80 [654829,41683] 0 2024-04-23T10:17:53.073 INFO:tasks.workunit.client.0.smithi026.stdout:0/588: unlink d7/d8/d2d/fab 0 2024-04-23T10:17:53.076 INFO:tasks.workunit.client.0.smithi026.stdout:0/589: stat d7/d8/d1e/d1d/d2f/d6c/fd2 0 2024-04-23T10:17:53.081 INFO:tasks.workunit.client.0.smithi026.stdout:0/590: creat d7/d8/d1e/d1d/d2f/d6c/fe1 x:0 0 0 2024-04-23T10:17:53.083 INFO:tasks.workunit.client.0.smithi026.stdout:9/576: dwrite d13/d2a/d45/d3a/d6b/f55 [0,4194304] 0 2024-04-23T10:17:53.085 INFO:tasks.workunit.client.0.smithi026.stdout:6/530: dread d6/d21/d2f/d32/f41 [0,4194304] 0 2024-04-23T10:17:53.086 INFO:tasks.workunit.client.0.smithi026.stdout:0/591: rmdir d7/d8/d2d/d60/d62 39 2024-04-23T10:17:53.086 INFO:tasks.workunit.client.0.smithi026.stdout:6/531: fdatasync d6/d21/d58/f94 0 2024-04-23T10:17:53.088 INFO:tasks.workunit.client.0.smithi026.stdout:2/423: dwrite d3/dd/f18 [4194304,4194304] 0 2024-04-23T10:17:53.089 INFO:tasks.workunit.client.0.smithi026.stdout:0/592: readlink d7/d8/d1e/d1d/d2f/d6c/lb0 0 2024-04-23T10:17:53.090 INFO:tasks.workunit.client.0.smithi026.stdout:2/424: readlink d3/d35/d4c/l7d 0 2024-04-23T10:17:53.095 INFO:tasks.workunit.client.0.smithi026.stdout:0/593: read d7/d43/f8d [2568456,53707] 0 2024-04-23T10:17:53.096 INFO:tasks.workunit.client.0.smithi026.stdout:9/577: dwrite d13/d3b/d4e/d76/f8f [0,4194304] 0 2024-04-23T10:17:53.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/425: dwrite d3/d19/d21/d23/d3a/d3c/f63 [0,4194304] 0 2024-04-23T10:17:53.105 INFO:tasks.workunit.client.0.smithi026.stdout:0/594: mkdir d7/d8/d2d/d60/d62/db2/db4/de2 0 2024-04-23T10:17:53.108 INFO:tasks.workunit.client.0.smithi026.stdout:2/426: dread - d3/d19/d1d/f7f zero size 2024-04-23T10:17:53.115 INFO:tasks.workunit.client.0.smithi026.stdout:9/578: link d13/d2a/d45/d6d/ca2 d13/d31/d87/cae 0 2024-04-23T10:17:53.116 INFO:tasks.workunit.client.0.smithi026.stdout:2/427: symlink d3/d19/d1d/l98 0 2024-04-23T10:17:53.117 INFO:tasks.workunit.client.0.smithi026.stdout:0/595: getdents d7/d8/d1e/d1d/d2f 0 2024-04-23T10:17:53.118 INFO:tasks.workunit.client.0.smithi026.stdout:2/428: dread - d3/d19/d21/d23/f94 zero size 2024-04-23T10:17:53.122 INFO:tasks.workunit.client.0.smithi026.stdout:2/429: creat d3/d19/d21/d23/d3a/d65/f99 x:0 0 0 2024-04-23T10:17:53.123 INFO:tasks.workunit.client.0.smithi026.stdout:2/430: write d3/dd/f56 [111932,98225] 0 2024-04-23T10:17:53.126 INFO:tasks.workunit.client.0.smithi026.stdout:0/596: write d7/fbb [773227,88485] 0 2024-04-23T10:17:53.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/597: fdatasync d7/d8/d1e/d2a/d6a/d70/f8e 0 2024-04-23T10:17:53.133 INFO:tasks.workunit.client.0.smithi026.stdout:9/579: dread d13/d2a/d45/d67/f7c [0,4194304] 0 2024-04-23T10:17:53.142 INFO:tasks.workunit.client.0.smithi026.stdout:0/598: dwrite d7/d8/d1e/d1d/d2f/d6c/fe1 [0,4194304] 0 2024-04-23T10:17:53.144 INFO:tasks.workunit.client.0.smithi026.stdout:0/599: truncate d7/d5b/f76 2470390 0 2024-04-23T10:17:53.145 INFO:tasks.workunit.client.0.smithi026.stdout:9/580: dwrite d13/d2a/d45/d3a/f56 [0,4194304] 0 2024-04-23T10:17:53.147 INFO:tasks.workunit.client.0.smithi026.stdout:9/581: truncate d13/d2a/d45/d3a/d6b/f96 959565 0 2024-04-23T10:17:53.149 INFO:tasks.workunit.client.0.smithi026.stdout:9/582: chown d13/d2a/d45/d67/lab 932145 1 2024-04-23T10:17:53.152 INFO:tasks.workunit.client.0.smithi026.stdout:0/600: rename d7/d5b/fa7 to d7/d8/d2d/d60/d62/da2/dd9/fe3 0 2024-04-23T10:17:53.156 INFO:tasks.workunit.client.0.smithi026.stdout:0/601: dread - d7/d8/d1e/d1d/d2f/dd1/fe0 zero size 2024-04-23T10:17:53.157 INFO:tasks.workunit.client.0.smithi026.stdout:0/602: fdatasync d7/d8/d2d/f8c 0 2024-04-23T10:17:53.158 INFO:tasks.workunit.client.0.smithi026.stdout:0/603: chown d7/d8/d1e/d1d 825919 1 2024-04-23T10:17:53.159 INFO:tasks.workunit.client.0.smithi026.stdout:0/604: chown d7/d8/d2d/d60/d77/fc4 293399 1 2024-04-23T10:17:53.160 INFO:tasks.workunit.client.0.smithi026.stdout:0/605: write d7/d8/d2d/d60/d62/f40 [1342499,71219] 0 2024-04-23T10:17:53.161 INFO:tasks.workunit.client.0.smithi026.stdout:0/606: readlink d7/d8/d2d/l93 0 2024-04-23T10:17:53.162 INFO:tasks.workunit.client.0.smithi026.stdout:9/583: creat d13/faf x:0 0 0 2024-04-23T10:17:53.170 INFO:tasks.workunit.client.0.smithi026.stdout:0/607: dwrite d7/d8/d1e/d57/f5e [0,4194304] 0 2024-04-23T10:17:53.170 INFO:tasks.workunit.client.0.smithi026.stdout:9/584: write d13/d1b/d26/f58 [1057493,77064] 0 2024-04-23T10:17:53.172 INFO:tasks.workunit.client.0.smithi026.stdout:0/608: creat d7/d8/d2d/d60/d77/fe4 x:0 0 0 2024-04-23T10:17:53.173 INFO:tasks.workunit.client.0.smithi026.stdout:9/585: mknod d13/d1b/d26/d88/cb0 0 2024-04-23T10:17:53.174 INFO:tasks.workunit.client.0.smithi026.stdout:0/609: getdents d7/d8/d1e/dd3 0 2024-04-23T10:17:53.176 INFO:tasks.workunit.client.0.smithi026.stdout:0/610: write d7/fa4 [7158,46714] 0 2024-04-23T10:17:53.178 INFO:tasks.workunit.client.0.smithi026.stdout:0/611: dread - d7/d8/d2d/d60/d62/db2/db4/fc3 zero size 2024-04-23T10:17:53.185 INFO:tasks.workunit.client.0.smithi026.stdout:9/586: dwrite d13/d1b/d26/f2e [4194304,4194304] 0 2024-04-23T10:17:53.188 INFO:tasks.workunit.client.0.smithi026.stdout:0/612: link d7/d8/d1e/d1d/l99 d7/d8/d1e/d1d/d2f/d6c/le5 0 2024-04-23T10:17:53.190 INFO:tasks.workunit.client.0.smithi026.stdout:9/587: rename d13/d1b/l29 to d13/d1b/lb1 0 2024-04-23T10:17:53.191 INFO:tasks.workunit.client.0.smithi026.stdout:9/588: truncate d13/d2a/d45/d6d/fa5 256144 0 2024-04-23T10:17:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:0/613: rename d7/d8/d2d/d60/d77/fc4 to d7/d8/d1e/d1d/d2f/dd1/dd6/fe6 0 2024-04-23T10:17:53.192 INFO:tasks.workunit.client.0.smithi026.stdout:0/614: chown d7/d8/d2d/d60/d77 265485287 1 2024-04-23T10:17:53.194 INFO:tasks.workunit.client.0.smithi026.stdout:7/454: sync 2024-04-23T10:17:53.194 INFO:tasks.workunit.client.0.smithi026.stdout:3/438: sync 2024-04-23T10:17:53.195 INFO:tasks.workunit.client.0.smithi026.stdout:9/589: rename d13/d3e/f5e to d13/d1b/d26/fb2 0 2024-04-23T10:17:53.197 INFO:tasks.workunit.client.0.smithi026.stdout:0/615: mkdir d7/d8/d1e/dd3/de7 0 2024-04-23T10:17:53.199 INFO:tasks.workunit.client.0.smithi026.stdout:3/439: getdents d0/d51 0 2024-04-23T10:17:53.201 INFO:tasks.workunit.client.0.smithi026.stdout:9/590: read d13/d3e/f41 [2150382,89547] 0 2024-04-23T10:17:53.203 INFO:tasks.workunit.client.0.smithi026.stdout:0/616: dread - d7/d8/d1e/d1d/d2f/dd1/dd6/fe6 zero size 2024-04-23T10:17:53.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/591: readlink d13/d3b/d68/l7d 0 2024-04-23T10:17:53.205 INFO:tasks.workunit.client.0.smithi026.stdout:7/455: dwrite dd/d1d/f71 [0,4194304] 0 2024-04-23T10:17:53.205 INFO:tasks.workunit.client.0.smithi026.stdout:9/592: write d13/d3b/d68/f9b [751439,9186] 0 2024-04-23T10:17:53.207 INFO:tasks.workunit.client.0.smithi026.stdout:9/593: write d13/f1c [4013885,123385] 0 2024-04-23T10:17:53.214 INFO:tasks.workunit.client.0.smithi026.stdout:9/594: getdents d13 0 2024-04-23T10:17:53.215 INFO:tasks.workunit.client.0.smithi026.stdout:0/617: rename d7/d8/d2d/d60/c85 to d7/d8/d2d/d60/d62/db2/db4/de2/ce8 0 2024-04-23T10:17:53.216 INFO:tasks.workunit.client.0.smithi026.stdout:0/618: stat d7/dc2 0 2024-04-23T10:17:53.217 INFO:tasks.workunit.client.0.smithi026.stdout:9/595: write d13/d3b/d4e/f89 [1670156,34078] 0 2024-04-23T10:17:53.219 INFO:tasks.workunit.client.0.smithi026.stdout:0/619: write d7/d8/d2d/fd7 [351318,64049] 0 2024-04-23T10:17:53.224 INFO:tasks.workunit.client.0.smithi026.stdout:9/596: mknod d13/d1b/d2b/cb3 0 2024-04-23T10:17:53.225 INFO:tasks.workunit.client.0.smithi026.stdout:9/597: readlink d13/d3b/l97 0 2024-04-23T10:17:53.226 INFO:tasks.workunit.client.0.smithi026.stdout:3/440: dread d0/d1e/d30/d43/f5f [0,4194304] 0 2024-04-23T10:17:53.227 INFO:tasks.workunit.client.0.smithi026.stdout:0/620: creat d7/d8/d2d/d60/d62/db2/fe9 x:0 0 0 2024-04-23T10:17:53.228 INFO:tasks.workunit.client.0.smithi026.stdout:9/598: symlink d13/d1b/d26/d88/lb4 0 2024-04-23T10:17:53.233 INFO:tasks.workunit.client.0.smithi026.stdout:0/621: rename d7/d43/f53 to d7/d8/d2d/d60/d62/fea 0 2024-04-23T10:17:53.237 INFO:tasks.workunit.client.0.smithi026.stdout:9/599: dwrite d13/d3e/f80 [0,4194304] 0 2024-04-23T10:17:53.238 INFO:tasks.workunit.client.0.smithi026.stdout:0/622: write d7/d8/d1e/d2a/f55 [528360,64342] 0 2024-04-23T10:17:53.240 INFO:tasks.workunit.client.0.smithi026.stdout:9/600: write d13/f5c [3818929,128440] 0 2024-04-23T10:17:53.241 INFO:tasks.workunit.client.0.smithi026.stdout:9/601: write d13/d2a/d45/d67/f82 [2524020,63952] 0 2024-04-23T10:17:53.245 INFO:tasks.workunit.client.0.smithi026.stdout:3/441: dread d0/d51/f83 [0,4194304] 0 2024-04-23T10:17:53.249 INFO:tasks.workunit.client.0.smithi026.stdout:9/602: mkdir d13/d1b/d26/d88/db5 0 2024-04-23T10:17:53.252 INFO:tasks.workunit.client.0.smithi026.stdout:7/456: dread dd/d3f/d47/d4c/f6f [0,4194304] 0 2024-04-23T10:17:53.255 INFO:tasks.workunit.client.0.smithi026.stdout:3/442: mknod d0/d1e/c9c 0 2024-04-23T10:17:53.261 INFO:tasks.workunit.client.0.smithi026.stdout:9/603: dwrite d13/d2a/d45/d67/f7c [0,4194304] 0 2024-04-23T10:17:53.261 INFO:tasks.workunit.client.0.smithi026.stdout:7/457: truncate dd/f36 2955261 0 2024-04-23T10:17:53.285 INFO:tasks.workunit.client.0.smithi026.stdout:7/458: dread dd/d1d/f37 [0,4194304] 0 2024-04-23T10:17:53.286 INFO:tasks.workunit.client.0.smithi026.stdout:9/604: dread d13/d3b/d5b/f90 [0,4194304] 0 2024-04-23T10:17:53.287 INFO:tasks.workunit.client.0.smithi026.stdout:3/443: getdents d0/d1e/d30/d43 0 2024-04-23T10:17:53.292 INFO:tasks.workunit.client.0.smithi026.stdout:7/459: dwrite dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:53.293 INFO:tasks.workunit.client.0.smithi026.stdout:7/460: stat dd/d44/f23 0 2024-04-23T10:17:53.293 INFO:tasks.workunit.client.0.smithi026.stdout:9/605: dwrite d13/f1e [0,4194304] 0 2024-04-23T10:17:53.293 INFO:tasks.workunit.client.0.smithi026.stdout:7/461: stat cb 0 2024-04-23T10:17:53.296 INFO:tasks.workunit.client.0.smithi026.stdout:3/444: rename d0/d1e/d30/d43/df/d17/c4d to d0/d51/c9d 0 2024-04-23T10:17:53.297 INFO:tasks.workunit.client.0.smithi026.stdout:7/462: symlink dd/d46/l84 0 2024-04-23T10:17:53.299 INFO:tasks.workunit.client.0.smithi026.stdout:9/606: mkdir d13/d36/d66/db6 0 2024-04-23T10:17:53.309 INFO:tasks.workunit.client.0.smithi026.stdout:7/463: creat dd/d2c/d48/f85 x:0 0 0 2024-04-23T10:17:53.311 INFO:tasks.workunit.client.0.smithi026.stdout:3/445: truncate d0/d1e/d30/d43/f38 1577290 0 2024-04-23T10:17:53.317 INFO:tasks.workunit.client.0.smithi026.stdout:9/607: rename d13/d3b/d4e/f89 to d13/d19/fb7 0 2024-04-23T10:17:53.318 INFO:tasks.workunit.client.0.smithi026.stdout:7/464: creat dd/d44/f86 x:0 0 0 2024-04-23T10:17:53.526 INFO:tasks.workunit.client.0.smithi026.stdout:1/438: sync 2024-04-23T10:17:53.540 INFO:tasks.workunit.client.0.smithi026.stdout:3/446: getdents d0 0 2024-04-23T10:17:53.544 INFO:tasks.workunit.client.0.smithi026.stdout:3/447: readlink d0/d1e/d30/d43/d6c/d79/l3a 0 2024-04-23T10:17:53.559 INFO:tasks.workunit.client.0.smithi026.stdout:3/448: mkdir d0/d1e/d23/d9e 0 2024-04-23T10:17:53.562 INFO:tasks.workunit.client.0.smithi026.stdout:1/439: write dd/d15/f68 [694031,42286] 0 2024-04-23T10:17:53.564 INFO:tasks.workunit.client.0.smithi026.stdout:1/440: chown dd/f3b 49 1 2024-04-23T10:17:53.567 INFO:tasks.workunit.client.0.smithi026.stdout:1/441: write dd/f90 [822881,118583] 0 2024-04-23T10:17:53.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/442: dread - dd/d1a/d20/d25/f91 zero size 2024-04-23T10:17:53.576 INFO:tasks.workunit.client.0.smithi026.stdout:7/465: creat dd/d1d/d50/f87 x:0 0 0 2024-04-23T10:17:53.577 INFO:tasks.workunit.client.0.smithi026.stdout:7/466: chown l1 59149 1 2024-04-23T10:17:53.580 INFO:tasks.workunit.client.0.smithi026.stdout:3/449: symlink d0/d1e/d30/d43/df/d17/l9f 0 2024-04-23T10:17:53.599 INFO:tasks.workunit.client.0.smithi026.stdout:1/443: dwrite dd/d1a/d20/d25/d35/f53 [0,4194304] 0 2024-04-23T10:17:53.605 INFO:tasks.workunit.client.0.smithi026.stdout:7/467: unlink dd/l15 0 2024-04-23T10:17:53.608 INFO:tasks.workunit.client.0.smithi026.stdout:3/450: getdents d0/d1e/d23/d9e 0 2024-04-23T10:17:53.615 INFO:tasks.workunit.client.0.smithi026.stdout:3/451: readlink d0/d1e/d23/l6e 0 2024-04-23T10:17:53.621 INFO:tasks.workunit.client.0.smithi026.stdout:1/444: creat dd/d1a/d23/d92/fa2 x:0 0 0 2024-04-23T10:17:53.637 INFO:tasks.workunit.client.0.smithi026.stdout:3/452: write d0/d1e/f31 [378250,43210] 0 2024-04-23T10:17:53.644 INFO:tasks.workunit.client.0.smithi026.stdout:1/445: write dd/d1a/d20/d25/d35/d7f/f8d [925817,124381] 0 2024-04-23T10:17:53.649 INFO:tasks.workunit.client.0.smithi026.stdout:7/468: getdents dd/d1d/d50/d58 0 2024-04-23T10:17:53.657 INFO:tasks.workunit.client.0.smithi026.stdout:4/338: sync 2024-04-23T10:17:53.657 INFO:tasks.workunit.client.0.smithi026.stdout:5/379: sync 2024-04-23T10:17:53.662 INFO:tasks.workunit.client.0.smithi026.stdout:4/339: mknod d4/d7/d34/c70 0 2024-04-23T10:17:53.664 INFO:tasks.workunit.client.0.smithi026.stdout:7/469: fsync dd/f41 0 2024-04-23T10:17:53.665 INFO:tasks.workunit.client.0.smithi026.stdout:4/340: dread - d4/d7/d34/f41 zero size 2024-04-23T10:17:53.667 INFO:tasks.workunit.client.0.smithi026.stdout:5/380: symlink d0/d6f/l7a 0 2024-04-23T10:17:53.671 INFO:tasks.workunit.client.0.smithi026.stdout:3/453: dread d0/d1e/d30/d43/d29/f34 [0,4194304] 0 2024-04-23T10:17:53.672 INFO:tasks.workunit.client.0.smithi026.stdout:5/381: mknod d0/d12/c7b 0 2024-04-23T10:17:53.673 INFO:tasks.workunit.client.0.smithi026.stdout:3/454: chown d0/d4c/f9b 662299 1 2024-04-23T10:17:53.676 INFO:tasks.workunit.client.0.smithi026.stdout:3/455: chown d0/d1e/d30/d43/df/d63/f7b 16107647 1 2024-04-23T10:17:53.681 INFO:tasks.workunit.client.0.smithi026.stdout:7/470: mknod dd/d1d/d7d/c88 0 2024-04-23T10:17:53.686 INFO:tasks.workunit.client.0.smithi026.stdout:5/382: getdents d0/d68 0 2024-04-23T10:17:53.692 INFO:tasks.workunit.client.0.smithi026.stdout:7/471: mknod dd/d1d/d50/c89 0 2024-04-23T10:17:53.698 INFO:tasks.workunit.client.0.smithi026.stdout:5/383: creat d0/d3c/f7c x:0 0 0 2024-04-23T10:17:53.705 INFO:tasks.workunit.client.0.smithi026.stdout:7/472: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:53.707 INFO:tasks.workunit.client.0.smithi026.stdout:5/384: rename d0/f21 to d0/d3c/d57/f7d 0 2024-04-23T10:17:53.722 INFO:tasks.workunit.client.0.smithi026.stdout:7/473: dwrite dd/d1d/d50/f5c [4194304,4194304] 0 2024-04-23T10:17:53.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/385: symlink d0/d12/l7e 0 2024-04-23T10:17:53.760 INFO:tasks.workunit.client.0.smithi026.stdout:6/532: sync 2024-04-23T10:17:53.760 INFO:tasks.workunit.client.0.smithi026.stdout:9/608: sync 2024-04-23T10:17:53.761 INFO:tasks.workunit.client.0.smithi026.stdout:8/554: sync 2024-04-23T10:17:53.761 INFO:tasks.workunit.client.0.smithi026.stdout:2/431: sync 2024-04-23T10:17:53.764 INFO:tasks.workunit.client.0.smithi026.stdout:2/432: write d3/d19/d21/f85 [577606,92538] 0 2024-04-23T10:17:53.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/533: truncate d6/d21/d58/d8d/f5b 1086362 0 2024-04-23T10:17:53.775 INFO:tasks.workunit.client.0.smithi026.stdout:8/555: rename d5/d56/d15/f34 to d5/d56/d47/fb5 0 2024-04-23T10:17:53.777 INFO:tasks.workunit.client.0.smithi026.stdout:2/433: symlink d3/d19/d21/d23/d3a/d3c/d80/l9a 0 2024-04-23T10:17:53.779 INFO:tasks.workunit.client.0.smithi026.stdout:7/474: dwrite dd/f35 [4194304,4194304] 0 2024-04-23T10:17:53.781 INFO:tasks.workunit.client.0.smithi026.stdout:6/534: rename d6/d21/d58/f94 to d6/d21/d58/f9b 0 2024-04-23T10:17:53.783 INFO:tasks.workunit.client.0.smithi026.stdout:5/386: link d0/f3 d0/d3c/d5d/d3a/f7f 0 2024-04-23T10:17:53.788 INFO:tasks.workunit.client.0.smithi026.stdout:2/434: creat d3/d19/d21/d23/d3a/d3c/d5d/f9b x:0 0 0 2024-04-23T10:17:53.793 INFO:tasks.workunit.client.0.smithi026.stdout:9/609: rename d13/d2a/d45/d6d/ca2 to d13/d2a/d45/d3a/d6b/cb8 0 2024-04-23T10:17:53.794 INFO:tasks.workunit.client.0.smithi026.stdout:0/623: dread d7/d8/d1e/d1d/f6d [0,4194304] 0 2024-04-23T10:17:53.798 INFO:tasks.workunit.client.0.smithi026.stdout:0/624: write d7/d8/d1e/d2a/d6a/f6b [4045685,59523] 0 2024-04-23T10:17:53.799 INFO:tasks.workunit.client.0.smithi026.stdout:6/535: truncate d6/fd 2936143 0 2024-04-23T10:17:53.800 INFO:tasks.workunit.client.0.smithi026.stdout:6/536: chown d6 1 1 2024-04-23T10:17:53.801 INFO:tasks.workunit.client.0.smithi026.stdout:0/625: readlink d7/d5b/l5d 0 2024-04-23T10:17:53.808 INFO:tasks.workunit.client.0.smithi026.stdout:9/610: creat d13/d3b/d68/fb9 x:0 0 0 2024-04-23T10:17:53.810 INFO:tasks.workunit.client.0.smithi026.stdout:9/611: read d13/d2a/d45/d3a/d4f/f59 [3695809,83171] 0 2024-04-23T10:17:53.815 INFO:tasks.workunit.client.0.smithi026.stdout:5/387: rename d0/f26 to d0/f80 0 2024-04-23T10:17:53.819 INFO:tasks.workunit.client.0.smithi026.stdout:6/537: write d6/d21/d2f/d37/f6d [2595376,19110] 0 2024-04-23T10:17:53.819 INFO:tasks.workunit.client.0.smithi026.stdout:9/612: dread d13/d1b/f77 [0,4194304] 0 2024-04-23T10:17:53.821 INFO:tasks.workunit.client.0.smithi026.stdout:8/556: link d5/d50/d9a/lb0 d5/d9/d64/lb6 0 2024-04-23T10:17:53.835 INFO:tasks.workunit.client.0.smithi026.stdout:5/388: dwrite d0/d12/f3f [0,4194304] 0 2024-04-23T10:17:53.835 INFO:tasks.workunit.client.0.smithi026.stdout:9/613: dwrite d13/faf [0,4194304] 0 2024-04-23T10:17:53.838 INFO:tasks.workunit.client.0.smithi026.stdout:6/538: mknod d6/d13/d15/c9c 0 2024-04-23T10:17:53.839 INFO:tasks.workunit.client.0.smithi026.stdout:6/539: readlink d6/d13/d15/l20 0 2024-04-23T10:17:53.841 INFO:tasks.workunit.client.0.smithi026.stdout:7/475: link dd/d1d/l3a dd/d3f/l8a 0 2024-04-23T10:17:53.841 INFO:tasks.workunit.client.0.smithi026.stdout:6/540: fdatasync d6/d21/d2f/d32/f55 0 2024-04-23T10:17:53.842 INFO:tasks.workunit.client.0.smithi026.stdout:0/626: dread d7/d8/d1e/d2a/d6a/f6b [0,4194304] 0 2024-04-23T10:17:53.845 INFO:tasks.workunit.client.0.smithi026.stdout:1/446: sync 2024-04-23T10:17:53.847 INFO:tasks.workunit.client.0.smithi026.stdout:2/435: getdents d3/d19/d31/d83 0 2024-04-23T10:17:53.856 INFO:tasks.workunit.client.0.smithi026.stdout:5/389: symlink d0/d6f/l81 0 2024-04-23T10:17:53.856 INFO:tasks.workunit.client.0.smithi026.stdout:9/614: symlink d13/d3b/d4e/lba 0 2024-04-23T10:17:53.857 INFO:tasks.workunit.client.0.smithi026.stdout:9/615: stat d13/f1e 0 2024-04-23T10:17:53.861 INFO:tasks.workunit.client.0.smithi026.stdout:6/541: creat d6/d21/d2f/d32/d87/f9d x:0 0 0 2024-04-23T10:17:53.863 INFO:tasks.workunit.client.0.smithi026.stdout:0/627: creat d7/d8/d2d/d60/d77/feb x:0 0 0 2024-04-23T10:17:53.864 INFO:tasks.workunit.client.0.smithi026.stdout:0/628: stat d7/c13 0 2024-04-23T10:17:53.868 INFO:tasks.workunit.client.0.smithi026.stdout:2/436: mkdir d3/dd/d4b/d9c 0 2024-04-23T10:17:53.868 INFO:tasks.workunit.client.0.smithi026.stdout:0/629: truncate d7/d8/d1e/d2a/fd5 469352 0 2024-04-23T10:17:53.869 INFO:tasks.workunit.client.0.smithi026.stdout:5/390: mknod d0/d12/c82 0 2024-04-23T10:17:53.870 INFO:tasks.workunit.client.0.smithi026.stdout:0/630: chown d7/dc2/dcc 98436432 1 2024-04-23T10:17:53.870 INFO:tasks.workunit.client.0.smithi026.stdout:9/616: dwrite d13/d3b/d68/f9b [0,4194304] 0 2024-04-23T10:17:53.870 INFO:tasks.workunit.client.0.smithi026.stdout:8/557: rmdir d5/dab 0 2024-04-23T10:17:53.871 INFO:tasks.workunit.client.0.smithi026.stdout:5/391: chown d0/d12/f4f 913679364 1 2024-04-23T10:17:53.874 INFO:tasks.workunit.client.0.smithi026.stdout:2/437: creat d3/d19/d31/f9d x:0 0 0 2024-04-23T10:17:53.877 INFO:tasks.workunit.client.0.smithi026.stdout:2/438: dread - d3/d19/d31/f66 zero size 2024-04-23T10:17:53.877 INFO:tasks.workunit.client.0.smithi026.stdout:9/617: write d13/d3b/d5b/f90 [567595,40977] 0 2024-04-23T10:17:53.884 INFO:tasks.workunit.client.0.smithi026.stdout:5/392: creat d0/d12/d49/f83 x:0 0 0 2024-04-23T10:17:53.885 INFO:tasks.workunit.client.0.smithi026.stdout:0/631: dwrite d7/d8/f82 [0,4194304] 0 2024-04-23T10:17:53.888 INFO:tasks.workunit.client.0.smithi026.stdout:5/393: write d0/d12/f3f [352571,102033] 0 2024-04-23T10:17:53.890 INFO:tasks.workunit.client.0.smithi026.stdout:6/542: dwrite d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:53.890 INFO:tasks.workunit.client.0.smithi026.stdout:1/447: dread dd/d1a/d23/f67 [0,4194304] 0 2024-04-23T10:17:53.893 INFO:tasks.workunit.client.0.smithi026.stdout:8/558: creat d5/d56/fb7 x:0 0 0 2024-04-23T10:17:53.895 INFO:tasks.workunit.client.0.smithi026.stdout:8/559: stat d5/d50 0 2024-04-23T10:17:53.896 INFO:tasks.workunit.client.0.smithi026.stdout:0/632: write d7/d8/d1e/d1d/d2f/d6c/d7f/fdb [447025,94664] 0 2024-04-23T10:17:53.898 INFO:tasks.workunit.client.0.smithi026.stdout:5/394: stat d0/la 0 2024-04-23T10:17:53.900 INFO:tasks.workunit.client.0.smithi026.stdout:2/439: dwrite d3/d19/d21/d23/d3a/d3c/f63 [0,4194304] 0 2024-04-23T10:17:53.904 INFO:tasks.workunit.client.0.smithi026.stdout:1/448: chown dd/d1a/d20/d25/d35/d73 0 1 2024-04-23T10:17:53.906 INFO:tasks.workunit.client.0.smithi026.stdout:0/633: mkdir d7/dc2/dec 0 2024-04-23T10:17:53.907 INFO:tasks.workunit.client.0.smithi026.stdout:0/634: readlink d7/d8/d2d/l4f 0 2024-04-23T10:17:53.915 INFO:tasks.workunit.client.0.smithi026.stdout:1/449: write dd/d1a/d23/f29 [4272898,12991] 0 2024-04-23T10:17:53.918 INFO:tasks.workunit.client.0.smithi026.stdout:1/450: write dd/f2b [323123,37060] 0 2024-04-23T10:17:53.918 INFO:tasks.workunit.client.0.smithi026.stdout:5/395: mkdir d0/d3c/d84 0 2024-04-23T10:17:53.920 INFO:tasks.workunit.client.0.smithi026.stdout:8/560: link d5/d56/f1c d5/d56/d15/d76/fb8 0 2024-04-23T10:17:53.920 INFO:tasks.workunit.client.0.smithi026.stdout:9/618: dread d13/d1b/d2b/f6f [0,4194304] 0 2024-04-23T10:17:53.922 INFO:tasks.workunit.client.0.smithi026.stdout:6/543: dread d6/d21/d58/f75 [0,4194304] 0 2024-04-23T10:17:53.929 INFO:tasks.workunit.client.0.smithi026.stdout:9/619: chown d13/d3b/d68/fb9 47622395 1 2024-04-23T10:17:53.929 INFO:tasks.workunit.client.0.smithi026.stdout:6/544: chown d6/d13/d15/f2e 252952 1 2024-04-23T10:17:53.931 INFO:tasks.workunit.client.0.smithi026.stdout:0/635: truncate d7/d8/d1e/d2a/d6a/d70/f8e 2230771 0 2024-04-23T10:17:53.934 INFO:tasks.workunit.client.0.smithi026.stdout:2/440: dwrite d3/d19/d21/d23/d3a/f69 [0,4194304] 0 2024-04-23T10:17:53.937 INFO:tasks.workunit.client.0.smithi026.stdout:9/620: mknod d13/d3b/cbb 0 2024-04-23T10:17:53.940 INFO:tasks.workunit.client.0.smithi026.stdout:5/396: dwrite d0/f42 [0,4194304] 0 2024-04-23T10:17:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/341: sync 2024-04-23T10:17:53.941 INFO:tasks.workunit.client.0.smithi026.stdout:3/456: sync 2024-04-23T10:17:53.943 INFO:tasks.workunit.client.0.smithi026.stdout:2/441: write d3/d19/d21/d23/d3a/d3c/d5d/f9b [525402,48549] 0 2024-04-23T10:17:53.945 INFO:tasks.workunit.client.0.smithi026.stdout:8/561: dwrite d5/d56/d47/f8e [0,4194304] 0 2024-04-23T10:17:53.955 INFO:tasks.workunit.client.0.smithi026.stdout:6/545: dread d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:53.957 INFO:tasks.workunit.client.0.smithi026.stdout:6/546: truncate d6/d21/d58/f75 1596062 0 2024-04-23T10:17:53.961 INFO:tasks.workunit.client.0.smithi026.stdout:8/562: creat d5/d9/d22/d65/d78/d3e/fb9 x:0 0 0 2024-04-23T10:17:53.961 INFO:tasks.workunit.client.0.smithi026.stdout:8/563: read d5/d56/d3f/f8d [76562,39327] 0 2024-04-23T10:17:53.962 INFO:tasks.workunit.client.0.smithi026.stdout:7/476: sync 2024-04-23T10:17:53.964 INFO:tasks.workunit.client.0.smithi026.stdout:6/547: symlink d6/d21/d2f/d37/d4f/l9e 0 2024-04-23T10:17:53.970 INFO:tasks.workunit.client.0.smithi026.stdout:8/564: write d5/d9/d22/f60 [1836221,78678] 0 2024-04-23T10:17:53.971 INFO:tasks.workunit.client.0.smithi026.stdout:3/457: creat d0/d1e/d30/d77/fa0 x:0 0 0 2024-04-23T10:17:53.980 INFO:tasks.workunit.client.0.smithi026.stdout:3/458: stat d0/d1e/f31 0 2024-04-23T10:17:53.980 INFO:tasks.workunit.client.0.smithi026.stdout:5/397: dwrite d0/d12/f28 [0,4194304] 0 2024-04-23T10:17:53.980 INFO:tasks.workunit.client.0.smithi026.stdout:2/442: dwrite d3/d19/d21/d23/d3a/d3c/f6c [0,4194304] 0 2024-04-23T10:17:53.982 INFO:tasks.workunit.client.0.smithi026.stdout:0/636: dread d7/f84 [0,4194304] 0 2024-04-23T10:17:53.984 INFO:tasks.workunit.client.0.smithi026.stdout:4/342: dwrite d4/d7/f15 [0,4194304] 0 2024-04-23T10:17:53.984 INFO:tasks.workunit.client.0.smithi026.stdout:1/451: dread dd/d1a/d20/d25/d35/d43/f51 [0,4194304] 0 2024-04-23T10:17:53.985 INFO:tasks.workunit.client.0.smithi026.stdout:5/398: write d0/d3c/d5d/d3a/f58 [405729,94159] 0 2024-04-23T10:17:53.988 INFO:tasks.workunit.client.0.smithi026.stdout:8/565: unlink d5/d56/d15/c75 0 2024-04-23T10:17:53.989 INFO:tasks.workunit.client.0.smithi026.stdout:4/343: dread - d4/d14/d3d/f4a zero size 2024-04-23T10:17:53.990 INFO:tasks.workunit.client.0.smithi026.stdout:7/477: creat dd/d1d/d50/f8b x:0 0 0 2024-04-23T10:17:53.992 INFO:tasks.workunit.client.0.smithi026.stdout:8/566: truncate d5/d56/d3f/f82 417103 0 2024-04-23T10:17:53.995 INFO:tasks.workunit.client.0.smithi026.stdout:8/567: chown d5/d9/d22/d65/d78/d3e/f92 4 1 2024-04-23T10:17:53.997 INFO:tasks.workunit.client.0.smithi026.stdout:4/344: readlink d4/d14/l3b 0 2024-04-23T10:17:53.998 INFO:tasks.workunit.client.0.smithi026.stdout:5/399: creat d0/d6f/f85 x:0 0 0 2024-04-23T10:17:54.001 INFO:tasks.workunit.client.0.smithi026.stdout:6/548: link d6/d13/l47 d6/d21/d2f/d37/d9a/l9f 0 2024-04-23T10:17:54.002 INFO:tasks.workunit.client.0.smithi026.stdout:9/621: dread d13/f1c [0,4194304] 0 2024-04-23T10:17:54.003 INFO:tasks.workunit.client.0.smithi026.stdout:8/568: creat d5/d50/fba x:0 0 0 2024-04-23T10:17:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:9/622: chown d13/d2a/d45/d67/lab 132602 1 2024-04-23T10:17:54.005 INFO:tasks.workunit.client.0.smithi026.stdout:7/478: readlink dd/d3f/d47/d4c/d60/l6d 0 2024-04-23T10:17:54.006 INFO:tasks.workunit.client.0.smithi026.stdout:3/459: link d0/d1e/d30/d43/df/d63/f96 d0/d1e/d30/d43/df/d17/fa1 0 2024-04-23T10:17:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:3/460: readlink d0/l2 0 2024-04-23T10:17:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:8/569: mknod d5/d56/d15/cbb 0 2024-04-23T10:17:54.007 INFO:tasks.workunit.client.0.smithi026.stdout:5/400: dread d0/f42 [0,4194304] 0 2024-04-23T10:17:54.011 INFO:tasks.workunit.client.0.smithi026.stdout:1/452: dread dd/f90 [0,4194304] 0 2024-04-23T10:17:54.014 INFO:tasks.workunit.client.0.smithi026.stdout:8/570: mknod d5/d56/d47/d99/cbc 0 2024-04-23T10:17:54.018 INFO:tasks.workunit.client.0.smithi026.stdout:3/461: fsync d0/d1e/d23/d52/f61 0 2024-04-23T10:17:54.019 INFO:tasks.workunit.client.0.smithi026.stdout:9/623: write d13/f2d [2361456,62290] 0 2024-04-23T10:17:54.026 INFO:tasks.workunit.client.0.smithi026.stdout:1/453: link dd/d1a/d6a/f86 dd/d1a/d23/d92/fa3 0 2024-04-23T10:17:54.032 INFO:tasks.workunit.client.0.smithi026.stdout:7/479: dwrite dd/d2c/d48/f5b [0,4194304] 0 2024-04-23T10:17:54.032 INFO:tasks.workunit.client.0.smithi026.stdout:8/571: link d5/d9/d22/f36 d5/d56/d47/d99/fbd 0 2024-04-23T10:17:54.033 INFO:tasks.workunit.client.0.smithi026.stdout:4/345: dwrite d4/d22/f29 [0,4194304] 0 2024-04-23T10:17:54.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/624: symlink d13/d1b/d26/lbc 0 2024-04-23T10:17:54.035 INFO:tasks.workunit.client.0.smithi026.stdout:9/625: readlink ld 0 2024-04-23T10:17:54.037 INFO:tasks.workunit.client.0.smithi026.stdout:0/637: dread d7/d8/d1e/d1d/f67 [0,4194304] 0 2024-04-23T10:17:54.038 INFO:tasks.workunit.client.0.smithi026.stdout:3/462: truncate d0/d1e/d30/d77/fa0 650666 0 2024-04-23T10:17:54.040 INFO:tasks.workunit.client.0.smithi026.stdout:1/454: dread dd/d1a/d20/d25/d35/d43/f50 [0,4194304] 0 2024-04-23T10:17:54.041 INFO:tasks.workunit.client.0.smithi026.stdout:5/401: dread d0/d3c/d5d/d3a/f7f [0,4194304] 0 2024-04-23T10:17:54.042 INFO:tasks.workunit.client.0.smithi026.stdout:6/549: dwrite d6/fd [0,4194304] 0 2024-04-23T10:17:54.047 INFO:tasks.workunit.client.0.smithi026.stdout:8/572: rename d5/d24/c98 to d5/d50/cbe 0 2024-04-23T10:17:54.049 INFO:tasks.workunit.client.0.smithi026.stdout:5/402: fdatasync d0/f80 0 2024-04-23T10:17:54.049 INFO:tasks.workunit.client.0.smithi026.stdout:3/463: write d0/d1e/d30/d43/d6c/d79/f62 [2417555,74511] 0 2024-04-23T10:17:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:1/455: unlink dd/d15/c99 0 2024-04-23T10:17:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:4/346: mknod d4/d7/d51/c71 0 2024-04-23T10:17:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:5/403: write d0/f39 [3540455,106440] 0 2024-04-23T10:17:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:9/626: dwrite d13/d2a/d45/fac [0,4194304] 0 2024-04-23T10:17:54.059 INFO:tasks.workunit.client.0.smithi026.stdout:0/638: dread d7/d5b/fc7 [0,4194304] 0 2024-04-23T10:17:54.061 INFO:tasks.workunit.client.0.smithi026.stdout:3/464: rename d0/d1e/d30/d43/df/l28 to d0/d1e/d30/d43/df/d72/d8c/la2 0 2024-04-23T10:17:54.064 INFO:tasks.workunit.client.0.smithi026.stdout:1/456: write dd/d1a/d20/f4d [821443,74412] 0 2024-04-23T10:17:54.070 INFO:tasks.workunit.client.0.smithi026.stdout:9/627: dread d13/f25 [0,4194304] 0 2024-04-23T10:17:54.075 INFO:tasks.workunit.client.0.smithi026.stdout:6/550: dwrite d6/d13/d15/f4c [0,4194304] 0 2024-04-23T10:17:54.077 INFO:tasks.workunit.client.0.smithi026.stdout:8/573: dwrite d5/d56/fa4 [0,4194304] 0 2024-04-23T10:17:54.078 INFO:tasks.workunit.client.0.smithi026.stdout:0/639: fsync d7/d8/d1e/d1d/d2f/d6c/fb7 0 2024-04-23T10:17:54.082 INFO:tasks.workunit.client.0.smithi026.stdout:4/347: write d4/d7/d61/f62 [3748845,36070] 0 2024-04-23T10:17:54.084 INFO:tasks.workunit.client.0.smithi026.stdout:9/628: symlink d13/d3b/d68/lbd 0 2024-04-23T10:17:54.085 INFO:tasks.workunit.client.0.smithi026.stdout:6/551: chown d6/d21/d58/d8d/f92 26604608 1 2024-04-23T10:17:54.087 INFO:tasks.workunit.client.0.smithi026.stdout:5/404: dwrite d0/d3c/d57/f5a [0,4194304] 0 2024-04-23T10:17:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:4/348: dread - d4/d7/d34/d36/d38/f58 zero size 2024-04-23T10:17:54.089 INFO:tasks.workunit.client.0.smithi026.stdout:5/405: chown d0/d12/c82 62 1 2024-04-23T10:17:54.091 INFO:tasks.workunit.client.0.smithi026.stdout:9/629: rename d13/d3b/d68 to d13/d3b/d68/dbe 22 2024-04-23T10:17:54.092 INFO:tasks.workunit.client.0.smithi026.stdout:8/574: rmdir d5/d56/d47 39 2024-04-23T10:17:54.093 INFO:tasks.workunit.client.0.smithi026.stdout:0/640: creat d7/d8/d2d/d60/d62/da2/dd9/fed x:0 0 0 2024-04-23T10:17:54.093 INFO:tasks.workunit.client.0.smithi026.stdout:6/552: dread - d6/f5c zero size 2024-04-23T10:17:54.095 INFO:tasks.workunit.client.0.smithi026.stdout:5/406: write d0/d3c/d5d/d3a/f7f [4878772,75809] 0 2024-04-23T10:17:54.098 INFO:tasks.workunit.client.0.smithi026.stdout:1/457: getdents dd/d1a/d23/d92 0 2024-04-23T10:17:54.098 INFO:tasks.workunit.client.0.smithi026.stdout:8/575: rmdir d5/d9/d22/d65/d78 39 2024-04-23T10:17:54.101 INFO:tasks.workunit.client.0.smithi026.stdout:8/576: chown d5/d9/f5b 33828 1 2024-04-23T10:17:54.101 INFO:tasks.workunit.client.0.smithi026.stdout:4/349: rename d4/d14/d3d/f4a to d4/d22/d4e/d57/f72 0 2024-04-23T10:17:54.105 INFO:tasks.workunit.client.0.smithi026.stdout:1/458: symlink dd/d1a/d23/d3f/la4 0 2024-04-23T10:17:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:0/641: mkdir d7/d8/d1e/dd3/de7/dee 0 2024-04-23T10:17:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:9/630: dwrite d13/d2a/d45/d67/f82 [0,4194304] 0 2024-04-23T10:17:54.108 INFO:tasks.workunit.client.0.smithi026.stdout:4/350: mkdir d4/d14/d3d/d73 0 2024-04-23T10:17:54.109 INFO:tasks.workunit.client.0.smithi026.stdout:6/553: creat d6/d13/fa0 x:0 0 0 2024-04-23T10:17:54.110 INFO:tasks.workunit.client.0.smithi026.stdout:3/465: dread d0/d1e/d30/d43/df/f1a [0,4194304] 0 2024-04-23T10:17:54.110 INFO:tasks.workunit.client.0.smithi026.stdout:5/407: creat d0/d3c/d5d/f86 x:0 0 0 2024-04-23T10:17:54.111 INFO:tasks.workunit.client.0.smithi026.stdout:7/480: dread dd/f13 [0,4194304] 0 2024-04-23T10:17:54.113 INFO:tasks.workunit.client.0.smithi026.stdout:1/459: mkdir dd/d1a/d20/d25/d35/d7f/da5 0 2024-04-23T10:17:54.114 INFO:tasks.workunit.client.0.smithi026.stdout:0/642: mknod d7/d8/d1e/dd3/de7/cef 0 2024-04-23T10:17:54.114 INFO:tasks.workunit.client.0.smithi026.stdout:9/631: mkdir d13/d36/d66/dbf 0 2024-04-23T10:17:54.114 INFO:tasks.workunit.client.0.smithi026.stdout:6/554: symlink d6/d33/la1 0 2024-04-23T10:17:54.117 INFO:tasks.workunit.client.0.smithi026.stdout:4/351: rename d4/d7/d19 to d4/d7/d61/d74 0 2024-04-23T10:17:54.117 INFO:tasks.workunit.client.0.smithi026.stdout:1/460: chown dd/d1a/f41 116 1 2024-04-23T10:17:54.121 INFO:tasks.workunit.client.0.smithi026.stdout:3/466: write d0/d1e/d30/d43/d29/f35 [815888,120128] 0 2024-04-23T10:17:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:9/632: chown d13/d36/c5a 11663840 1 2024-04-23T10:17:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:0/643: rmdir d7/dc2 39 2024-04-23T10:17:54.122 INFO:tasks.workunit.client.0.smithi026.stdout:6/555: readlink d6/d21/d2f/d37/d4f/l9e 0 2024-04-23T10:17:54.123 INFO:tasks.workunit.client.0.smithi026.stdout:6/556: stat d6/c6f 0 2024-04-23T10:17:54.123 INFO:tasks.workunit.client.0.smithi026.stdout:7/481: creat dd/d46/f8c x:0 0 0 2024-04-23T10:17:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:5/408: creat d0/d3c/d84/f87 x:0 0 0 2024-04-23T10:17:54.125 INFO:tasks.workunit.client.0.smithi026.stdout:3/467: fsync d0/d1e/d30/d43/df/d63/f65 0 2024-04-23T10:17:54.127 INFO:tasks.workunit.client.0.smithi026.stdout:0/644: creat d7/d8/d1e/dd3/ff0 x:0 0 0 2024-04-23T10:17:54.127 INFO:tasks.workunit.client.0.smithi026.stdout:8/577: dwrite d5/d9/dac/faf [0,4194304] 0 2024-04-23T10:17:54.127 INFO:tasks.workunit.client.0.smithi026.stdout:9/633: write d13/d19/fb7 [639474,14394] 0 2024-04-23T10:17:54.127 INFO:tasks.workunit.client.0.smithi026.stdout:4/352: rmdir d4/d22/d2e 39 2024-04-23T10:17:54.129 INFO:tasks.workunit.client.0.smithi026.stdout:6/557: fsync d6/d21/d2f/d32/d53/f8b 0 2024-04-23T10:17:54.131 INFO:tasks.workunit.client.0.smithi026.stdout:3/468: chown d0/d1e/d30/d43/d29/c90 1029263 1 2024-04-23T10:17:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:1/461: creat dd/d15/d7d/da1/fa6 x:0 0 0 2024-04-23T10:17:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:6/558: fsync d6/d21/d2f/d37/d68/f6a 0 2024-04-23T10:17:54.133 INFO:tasks.workunit.client.0.smithi026.stdout:0/645: write d7/fbb [852361,86961] 0 2024-04-23T10:17:54.134 INFO:tasks.workunit.client.0.smithi026.stdout:7/482: mkdir dd/d2c/d48/d8d 0 2024-04-23T10:17:54.140 INFO:tasks.workunit.client.0.smithi026.stdout:9/634: write d13/d1b/d2b/f6f [1184262,38330] 0 2024-04-23T10:17:54.147 INFO:tasks.workunit.client.0.smithi026.stdout:1/462: write f9 [1615496,127300] 0 2024-04-23T10:17:54.147 INFO:tasks.workunit.client.0.smithi026.stdout:4/353: link d4/d7/d61/d74/f21 d4/d5b/f75 0 2024-04-23T10:17:54.148 INFO:tasks.workunit.client.0.smithi026.stdout:8/578: rename d5/d56/d15/d76/fb8 to d5/d50/fbf 0 2024-04-23T10:17:54.149 INFO:tasks.workunit.client.0.smithi026.stdout:9/635: write d13/d3b/d68/f9b [1958567,33233] 0 2024-04-23T10:17:54.149 INFO:tasks.workunit.client.0.smithi026.stdout:4/354: fsync d4/d22/f59 0 2024-04-23T10:17:54.150 INFO:tasks.workunit.client.0.smithi026.stdout:5/409: dwrite d0/fe [0,4194304] 0 2024-04-23T10:17:54.155 INFO:tasks.workunit.client.0.smithi026.stdout:3/469: creat d0/d1e/d30/d43/d6c/d79/d73/d99/fa3 x:0 0 0 2024-04-23T10:17:54.156 INFO:tasks.workunit.client.0.smithi026.stdout:7/483: symlink dd/d6c/d72/l8e 0 2024-04-23T10:17:54.156 INFO:tasks.workunit.client.0.smithi026.stdout:3/470: truncate d0/d1e/f91 742947 0 2024-04-23T10:17:54.157 INFO:tasks.workunit.client.0.smithi026.stdout:3/471: chown d0/d1e/d30/d43/d6c/d79 1630882 1 2024-04-23T10:17:54.158 INFO:tasks.workunit.client.0.smithi026.stdout:3/472: readlink d0/d1e/d30/d43/df/d63/l6d 0 2024-04-23T10:17:54.158 INFO:tasks.workunit.client.0.smithi026.stdout:4/355: mknod d4/d7/d61/c76 0 2024-04-23T10:17:54.160 INFO:tasks.workunit.client.0.smithi026.stdout:9/636: creat d13/d31/d87/fc0 x:0 0 0 2024-04-23T10:17:54.160 INFO:tasks.workunit.client.0.smithi026.stdout:9/637: chown d13/d36/d66/db6 1145 1 2024-04-23T10:17:54.161 INFO:tasks.workunit.client.0.smithi026.stdout:5/410: fsync d0/d12/f1b 0 2024-04-23T10:17:54.162 INFO:tasks.workunit.client.0.smithi026.stdout:5/411: chown d0/d3c/d5d/d3a/f7f 0 1 2024-04-23T10:17:54.164 INFO:tasks.workunit.client.0.smithi026.stdout:5/412: write d0/d12/f32 [2222434,73219] 0 2024-04-23T10:17:54.165 INFO:tasks.workunit.client.0.smithi026.stdout:5/413: chown d0/d3c/f51 0 1 2024-04-23T10:17:54.165 INFO:tasks.workunit.client.0.smithi026.stdout:3/473: mkdir d0/d51/d5e/da4 0 2024-04-23T10:17:54.167 INFO:tasks.workunit.client.0.smithi026.stdout:3/474: chown d0/d1e/d23/d52/d75/c7c 0 1 2024-04-23T10:17:54.168 INFO:tasks.workunit.client.0.smithi026.stdout:6/559: link d6/c6f d6/d21/d2f/d31/ca2 0 2024-04-23T10:17:54.171 INFO:tasks.workunit.client.0.smithi026.stdout:0/646: getdents d7/d8/d2d/d60/d62/db9 0 2024-04-23T10:17:54.172 INFO:tasks.workunit.client.0.smithi026.stdout:9/638: getdents d13/d36/d66/db6 0 2024-04-23T10:17:54.177 INFO:tasks.workunit.client.0.smithi026.stdout:0/647: write d7/d8/d2d/d60/d62/da2/dd9/fe3 [939044,74098] 0 2024-04-23T10:17:54.178 INFO:tasks.workunit.client.0.smithi026.stdout:8/579: write d5/d56/d47/fb5 [731653,1320] 0 2024-04-23T10:17:54.178 INFO:tasks.workunit.client.0.smithi026.stdout:6/560: dwrite d6/d21/d58/d8d/d64/f95 [0,4194304] 0 2024-04-23T10:17:54.179 INFO:tasks.workunit.client.0.smithi026.stdout:6/561: readlink d6/d21/d2f/d31/l76 0 2024-04-23T10:17:54.179 INFO:tasks.workunit.client.0.smithi026.stdout:0/648: read d7/d8/d1e/d1d/d2f/f48 [4175971,77217] 0 2024-04-23T10:17:54.180 INFO:tasks.workunit.client.0.smithi026.stdout:6/562: read - d6/d13/fa0 zero size 2024-04-23T10:17:54.182 INFO:tasks.workunit.client.0.smithi026.stdout:0/649: fdatasync d7/d8/d2d/d60/d62/da2/dd9/fed 0 2024-04-23T10:17:54.182 INFO:tasks.workunit.client.0.smithi026.stdout:9/639: write d13/d1b/f77 [3600420,68356] 0 2024-04-23T10:17:54.183 INFO:tasks.workunit.client.0.smithi026.stdout:0/650: chown d7/d8/d1e/d2a/d6a/d70/fd0 1997692049 1 2024-04-23T10:17:54.184 INFO:tasks.workunit.client.0.smithi026.stdout:6/563: stat d6/d33/c69 0 2024-04-23T10:17:54.188 INFO:tasks.workunit.client.0.smithi026.stdout:6/564: creat d6/d21/d2f/d37/d9a/fa3 x:0 0 0 2024-04-23T10:17:54.189 INFO:tasks.workunit.client.0.smithi026.stdout:9/640: write d13/d2a/f35 [854916,111370] 0 2024-04-23T10:17:54.189 INFO:tasks.workunit.client.0.smithi026.stdout:0/651: write d7/d8/d1e/d1d/f6d [4570728,13404] 0 2024-04-23T10:17:54.194 INFO:tasks.workunit.client.0.smithi026.stdout:8/580: getdents d5/d9/d22/d65 0 2024-04-23T10:17:54.196 INFO:tasks.workunit.client.0.smithi026.stdout:6/565: dread d6/d21/d58/d8d/f5b [0,4194304] 0 2024-04-23T10:17:54.203 INFO:tasks.workunit.client.0.smithi026.stdout:9/641: dwrite d13/d1b/d26/fb2 [0,4194304] 0 2024-04-23T10:17:54.205 INFO:tasks.workunit.client.0.smithi026.stdout:8/581: symlink d5/d24/lc0 0 2024-04-23T10:17:54.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/566: dread d6/d21/d2f/d32/f55 [0,4194304] 0 2024-04-23T10:17:54.207 INFO:tasks.workunit.client.0.smithi026.stdout:9/642: readlink d13/l7e 0 2024-04-23T10:17:54.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/643: unlink d13/d3b/d68/l7d 0 2024-04-23T10:17:54.210 INFO:tasks.workunit.client.0.smithi026.stdout:9/644: chown d13/d3b/c83 0 1 2024-04-23T10:17:54.211 INFO:tasks.workunit.client.0.smithi026.stdout:6/567: rename d6/d21/d2f/d32/l66 to d6/d21/d2f/d32/d53/la4 0 2024-04-23T10:17:54.211 INFO:tasks.workunit.client.0.smithi026.stdout:9/645: fsync d13/d2a/f35 0 2024-04-23T10:17:54.213 INFO:tasks.workunit.client.0.smithi026.stdout:8/582: creat d5/d56/fc1 x:0 0 0 2024-04-23T10:17:54.217 INFO:tasks.workunit.client.0.smithi026.stdout:9/646: mkdir d13/d19/da7/dc1 0 2024-04-23T10:17:54.218 INFO:tasks.workunit.client.0.smithi026.stdout:8/583: getdents d5/d9/d22/d65/d78/d3e/da1/da8 0 2024-04-23T10:17:54.220 INFO:tasks.workunit.client.0.smithi026.stdout:9/647: chown d13/d19/f4d 624443 1 2024-04-23T10:17:54.221 INFO:tasks.workunit.client.0.smithi026.stdout:8/584: mkdir d5/d9/d22/d65/d78/d3e/da1/dc2 0 2024-04-23T10:17:54.223 INFO:tasks.workunit.client.0.smithi026.stdout:9/648: mkdir d13/d36/d66/dc2 0 2024-04-23T10:17:54.226 INFO:tasks.workunit.client.0.smithi026.stdout:9/649: mkdir d13/d36/d66/dc2/dc3 0 2024-04-23T10:17:54.233 INFO:tasks.workunit.client.0.smithi026.stdout:9/650: dwrite d13/f1c [0,4194304] 0 2024-04-23T10:17:54.234 INFO:tasks.workunit.client.0.smithi026.stdout:9/651: chown d13/d2a/d45/d3a/d6b/l6a 6530139 1 2024-04-23T10:17:54.236 INFO:tasks.workunit.client.0.smithi026.stdout:8/585: getdents d5/d50/d9a 0 2024-04-23T10:17:54.237 INFO:tasks.workunit.client.0.smithi026.stdout:8/586: write d5/d56/d15/d8b/fa5 [285385,78055] 0 2024-04-23T10:17:54.238 INFO:tasks.workunit.client.0.smithi026.stdout:8/587: chown d5/d56 18695158 1 2024-04-23T10:17:54.244 INFO:tasks.workunit.client.0.smithi026.stdout:9/652: dwrite d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:54.254 INFO:tasks.workunit.client.0.smithi026.stdout:9/653: rmdir d13/d2a/d45/d3a/d4f 39 2024-04-23T10:17:54.258 INFO:tasks.workunit.client.0.smithi026.stdout:9/654: symlink d13/d36/d66/d72/lc4 0 2024-04-23T10:17:54.262 INFO:tasks.workunit.client.0.smithi026.stdout:9/655: dread - d13/d3b/d4e/d76/f91 zero size 2024-04-23T10:17:54.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/588: dread d5/d56/d15/f31 [0,4194304] 0 2024-04-23T10:17:54.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/589: fsync d5/d56/d15/f31 0 2024-04-23T10:17:54.263 INFO:tasks.workunit.client.0.smithi026.stdout:8/590: symlink d5/d9/d22/lc3 0 2024-04-23T10:17:54.263 INFO:tasks.workunit.client.0.smithi026.stdout:8/591: chown d5/d9/dac 11752 1 2024-04-23T10:17:54.266 INFO:tasks.workunit.client.0.smithi026.stdout:8/592: creat d5/d9/d22/d65/d78/d3e/da1/da8/fc4 x:0 0 0 2024-04-23T10:17:54.267 INFO:tasks.workunit.client.0.smithi026.stdout:8/593: write d5/d56/d33/f58 [423515,65663] 0 2024-04-23T10:17:54.275 INFO:tasks.workunit.client.0.smithi026.stdout:8/594: dwrite d5/d56/d47/fb5 [0,4194304] 0 2024-04-23T10:17:54.279 INFO:tasks.workunit.client.0.smithi026.stdout:9/656: dread d13/d31/f53 [0,4194304] 0 2024-04-23T10:17:54.279 INFO:tasks.workunit.client.0.smithi026.stdout:8/595: getdents d5/d9/d22/d65 0 2024-04-23T10:17:54.281 INFO:tasks.workunit.client.0.smithi026.stdout:9/657: write d13/f22 [345094,123080] 0 2024-04-23T10:17:54.283 INFO:tasks.workunit.client.0.smithi026.stdout:8/596: unlink d5/d56/d47/fb5 0 2024-04-23T10:17:54.285 INFO:tasks.workunit.client.0.smithi026.stdout:8/597: write d5/d56/d15/d8b/fa5 [1152082,115441] 0 2024-04-23T10:17:54.285 INFO:tasks.workunit.client.0.smithi026.stdout:8/598: chown d5/l5c 413538 1 2024-04-23T10:17:54.286 INFO:tasks.workunit.client.0.smithi026.stdout:9/658: symlink d13/d3b/d68/lc5 0 2024-04-23T10:17:54.289 INFO:tasks.workunit.client.0.smithi026.stdout:8/599: unlink d5/d56/d3f/f57 0 2024-04-23T10:17:54.292 INFO:tasks.workunit.client.0.smithi026.stdout:8/600: mkdir d5/d9/d64/dc5 0 2024-04-23T10:17:54.295 INFO:tasks.workunit.client.0.smithi026.stdout:9/659: dwrite d13/d1b/d26/f2e [0,4194304] 0 2024-04-23T10:17:54.297 INFO:tasks.workunit.client.0.smithi026.stdout:9/660: mknod d13/d2a/cc6 0 2024-04-23T10:17:54.302 INFO:tasks.workunit.client.0.smithi026.stdout:2/443: sync 2024-04-23T10:17:54.303 INFO:tasks.workunit.client.0.smithi026.stdout:8/601: dread d5/d9/f8f [0,4194304] 0 2024-04-23T10:17:54.305 INFO:tasks.workunit.client.0.smithi026.stdout:8/602: write d5/d24/f66 [3765302,82680] 0 2024-04-23T10:17:54.307 INFO:tasks.workunit.client.0.smithi026.stdout:9/661: dwrite d13/d19/fb7 [0,4194304] 0 2024-04-23T10:17:54.312 INFO:tasks.workunit.client.0.smithi026.stdout:8/603: creat d5/d9/d22/d65/d78/d3e/fc6 x:0 0 0 2024-04-23T10:17:54.313 INFO:tasks.workunit.client.0.smithi026.stdout:8/604: stat d5/d9/d22/d65/d78/d3e 0 2024-04-23T10:17:54.320 INFO:tasks.workunit.client.0.smithi026.stdout:2/444: dwrite d3/f6 [0,4194304] 0 2024-04-23T10:17:54.322 INFO:tasks.workunit.client.0.smithi026.stdout:2/445: truncate d3/d19/d31/f91 204744 0 2024-04-23T10:17:54.323 INFO:tasks.workunit.client.0.smithi026.stdout:9/662: truncate d13/f2d 2043330 0 2024-04-23T10:17:54.324 INFO:tasks.workunit.client.0.smithi026.stdout:2/446: symlink d3/d19/d21/d23/d3a/l9e 0 2024-04-23T10:17:54.328 INFO:tasks.workunit.client.0.smithi026.stdout:8/605: dread d5/d9/d22/d65/d78/f7d [0,4194304] 0 2024-04-23T10:17:54.329 INFO:tasks.workunit.client.0.smithi026.stdout:9/663: mkdir d13/d1b/d98/dc7 0 2024-04-23T10:17:54.330 INFO:tasks.workunit.client.0.smithi026.stdout:9/664: stat d13/d3e/f80 0 2024-04-23T10:17:54.333 INFO:tasks.workunit.client.0.smithi026.stdout:8/606: creat d5/d9/d22/d65/d78/d3e/da1/fc7 x:0 0 0 2024-04-23T10:17:54.335 INFO:tasks.workunit.client.0.smithi026.stdout:2/447: dwrite d3/dd/f30 [0,4194304] 0 2024-04-23T10:17:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:9/665: rename d13/d3b/d68/ca0 to d13/d2a/cc8 0 2024-04-23T10:17:54.337 INFO:tasks.workunit.client.0.smithi026.stdout:2/448: symlink d3/d19/d21/d23/d3a/d3c/d80/l9f 0 2024-04-23T10:17:54.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/449: chown d3/d19/d21/c40 21287686 1 2024-04-23T10:17:54.343 INFO:tasks.workunit.client.0.smithi026.stdout:2/450: mkdir d3/d19/d21/d23/d3a/d3c/d5d/da0 0 2024-04-23T10:17:54.344 INFO:tasks.workunit.client.0.smithi026.stdout:8/607: dwrite d5/d9/d22/d65/f87 [0,4194304] 0 2024-04-23T10:17:54.346 INFO:tasks.workunit.client.0.smithi026.stdout:9/666: read d13/d1b/d26/f30 [723381,59159] 0 2024-04-23T10:17:54.348 INFO:tasks.workunit.client.0.smithi026.stdout:9/667: mkdir d13/d3b/d5b/dc9 0 2024-04-23T10:17:54.349 INFO:tasks.workunit.client.0.smithi026.stdout:2/451: mknod d3/d19/d1d/ca1 0 2024-04-23T10:17:54.350 INFO:tasks.workunit.client.0.smithi026.stdout:8/608: getdents d5/d9 0 2024-04-23T10:17:54.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/668: rename d13/d2a/ca3 to d13/d36/d66/dc2/dc3/cca 0 2024-04-23T10:17:54.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/452: mkdir d3/d19/d21/d23/da2 0 2024-04-23T10:17:54.354 INFO:tasks.workunit.client.0.smithi026.stdout:2/453: dread - d3/d19/d31/f66 zero size 2024-04-23T10:17:54.355 INFO:tasks.workunit.client.0.smithi026.stdout:8/609: link d5/d56/d15/c61 d5/d56/d47/d99/cc8 0 2024-04-23T10:17:54.357 INFO:tasks.workunit.client.0.smithi026.stdout:9/669: getdents d13/d1b/d98 0 2024-04-23T10:17:54.360 INFO:tasks.workunit.client.0.smithi026.stdout:8/610: rename d5/d24 to d5/d9/d22/d65/d78/dc9 0 2024-04-23T10:17:54.362 INFO:tasks.workunit.client.0.smithi026.stdout:8/611: symlink d5/lca 0 2024-04-23T10:17:54.363 INFO:tasks.workunit.client.0.smithi026.stdout:2/454: dwrite d3/d19/d21/d23/d3a/d65/f86 [0,4194304] 0 2024-04-23T10:17:54.365 INFO:tasks.workunit.client.0.smithi026.stdout:2/455: write d3/d19/d21/d23/d3a/d65/f90 [675168,96561] 0 2024-04-23T10:17:54.368 INFO:tasks.workunit.client.0.smithi026.stdout:8/612: link d5/d9/d22/d65/d78/l9c d5/d56/d15/d8b/lcb 0 2024-04-23T10:17:54.370 INFO:tasks.workunit.client.0.smithi026.stdout:8/613: write d5/d56/fad [8285195,80856] 0 2024-04-23T10:17:54.371 INFO:tasks.workunit.client.0.smithi026.stdout:2/456: read d3/d19/d21/d23/f33 [131094,91117] 0 2024-04-23T10:17:54.372 INFO:tasks.workunit.client.0.smithi026.stdout:9/670: dwrite d13/f2d [0,4194304] 0 2024-04-23T10:17:54.373 INFO:tasks.workunit.client.0.smithi026.stdout:2/457: write d3/f22 [1064115,13154] 0 2024-04-23T10:17:54.379 INFO:tasks.workunit.client.0.smithi026.stdout:2/458: mknod d3/dd/d4b/d9c/ca3 0 2024-04-23T10:17:54.380 INFO:tasks.workunit.client.0.smithi026.stdout:8/614: dwrite d5/d56/d33/f58 [0,4194304] 0 2024-04-23T10:17:54.384 INFO:tasks.workunit.client.0.smithi026.stdout:8/615: mkdir d5/d9/d22/d65/d78/d3e/dcc 0 2024-04-23T10:17:54.387 INFO:tasks.workunit.client.0.smithi026.stdout:9/671: truncate d13/d2a/d45/fac 1406730 0 2024-04-23T10:17:54.391 INFO:tasks.workunit.client.0.smithi026.stdout:8/616: creat d5/d56/d15/fcd x:0 0 0 2024-04-23T10:17:54.392 INFO:tasks.workunit.client.0.smithi026.stdout:8/617: readlink d5/d9/d64/l9b 0 2024-04-23T10:17:54.392 INFO:tasks.workunit.client.0.smithi026.stdout:8/618: chown l1 712555 1 2024-04-23T10:17:54.396 INFO:tasks.workunit.client.0.smithi026.stdout:9/672: creat d13/d3e/fcb x:0 0 0 2024-04-23T10:17:54.399 INFO:tasks.workunit.client.0.smithi026.stdout:8/619: link d5/d56/d15/f31 d5/d9/d64/dc5/fce 0 2024-04-23T10:17:54.400 INFO:tasks.workunit.client.0.smithi026.stdout:8/620: read d5/d56/d33/f8c [205258,39946] 0 2024-04-23T10:17:54.404 INFO:tasks.workunit.client.0.smithi026.stdout:9/673: rename d13/d3b/d68/f9b to d13/d2a/d45/fcc 0 2024-04-23T10:17:54.405 INFO:tasks.workunit.client.0.smithi026.stdout:8/621: creat d5/d56/d3f/fcf x:0 0 0 2024-04-23T10:17:54.408 INFO:tasks.workunit.client.0.smithi026.stdout:2/459: dread d3/d19/d21/d23/f29 [0,4194304] 0 2024-04-23T10:17:54.411 INFO:tasks.workunit.client.0.smithi026.stdout:9/674: creat d13/d1b/d26/fcd x:0 0 0 2024-04-23T10:17:54.413 INFO:tasks.workunit.client.0.smithi026.stdout:9/675: mkdir d13/d31/d87/dce 0 2024-04-23T10:17:54.419 INFO:tasks.workunit.client.0.smithi026.stdout:2/460: mkdir d3/d19/d21/d23/d3a/d3c/d5d/da0/da4 0 2024-04-23T10:17:54.420 INFO:tasks.workunit.client.0.smithi026.stdout:9/676: dwrite d13/d1b/d26/fcd [0,4194304] 0 2024-04-23T10:17:54.423 INFO:tasks.workunit.client.0.smithi026.stdout:2/461: mknod d3/d19/d21/d23/d3a/d3c/d80/ca5 0 2024-04-23T10:17:54.425 INFO:tasks.workunit.client.0.smithi026.stdout:2/462: truncate d3/d19/d21/d23/d3a/d65/f87 819682 0 2024-04-23T10:17:54.429 INFO:tasks.workunit.client.0.smithi026.stdout:2/463: chown d3/d19/f5a 0 1 2024-04-23T10:17:54.431 INFO:tasks.workunit.client.0.smithi026.stdout:2/464: write d3/d19/d21/d23/d3a/d3c/f7c [228691,47508] 0 2024-04-23T10:17:54.436 INFO:tasks.workunit.client.0.smithi026.stdout:2/465: creat d3/d35/fa6 x:0 0 0 2024-04-23T10:17:54.437 INFO:tasks.workunit.client.0.smithi026.stdout:2/466: fdatasync d3/d19/d31/f91 0 2024-04-23T10:17:54.439 INFO:tasks.workunit.client.0.smithi026.stdout:9/677: getdents d13/d2a/d45/d6d 0 2024-04-23T10:17:54.440 INFO:tasks.workunit.client.0.smithi026.stdout:2/467: mkdir d3/d19/d21/d23/d3a/d3c/d80/da7 0 2024-04-23T10:17:54.441 INFO:tasks.workunit.client.0.smithi026.stdout:2/468: read d3/d19/d21/d23/f29 [115418,7358] 0 2024-04-23T10:17:54.443 INFO:tasks.workunit.client.0.smithi026.stdout:9/678: mkdir d13/d1b/d26/d88/dcf 0 2024-04-23T10:17:54.445 INFO:tasks.workunit.client.0.smithi026.stdout:2/469: dread d3/d19/d31/f97 [0,4194304] 0 2024-04-23T10:17:54.456 INFO:tasks.workunit.client.0.smithi026.stdout:9/679: dread d13/d2a/d45/d6d/f71 [0,4194304] 0 2024-04-23T10:17:54.458 INFO:tasks.workunit.client.0.smithi026.stdout:9/680: write d13/d2a/d45/fcc [855943,71234] 0 2024-04-23T10:17:54.458 INFO:tasks.workunit.client.0.smithi026.stdout:9/681: chown d13/d2a/d45/d3a 938511692 1 2024-04-23T10:17:54.460 INFO:tasks.workunit.client.0.smithi026.stdout:2/470: getdents d3/d19/d21/d23/d3a/d3c/d80/da7 0 2024-04-23T10:17:54.467 INFO:tasks.workunit.client.0.smithi026.stdout:2/471: dwrite d3/d19/d21/d23/d3a/d65/f87 [0,4194304] 0 2024-04-23T10:17:54.471 INFO:tasks.workunit.client.0.smithi026.stdout:2/472: chown d3/d19/f62 0 1 2024-04-23T10:17:54.472 INFO:tasks.workunit.client.0.smithi026.stdout:9/682: getdents d13/d31 0 2024-04-23T10:17:54.475 INFO:tasks.workunit.client.0.smithi026.stdout:2/473: mkdir d3/d19/d1d/da8 0 2024-04-23T10:17:54.476 INFO:tasks.workunit.client.0.smithi026.stdout:9/683: dread d13/f2d [0,4194304] 0 2024-04-23T10:17:54.479 INFO:tasks.workunit.client.0.smithi026.stdout:2/474: read d3/d19/d31/f5c [223876,82729] 0 2024-04-23T10:17:54.481 INFO:tasks.workunit.client.0.smithi026.stdout:9/684: creat d13/d1b/d98/fd0 x:0 0 0 2024-04-23T10:17:54.482 INFO:tasks.workunit.client.0.smithi026.stdout:9/685: chown d13/d3b/d68/lc5 2336 1 2024-04-23T10:17:54.483 INFO:tasks.workunit.client.0.smithi026.stdout:2/475: dread d3/d19/d21/d23/d3a/d65/f87 [0,4194304] 0 2024-04-23T10:17:54.484 INFO:tasks.workunit.client.0.smithi026.stdout:2/476: readlink d3/d19/d21/d23/d3a/d3c/d80/l93 0 2024-04-23T10:17:54.504 INFO:tasks.workunit.client.0.smithi026.stdout:2/477: dread d3/dd/f18 [0,4194304] 0 2024-04-23T10:17:54.525 INFO:tasks.workunit.client.0.smithi026.stdout:1/463: sync 2024-04-23T10:17:54.527 INFO:tasks.workunit.client.0.smithi026.stdout:1/464: write dd/d1a/f83 [1015598,99422] 0 2024-04-23T10:17:54.531 INFO:tasks.workunit.client.0.smithi026.stdout:9/686: getdents d13/d2a/d45/d3a/d4f 0 2024-04-23T10:17:54.538 INFO:tasks.workunit.client.0.smithi026.stdout:1/465: link dd/d1a/d6a/d7c/f8a dd/d15/fa7 0 2024-04-23T10:17:54.540 INFO:tasks.workunit.client.0.smithi026.stdout:9/687: mkdir d13/d1b/d26/d88/dcf/dd1 0 2024-04-23T10:17:54.544 INFO:tasks.workunit.client.0.smithi026.stdout:1/466: unlink dd/d1a/d20/d25/d35/d43/f51 0 2024-04-23T10:17:54.551 INFO:tasks.workunit.client.0.smithi026.stdout:1/467: dwrite dd/d1a/d23/f29 [4194304,4194304] 0 2024-04-23T10:17:54.555 INFO:tasks.workunit.client.0.smithi026.stdout:9/688: dread d13/d3b/d5b/f90 [0,4194304] 0 2024-04-23T10:17:54.579 INFO:tasks.workunit.client.0.smithi026.stdout:9/689: dread d13/d1b/d26/f30 [0,4194304] 0 2024-04-23T10:17:54.579 INFO:tasks.workunit.client.0.smithi026.stdout:9/690: write d13/faf [3964565,118747] 0 2024-04-23T10:17:54.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/468: creat dd/d1a/d20/fa8 x:0 0 0 2024-04-23T10:17:54.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/469: chown dd/f2b 3 1 2024-04-23T10:17:54.698 INFO:tasks.workunit.client.0.smithi026.stdout:7/484: sync 2024-04-23T10:17:54.708 INFO:tasks.workunit.client.0.smithi026.stdout:7/485: dwrite dd/f35 [8388608,4194304] 0 2024-04-23T10:17:54.735 INFO:tasks.workunit.client.0.smithi026.stdout:1/470: dread f7 [0,4194304] 0 2024-04-23T10:17:54.779 INFO:tasks.workunit.client.0.smithi026.stdout:1/471: dwrite dd/d1a/d23/f28 [0,4194304] 0 2024-04-23T10:17:54.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/486: dread dd/f76 [0,4194304] 0 2024-04-23T10:17:54.795 INFO:tasks.workunit.client.0.smithi026.stdout:7/487: chown l1 87651 1 2024-04-23T10:17:54.811 INFO:tasks.workunit.client.0.smithi026.stdout:4/356: sync 2024-04-23T10:17:54.820 INFO:tasks.workunit.client.0.smithi026.stdout:1/472: creat dd/d1a/d20/d25/fa9 x:0 0 0 2024-04-23T10:17:54.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/488: dread dd/d3f/d47/d4c/f64 [0,4194304] 0 2024-04-23T10:17:54.824 INFO:tasks.workunit.client.0.smithi026.stdout:1/473: readlink dd/d1a/d23/d3f/l79 0 2024-04-23T10:17:54.827 INFO:tasks.workunit.client.0.smithi026.stdout:1/474: write dd/d1a/f41 [1243804,7999] 0 2024-04-23T10:17:54.827 INFO:tasks.workunit.client.0.smithi026.stdout:4/357: creat d4/d7/f77 x:0 0 0 2024-04-23T10:17:54.831 INFO:tasks.workunit.client.0.smithi026.stdout:1/475: dread - dd/d1a/d20/d25/f4a zero size 2024-04-23T10:17:54.831 INFO:tasks.workunit.client.0.smithi026.stdout:4/358: write d4/d7/d34/f37 [7544169,76544] 0 2024-04-23T10:17:54.841 INFO:tasks.workunit.client.0.smithi026.stdout:1/476: chown dd/c45 176766 1 2024-04-23T10:17:54.846 INFO:tasks.workunit.client.0.smithi026.stdout:7/489: dwrite dd/d3f/d47/d4c/f4a [0,4194304] 0 2024-04-23T10:17:54.847 INFO:tasks.workunit.client.0.smithi026.stdout:4/359: fsync d4/f5 0 2024-04-23T10:17:54.851 INFO:tasks.workunit.client.0.smithi026.stdout:1/477: symlink dd/d1a/d6a/laa 0 2024-04-23T10:17:54.855 INFO:tasks.workunit.client.0.smithi026.stdout:7/490: mknod dd/d3f/d47/d4c/d60/c8f 0 2024-04-23T10:17:54.857 INFO:tasks.workunit.client.0.smithi026.stdout:4/360: mkdir d4/d7/d51/d6c/d78 0 2024-04-23T10:17:54.861 INFO:tasks.workunit.client.0.smithi026.stdout:7/491: symlink dd/d6c/l90 0 2024-04-23T10:17:54.869 INFO:tasks.workunit.client.0.smithi026.stdout:4/361: write d4/d22/d2e/f6d [8169893,112147] 0 2024-04-23T10:17:54.873 INFO:tasks.workunit.client.0.smithi026.stdout:7/492: mknod dd/d3f/d47/d4c/d60/c91 0 2024-04-23T10:17:54.884 INFO:tasks.workunit.client.0.smithi026.stdout:7/493: read dd/f67 [97396,1547] 0 2024-04-23T10:17:54.888 INFO:tasks.workunit.client.0.smithi026.stdout:4/362: link d4/d7/f1f d4/d7/d51/d6c/f79 0 2024-04-23T10:17:54.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/652: sync 2024-04-23T10:17:54.902 INFO:tasks.workunit.client.0.smithi026.stdout:3/475: sync 2024-04-23T10:17:54.902 INFO:tasks.workunit.client.0.smithi026.stdout:5/414: sync 2024-04-23T10:17:54.902 INFO:tasks.workunit.client.0.smithi026.stdout:6/568: sync 2024-04-23T10:17:54.906 INFO:tasks.workunit.client.0.smithi026.stdout:4/363: dread d4/d7/f3e [0,4194304] 0 2024-04-23T10:17:54.907 INFO:tasks.workunit.client.0.smithi026.stdout:5/415: truncate d0/d3c/d84/f87 809529 0 2024-04-23T10:17:54.909 INFO:tasks.workunit.client.0.smithi026.stdout:6/569: truncate d6/d21/d58/d8d/f5b 1678356 0 2024-04-23T10:17:54.913 INFO:tasks.workunit.client.0.smithi026.stdout:0/653: rename d7/d8/d1e/d2a/l64 to d7/d8/d1e/dd3/de7/dee/lf1 0 2024-04-23T10:17:54.917 INFO:tasks.workunit.client.0.smithi026.stdout:6/570: symlink d6/d21/d58/d8d/la5 0 2024-04-23T10:17:54.918 INFO:tasks.workunit.client.0.smithi026.stdout:4/364: creat d4/d14/d3d/d73/f7a x:0 0 0 2024-04-23T10:17:54.921 INFO:tasks.workunit.client.0.smithi026.stdout:5/416: creat d0/d3c/f88 x:0 0 0 2024-04-23T10:17:54.922 INFO:tasks.workunit.client.0.smithi026.stdout:6/571: mknod d6/d21/d2f/d32/d53/ca6 0 2024-04-23T10:17:54.923 INFO:tasks.workunit.client.0.smithi026.stdout:5/417: write d0/d12/f2b [3001162,120551] 0 2024-04-23T10:17:54.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/365: dread d4/d7/d34/f4f [0,4194304] 0 2024-04-23T10:17:54.930 INFO:tasks.workunit.client.0.smithi026.stdout:3/476: dread d0/d1e/d30/d43/f5f [0,4194304] 0 2024-04-23T10:17:54.931 INFO:tasks.workunit.client.0.smithi026.stdout:5/418: unlink d0/f39 0 2024-04-23T10:17:54.934 INFO:tasks.workunit.client.0.smithi026.stdout:5/419: read d0/f16 [4594312,16215] 0 2024-04-23T10:17:54.935 INFO:tasks.workunit.client.0.smithi026.stdout:0/654: creat d7/d8/d2d/d60/ff2 x:0 0 0 2024-04-23T10:17:54.935 INFO:tasks.workunit.client.0.smithi026.stdout:5/420: fdatasync d0/fe 0 2024-04-23T10:17:54.936 INFO:tasks.workunit.client.0.smithi026.stdout:5/421: write d0/d3c/d84/f87 [1156923,35451] 0 2024-04-23T10:17:54.937 INFO:tasks.workunit.client.0.smithi026.stdout:6/572: unlink d6/d21/d2f/d32/d87/c8c 0 2024-04-23T10:17:54.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/366: rename d4/d7/d34 to d4/d5b/d7b 0 2024-04-23T10:17:54.948 INFO:tasks.workunit.client.0.smithi026.stdout:6/573: dwrite d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:17:54.952 INFO:tasks.workunit.client.0.smithi026.stdout:0/655: dwrite f4 [4194304,4194304] 0 2024-04-23T10:17:54.953 INFO:tasks.workunit.client.0.smithi026.stdout:8/622: sync 2024-04-23T10:17:54.953 INFO:tasks.workunit.client.0.smithi026.stdout:2/478: sync 2024-04-23T10:17:54.956 INFO:tasks.workunit.client.0.smithi026.stdout:3/477: creat d0/d1e/d30/fa5 x:0 0 0 2024-04-23T10:17:54.958 INFO:tasks.workunit.client.0.smithi026.stdout:1/478: dwrite dd/d1a/d6a/f86 [0,4194304] 0 2024-04-23T10:17:54.959 INFO:tasks.workunit.client.0.smithi026.stdout:7/494: write dd/d44/f5e [2531609,1303] 0 2024-04-23T10:17:54.963 INFO:tasks.workunit.client.0.smithi026.stdout:7/495: read dd/d44/f23 [4076416,113906] 0 2024-04-23T10:17:54.965 INFO:tasks.workunit.client.0.smithi026.stdout:2/479: creat d3/d35/fa9 x:0 0 0 2024-04-23T10:17:54.967 INFO:tasks.workunit.client.0.smithi026.stdout:0/656: dwrite d7/d8/d1e/d1d/f6d [0,4194304] 0 2024-04-23T10:17:54.970 INFO:tasks.workunit.client.0.smithi026.stdout:4/367: creat d4/d7/f7c x:0 0 0 2024-04-23T10:17:54.978 INFO:tasks.workunit.client.0.smithi026.stdout:6/574: unlink d6/d21/d2f/d37/f3a 0 2024-04-23T10:17:54.979 INFO:tasks.workunit.client.0.smithi026.stdout:6/575: chown d6/d21/d58/d8d/f92 1316 1 2024-04-23T10:17:54.982 INFO:tasks.workunit.client.0.smithi026.stdout:1/479: dwrite dd/d15/f4f [4194304,4194304] 0 2024-04-23T10:17:54.983 INFO:tasks.workunit.client.0.smithi026.stdout:0/657: unlink d7/d8/d1e/d1d/d2f/d6c/lba 0 2024-04-23T10:17:54.984 INFO:tasks.workunit.client.0.smithi026.stdout:0/658: readlink d7/d8/d2d/l93 0 2024-04-23T10:17:54.985 INFO:tasks.workunit.client.0.smithi026.stdout:0/659: read - d7/d8/d2d/d60/d62/db2/db4/fc3 zero size 2024-04-23T10:17:54.986 INFO:tasks.workunit.client.0.smithi026.stdout:0/660: fdatasync d7/d8/d1e/d1d/d2f/d6c/fb7 0 2024-04-23T10:17:54.987 INFO:tasks.workunit.client.0.smithi026.stdout:6/576: mknod d6/d21/d58/d8d/ca7 0 2024-04-23T10:17:54.991 INFO:tasks.workunit.client.0.smithi026.stdout:2/480: dread d3/d19/f62 [0,4194304] 0 2024-04-23T10:17:54.995 INFO:tasks.workunit.client.0.smithi026.stdout:0/661: mknod d7/d8/d2d/d60/d62/da2/dd9/cf3 0 2024-04-23T10:17:54.995 INFO:tasks.workunit.client.0.smithi026.stdout:4/368: dwrite d4/d7/f13 [4194304,4194304] 0 2024-04-23T10:17:54.995 INFO:tasks.workunit.client.0.smithi026.stdout:4/369: chown d4/d42 25207920 1 2024-04-23T10:17:54.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/577: unlink d6/d21/d2f/d32/d87/c88 0 2024-04-23T10:17:54.998 INFO:tasks.workunit.client.0.smithi026.stdout:8/623: link d5/d56/d33/c91 d5/d9/d64/dc5/cd0 0 2024-04-23T10:17:54.998 INFO:tasks.workunit.client.0.smithi026.stdout:6/578: write d6/d21/d2f/d32/f55 [1550826,57980] 0 2024-04-23T10:17:54.999 INFO:tasks.workunit.client.0.smithi026.stdout:2/481: mknod d3/d19/d21/d23/d3a/d3c/caa 0 2024-04-23T10:17:54.999 INFO:tasks.workunit.client.0.smithi026.stdout:8/624: chown d5/d9/d22/d65/d78/d3e/da1/cb4 75813 1 2024-04-23T10:17:55.001 INFO:tasks.workunit.client.0.smithi026.stdout:2/482: fsync d3/dd/f56 0 2024-04-23T10:17:55.002 INFO:tasks.workunit.client.0.smithi026.stdout:8/625: chown d5/d9/d22/d65 714 1 2024-04-23T10:17:55.005 INFO:tasks.workunit.client.0.smithi026.stdout:6/579: mkdir d6/d21/d2f/d37/d68/da8 0 2024-04-23T10:17:55.013 INFO:tasks.workunit.client.0.smithi026.stdout:0/662: dwrite d7/d8/d2d/d60/d62/fbf [0,4194304] 0 2024-04-23T10:17:55.013 INFO:tasks.workunit.client.0.smithi026.stdout:8/626: creat d5/d9/d22/d65/d78/d3e/da1/dc2/fd1 x:0 0 0 2024-04-23T10:17:55.016 INFO:tasks.workunit.client.0.smithi026.stdout:2/483: creat d3/d19/d1d/fab x:0 0 0 2024-04-23T10:17:55.017 INFO:tasks.workunit.client.0.smithi026.stdout:1/480: dread f9 [0,4194304] 0 2024-04-23T10:17:55.018 INFO:tasks.workunit.client.0.smithi026.stdout:8/627: symlink d5/d50/ld2 0 2024-04-23T10:17:55.019 INFO:tasks.workunit.client.0.smithi026.stdout:0/663: symlink d7/d8/d2d/d60/d77/lf4 0 2024-04-23T10:17:55.019 INFO:tasks.workunit.client.0.smithi026.stdout:6/580: dwrite d6/d21/d2f/d37/f6d [4194304,4194304] 0 2024-04-23T10:17:55.021 INFO:tasks.workunit.client.0.smithi026.stdout:1/481: mkdir dd/d48/dab 0 2024-04-23T10:17:55.021 INFO:tasks.workunit.client.0.smithi026.stdout:2/484: chown d3/d19/d21/d23/d3a/d3c/f59 120147 1 2024-04-23T10:17:55.021 INFO:tasks.workunit.client.0.smithi026.stdout:6/581: write d6/fd [5174392,36681] 0 2024-04-23T10:17:55.022 INFO:tasks.workunit.client.0.smithi026.stdout:0/664: truncate d7/f39 1648597 0 2024-04-23T10:17:55.023 INFO:tasks.workunit.client.0.smithi026.stdout:8/628: mknod d5/d56/d15/d76/cd3 0 2024-04-23T10:17:55.024 INFO:tasks.workunit.client.0.smithi026.stdout:2/485: chown d3/dd/f2d 528286075 1 2024-04-23T10:17:55.024 INFO:tasks.workunit.client.0.smithi026.stdout:1/482: readlink dd/d1a/d20/d25/l57 0 2024-04-23T10:17:55.025 INFO:tasks.workunit.client.0.smithi026.stdout:8/629: symlink d5/d9/dac/ld4 0 2024-04-23T10:17:55.029 INFO:tasks.workunit.client.0.smithi026.stdout:1/483: unlink dd/d1a/d20/d25/d35/d73/f8e 0 2024-04-23T10:17:55.031 INFO:tasks.workunit.client.0.smithi026.stdout:6/582: symlink d6/d21/d2f/d31/d52/la9 0 2024-04-23T10:17:55.031 INFO:tasks.workunit.client.0.smithi026.stdout:6/583: chown d6/d21/d2f/d37/f39 29057058 1 2024-04-23T10:17:55.040 INFO:tasks.workunit.client.0.smithi026.stdout:8/630: unlink d5/l16 0 2024-04-23T10:17:55.041 INFO:tasks.workunit.client.0.smithi026.stdout:6/584: creat d6/d21/d2f/d31/faa x:0 0 0 2024-04-23T10:17:55.045 INFO:tasks.workunit.client.0.smithi026.stdout:6/585: mknod d6/d21/cab 0 2024-04-23T10:17:55.046 INFO:tasks.workunit.client.0.smithi026.stdout:6/586: stat d6/d21/d2f/d31/d52/d82/l93 0 2024-04-23T10:17:55.047 INFO:tasks.workunit.client.0.smithi026.stdout:6/587: write d6/d21/d2f/d37/d9a/fa3 [201105,110377] 0 2024-04-23T10:17:55.051 INFO:tasks.workunit.client.0.smithi026.stdout:6/588: truncate d6/d21/d2f/d37/f39 3283614 0 2024-04-23T10:17:55.052 INFO:tasks.workunit.client.0.smithi026.stdout:6/589: dread - d6/f5c zero size 2024-04-23T10:17:55.052 INFO:tasks.workunit.client.0.smithi026.stdout:1/484: dread dd/d1a/d23/f44 [0,4194304] 0 2024-04-23T10:17:55.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/691: sync 2024-04-23T10:17:55.055 INFO:tasks.workunit.client.0.smithi026.stdout:6/590: mkdir d6/d21/d2f/d31/dac 0 2024-04-23T10:17:55.055 INFO:tasks.workunit.client.0.smithi026.stdout:1/485: fdatasync dd/f90 0 2024-04-23T10:17:55.056 INFO:tasks.workunit.client.0.smithi026.stdout:1/486: write dd/d1a/d20/d25/f9c [1002375,35439] 0 2024-04-23T10:17:55.056 INFO:tasks.workunit.client.0.smithi026.stdout:9/692: unlink d13/d2a/l3d 0 2024-04-23T10:17:55.057 INFO:tasks.workunit.client.0.smithi026.stdout:6/591: creat d6/d21/d58/fad x:0 0 0 2024-04-23T10:17:55.059 INFO:tasks.workunit.client.0.smithi026.stdout:1/487: write dd/d1a/d20/f5f [154411,32849] 0 2024-04-23T10:17:55.060 INFO:tasks.workunit.client.0.smithi026.stdout:2/486: dread d3/dd/d4b/f61 [0,4194304] 0 2024-04-23T10:17:55.061 INFO:tasks.workunit.client.0.smithi026.stdout:6/592: creat d6/d13/d15/fae x:0 0 0 2024-04-23T10:17:55.063 INFO:tasks.workunit.client.0.smithi026.stdout:9/693: dread d13/d3e/f44 [0,4194304] 0 2024-04-23T10:17:55.064 INFO:tasks.workunit.client.0.smithi026.stdout:2/487: write d3/d19/d21/d23/d3a/f69 [2000991,35030] 0 2024-04-23T10:17:55.065 INFO:tasks.workunit.client.0.smithi026.stdout:2/488: fsync d3/d19/d31/f9d 0 2024-04-23T10:17:55.067 INFO:tasks.workunit.client.0.smithi026.stdout:2/489: write d3/d35/d4c/f76 [55418,17729] 0 2024-04-23T10:17:55.069 INFO:tasks.workunit.client.0.smithi026.stdout:2/490: read d3/d19/f62 [285684,79031] 0 2024-04-23T10:17:55.072 INFO:tasks.workunit.client.0.smithi026.stdout:5/422: write d0/d3c/f3d [5150879,32665] 0 2024-04-23T10:17:55.072 INFO:tasks.workunit.client.0.smithi026.stdout:2/491: fdatasync d3/d19/f62 0 2024-04-23T10:17:55.078 INFO:tasks.workunit.client.0.smithi026.stdout:5/423: fsync d0/d3c/d5d/f19 0 2024-04-23T10:17:55.078 INFO:tasks.workunit.client.0.smithi026.stdout:2/492: mkdir d3/d19/d21/d23/d3a/d3c/d80/da7/dac 0 2024-04-23T10:17:55.078 INFO:tasks.workunit.client.0.smithi026.stdout:1/488: dread dd/d1a/d20/f5f [0,4194304] 0 2024-04-23T10:17:55.079 INFO:tasks.workunit.client.0.smithi026.stdout:5/424: unlink d0/d12/c3e 0 2024-04-23T10:17:55.079 INFO:tasks.workunit.client.0.smithi026.stdout:2/493: mknod d3/dd/d4b/d9c/cad 0 2024-04-23T10:17:55.081 INFO:tasks.workunit.client.0.smithi026.stdout:2/494: creat d3/d19/d31/d83/fae x:0 0 0 2024-04-23T10:17:55.082 INFO:tasks.workunit.client.0.smithi026.stdout:1/489: dread f7 [0,4194304] 0 2024-04-23T10:17:55.084 INFO:tasks.workunit.client.0.smithi026.stdout:2/495: unlink d3/d35/c3d 0 2024-04-23T10:17:55.087 INFO:tasks.workunit.client.0.smithi026.stdout:5/425: dwrite d0/d3c/d57/f7d [0,4194304] 0 2024-04-23T10:17:55.087 INFO:tasks.workunit.client.0.smithi026.stdout:2/496: mkdir d3/d19/d21/d23/daf 0 2024-04-23T10:17:55.088 INFO:tasks.workunit.client.0.smithi026.stdout:5/426: chown d0/f16 29743 1 2024-04-23T10:17:55.090 INFO:tasks.workunit.client.0.smithi026.stdout:1/490: dwrite dd/d48/f72 [0,4194304] 0 2024-04-23T10:17:55.092 INFO:tasks.workunit.client.0.smithi026.stdout:5/427: rmdir d0/d6f 39 2024-04-23T10:17:55.092 INFO:tasks.workunit.client.0.smithi026.stdout:2/497: symlink d3/dd/lb0 0 2024-04-23T10:17:55.093 INFO:tasks.workunit.client.0.smithi026.stdout:5/428: write d0/d3c/d5d/f19 [393153,28761] 0 2024-04-23T10:17:55.094 INFO:tasks.workunit.client.0.smithi026.stdout:8/631: write d5/d56/d47/f4f [159473,88452] 0 2024-04-23T10:17:55.098 INFO:tasks.workunit.client.0.smithi026.stdout:1/491: mkdir dd/d48/dac 0 2024-04-23T10:17:55.102 INFO:tasks.workunit.client.0.smithi026.stdout:2/498: creat d3/d19/d21/d23/d3a/d3c/d80/fb1 x:0 0 0 2024-04-23T10:17:55.103 INFO:tasks.workunit.client.0.smithi026.stdout:1/492: rename dd/d1a/d20/d25/d35/d43/f4c to dd/d1a/d23/fad 0 2024-04-23T10:17:55.105 INFO:tasks.workunit.client.0.smithi026.stdout:8/632: link d5/f2a d5/d9/d22/d65/d78/d3e/da1/dc2/fd5 0 2024-04-23T10:17:55.105 INFO:tasks.workunit.client.0.smithi026.stdout:5/429: dwrite d0/f42 [0,4194304] 0 2024-04-23T10:17:55.107 INFO:tasks.workunit.client.0.smithi026.stdout:5/430: write d0/f54 [443882,107245] 0 2024-04-23T10:17:55.108 INFO:tasks.workunit.client.0.smithi026.stdout:2/499: unlink d3/d19/d31/f97 0 2024-04-23T10:17:55.116 INFO:tasks.workunit.client.0.smithi026.stdout:8/633: rename d5/d9/d22/d65/d78/dc9/l80 to d5/d56/d33/ld6 0 2024-04-23T10:17:55.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/593: truncate d6/d21/d2f/d37/d4f/f7b 57949 0 2024-04-23T10:17:55.119 INFO:tasks.workunit.client.0.smithi026.stdout:9/694: truncate d13/d2a/d45/d67/f82 173690 0 2024-04-23T10:17:55.123 INFO:tasks.workunit.client.0.smithi026.stdout:5/431: dwrite d0/d3c/d5d/d3a/f58 [0,4194304] 0 2024-04-23T10:17:55.123 INFO:tasks.workunit.client.0.smithi026.stdout:8/634: fdatasync d5/d9/d22/d65/d78/fa2 0 2024-04-23T10:17:55.125 INFO:tasks.workunit.client.0.smithi026.stdout:1/493: dwrite f9 [0,4194304] 0 2024-04-23T10:17:55.126 INFO:tasks.workunit.client.0.smithi026.stdout:2/500: rename d3/d35/d4c/l7d to d3/d19/lb2 0 2024-04-23T10:17:55.126 INFO:tasks.workunit.client.0.smithi026.stdout:6/594: rename d6 to d6/d13/d15/daf 22 2024-04-23T10:17:55.126 INFO:tasks.workunit.client.0.smithi026.stdout:8/635: mknod d5/d56/d15/d8b/cd7 0 2024-04-23T10:17:55.127 INFO:tasks.workunit.client.0.smithi026.stdout:1/494: write dd/d1a/d23/f28 [4860613,90007] 0 2024-04-23T10:17:55.131 INFO:tasks.workunit.client.0.smithi026.stdout:1/495: dread dd/f21 [0,4194304] 0 2024-04-23T10:17:55.132 INFO:tasks.workunit.client.0.smithi026.stdout:5/432: mkdir d0/d3c/d84/d89 0 2024-04-23T10:17:55.134 INFO:tasks.workunit.client.0.smithi026.stdout:5/433: fsync d0/d3c/d5d/d3a/f7f 0 2024-04-23T10:17:55.140 INFO:tasks.workunit.client.0.smithi026.stdout:8/636: mknod d5/d50/d9a/cd8 0 2024-04-23T10:17:55.149 INFO:tasks.workunit.client.0.smithi026.stdout:8/637: symlink d5/d9/d22/ld9 0 2024-04-23T10:17:55.152 INFO:tasks.workunit.client.0.smithi026.stdout:8/638: chown d5/d56/d15/d76 1695 1 2024-04-23T10:17:55.152 INFO:tasks.workunit.client.0.smithi026.stdout:5/434: dread d0/f54 [0,4194304] 0 2024-04-23T10:17:55.153 INFO:tasks.workunit.client.0.smithi026.stdout:6/595: dread d6/f1d [0,4194304] 0 2024-04-23T10:17:55.155 INFO:tasks.workunit.client.0.smithi026.stdout:2/501: getdents d3/d19 0 2024-04-23T10:17:55.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/596: dread - d6/d13/d15/fae zero size 2024-04-23T10:17:55.156 INFO:tasks.workunit.client.0.smithi026.stdout:6/597: stat d6/d21/d2f/d32/d53/f61 0 2024-04-23T10:17:55.158 INFO:tasks.workunit.client.0.smithi026.stdout:6/598: write d6/d13/d15/fae [351901,5882] 0 2024-04-23T10:17:55.158 INFO:tasks.workunit.client.0.smithi026.stdout:2/502: chown d3/d19/d31/f5c 22559600 1 2024-04-23T10:17:55.159 INFO:tasks.workunit.client.0.smithi026.stdout:2/503: chown d3/d35/d4c/f6a 530223 1 2024-04-23T10:17:55.165 INFO:tasks.workunit.client.0.smithi026.stdout:6/599: dwrite d6/d21/d2f/d31/f79 [0,4194304] 0 2024-04-23T10:17:55.166 INFO:tasks.workunit.client.0.smithi026.stdout:2/504: rename d3/d19/d21/d23/d3a/d3c/d80/l93 to d3/d19/d21/d23/d3a/d3c/d80/lb3 0 2024-04-23T10:17:55.167 INFO:tasks.workunit.client.0.smithi026.stdout:9/695: creat d13/d1b/d26/d88/fd2 x:0 0 0 2024-04-23T10:17:55.168 INFO:tasks.workunit.client.0.smithi026.stdout:2/505: write d3/d19/d21/f85 [1531019,8415] 0 2024-04-23T10:17:55.172 INFO:tasks.workunit.client.0.smithi026.stdout:5/435: dwrite d0/d3c/d5d/f29 [0,4194304] 0 2024-04-23T10:17:55.174 INFO:tasks.workunit.client.0.smithi026.stdout:9/696: mknod d13/d3b/d4e/cd3 0 2024-04-23T10:17:55.174 INFO:tasks.workunit.client.0.smithi026.stdout:6/600: dread d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:17:55.176 INFO:tasks.workunit.client.0.smithi026.stdout:6/601: fsync d6/d13/d15/f7c 0 2024-04-23T10:17:55.176 INFO:tasks.workunit.client.0.smithi026.stdout:5/436: creat d0/d3c/d84/d89/f8a x:0 0 0 2024-04-23T10:17:55.178 INFO:tasks.workunit.client.0.smithi026.stdout:3/478: sync 2024-04-23T10:17:55.186 INFO:tasks.workunit.client.0.smithi026.stdout:5/437: mknod d0/d3c/d84/c8b 0 2024-04-23T10:17:55.186 INFO:tasks.workunit.client.0.smithi026.stdout:1/496: write dd/d1a/d20/d25/d35/d43/f50 [452267,80975] 0 2024-04-23T10:17:55.188 INFO:tasks.workunit.client.0.smithi026.stdout:9/697: symlink d13/d36/d66/dbf/ld4 0 2024-04-23T10:17:55.189 INFO:tasks.workunit.client.0.smithi026.stdout:3/479: creat d0/d1e/d23/d9e/fa6 x:0 0 0 2024-04-23T10:17:55.192 INFO:tasks.workunit.client.0.smithi026.stdout:5/438: creat d0/d3c/d84/f8c x:0 0 0 2024-04-23T10:17:55.195 INFO:tasks.workunit.client.0.smithi026.stdout:8/639: creat d5/d50/d9a/fda x:0 0 0 2024-04-23T10:17:55.196 INFO:tasks.workunit.client.0.smithi026.stdout:9/698: creat d13/d1b/d26/d88/dcf/dd1/fd5 x:0 0 0 2024-04-23T10:17:55.199 INFO:tasks.workunit.client.0.smithi026.stdout:8/640: chown d5/d9/d22/d65/d78/dc9/l9d 257 1 2024-04-23T10:17:55.200 INFO:tasks.workunit.client.0.smithi026.stdout:9/699: unlink d13/d1b/d2b/f6f 0 2024-04-23T10:17:55.200 INFO:tasks.workunit.client.0.smithi026.stdout:8/641: write d5/d50/f79 [1911340,18140] 0 2024-04-23T10:17:55.204 INFO:tasks.workunit.client.0.smithi026.stdout:8/642: creat d5/d9/dac/fdb x:0 0 0 2024-04-23T10:17:55.206 INFO:tasks.workunit.client.0.smithi026.stdout:9/700: getdents d13/d36/d66/d72 0 2024-04-23T10:17:55.206 INFO:tasks.workunit.client.0.smithi026.stdout:8/643: write d5/d9/d22/d65/d78/d3e/f92 [211072,28049] 0 2024-04-23T10:17:55.207 INFO:tasks.workunit.client.0.smithi026.stdout:3/480: dread d0/d1e/d30/d43/d29/f5c [0,4194304] 0 2024-04-23T10:17:55.210 INFO:tasks.workunit.client.0.smithi026.stdout:6/602: dread d6/d21/d2f/d37/f6d [0,4194304] 0 2024-04-23T10:17:55.210 INFO:tasks.workunit.client.0.smithi026.stdout:8/644: mkdir d5/d56/d33/ddc 0 2024-04-23T10:17:55.212 INFO:tasks.workunit.client.0.smithi026.stdout:9/701: rename d13/d2a to d13/d3b/d68/dd6 0 2024-04-23T10:17:55.212 INFO:tasks.workunit.client.0.smithi026.stdout:6/603: read d6/f10 [227632,25485] 0 2024-04-23T10:17:55.213 INFO:tasks.workunit.client.0.smithi026.stdout:8/645: symlink d5/d56/d15/d76/ldd 0 2024-04-23T10:17:55.214 INFO:tasks.workunit.client.0.smithi026.stdout:8/646: chown d5/f84 429 1 2024-04-23T10:17:55.216 INFO:tasks.workunit.client.0.smithi026.stdout:5/439: dread d0/d3c/d5d/f14 [0,4194304] 0 2024-04-23T10:17:55.218 INFO:tasks.workunit.client.0.smithi026.stdout:6/604: link f3 d6/d21/d2f/d32/d53/fb0 0 2024-04-23T10:17:55.219 INFO:tasks.workunit.client.0.smithi026.stdout:8/647: symlink d5/d9/d22/d65/d78/d3e/da1/dc2/lde 0 2024-04-23T10:17:55.219 INFO:tasks.workunit.client.0.smithi026.stdout:3/481: dwrite d0/d1e/d30/d43/d6c/d79/f62 [4194304,4194304] 0 2024-04-23T10:17:55.220 INFO:tasks.workunit.client.0.smithi026.stdout:6/605: chown d6/d21/d2f/d37/d4f/c7e 742856509 1 2024-04-23T10:17:55.221 INFO:tasks.workunit.client.0.smithi026.stdout:5/440: read d0/f25 [2912850,130755] 0 2024-04-23T10:17:55.223 INFO:tasks.workunit.client.0.smithi026.stdout:8/648: chown d5/d9/d22/d65/d78/d3e/da1/cb4 499 1 2024-04-23T10:17:55.223 INFO:tasks.workunit.client.0.smithi026.stdout:6/606: write d6/d21/d2f/d32/f97 [1146256,40527] 0 2024-04-23T10:17:55.223 INFO:tasks.workunit.client.0.smithi026.stdout:5/441: mkdir d0/d3c/d84/d89/d8d 0 2024-04-23T10:17:55.225 INFO:tasks.workunit.client.0.smithi026.stdout:6/607: chown d6/d21/d58/d8d/f5b 95877026 1 2024-04-23T10:17:55.226 INFO:tasks.workunit.client.0.smithi026.stdout:6/608: write d6/d21/d58/d8d/f84 [902496,99648] 0 2024-04-23T10:17:55.230 INFO:tasks.workunit.client.0.smithi026.stdout:3/482: link d0/d1e/d30/d43/d6c/d79/l2b d0/d1e/d30/d43/df/d72/la7 0 2024-04-23T10:17:55.235 INFO:tasks.workunit.client.0.smithi026.stdout:3/483: fsync d0/d4c/f67 0 2024-04-23T10:17:55.236 INFO:tasks.workunit.client.0.smithi026.stdout:8/649: dwrite d5/d9/d22/d65/d78/d3e/fb9 [0,4194304] 0 2024-04-23T10:17:55.239 INFO:tasks.workunit.client.0.smithi026.stdout:5/442: dwrite d0/d3c/f74 [0,4194304] 0 2024-04-23T10:17:55.241 INFO:tasks.workunit.client.0.smithi026.stdout:6/609: dwrite d6/d13/d15/f7c [0,4194304] 0 2024-04-23T10:17:55.243 INFO:tasks.workunit.client.0.smithi026.stdout:5/443: write d0/d3c/d84/f87 [1171660,251] 0 2024-04-23T10:17:55.245 INFO:tasks.workunit.client.0.smithi026.stdout:6/610: chown d6/d21/d2f/d31/l44 4492736 1 2024-04-23T10:17:55.256 INFO:tasks.workunit.client.0.smithi026.stdout:3/484: dwrite d0/d1e/d30/d43/f5f [0,4194304] 0 2024-04-23T10:17:55.259 INFO:tasks.workunit.client.0.smithi026.stdout:8/650: dread d5/d56/d15/d76/f85 [0,4194304] 0 2024-04-23T10:17:55.259 INFO:tasks.workunit.client.0.smithi026.stdout:3/485: truncate d0/d1e/d23/d9e/fa6 612063 0 2024-04-23T10:17:55.262 INFO:tasks.workunit.client.0.smithi026.stdout:3/486: mkdir d0/d1e/d30/d43/d6c/d79/d73/d99/da8 0 2024-04-23T10:17:55.264 INFO:tasks.workunit.client.0.smithi026.stdout:8/651: mknod d5/d50/d9a/cdf 0 2024-04-23T10:17:55.265 INFO:tasks.workunit.client.0.smithi026.stdout:3/487: chown d0/d1e/d30/d43/df/f1b 52 1 2024-04-23T10:17:55.266 INFO:tasks.workunit.client.0.smithi026.stdout:8/652: symlink d5/le0 0 2024-04-23T10:17:55.267 INFO:tasks.workunit.client.0.smithi026.stdout:8/653: dread - d5/d56/d3f/f6b zero size 2024-04-23T10:17:55.267 INFO:tasks.workunit.client.0.smithi026.stdout:6/611: dwrite d6/d21/d2f/d32/f91 [0,4194304] 0 2024-04-23T10:17:55.268 INFO:tasks.workunit.client.0.smithi026.stdout:6/612: chown d6/d21/d58/f85 5077 1 2024-04-23T10:17:55.269 INFO:tasks.workunit.client.0.smithi026.stdout:6/613: chown d6/d21/d2f 1 1 2024-04-23T10:17:55.272 INFO:tasks.workunit.client.0.smithi026.stdout:8/654: unlink d5/d56/d47/c55 0 2024-04-23T10:17:55.273 INFO:tasks.workunit.client.0.smithi026.stdout:6/614: mkdir d6/d21/d2f/d37/d9a/db1 0 2024-04-23T10:17:55.274 INFO:tasks.workunit.client.0.smithi026.stdout:8/655: dread d5/d56/d3f/f82 [0,4194304] 0 2024-04-23T10:17:55.275 INFO:tasks.workunit.client.0.smithi026.stdout:6/615: rmdir d6/d21/d2f/d31 39 2024-04-23T10:17:55.278 INFO:tasks.workunit.client.0.smithi026.stdout:8/656: truncate d5/d9/d22/d65/d78/d3e/da1/da8/fc4 979515 0 2024-04-23T10:17:55.280 INFO:tasks.workunit.client.0.smithi026.stdout:8/657: rmdir d5/d56/d15/d76 39 2024-04-23T10:17:55.280 INFO:tasks.workunit.client.0.smithi026.stdout:8/658: fsync d5/d56/d33/f4e 0 2024-04-23T10:17:55.281 INFO:tasks.workunit.client.0.smithi026.stdout:6/616: read d6/d21/f72 [692539,99443] 0 2024-04-23T10:17:55.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/617: dwrite d6/d21/d58/d8d/f92 [0,4194304] 0 2024-04-23T10:17:55.290 INFO:tasks.workunit.client.0.smithi026.stdout:6/618: write d6/d13/d15/f7c [3454637,11474] 0 2024-04-23T10:17:55.299 INFO:tasks.workunit.client.0.smithi026.stdout:6/619: dread d6/d21/d2f/d32/f89 [0,4194304] 0 2024-04-23T10:17:55.316 INFO:tasks.workunit.client.0.smithi026.stdout:6/620: dread d6/d21/d2f/d32/d53/fb0 [0,4194304] 0 2024-04-23T10:17:55.319 INFO:tasks.workunit.client.0.smithi026.stdout:6/621: mknod d6/d21/d2f/d37/d4f/cb2 0 2024-04-23T10:17:55.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/622: symlink d6/d21/d2f/d32/lb3 0 2024-04-23T10:17:55.323 INFO:tasks.workunit.client.0.smithi026.stdout:6/623: getdents d6/d21/d2f/d37/d9a/db1 0 2024-04-23T10:17:55.327 INFO:tasks.workunit.client.0.smithi026.stdout:6/624: dread d6/f10 [0,4194304] 0 2024-04-23T10:17:55.330 INFO:tasks.workunit.client.0.smithi026.stdout:6/625: rename d6/d13/d15/c99 to d6/d21/d58/cb4 0 2024-04-23T10:17:55.330 INFO:tasks.workunit.client.0.smithi026.stdout:6/626: chown d6/d21/d2f/d37/f3f 1127323 1 2024-04-23T10:17:55.336 INFO:tasks.workunit.client.0.smithi026.stdout:6/627: dwrite d6/d33/f2c [0,4194304] 0 2024-04-23T10:17:55.361 INFO:tasks.workunit.client.0.smithi026.stdout:7/496: sync 2024-04-23T10:17:55.362 INFO:tasks.workunit.client.0.smithi026.stdout:6/628: dread d6/d21/d58/d8d/d64/f95 [0,4194304] 0 2024-04-23T10:17:55.364 INFO:tasks.workunit.client.0.smithi026.stdout:7/497: creat dd/d3f/d47/d4c/d60/d75/f92 x:0 0 0 2024-04-23T10:17:55.364 INFO:tasks.workunit.client.0.smithi026.stdout:6/629: chown d6/d21/d2f/d31/d52 56994 1 2024-04-23T10:17:55.365 INFO:tasks.workunit.client.0.smithi026.stdout:7/498: fsync dd/d3f/d47/d4c/d60/d75/f7a 0 2024-04-23T10:17:55.369 INFO:tasks.workunit.client.0.smithi026.stdout:6/630: rmdir d6/d21/d2f/d31/dac 0 2024-04-23T10:17:55.370 INFO:tasks.workunit.client.0.smithi026.stdout:3/488: write d0/f20 [6437936,91173] 0 2024-04-23T10:17:55.371 INFO:tasks.workunit.client.0.smithi026.stdout:3/489: write d0/d1e/d30/d43/d6c/d79/f62 [6860009,94641] 0 2024-04-23T10:17:55.375 INFO:tasks.workunit.client.0.smithi026.stdout:3/490: mkdir d0/d1e/d30/d43/d6c/da9 0 2024-04-23T10:17:55.376 INFO:tasks.workunit.client.0.smithi026.stdout:3/491: fdatasync d0/d1e/d30/d43/d6c/d79/f62 0 2024-04-23T10:17:55.379 INFO:tasks.workunit.client.0.smithi026.stdout:3/492: creat d0/d1e/d30/d43/d6c/d79/d73/faa x:0 0 0 2024-04-23T10:17:55.386 INFO:tasks.workunit.client.0.smithi026.stdout:3/493: dwrite d0/d1e/d30/d43/df/d63/f65 [0,4194304] 0 2024-04-23T10:17:55.391 INFO:tasks.workunit.client.0.smithi026.stdout:3/494: rename d0/f4 to d0/d1e/d30/d43/d82/fab 0 2024-04-23T10:17:55.394 INFO:tasks.workunit.client.0.smithi026.stdout:6/631: dread d6/d13/d15/f1c [0,4194304] 0 2024-04-23T10:17:55.397 INFO:tasks.workunit.client.0.smithi026.stdout:6/632: symlink d6/d21/d2f/d31/d52/d82/lb5 0 2024-04-23T10:17:55.400 INFO:tasks.workunit.client.0.smithi026.stdout:6/633: creat d6/d21/d2f/d37/d9a/fb6 x:0 0 0 2024-04-23T10:17:55.402 INFO:tasks.workunit.client.0.smithi026.stdout:6/634: mknod d6/d13/d15/cb7 0 2024-04-23T10:17:55.404 INFO:tasks.workunit.client.0.smithi026.stdout:6/635: write d6/d21/d2f/d32/d53/f8b [3378069,101030] 0 2024-04-23T10:17:55.404 INFO:tasks.workunit.client.0.smithi026.stdout:6/636: stat d6/d21/d2f/d31/d52/c6e 0 2024-04-23T10:17:55.408 INFO:tasks.workunit.client.0.smithi026.stdout:6/637: mkdir d6/db8 0 2024-04-23T10:17:55.412 INFO:tasks.workunit.client.0.smithi026.stdout:6/638: rename d6/d13/d15/l45 to d6/d21/d2f/d32/lb9 0 2024-04-23T10:17:55.478 INFO:tasks.workunit.client.0.smithi026.stdout:6/639: dread d6/fd [0,4194304] 0 2024-04-23T10:17:55.483 INFO:tasks.workunit.client.0.smithi026.stdout:6/640: creat d6/d21/d2f/d31/d52/d82/fba x:0 0 0 2024-04-23T10:17:55.533 INFO:tasks.workunit.client.0.smithi026.stdout:2/506: sync 2024-04-23T10:17:55.534 INFO:tasks.workunit.client.0.smithi026.stdout:0/665: sync 2024-04-23T10:17:55.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/370: sync 2024-04-23T10:17:55.539 INFO:tasks.workunit.client.0.smithi026.stdout:0/666: mkdir d7/da1/df5 0 2024-04-23T10:17:55.541 INFO:tasks.workunit.client.0.smithi026.stdout:0/667: chown d7/d8/d2d/fd7 948 1 2024-04-23T10:17:55.542 INFO:tasks.workunit.client.0.smithi026.stdout:4/371: creat d4/d22/d2e/f7d x:0 0 0 2024-04-23T10:17:55.546 INFO:tasks.workunit.client.0.smithi026.stdout:0/668: creat d7/d43/ff6 x:0 0 0 2024-04-23T10:17:55.548 INFO:tasks.workunit.client.0.smithi026.stdout:4/372: read d4/d7/d61/d74/f21 [2823092,44540] 0 2024-04-23T10:17:55.554 INFO:tasks.workunit.client.0.smithi026.stdout:4/373: truncate d4/d14/f1c 1045623 0 2024-04-23T10:17:55.555 INFO:tasks.workunit.client.0.smithi026.stdout:2/507: dwrite d3/d19/d31/f77 [0,4194304] 0 2024-04-23T10:17:55.556 INFO:tasks.workunit.client.0.smithi026.stdout:0/669: fdatasync d7/d8/d1e/d1d/d2f/f48 0 2024-04-23T10:17:55.558 INFO:tasks.workunit.client.0.smithi026.stdout:7/499: write dd/f1b [7142556,116684] 0 2024-04-23T10:17:55.559 INFO:tasks.workunit.client.0.smithi026.stdout:2/508: readlink d3/d19/d1d/l98 0 2024-04-23T10:17:55.566 INFO:tasks.workunit.client.0.smithi026.stdout:0/670: write d7/d8/d1e/d2a/f47 [390641,122849] 0 2024-04-23T10:17:55.569 INFO:tasks.workunit.client.0.smithi026.stdout:4/374: creat d4/f7e x:0 0 0 2024-04-23T10:17:55.574 INFO:tasks.workunit.client.0.smithi026.stdout:0/671: rmdir d7/d8/d1e/d2a 39 2024-04-23T10:17:55.577 INFO:tasks.workunit.client.0.smithi026.stdout:4/375: mkdir d4/d7/d61/d74/d7f 0 2024-04-23T10:17:55.578 INFO:tasks.workunit.client.0.smithi026.stdout:2/509: truncate d3/d19/d21/d23/d3a/d3c/f59 1724697 0 2024-04-23T10:17:55.581 INFO:tasks.workunit.client.0.smithi026.stdout:2/510: fsync d3/d35/d4c/f76 0 2024-04-23T10:17:55.587 INFO:tasks.workunit.client.0.smithi026.stdout:2/511: chown d3/d19/d21/d23/d3a/d3c/d5d/c89 54599619 1 2024-04-23T10:17:55.588 INFO:tasks.workunit.client.0.smithi026.stdout:4/376: mkdir d4/d7/d51/d6c/d6f/d80 0 2024-04-23T10:17:55.591 INFO:tasks.workunit.client.0.smithi026.stdout:0/672: creat d7/d8/d2d/d60/d62/da2/ff7 x:0 0 0 2024-04-23T10:17:55.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/673: write d7/d8/d2d/d60/d77/feb [794877,18661] 0 2024-04-23T10:17:55.597 INFO:tasks.workunit.client.0.smithi026.stdout:0/674: stat d7/d8/d2d/d60/f98 0 2024-04-23T10:17:55.597 INFO:tasks.workunit.client.0.smithi026.stdout:4/377: mkdir d4/d22/d4e/d57/d81 0 2024-04-23T10:17:55.602 INFO:tasks.workunit.client.0.smithi026.stdout:0/675: write d7/d8/d2d/d60/d62/db2/db4/fc3 [890859,127115] 0 2024-04-23T10:17:55.603 INFO:tasks.workunit.client.0.smithi026.stdout:4/378: unlink d4/c17 0 2024-04-23T10:17:55.605 INFO:tasks.workunit.client.0.smithi026.stdout:4/379: dread - d4/d1b/f67 zero size 2024-04-23T10:17:55.608 INFO:tasks.workunit.client.0.smithi026.stdout:1/497: sync 2024-04-23T10:17:55.608 INFO:tasks.workunit.client.0.smithi026.stdout:2/512: creat d3/dd/fb4 x:0 0 0 2024-04-23T10:17:55.609 INFO:tasks.workunit.client.0.smithi026.stdout:3/495: mknod d0/d1e/d30/d43/d29/d39/d93/cac 0 2024-04-23T10:17:55.610 INFO:tasks.workunit.client.0.smithi026.stdout:0/676: write d7/d43/f8d [430884,101648] 0 2024-04-23T10:17:55.611 INFO:tasks.workunit.client.0.smithi026.stdout:4/380: mknod d4/d5b/d7b/d36/c82 0 2024-04-23T10:17:55.614 INFO:tasks.workunit.client.0.smithi026.stdout:4/381: read d4/d7/f3e [856657,102817] 0 2024-04-23T10:17:55.616 INFO:tasks.workunit.client.0.smithi026.stdout:1/498: creat dd/d1a/d20/d25/d35/d43/fae x:0 0 0 2024-04-23T10:17:55.619 INFO:tasks.workunit.client.0.smithi026.stdout:3/496: symlink d0/d1e/d30/d43/d6c/d79/d73/d99/lad 0 2024-04-23T10:17:55.621 INFO:tasks.workunit.client.0.smithi026.stdout:0/677: creat d7/d8/d2d/d60/d62/db2/db4/ff8 x:0 0 0 2024-04-23T10:17:55.625 INFO:tasks.workunit.client.0.smithi026.stdout:4/382: dwrite d4/d22/d2e/f6d [4194304,4194304] 0 2024-04-23T10:17:55.626 INFO:tasks.workunit.client.0.smithi026.stdout:0/678: truncate d7/d8/d2d/d60/d62/da2/ff7 901165 0 2024-04-23T10:17:55.627 INFO:tasks.workunit.client.0.smithi026.stdout:0/679: write d7/d8/d2d/fd7 [1135513,41719] 0 2024-04-23T10:17:55.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/497: rmdir d0/d1e/d30/d43/d6c/da9 0 2024-04-23T10:17:55.630 INFO:tasks.workunit.client.0.smithi026.stdout:3/498: stat d0/d1e/d30/d43/df/f1b 0 2024-04-23T10:17:55.631 INFO:tasks.workunit.client.0.smithi026.stdout:4/383: unlink d4/f2b 0 2024-04-23T10:17:55.634 INFO:tasks.workunit.client.0.smithi026.stdout:3/499: truncate d0/d1e/d30/d43/df/d63/f65 5166952 0 2024-04-23T10:17:55.637 INFO:tasks.workunit.client.0.smithi026.stdout:4/384: mkdir d4/d5b/d7b/d36/d38/d83 0 2024-04-23T10:17:55.642 INFO:tasks.workunit.client.0.smithi026.stdout:3/500: creat d0/d51/fae x:0 0 0 2024-04-23T10:17:55.645 INFO:tasks.workunit.client.0.smithi026.stdout:3/501: write d0/d1e/d23/d52/d75/f88 [129315,119546] 0 2024-04-23T10:17:55.645 INFO:tasks.workunit.client.0.smithi026.stdout:0/680: dwrite d7/d8/d2d/d60/d62/f5c [0,4194304] 0 2024-04-23T10:17:55.649 INFO:tasks.workunit.client.0.smithi026.stdout:2/513: dread d3/d19/d4d/f82 [0,4194304] 0 2024-04-23T10:17:55.651 INFO:tasks.workunit.client.0.smithi026.stdout:0/681: chown d7/d8/d1e/d2a/d6a/d70/fcd 14839793 1 2024-04-23T10:17:55.657 INFO:tasks.workunit.client.0.smithi026.stdout:2/514: rmdir d3/d19/d4d 39 2024-04-23T10:17:55.658 INFO:tasks.workunit.client.0.smithi026.stdout:2/515: write d3/d35/fa6 [252072,17609] 0 2024-04-23T10:17:55.663 INFO:tasks.workunit.client.0.smithi026.stdout:6/641: dwrite d6/f5c [0,4194304] 0 2024-04-23T10:17:55.668 INFO:tasks.workunit.client.0.smithi026.stdout:2/516: creat d3/dd/d4b/fb5 x:0 0 0 2024-04-23T10:17:55.668 INFO:tasks.workunit.client.0.smithi026.stdout:7/500: write dd/d44/f23 [4095275,72015] 0 2024-04-23T10:17:55.670 INFO:tasks.workunit.client.0.smithi026.stdout:6/642: creat d6/d21/d58/fbb x:0 0 0 2024-04-23T10:17:55.678 INFO:tasks.workunit.client.0.smithi026.stdout:7/501: fdatasync dd/d1d/f71 0 2024-04-23T10:17:55.680 INFO:tasks.workunit.client.0.smithi026.stdout:7/502: write dd/d3f/f73 [38239,88931] 0 2024-04-23T10:17:55.688 INFO:tasks.workunit.client.0.smithi026.stdout:3/502: write d0/d1e/d23/d52/f61 [4739190,51227] 0 2024-04-23T10:17:55.691 INFO:tasks.workunit.client.0.smithi026.stdout:4/385: dwrite d4/d7/d61/d74/f21 [0,4194304] 0 2024-04-23T10:17:55.694 INFO:tasks.workunit.client.0.smithi026.stdout:3/503: mknod d0/d1e/d30/d43/df/d17/caf 0 2024-04-23T10:17:55.695 INFO:tasks.workunit.client.0.smithi026.stdout:6/643: link d6/d21/d2f/d32/l77 d6/d21/d58/d8d/lbc 0 2024-04-23T10:17:55.696 INFO:tasks.workunit.client.0.smithi026.stdout:3/504: stat d0/d1e/d23/d52/d75/f88 0 2024-04-23T10:17:55.696 INFO:tasks.workunit.client.0.smithi026.stdout:4/386: fsync d4/d14/f25 0 2024-04-23T10:17:55.697 INFO:tasks.workunit.client.0.smithi026.stdout:3/505: readlink d0/d1e/d30/d43/d6c/d79/d73/d99/lad 0 2024-04-23T10:17:55.697 INFO:tasks.workunit.client.0.smithi026.stdout:4/387: fsync d4/f7e 0 2024-04-23T10:17:55.698 INFO:tasks.workunit.client.0.smithi026.stdout:6/644: chown d6/d21/d58/cb4 2 1 2024-04-23T10:17:55.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/388: fdatasync d4/d14/f40 0 2024-04-23T10:17:55.699 INFO:tasks.workunit.client.0.smithi026.stdout:0/682: write d7/d8/d1e/d1d/d2f/f52 [868952,67371] 0 2024-04-23T10:17:55.704 INFO:tasks.workunit.client.0.smithi026.stdout:3/506: mknod d0/d1e/d30/d43/df/d72/d8c/cb0 0 2024-04-23T10:17:55.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/683: creat d7/d8/d2d/d60/d77/ff9 x:0 0 0 2024-04-23T10:17:55.707 INFO:tasks.workunit.client.0.smithi026.stdout:0/684: truncate d7/d8/d2d/d60/d62/da2/dd9/fed 697748 0 2024-04-23T10:17:55.708 INFO:tasks.workunit.client.0.smithi026.stdout:6/645: fsync d6/d21/d2f/d37/d4f/f7b 0 2024-04-23T10:17:55.710 INFO:tasks.workunit.client.0.smithi026.stdout:6/646: fsync d6/d21/d2f/d37/d9a/fa3 0 2024-04-23T10:17:55.715 INFO:tasks.workunit.client.0.smithi026.stdout:0/685: rename d7/d8/d1e/d57/f5e to d7/d8/d2d/d60/ffa 0 2024-04-23T10:17:55.716 INFO:tasks.workunit.client.0.smithi026.stdout:6/647: getdents d6/d21/d2f/d32/d87/d8e 0 2024-04-23T10:17:55.717 INFO:tasks.workunit.client.0.smithi026.stdout:3/507: getdents d0/d1e/d30/d43/d6c/d79 0 2024-04-23T10:17:55.717 INFO:tasks.workunit.client.0.smithi026.stdout:0/686: readlink d7/d8/d1e/l1b 0 2024-04-23T10:17:55.718 INFO:tasks.workunit.client.0.smithi026.stdout:3/508: dread - d0/d1e/d30/fa5 zero size 2024-04-23T10:17:55.719 INFO:tasks.workunit.client.0.smithi026.stdout:2/517: dwrite d3/f13 [0,4194304] 0 2024-04-23T10:17:55.719 INFO:tasks.workunit.client.0.smithi026.stdout:0/687: symlink d7/d43/lfb 0 2024-04-23T10:17:55.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/648: mknod d6/d21/d2f/d32/cbd 0 2024-04-23T10:17:55.722 INFO:tasks.workunit.client.0.smithi026.stdout:6/649: truncate d6/d21/d58/f96 61431 0 2024-04-23T10:17:55.722 INFO:tasks.workunit.client.0.smithi026.stdout:3/509: unlink d0/d1e/d30/d43/df/d17/l9f 0 2024-04-23T10:17:55.723 INFO:tasks.workunit.client.0.smithi026.stdout:6/650: chown d6/d13/d15/cb7 14968325 1 2024-04-23T10:17:55.723 INFO:tasks.workunit.client.0.smithi026.stdout:2/518: readlink d3/d19/d4d/l58 0 2024-04-23T10:17:55.724 INFO:tasks.workunit.client.0.smithi026.stdout:0/688: creat d7/d8/d1e/d57/da9/ffc x:0 0 0 2024-04-23T10:17:55.725 INFO:tasks.workunit.client.0.smithi026.stdout:2/519: fdatasync d3/d19/d31/f66 0 2024-04-23T10:17:55.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/510: creat d0/d1e/d30/d43/d29/fb1 x:0 0 0 2024-04-23T10:17:55.726 INFO:tasks.workunit.client.0.smithi026.stdout:6/651: chown d6/d13/d15/c48 996925 1 2024-04-23T10:17:55.726 INFO:tasks.workunit.client.0.smithi026.stdout:3/511: chown d0/d1e/f5d 1896951 1 2024-04-23T10:17:55.729 INFO:tasks.workunit.client.0.smithi026.stdout:8/659: sync 2024-04-23T10:17:55.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/444: sync 2024-04-23T10:17:55.730 INFO:tasks.workunit.client.0.smithi026.stdout:3/512: creat d0/d1e/d30/d43/df/d72/fb2 x:0 0 0 2024-04-23T10:17:55.734 INFO:tasks.workunit.client.0.smithi026.stdout:5/445: chown d0/d12/d49/c75 28 1 2024-04-23T10:17:55.737 INFO:tasks.workunit.client.0.smithi026.stdout:3/513: mkdir d0/d1e/d23/d87/db3 0 2024-04-23T10:17:55.741 INFO:tasks.workunit.client.0.smithi026.stdout:5/446: chown d0/d3c/d5d/l77 79471 1 2024-04-23T10:17:55.742 INFO:tasks.workunit.client.0.smithi026.stdout:5/447: stat d0/f2a 0 2024-04-23T10:17:55.742 INFO:tasks.workunit.client.0.smithi026.stdout:3/514: unlink d0/d1e/d30/d43/d6c/d79/c6b 0 2024-04-23T10:17:55.742 INFO:tasks.workunit.client.0.smithi026.stdout:0/689: dwrite d7/d8/d2d/d60/ff2 [0,4194304] 0 2024-04-23T10:17:55.744 INFO:tasks.workunit.client.0.smithi026.stdout:2/520: dwrite d3/d19/d31/f66 [0,4194304] 0 2024-04-23T10:17:55.744 INFO:tasks.workunit.client.0.smithi026.stdout:4/389: write d4/f5 [3326497,24978] 0 2024-04-23T10:17:55.744 INFO:tasks.workunit.client.0.smithi026.stdout:6/652: dwrite d6/d13/fa0 [0,4194304] 0 2024-04-23T10:17:55.747 INFO:tasks.workunit.client.0.smithi026.stdout:0/690: chown d7/d8/d1e/d1d/d2f/d6c/d7f 1431453330 1 2024-04-23T10:17:55.748 INFO:tasks.workunit.client.0.smithi026.stdout:3/515: chown d0/d51/fae 660 1 2024-04-23T10:17:55.752 INFO:tasks.workunit.client.0.smithi026.stdout:4/390: unlink d4/d5b/d7b/c45 0 2024-04-23T10:17:55.753 INFO:tasks.workunit.client.0.smithi026.stdout:5/448: dread d0/d3c/d5d/f14 [4194304,4194304] 0 2024-04-23T10:17:55.755 INFO:tasks.workunit.client.0.smithi026.stdout:3/516: mkdir d0/d1e/d30/d43/db4 0 2024-04-23T10:17:55.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/691: mkdir d7/da1/dfd 0 2024-04-23T10:17:55.757 INFO:tasks.workunit.client.0.smithi026.stdout:5/449: mknod d0/d68/c8e 0 2024-04-23T10:17:55.760 INFO:tasks.workunit.client.0.smithi026.stdout:3/517: chown d0/d1e/d30/d43/f7e 174 1 2024-04-23T10:17:55.762 INFO:tasks.workunit.client.0.smithi026.stdout:4/391: creat d4/d7/f84 x:0 0 0 2024-04-23T10:17:55.763 INFO:tasks.workunit.client.0.smithi026.stdout:0/692: mkdir d7/d8/d1e/dd3/de7/dfe 0 2024-04-23T10:17:55.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/518: write d0/d1e/d30/d43/d6c/d79/f62 [4397778,66184] 0 2024-04-23T10:17:55.764 INFO:tasks.workunit.client.0.smithi026.stdout:4/392: chown d4/d7/d51/f56 2880950 1 2024-04-23T10:17:55.765 INFO:tasks.workunit.client.0.smithi026.stdout:5/450: dread d0/f42 [0,4194304] 0 2024-04-23T10:17:55.767 INFO:tasks.workunit.client.0.smithi026.stdout:0/693: dread - d7/d8/d1e/d2a/d6a/fb3 zero size 2024-04-23T10:17:55.767 INFO:tasks.workunit.client.0.smithi026.stdout:3/519: dread d0/d1e/f91 [0,4194304] 0 2024-04-23T10:17:55.768 INFO:tasks.workunit.client.0.smithi026.stdout:5/451: unlink d0/d12/f1b 0 2024-04-23T10:17:55.771 INFO:tasks.workunit.client.0.smithi026.stdout:3/520: fsync d0/d1e/d23/d87/f8d 0 2024-04-23T10:17:55.774 INFO:tasks.workunit.client.0.smithi026.stdout:2/521: rename d3/d19/d21/d23/d3a/d3c/f59 to d3/d19/d4d/fb6 0 2024-04-23T10:17:55.775 INFO:tasks.workunit.client.0.smithi026.stdout:4/393: dwrite d4/d14/f40 [0,4194304] 0 2024-04-23T10:17:55.776 INFO:tasks.workunit.client.0.smithi026.stdout:2/522: write d3/f84 [251487,31955] 0 2024-04-23T10:17:55.776 INFO:tasks.workunit.client.0.smithi026.stdout:3/521: rmdir d0/d1e 39 2024-04-23T10:17:55.777 INFO:tasks.workunit.client.0.smithi026.stdout:8/660: write d5/d56/d47/f53 [525589,16714] 0 2024-04-23T10:17:55.781 INFO:tasks.workunit.client.0.smithi026.stdout:2/523: rmdir d3/d35/d4c 39 2024-04-23T10:17:55.782 INFO:tasks.workunit.client.0.smithi026.stdout:2/524: fdatasync d3/dd/f30 0 2024-04-23T10:17:55.784 INFO:tasks.workunit.client.0.smithi026.stdout:4/394: creat d4/d5b/d7b/d36/d38/f85 x:0 0 0 2024-04-23T10:17:55.784 INFO:tasks.workunit.client.0.smithi026.stdout:8/661: rename d5/d9/d22/d65/d78/d3e/da1 to d5/d56/d33/ddc/de1 0 2024-04-23T10:17:55.790 INFO:tasks.workunit.client.0.smithi026.stdout:4/395: mkdir d4/d5b/d7b/d86 0 2024-04-23T10:17:55.791 INFO:tasks.workunit.client.0.smithi026.stdout:8/662: read d5/f28 [1542348,29582] 0 2024-04-23T10:17:55.792 INFO:tasks.workunit.client.0.smithi026.stdout:3/522: dread d0/d1e/d30/d43/df/d63/f65 [0,4194304] 0 2024-04-23T10:17:55.793 INFO:tasks.workunit.client.0.smithi026.stdout:9/702: dread d13/d1b/f33 [4194304,4194304] 0 2024-04-23T10:17:55.793 INFO:tasks.workunit.client.0.smithi026.stdout:5/452: dread d0/d3c/d5d/d3a/f7f [4194304,4194304] 0 2024-04-23T10:17:55.797 INFO:tasks.workunit.client.0.smithi026.stdout:9/703: mkdir d13/d3e/dd7 0 2024-04-23T10:17:55.797 INFO:tasks.workunit.client.0.smithi026.stdout:9/704: stat d13 0 2024-04-23T10:17:55.798 INFO:tasks.workunit.client.0.smithi026.stdout:3/523: creat d0/d1e/d30/d43/df/d72/d8c/fb5 x:0 0 0 2024-04-23T10:17:55.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/705: fsync d13/d3e/f80 0 2024-04-23T10:17:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:6/653: dread d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:55.799 INFO:tasks.workunit.client.0.smithi026.stdout:4/396: dread d4/d7/f13 [4194304,4194304] 0 2024-04-23T10:17:55.800 INFO:tasks.workunit.client.0.smithi026.stdout:5/453: mkdir d0/d3c/d84/d89/d8d/d8f 0 2024-04-23T10:17:55.801 INFO:tasks.workunit.client.0.smithi026.stdout:3/524: dread - d0/d1e/d30/d43/df/d17/fa1 zero size 2024-04-23T10:17:55.801 INFO:tasks.workunit.client.0.smithi026.stdout:5/454: stat d0/l64 0 2024-04-23T10:17:55.802 INFO:tasks.workunit.client.0.smithi026.stdout:6/654: unlink d6/d21/d58/d8d/l6b 0 2024-04-23T10:17:55.802 INFO:tasks.workunit.client.0.smithi026.stdout:9/706: creat d13/d1b/d26/d88/dcf/fd8 x:0 0 0 2024-04-23T10:17:55.803 INFO:tasks.workunit.client.0.smithi026.stdout:3/525: write d0/d1e/d30/d43/d29/fb1 [63957,122153] 0 2024-04-23T10:17:55.807 INFO:tasks.workunit.client.0.smithi026.stdout:5/455: creat d0/f90 x:0 0 0 2024-04-23T10:17:55.807 INFO:tasks.workunit.client.0.smithi026.stdout:9/707: mkdir d13/d1b/d26/d88/db5/dd9 0 2024-04-23T10:17:55.808 INFO:tasks.workunit.client.0.smithi026.stdout:3/526: rmdir d0/d1e/d30/d43/df/d17 39 2024-04-23T10:17:55.809 INFO:tasks.workunit.client.0.smithi026.stdout:4/397: dread d4/d5b/d7b/f37 [4194304,4194304] 0 2024-04-23T10:17:55.809 INFO:tasks.workunit.client.0.smithi026.stdout:9/708: rmdir d13/d3b/d68 39 2024-04-23T10:17:55.810 INFO:tasks.workunit.client.0.smithi026.stdout:6/655: link d6/d21/d2f/d31/d52/l65 d6/lbe 0 2024-04-23T10:17:55.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/527: fdatasync d0/d1e/d30/d43/df/d63/f95 0 2024-04-23T10:17:55.811 INFO:tasks.workunit.client.0.smithi026.stdout:5/456: dread d0/d3c/d5d/d3a/f7f [4194304,4194304] 0 2024-04-23T10:17:55.811 INFO:tasks.workunit.client.0.smithi026.stdout:9/709: fdatasync d13/d1b/fa9 0 2024-04-23T10:17:55.812 INFO:tasks.workunit.client.0.smithi026.stdout:6/656: readlink d6/l2a 0 2024-04-23T10:17:55.813 INFO:tasks.workunit.client.0.smithi026.stdout:3/528: rmdir d0/d1e/d23/d87 39 2024-04-23T10:17:55.814 INFO:tasks.workunit.client.0.smithi026.stdout:5/457: rename d0/d12/d49 to d0/d68/d91 0 2024-04-23T10:17:55.815 INFO:tasks.workunit.client.0.smithi026.stdout:5/458: stat d0/d12/f28 0 2024-04-23T10:17:55.815 INFO:tasks.workunit.client.0.smithi026.stdout:9/710: creat d13/d1b/d26/d88/db5/fda x:0 0 0 2024-04-23T10:17:55.816 INFO:tasks.workunit.client.0.smithi026.stdout:6/657: mknod d6/db8/cbf 0 2024-04-23T10:17:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:9/711: write d13/d1b/d98/fd0 [69077,22931] 0 2024-04-23T10:17:55.817 INFO:tasks.workunit.client.0.smithi026.stdout:5/459: mknod d0/d3c/d84/d89/c92 0 2024-04-23T10:17:55.818 INFO:tasks.workunit.client.0.smithi026.stdout:3/529: fsync d0/d1e/d30/d43/f38 0 2024-04-23T10:17:55.818 INFO:tasks.workunit.client.0.smithi026.stdout:9/712: chown d13/d1b/d26 29953 1 2024-04-23T10:17:55.820 INFO:tasks.workunit.client.0.smithi026.stdout:5/460: unlink d0/c69 0 2024-04-23T10:17:55.825 INFO:tasks.workunit.client.0.smithi026.stdout:5/461: mknod d0/d6f/c93 0 2024-04-23T10:17:55.826 INFO:tasks.workunit.client.0.smithi026.stdout:9/713: creat d13/d3b/d68/dd6/d45/d6d/fdb x:0 0 0 2024-04-23T10:17:55.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/658: link d6/d13/l28 d6/d21/lc0 0 2024-04-23T10:17:55.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/714: dread - d13/d1b/fa9 zero size 2024-04-23T10:17:55.829 INFO:tasks.workunit.client.0.smithi026.stdout:6/659: write d6/d21/d2f/d31/faa [456091,124915] 0 2024-04-23T10:17:55.831 INFO:tasks.workunit.client.0.smithi026.stdout:3/530: dread d0/d1e/d30/d43/f38 [0,4194304] 0 2024-04-23T10:17:55.834 INFO:tasks.workunit.client.0.smithi026.stdout:4/398: dread d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:55.835 INFO:tasks.workunit.client.0.smithi026.stdout:3/531: write d0/f3c [100404,9982] 0 2024-04-23T10:17:55.836 INFO:tasks.workunit.client.0.smithi026.stdout:6/660: creat d6/d21/d2f/fc1 x:0 0 0 2024-04-23T10:17:55.838 INFO:tasks.workunit.client.0.smithi026.stdout:4/399: mknod d4/d14/d3d/c87 0 2024-04-23T10:17:55.839 INFO:tasks.workunit.client.0.smithi026.stdout:5/462: dwrite d0/d3c/f3d [0,4194304] 0 2024-04-23T10:17:55.841 INFO:tasks.workunit.client.0.smithi026.stdout:6/661: read d6/d13/f4d [465001,64581] 0 2024-04-23T10:17:55.843 INFO:tasks.workunit.client.0.smithi026.stdout:4/400: symlink d4/d5b/d7b/d36/d38/d83/l88 0 2024-04-23T10:17:55.844 INFO:tasks.workunit.client.0.smithi026.stdout:4/401: readlink d4/d7/d61/d74/l5c 0 2024-04-23T10:17:55.844 INFO:tasks.workunit.client.0.smithi026.stdout:3/532: truncate d0/d1e/d30/d43/f38 1725243 0 2024-04-23T10:17:55.845 INFO:tasks.workunit.client.0.smithi026.stdout:5/463: creat d0/d3c/d5d/f94 x:0 0 0 2024-04-23T10:17:55.847 INFO:tasks.workunit.client.0.smithi026.stdout:5/464: readlink d0/d6f/l81 0 2024-04-23T10:17:55.848 INFO:tasks.workunit.client.0.smithi026.stdout:5/465: stat d0/d12/c7b 0 2024-04-23T10:17:55.848 INFO:tasks.workunit.client.0.smithi026.stdout:3/533: mkdir d0/d1e/d23/d87/db6 0 2024-04-23T10:17:55.853 INFO:tasks.workunit.client.0.smithi026.stdout:6/662: dwrite d6/d13/d15/f2e [0,4194304] 0 2024-04-23T10:17:55.859 INFO:tasks.workunit.client.0.smithi026.stdout:4/402: read d4/d5b/d7b/f37 [1429875,28496] 0 2024-04-23T10:17:55.860 INFO:tasks.workunit.client.0.smithi026.stdout:5/466: dwrite d0/d3c/d5d/d3a/f7f [0,4194304] 0 2024-04-23T10:17:55.862 INFO:tasks.workunit.client.0.smithi026.stdout:6/663: dread d6/d21/d2f/d31/faa [0,4194304] 0 2024-04-23T10:17:55.862 INFO:tasks.workunit.client.0.smithi026.stdout:4/403: fdatasync d4/d22/f29 0 2024-04-23T10:17:55.863 INFO:tasks.workunit.client.0.smithi026.stdout:5/467: fsync d0/d3c/d5d/f19 0 2024-04-23T10:17:55.865 INFO:tasks.workunit.client.0.smithi026.stdout:5/468: chown d0/f42 121 1 2024-04-23T10:17:55.865 INFO:tasks.workunit.client.0.smithi026.stdout:3/534: dwrite d0/d1e/d30/d43/d6c/d79/f62 [4194304,4194304] 0 2024-04-23T10:17:55.866 INFO:tasks.workunit.client.0.smithi026.stdout:5/469: fsync d0/d12/f59 0 2024-04-23T10:17:55.867 INFO:tasks.workunit.client.0.smithi026.stdout:4/404: read d4/d5b/d7b/d36/f55 [2570264,121495] 0 2024-04-23T10:17:55.867 INFO:tasks.workunit.client.0.smithi026.stdout:6/664: mknod d6/cc2 0 2024-04-23T10:17:55.867 INFO:tasks.workunit.client.0.smithi026.stdout:4/405: chown d4/d14 340974 1 2024-04-23T10:17:55.873 INFO:tasks.workunit.client.0.smithi026.stdout:3/535: chown d0/d1e/d30/d43/df/d17/c49 20458920 1 2024-04-23T10:17:55.873 INFO:tasks.workunit.client.0.smithi026.stdout:1/499: sync 2024-04-23T10:17:55.873 INFO:tasks.workunit.client.0.smithi026.stdout:5/470: getdents d0/d3c/d84/d89/d8d 0 2024-04-23T10:17:55.874 INFO:tasks.workunit.client.0.smithi026.stdout:1/500: write dd/d1a/d20/fa8 [995152,100346] 0 2024-04-23T10:17:55.876 INFO:tasks.workunit.client.0.smithi026.stdout:5/471: chown d0/d12/l36 146792 1 2024-04-23T10:17:55.881 INFO:tasks.workunit.client.0.smithi026.stdout:1/501: mknod dd/d1a/d23/d3f/caf 0 2024-04-23T10:17:55.891 INFO:tasks.workunit.client.0.smithi026.stdout:3/536: getdents d0/d1e/d23/d52 0 2024-04-23T10:17:55.896 INFO:tasks.workunit.client.0.smithi026.stdout:5/472: dwrite d0/d3c/f65 [0,4194304] 0 2024-04-23T10:17:55.898 INFO:tasks.workunit.client.0.smithi026.stdout:1/502: dwrite dd/f3b [0,4194304] 0 2024-04-23T10:17:55.898 INFO:tasks.workunit.client.0.smithi026.stdout:5/473: write d0/f70 [311734,116334] 0 2024-04-23T10:17:55.899 INFO:tasks.workunit.client.0.smithi026.stdout:3/537: rename d0/d1e/d23/d9e to d0/d1e/d30/d43/d29/d39/db7 0 2024-04-23T10:17:55.901 INFO:tasks.workunit.client.0.smithi026.stdout:4/406: dread d4/d5b/f60 [0,4194304] 0 2024-04-23T10:17:55.903 INFO:tasks.workunit.client.0.smithi026.stdout:5/474: symlink d0/d6f/l95 0 2024-04-23T10:17:55.905 INFO:tasks.workunit.client.0.smithi026.stdout:1/503: rename dd/d1a/d23/l8c to dd/d15/d7d/d98/lb0 0 2024-04-23T10:17:55.906 INFO:tasks.workunit.client.0.smithi026.stdout:4/407: symlink d4/d22/d4e/d57/d81/l89 0 2024-04-23T10:17:55.906 INFO:tasks.workunit.client.0.smithi026.stdout:1/504: readlink dd/d1a/d20/d25/d35/d74/l88 0 2024-04-23T10:17:55.907 INFO:tasks.workunit.client.0.smithi026.stdout:4/408: chown d4/d1b/f67 4 1 2024-04-23T10:17:55.911 INFO:tasks.workunit.client.0.smithi026.stdout:3/538: getdents d0/d1e/d30/d43/d6c/d79/d73 0 2024-04-23T10:17:55.913 INFO:tasks.workunit.client.0.smithi026.stdout:1/505: mknod dd/d1a/d23/d69/d9d/cb1 0 2024-04-23T10:17:55.914 INFO:tasks.workunit.client.0.smithi026.stdout:4/409: mknod d4/d7/d51/d6c/c8a 0 2024-04-23T10:17:55.915 INFO:tasks.workunit.client.0.smithi026.stdout:4/410: chown d4/d5b/f75 13775553 1 2024-04-23T10:17:55.916 INFO:tasks.workunit.client.0.smithi026.stdout:1/506: mknod dd/d1a/d23/d3f/cb2 0 2024-04-23T10:17:55.917 INFO:tasks.workunit.client.0.smithi026.stdout:5/475: dwrite d0/d3c/f88 [0,4194304] 0 2024-04-23T10:17:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:4/411: chown d4/d22/d2e/f32 62 1 2024-04-23T10:17:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/476: fdatasync d0/d3c/f51 0 2024-04-23T10:17:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:1/507: creat dd/d1a/d20/d25/fb3 x:0 0 0 2024-04-23T10:17:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/477: read - d0/d3c/d84/f8c zero size 2024-04-23T10:17:55.926 INFO:tasks.workunit.client.0.smithi026.stdout:3/539: dread d0/d1e/d30/d43/d29/f3f [0,4194304] 0 2024-04-23T10:17:55.930 INFO:tasks.workunit.client.0.smithi026.stdout:5/478: unlink d0/d68/d91/f83 0 2024-04-23T10:17:55.932 INFO:tasks.workunit.client.0.smithi026.stdout:5/479: truncate d0/d3c/d84/f8c 60208 0 2024-04-23T10:17:55.933 INFO:tasks.workunit.client.0.smithi026.stdout:1/508: truncate dd/f90 631159 0 2024-04-23T10:17:55.933 INFO:tasks.workunit.client.0.smithi026.stdout:4/412: truncate d4/d14/f40 98506 0 2024-04-23T10:17:55.934 INFO:tasks.workunit.client.0.smithi026.stdout:1/509: write dd/d15/f81 [143180,125366] 0 2024-04-23T10:17:55.935 INFO:tasks.workunit.client.0.smithi026.stdout:1/510: chown dd/f3b 256841990 1 2024-04-23T10:17:55.937 INFO:tasks.workunit.client.0.smithi026.stdout:4/413: rmdir d4/d14/d3d/d73 39 2024-04-23T10:17:55.937 INFO:tasks.workunit.client.0.smithi026.stdout:5/480: creat d0/d3c/d84/d89/d8d/d8f/f96 x:0 0 0 2024-04-23T10:17:55.938 INFO:tasks.workunit.client.0.smithi026.stdout:1/511: creat dd/d1a/d20/d25/d35/d74/fb4 x:0 0 0 2024-04-23T10:17:55.940 INFO:tasks.workunit.client.0.smithi026.stdout:5/481: write d0/d3c/d57/f5a [4780753,104939] 0 2024-04-23T10:17:55.941 INFO:tasks.workunit.client.0.smithi026.stdout:4/414: getdents d4 0 2024-04-23T10:17:55.942 INFO:tasks.workunit.client.0.smithi026.stdout:5/482: truncate d0/d12/f3f 4203811 0 2024-04-23T10:17:55.942 INFO:tasks.workunit.client.0.smithi026.stdout:4/415: dread - d4/f7e zero size 2024-04-23T10:17:55.947 INFO:tasks.workunit.client.0.smithi026.stdout:5/483: creat d0/d3c/f97 x:0 0 0 2024-04-23T10:17:55.949 INFO:tasks.workunit.client.0.smithi026.stdout:1/512: dwrite dd/d1a/f55 [0,4194304] 0 2024-04-23T10:17:55.949 INFO:tasks.workunit.client.0.smithi026.stdout:5/484: creat d0/d12/f98 x:0 0 0 2024-04-23T10:17:55.954 INFO:tasks.workunit.client.0.smithi026.stdout:5/485: write d0/d3c/d57/f5a [1841223,60579] 0 2024-04-23T10:17:55.958 INFO:tasks.workunit.client.0.smithi026.stdout:5/486: stat d0/d3c/d5d/f19 0 2024-04-23T10:17:55.960 INFO:tasks.workunit.client.0.smithi026.stdout:1/513: truncate dd/f2b 102125 0 2024-04-23T10:17:55.963 INFO:tasks.workunit.client.0.smithi026.stdout:1/514: rmdir dd/d1a/d20/d25 39 2024-04-23T10:17:55.966 INFO:tasks.workunit.client.0.smithi026.stdout:1/515: fsync dd/d1a/d6a/d7c/f8a 0 2024-04-23T10:17:55.970 INFO:tasks.workunit.client.0.smithi026.stdout:1/516: chown dd/d1a/d20/d25 59215 1 2024-04-23T10:17:55.971 INFO:tasks.workunit.client.0.smithi026.stdout:5/487: dwrite d0/d12/f1f [0,4194304] 0 2024-04-23T10:17:55.974 INFO:tasks.workunit.client.0.smithi026.stdout:1/517: creat dd/d15/fb5 x:0 0 0 2024-04-23T10:17:55.975 INFO:tasks.workunit.client.0.smithi026.stdout:6/665: dread d6/d21/d58/d8d/d64/f83 [0,4194304] 0 2024-04-23T10:17:55.977 INFO:tasks.workunit.client.0.smithi026.stdout:1/518: symlink dd/d1a/d20/d25/d35/d73/lb6 0 2024-04-23T10:17:55.978 INFO:tasks.workunit.client.0.smithi026.stdout:6/666: write d6/d21/d2f/d31/f6c [3211221,123424] 0 2024-04-23T10:17:55.979 INFO:tasks.workunit.client.0.smithi026.stdout:5/488: getdents d0 0 2024-04-23T10:17:55.980 INFO:tasks.workunit.client.0.smithi026.stdout:1/519: creat dd/d15/d7d/da1/fb7 x:0 0 0 2024-04-23T10:17:55.981 INFO:tasks.workunit.client.0.smithi026.stdout:6/667: symlink d6/db8/lc3 0 2024-04-23T10:17:55.981 INFO:tasks.workunit.client.0.smithi026.stdout:1/520: write dd/d15/d7d/da1/fa6 [722281,19060] 0 2024-04-23T10:17:55.984 INFO:tasks.workunit.client.0.smithi026.stdout:6/668: dread - d6/d21/d2f/d31/d52/d82/fba zero size 2024-04-23T10:17:55.984 INFO:tasks.workunit.client.0.smithi026.stdout:1/521: write dd/f3b [3263523,128840] 0 2024-04-23T10:17:55.985 INFO:tasks.workunit.client.0.smithi026.stdout:5/489: creat d0/d3c/d57/f99 x:0 0 0 2024-04-23T10:17:55.987 INFO:tasks.workunit.client.0.smithi026.stdout:1/522: write dd/d1a/d20/d25/f38 [4903994,4351] 0 2024-04-23T10:17:55.987 INFO:tasks.workunit.client.0.smithi026.stdout:6/669: unlink d6/d21/d58/d8d/f8a 0 2024-04-23T10:17:55.988 INFO:tasks.workunit.client.0.smithi026.stdout:5/490: mkdir d0/d68/d91/d9a 0 2024-04-23T10:17:55.989 INFO:tasks.workunit.client.0.smithi026.stdout:6/670: stat d6/d21/d2f/d32/d53/c98 0 2024-04-23T10:17:55.989 INFO:tasks.workunit.client.0.smithi026.stdout:5/491: stat d0/d12/l36 0 2024-04-23T10:17:55.991 INFO:tasks.workunit.client.0.smithi026.stdout:5/492: write d0/d3c/d84/f87 [1975599,87332] 0 2024-04-23T10:17:55.992 INFO:tasks.workunit.client.0.smithi026.stdout:6/671: unlink d6/d13/d15/f4c 0 2024-04-23T10:17:55.993 INFO:tasks.workunit.client.0.smithi026.stdout:6/672: chown d6/d21/d2f/d37/d4f/c7e 46 1 2024-04-23T10:17:55.994 INFO:tasks.workunit.client.0.smithi026.stdout:1/523: mknod dd/d1a/d20/d25/cb8 0 2024-04-23T10:17:55.996 INFO:tasks.workunit.client.0.smithi026.stdout:5/493: unlink d0/d3c/d84/d89/f8a 0 2024-04-23T10:17:55.997 INFO:tasks.workunit.client.0.smithi026.stdout:6/673: readlink d6/lbe 0 2024-04-23T10:17:56.000 INFO:tasks.workunit.client.0.smithi026.stdout:1/524: rename dd/d1a/d23/c59 to dd/d1a/d23/d3f/cb9 0 2024-04-23T10:17:56.002 INFO:tasks.workunit.client.0.smithi026.stdout:1/525: stat dd/d15/f4f 0 2024-04-23T10:17:56.007 INFO:tasks.workunit.client.0.smithi026.stdout:5/494: dwrite d0/d12/f59 [0,4194304] 0 2024-04-23T10:17:56.007 INFO:tasks.workunit.client.0.smithi026.stdout:1/526: rename dd/f2c to dd/d1a/d23/d3f/d9a/d9e/fba 0 2024-04-23T10:17:56.008 INFO:tasks.workunit.client.0.smithi026.stdout:5/495: chown d0/f16 1 1 2024-04-23T10:17:56.008 INFO:tasks.workunit.client.0.smithi026.stdout:6/674: dwrite d6/d21/d58/fad [0,4194304] 0 2024-04-23T10:17:56.011 INFO:tasks.workunit.client.0.smithi026.stdout:6/675: symlink d6/d21/d2f/d37/d9a/lc4 0 2024-04-23T10:17:56.013 INFO:tasks.workunit.client.0.smithi026.stdout:6/676: creat d6/d21/d2f/d37/d68/fc5 x:0 0 0 2024-04-23T10:17:56.015 INFO:tasks.workunit.client.0.smithi026.stdout:6/677: write d6/f10 [791454,79567] 0 2024-04-23T10:17:56.024 INFO:tasks.workunit.client.0.smithi026.stdout:6/678: rename d6/d13/c73 to d6/d21/cc6 0 2024-04-23T10:17:56.025 INFO:tasks.workunit.client.0.smithi026.stdout:6/679: chown d6/lbe 40640412 1 2024-04-23T10:17:56.026 INFO:tasks.workunit.client.0.smithi026.stdout:6/680: chown d6/d21/c5f 76074 1 2024-04-23T10:17:56.028 INFO:tasks.workunit.client.0.smithi026.stdout:6/681: mknod d6/d21/d2f/d37/cc7 0 2024-04-23T10:17:56.031 INFO:tasks.workunit.client.0.smithi026.stdout:6/682: rename d6/fc to d6/d33/fc8 0 2024-04-23T10:17:56.032 INFO:tasks.workunit.client.0.smithi026.stdout:6/683: write d6/d21/d58/f78 [2734032,7647] 0 2024-04-23T10:17:56.036 INFO:tasks.workunit.client.0.smithi026.stdout:6/684: mknod d6/d21/d2f/d37/d68/da8/cc9 0 2024-04-23T10:17:56.037 INFO:tasks.workunit.client.0.smithi026.stdout:6/685: read d6/d21/d2f/d31/faa [100397,15222] 0 2024-04-23T10:17:56.046 INFO:tasks.workunit.client.0.smithi026.stdout:7/503: sync 2024-04-23T10:17:56.046 INFO:tasks.workunit.client.0.smithi026.stdout:6/686: dread d6/d21/d2f/d32/f55 [0,4194304] 0 2024-04-23T10:17:56.048 INFO:tasks.workunit.client.0.smithi026.stdout:6/687: write d6/d21/d58/d8d/d64/f83 [2648255,69244] 0 2024-04-23T10:17:56.049 INFO:tasks.workunit.client.0.smithi026.stdout:7/504: creat dd/d2c/d48/d7e/f93 x:0 0 0 2024-04-23T10:17:56.050 INFO:tasks.workunit.client.0.smithi026.stdout:7/505: write dd/d3f/d47/d4c/d60/d75/f7a [143885,51698] 0 2024-04-23T10:17:56.051 INFO:tasks.workunit.client.0.smithi026.stdout:6/688: unlink d6/d13/d15/f2e 0 2024-04-23T10:17:56.052 INFO:tasks.workunit.client.0.smithi026.stdout:7/506: mknod dd/d6c/d72/c94 0 2024-04-23T10:17:56.052 INFO:tasks.workunit.client.0.smithi026.stdout:6/689: dread - d6/d21/d2f/d37/d68/fc5 zero size 2024-04-23T10:17:56.114 INFO:tasks.workunit.client.0.smithi026.stdout:4/416: dread d4/d7/f1d [0,4194304] 0 2024-04-23T10:17:56.115 INFO:tasks.workunit.client.0.smithi026.stdout:7/507: dread dd/d3f/d47/d4c/d60/d75/f7c [0,4194304] 0 2024-04-23T10:17:56.119 INFO:tasks.workunit.client.0.smithi026.stdout:7/508: mknod dd/d3f/c95 0 2024-04-23T10:17:56.121 INFO:tasks.workunit.client.0.smithi026.stdout:4/417: creat d4/d7/d61/f8b x:0 0 0 2024-04-23T10:17:56.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/509: truncate dd/d3f/f73 991207 0 2024-04-23T10:17:56.123 INFO:tasks.workunit.client.0.smithi026.stdout:4/418: rmdir d4/d5b 39 2024-04-23T10:17:56.124 INFO:tasks.workunit.client.0.smithi026.stdout:7/510: fsync dd/d44/f23 0 2024-04-23T10:17:56.136 INFO:tasks.workunit.client.0.smithi026.stdout:7/511: symlink dd/d2c/d48/d8d/l96 0 2024-04-23T10:17:56.138 INFO:tasks.workunit.client.0.smithi026.stdout:7/512: write dd/d2c/d48/f59 [2072926,61266] 0 2024-04-23T10:17:56.140 INFO:tasks.workunit.client.0.smithi026.stdout:7/513: write dd/d44/d38/f3d [1674507,37762] 0 2024-04-23T10:17:56.141 INFO:tasks.workunit.client.0.smithi026.stdout:4/419: unlink d4/d7/f77 0 2024-04-23T10:17:56.162 INFO:tasks.workunit.client.0.smithi026.stdout:6/690: truncate d6/d21/d2f/d32/d53/f62 3196515 0 2024-04-23T10:17:56.163 INFO:tasks.workunit.client.0.smithi026.stdout:4/420: write d4/d5b/f75 [1658149,102072] 0 2024-04-23T10:17:56.184 INFO:tasks.workunit.client.0.smithi026.stdout:6/691: dwrite d6/d21/d58/f78 [0,4194304] 0 2024-04-23T10:17:56.187 INFO:tasks.workunit.client.0.smithi026.stdout:4/421: dwrite d4/d7/d61/f62 [0,4194304] 0 2024-04-23T10:17:56.211 INFO:tasks.workunit.client.0.smithi026.stdout:6/692: mkdir d6/d21/d2f/d32/d53/dca 0 2024-04-23T10:17:56.212 INFO:tasks.workunit.client.0.smithi026.stdout:6/693: read - d6/d21/d58/f9b zero size 2024-04-23T10:17:56.230 INFO:tasks.workunit.client.0.smithi026.stdout:6/694: creat d6/d21/d2f/d31/fcb x:0 0 0 2024-04-23T10:17:56.233 INFO:tasks.workunit.client.0.smithi026.stdout:4/422: dwrite d4/d7/f3e [0,4194304] 0 2024-04-23T10:17:56.237 INFO:tasks.workunit.client.0.smithi026.stdout:6/695: creat d6/d21/d2f/d37/d68/da8/fcc x:0 0 0 2024-04-23T10:17:56.239 INFO:tasks.workunit.client.0.smithi026.stdout:4/423: read d4/d7/f1f [2437230,124340] 0 2024-04-23T10:17:56.241 INFO:tasks.workunit.client.0.smithi026.stdout:4/424: fdatasync d4/d5b/d7b/f6b 0 2024-04-23T10:17:56.247 INFO:tasks.workunit.client.0.smithi026.stdout:0/694: sync 2024-04-23T10:17:56.252 INFO:tasks.workunit.client.0.smithi026.stdout:4/425: write d4/d7/f3c [270363,2466] 0 2024-04-23T10:17:56.259 INFO:tasks.workunit.client.0.smithi026.stdout:6/696: link d6/d13/l28 d6/d33/lcd 0 2024-04-23T10:17:56.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/426: truncate d4/d14/f1c 2001766 0 2024-04-23T10:17:56.262 INFO:tasks.workunit.client.0.smithi026.stdout:6/697: chown d6/d13/d15/c48 40042 1 2024-04-23T10:17:56.265 INFO:tasks.workunit.client.0.smithi026.stdout:0/695: creat d7/dc2/dcc/fff x:0 0 0 2024-04-23T10:17:56.271 INFO:tasks.workunit.client.0.smithi026.stdout:6/698: dread d6/d21/d58/d8d/d64/f83 [0,4194304] 0 2024-04-23T10:17:56.273 INFO:tasks.workunit.client.0.smithi026.stdout:6/699: fsync d6/d21/d58/fad 0 2024-04-23T10:17:56.274 INFO:tasks.workunit.client.0.smithi026.stdout:4/427: creat d4/d14/d3d/f8c x:0 0 0 2024-04-23T10:17:56.277 INFO:tasks.workunit.client.0.smithi026.stdout:6/700: chown d6/d21/d58/d8d/lbc 517 1 2024-04-23T10:17:56.281 INFO:tasks.workunit.client.0.smithi026.stdout:4/428: mknod d4/d7/d51/d6c/c8d 0 2024-04-23T10:17:56.282 INFO:tasks.workunit.client.0.smithi026.stdout:4/429: stat d4 0 2024-04-23T10:17:56.285 INFO:tasks.workunit.client.0.smithi026.stdout:4/430: mknod d4/d7/d51/d6c/d6f/c8e 0 2024-04-23T10:17:56.290 INFO:tasks.workunit.client.0.smithi026.stdout:6/701: rename d6/d21/d58/d8d/f5b to d6/d21/d2f/d32/fce 0 2024-04-23T10:17:56.301 INFO:tasks.workunit.client.0.smithi026.stdout:6/702: truncate d6/d21/d58/f78 2032525 0 2024-04-23T10:17:56.303 INFO:tasks.workunit.client.0.smithi026.stdout:4/431: getdents d4/d5b 0 2024-04-23T10:17:56.307 INFO:tasks.workunit.client.0.smithi026.stdout:4/432: readlink d4/d22/d4e/l5a 0 2024-04-23T10:17:56.311 INFO:tasks.workunit.client.0.smithi026.stdout:6/703: mkdir d6/d13/dcf 0 2024-04-23T10:17:56.314 INFO:tasks.workunit.client.0.smithi026.stdout:4/433: write d4/d5b/d7b/f41 [502920,5842] 0 2024-04-23T10:17:56.318 INFO:tasks.workunit.client.0.smithi026.stdout:6/704: fdatasync d6/d21/d2f/d37/f3f 0 2024-04-23T10:17:56.321 INFO:tasks.workunit.client.0.smithi026.stdout:4/434: stat d4/f7e 0 2024-04-23T10:17:56.329 INFO:tasks.workunit.client.0.smithi026.stdout:4/435: rename d4/d7/f3c to d4/d5b/d7b/d86/f8f 0 2024-04-23T10:17:56.392 INFO:tasks.workunit.client.0.smithi026.stdout:2/525: sync 2024-04-23T10:17:56.396 INFO:tasks.workunit.client.0.smithi026.stdout:4/436: readlink d4/l18 0 2024-04-23T10:17:56.410 INFO:tasks.workunit.client.0.smithi026.stdout:2/526: dwrite d3/d19/d21/d23/d3a/d65/f86 [4194304,4194304] 0 2024-04-23T10:17:56.413 INFO:tasks.workunit.client.0.smithi026.stdout:4/437: rename d4/d14/d3d/d66 to d4/d5b/d7b/d36/d90 0 2024-04-23T10:17:56.451 INFO:tasks.workunit.client.0.smithi026.stdout:2/527: creat d3/d19/d21/d23/d3a/d3c/d5d/fb7 x:0 0 0 2024-04-23T10:17:56.467 INFO:tasks.workunit.client.0.smithi026.stdout:2/528: dwrite d3/d19/d21/d23/d3a/d3c/f63 [0,4194304] 0 2024-04-23T10:17:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:8/663: sync 2024-04-23T10:17:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:9/715: sync 2024-04-23T10:17:56.490 INFO:tasks.workunit.client.0.smithi026.stdout:4/438: link d4/d22/d4e/d57/f72 d4/d7/d61/f91 0 2024-04-23T10:17:56.493 INFO:tasks.workunit.client.0.smithi026.stdout:4/439: chown d4/d14/d30/d52 0 1 2024-04-23T10:17:56.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/529: dwrite d3/d19/d21/d23/f94 [0,4194304] 0 2024-04-23T10:17:56.501 INFO:tasks.workunit.client.0.smithi026.stdout:8/664: dread d5/d56/d3f/f8d [0,4194304] 0 2024-04-23T10:17:56.509 INFO:tasks.workunit.client.0.smithi026.stdout:8/665: unlink d5/d56/d33/c67 0 2024-04-23T10:17:56.510 INFO:tasks.workunit.client.0.smithi026.stdout:4/440: dread d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:56.511 INFO:tasks.workunit.client.0.smithi026.stdout:9/716: getdents d13/d31 0 2024-04-23T10:17:56.517 INFO:tasks.workunit.client.0.smithi026.stdout:8/666: creat d5/fe2 x:0 0 0 2024-04-23T10:17:56.519 INFO:tasks.workunit.client.0.smithi026.stdout:2/530: rmdir d3/d19/d1d/da8 0 2024-04-23T10:17:56.522 INFO:tasks.workunit.client.0.smithi026.stdout:9/717: mknod d13/d3b/d68/dd6/d45/d3a/d6b/cdc 0 2024-04-23T10:17:56.525 INFO:tasks.workunit.client.0.smithi026.stdout:4/441: rename d4/d22/d4e/d57/d81 to d4/d14/d92 0 2024-04-23T10:17:56.527 INFO:tasks.workunit.client.0.smithi026.stdout:8/667: fsync d5/d56/f1c 0 2024-04-23T10:17:56.529 INFO:tasks.workunit.client.0.smithi026.stdout:2/531: dread d3/dd/f43 [0,4194304] 0 2024-04-23T10:17:56.540 INFO:tasks.workunit.client.0.smithi026.stdout:9/718: unlink d13/l23 0 2024-04-23T10:17:56.541 INFO:tasks.workunit.client.0.smithi026.stdout:9/719: readlink l1 0 2024-04-23T10:17:56.541 INFO:tasks.workunit.client.0.smithi026.stdout:4/442: dwrite d4/f7e [0,4194304] 0 2024-04-23T10:17:56.548 INFO:tasks.workunit.client.0.smithi026.stdout:8/668: rename d5/d56/d33/f44 to d5/d9/dac/fe3 0 2024-04-23T10:17:56.564 INFO:tasks.workunit.client.0.smithi026.stdout:8/669: creat d5/d56/d33/ddc/de1/fe4 x:0 0 0 2024-04-23T10:17:56.566 INFO:tasks.workunit.client.0.smithi026.stdout:2/532: mkdir d3/d19/d21/d23/da2/db8 0 2024-04-23T10:17:56.575 INFO:tasks.workunit.client.0.smithi026.stdout:3/540: sync 2024-04-23T10:17:56.575 INFO:tasks.workunit.client.0.smithi026.stdout:1/527: sync 2024-04-23T10:17:56.578 INFO:tasks.workunit.client.0.smithi026.stdout:1/528: readlink dd/d1a/d6a/d7c/l96 0 2024-04-23T10:17:56.582 INFO:tasks.workunit.client.0.smithi026.stdout:9/720: dwrite d13/f22 [0,4194304] 0 2024-04-23T10:17:56.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/670: creat d5/d56/d33/ddc/de1/fe5 x:0 0 0 2024-04-23T10:17:56.587 INFO:tasks.workunit.client.0.smithi026.stdout:4/443: rename d4/d1b/c33 to d4/d1b/c93 0 2024-04-23T10:17:56.589 INFO:tasks.workunit.client.0.smithi026.stdout:4/444: chown d4/d14/d92/l89 1852 1 2024-04-23T10:17:56.589 INFO:tasks.workunit.client.0.smithi026.stdout:3/541: dread d0/d1e/d30/d43/d29/f3f [0,4194304] 0 2024-04-23T10:17:56.591 INFO:tasks.workunit.client.0.smithi026.stdout:4/445: chown d4/d14/d92/l89 0 1 2024-04-23T10:17:56.593 INFO:tasks.workunit.client.0.smithi026.stdout:2/533: symlink d3/d19/d21/d23/d3a/d3c/d80/d96/lb9 0 2024-04-23T10:17:56.593 INFO:tasks.workunit.client.0.smithi026.stdout:8/671: rmdir d5/d56/d33/ddc 39 2024-04-23T10:17:56.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/446: mknod d4/d14/c94 0 2024-04-23T10:17:56.598 INFO:tasks.workunit.client.0.smithi026.stdout:3/542: creat d0/d4c/fb8 x:0 0 0 2024-04-23T10:17:56.603 INFO:tasks.workunit.client.0.smithi026.stdout:2/534: mknod d3/d19/d21/d23/d3a/d3c/d5d/da0/cba 0 2024-04-23T10:17:56.610 INFO:tasks.workunit.client.0.smithi026.stdout:9/721: dwrite d13/d3b/d68/dd6/d45/d6d/f71 [0,4194304] 0 2024-04-23T10:17:56.612 INFO:tasks.workunit.client.0.smithi026.stdout:3/543: dwrite d0/d1e/f8b [0,4194304] 0 2024-04-23T10:17:56.615 INFO:tasks.workunit.client.0.smithi026.stdout:2/535: creat d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fbb x:0 0 0 2024-04-23T10:17:56.616 INFO:tasks.workunit.client.0.smithi026.stdout:8/672: write d5/d9/d64/dc5/fce [724849,16247] 0 2024-04-23T10:17:56.616 INFO:tasks.workunit.client.0.smithi026.stdout:9/722: read - d13/d19/f8b zero size 2024-04-23T10:17:56.618 INFO:tasks.workunit.client.0.smithi026.stdout:4/447: truncate d4/d5b/f75 819399 0 2024-04-23T10:17:56.622 INFO:tasks.workunit.client.0.smithi026.stdout:2/536: symlink d3/d19/d21/d23/lbc 0 2024-04-23T10:17:56.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/696: sync 2024-04-23T10:17:56.628 INFO:tasks.workunit.client.0.smithi026.stdout:5/496: sync 2024-04-23T10:17:56.628 INFO:tasks.workunit.client.0.smithi026.stdout:7/514: sync 2024-04-23T10:17:56.628 INFO:tasks.workunit.client.0.smithi026.stdout:4/448: unlink d4/d7/d51/d6c/c8a 0 2024-04-23T10:17:56.630 INFO:tasks.workunit.client.0.smithi026.stdout:5/497: fsync d0/d12/f1f 0 2024-04-23T10:17:56.630 INFO:tasks.workunit.client.0.smithi026.stdout:2/537: truncate d3/dd/f15 1895316 0 2024-04-23T10:17:56.633 INFO:tasks.workunit.client.0.smithi026.stdout:0/697: rmdir d7/d8 39 2024-04-23T10:17:56.633 INFO:tasks.workunit.client.0.smithi026.stdout:9/723: link ld d13/d3b/d68/dd6/d45/d67/ldd 0 2024-04-23T10:17:56.635 INFO:tasks.workunit.client.0.smithi026.stdout:4/449: rename d4/d7/d61/d74/d7f to d4/d1b/d95 0 2024-04-23T10:17:56.637 INFO:tasks.workunit.client.0.smithi026.stdout:5/498: unlink d0/d6f/l95 0 2024-04-23T10:17:56.639 INFO:tasks.workunit.client.0.smithi026.stdout:2/538: creat d3/d19/d21/d23/d3a/d3c/d80/fbd x:0 0 0 2024-04-23T10:17:56.641 INFO:tasks.workunit.client.0.smithi026.stdout:0/698: symlink d7/d8/d1e/d1d/d2f/d6c/l100 0 2024-04-23T10:17:56.642 INFO:tasks.workunit.client.0.smithi026.stdout:9/724: creat d13/d3e/fde x:0 0 0 2024-04-23T10:17:56.643 INFO:tasks.workunit.client.0.smithi026.stdout:4/450: mknod d4/c96 0 2024-04-23T10:17:56.646 INFO:tasks.workunit.client.0.smithi026.stdout:5/499: mknod d0/d68/d91/d9a/c9b 0 2024-04-23T10:17:56.646 INFO:tasks.workunit.client.0.smithi026.stdout:7/515: dread dd/d1d/d50/f62 [0,4194304] 0 2024-04-23T10:17:56.648 INFO:tasks.workunit.client.0.smithi026.stdout:9/725: creat d13/d3b/d4e/fdf x:0 0 0 2024-04-23T10:17:56.652 INFO:tasks.workunit.client.0.smithi026.stdout:3/544: dread d0/d51/f83 [0,4194304] 0 2024-04-23T10:17:56.655 INFO:tasks.workunit.client.0.smithi026.stdout:5/500: rmdir d0/d3c/d5d/d3a 39 2024-04-23T10:17:56.656 INFO:tasks.workunit.client.0.smithi026.stdout:2/539: dwrite d3/dd/d4b/f64 [0,4194304] 0 2024-04-23T10:17:56.658 INFO:tasks.workunit.client.0.smithi026.stdout:7/516: symlink dd/d3f/d47/d4c/l97 0 2024-04-23T10:17:56.664 INFO:tasks.workunit.client.0.smithi026.stdout:7/517: chown dd/d1d/d7d/c88 3821439 1 2024-04-23T10:17:56.664 INFO:tasks.workunit.client.0.smithi026.stdout:0/699: dread d7/d8/d2d/d60/d62/db2/db4/fc3 [0,4194304] 0 2024-04-23T10:17:56.667 INFO:tasks.workunit.client.0.smithi026.stdout:2/540: symlink d3/d19/d21/d23/d3a/lbe 0 2024-04-23T10:17:56.669 INFO:tasks.workunit.client.0.smithi026.stdout:4/451: dwrite d4/d22/d2e/f6d [0,4194304] 0 2024-04-23T10:17:56.671 INFO:tasks.workunit.client.0.smithi026.stdout:4/452: dread - d4/d7/f84 zero size 2024-04-23T10:17:56.673 INFO:tasks.workunit.client.0.smithi026.stdout:0/700: mkdir d7/d8/d2d/d60/d62/da2/d101 0 2024-04-23T10:17:56.674 INFO:tasks.workunit.client.0.smithi026.stdout:0/701: stat d7/d8/d1e/d1d/d2f/f52 0 2024-04-23T10:17:56.675 INFO:tasks.workunit.client.0.smithi026.stdout:7/518: getdents dd/d1d/d50/d58 0 2024-04-23T10:17:56.676 INFO:tasks.workunit.client.0.smithi026.stdout:2/541: rmdir d3/d19/d21/d23/d3a/d3c/d80/da7/dac 39 2024-04-23T10:17:56.680 INFO:tasks.workunit.client.0.smithi026.stdout:5/501: truncate d0/d12/f2b 967229 0 2024-04-23T10:17:56.682 INFO:tasks.workunit.client.0.smithi026.stdout:0/702: creat d7/d8/d2d/d60/d62/da2/dd9/f102 x:0 0 0 2024-04-23T10:17:56.683 INFO:tasks.workunit.client.0.smithi026.stdout:7/519: rmdir dd/d1d/d50/d58 39 2024-04-23T10:17:56.683 INFO:tasks.workunit.client.0.smithi026.stdout:9/726: getdents d13/d36/d66/dc2/dc3 0 2024-04-23T10:17:56.684 INFO:tasks.workunit.client.0.smithi026.stdout:0/703: dread d7/f14 [0,4194304] 0 2024-04-23T10:17:56.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/704: write d7/d8/d2d/d60/f98 [1131095,57309] 0 2024-04-23T10:17:56.686 INFO:tasks.workunit.client.0.smithi026.stdout:4/453: symlink d4/d14/d30/d52/l97 0 2024-04-23T10:17:56.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/727: dread d13/d3b/d68/dd6/d45/d6d/fa5 [0,4194304] 0 2024-04-23T10:17:56.687 INFO:tasks.workunit.client.0.smithi026.stdout:5/502: mknod d0/d12/c9c 0 2024-04-23T10:17:56.688 INFO:tasks.workunit.client.0.smithi026.stdout:2/542: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/fbf x:0 0 0 2024-04-23T10:17:56.689 INFO:tasks.workunit.client.0.smithi026.stdout:3/545: dread d0/f20 [0,4194304] 0 2024-04-23T10:17:56.692 INFO:tasks.workunit.client.0.smithi026.stdout:9/728: write d13/d1b/fa9 [555503,111979] 0 2024-04-23T10:17:56.693 INFO:tasks.workunit.client.0.smithi026.stdout:4/454: mkdir d4/d14/d30/d98 0 2024-04-23T10:17:56.696 INFO:tasks.workunit.client.0.smithi026.stdout:3/546: rmdir d0/d4c 39 2024-04-23T10:17:56.697 INFO:tasks.workunit.client.0.smithi026.stdout:0/705: mknod d7/c103 0 2024-04-23T10:17:56.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/455: rename d4/c96 to d4/d7/d61/d74/c99 0 2024-04-23T10:17:56.699 INFO:tasks.workunit.client.0.smithi026.stdout:0/706: write d7/d8/d1e/d1d/d2f/f48 [1310745,85315] 0 2024-04-23T10:17:56.700 INFO:tasks.workunit.client.0.smithi026.stdout:5/503: truncate d0/d3c/d5d/f14 3261367 0 2024-04-23T10:17:56.705 INFO:tasks.workunit.client.0.smithi026.stdout:5/504: creat d0/d3c/d84/f9d x:0 0 0 2024-04-23T10:17:56.709 INFO:tasks.workunit.client.0.smithi026.stdout:5/505: symlink d0/d68/d91/l9e 0 2024-04-23T10:17:56.712 INFO:tasks.workunit.client.0.smithi026.stdout:5/506: creat d0/d3c/d84/d89/f9f x:0 0 0 2024-04-23T10:17:56.714 INFO:tasks.workunit.client.0.smithi026.stdout:5/507: symlink d0/d12/la0 0 2024-04-23T10:17:56.715 INFO:tasks.workunit.client.0.smithi026.stdout:5/508: dread - d0/f90 zero size 2024-04-23T10:17:56.715 INFO:tasks.workunit.client.0.smithi026.stdout:0/707: dread d7/d5b/f76 [0,4194304] 0 2024-04-23T10:17:56.718 INFO:tasks.workunit.client.0.smithi026.stdout:4/456: stat d4/d7/d61/d74/c99 0 2024-04-23T10:17:56.720 INFO:tasks.workunit.client.0.smithi026.stdout:0/708: mknod d7/d8/d2d/d60/d62/db2/db4/c104 0 2024-04-23T10:17:56.721 INFO:tasks.workunit.client.0.smithi026.stdout:4/457: rmdir d4/d22/d2e 39 2024-04-23T10:17:56.721 INFO:tasks.workunit.client.0.smithi026.stdout:9/729: write d13/f25 [899212,80750] 0 2024-04-23T10:17:56.726 INFO:tasks.workunit.client.0.smithi026.stdout:4/458: truncate d4/d7/f84 294604 0 2024-04-23T10:17:56.728 INFO:tasks.workunit.client.0.smithi026.stdout:0/709: write d7/d8/d2d/d60/d62/da2/dd9/fe3 [495364,63849] 0 2024-04-23T10:17:56.729 INFO:tasks.workunit.client.0.smithi026.stdout:5/509: dwrite d0/d3c/f51 [0,4194304] 0 2024-04-23T10:17:56.729 INFO:tasks.workunit.client.0.smithi026.stdout:9/730: write d13/d3b/d68/dd6/d45/d3a/d6b/f55 [1131840,47942] 0 2024-04-23T10:17:56.730 INFO:tasks.workunit.client.0.smithi026.stdout:3/547: dwrite d0/d1e/d30/d43/df/d63/f7b [0,4194304] 0 2024-04-23T10:17:56.731 INFO:tasks.workunit.client.0.smithi026.stdout:9/731: read - d13/d3b/d68/fb9 zero size 2024-04-23T10:17:56.733 INFO:tasks.workunit.client.0.smithi026.stdout:5/510: fdatasync d0/d3c/d84/f8c 0 2024-04-23T10:17:56.734 INFO:tasks.workunit.client.0.smithi026.stdout:4/459: dread d4/d7/f84 [0,4194304] 0 2024-04-23T10:17:56.735 INFO:tasks.workunit.client.0.smithi026.stdout:5/511: chown d0/d3c/d84/d89 0 1 2024-04-23T10:17:56.735 INFO:tasks.workunit.client.0.smithi026.stdout:9/732: creat d13/d1b/d26/d88/db5/fe0 x:0 0 0 2024-04-23T10:17:56.735 INFO:tasks.workunit.client.0.smithi026.stdout:0/710: fdatasync d7/d8/d1e/d2a/f55 0 2024-04-23T10:17:56.738 INFO:tasks.workunit.client.0.smithi026.stdout:4/460: dread - d4/d14/d3d/d73/f7a zero size 2024-04-23T10:17:56.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/512: truncate d0/d3c/d5d/f94 1012885 0 2024-04-23T10:17:56.740 INFO:tasks.workunit.client.0.smithi026.stdout:0/711: creat d7/d8/d2d/d60/d62/db2/db4/de2/f105 x:0 0 0 2024-04-23T10:17:56.742 INFO:tasks.workunit.client.0.smithi026.stdout:4/461: unlink d4/d22/f4c 0 2024-04-23T10:17:56.747 INFO:tasks.workunit.client.0.smithi026.stdout:9/733: creat d13/d3b/d5b/dc9/fe1 x:0 0 0 2024-04-23T10:17:56.748 INFO:tasks.workunit.client.0.smithi026.stdout:3/548: write d0/d4c/f9b [166230,95914] 0 2024-04-23T10:17:56.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/462: chown d4/d5b/d7b/d36/l4b 796890955 1 2024-04-23T10:17:56.750 INFO:tasks.workunit.client.0.smithi026.stdout:5/513: read d0/f80 [4052560,16433] 0 2024-04-23T10:17:56.751 INFO:tasks.workunit.client.0.smithi026.stdout:9/734: creat d13/d1b/d26/d88/db5/fe2 x:0 0 0 2024-04-23T10:17:56.752 INFO:tasks.workunit.client.0.smithi026.stdout:5/514: readlink d0/la 0 2024-04-23T10:17:56.756 INFO:tasks.workunit.client.0.smithi026.stdout:0/712: dwrite d7/d8/d1e/d1d/d2f/d6c/fd2 [0,4194304] 0 2024-04-23T10:17:56.757 INFO:tasks.workunit.client.0.smithi026.stdout:3/549: getdents d0/d1e/d30/d43/df/d72 0 2024-04-23T10:17:56.761 INFO:tasks.workunit.client.0.smithi026.stdout:9/735: rename d13/l7e to d13/d36/d66/d72/le3 0 2024-04-23T10:17:56.764 INFO:tasks.workunit.client.0.smithi026.stdout:0/713: write d7/da1/faf [619983,55268] 0 2024-04-23T10:17:56.765 INFO:tasks.workunit.client.0.smithi026.stdout:9/736: readlink d13/d1b/lb1 0 2024-04-23T10:17:56.766 INFO:tasks.workunit.client.0.smithi026.stdout:3/550: creat d0/d1e/d23/fb9 x:0 0 0 2024-04-23T10:17:56.768 INFO:tasks.workunit.client.0.smithi026.stdout:4/463: dwrite d4/d14/d3d/d73/f7a [0,4194304] 0 2024-04-23T10:17:56.771 INFO:tasks.workunit.client.0.smithi026.stdout:3/551: stat d0/d1e/d23/d52/d75 0 2024-04-23T10:17:56.771 INFO:tasks.workunit.client.0.smithi026.stdout:5/515: dwrite d0/d3c/d5d/d3a/f78 [0,4194304] 0 2024-04-23T10:17:56.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/714: mkdir d7/d8/d2d/d60/d62/da2/d106 0 2024-04-23T10:17:56.776 INFO:tasks.workunit.client.0.smithi026.stdout:0/715: fdatasync d7/fbb 0 2024-04-23T10:17:56.776 INFO:tasks.workunit.client.0.smithi026.stdout:5/516: creat d0/d68/d91/fa1 x:0 0 0 2024-04-23T10:17:56.776 INFO:tasks.workunit.client.0.smithi026.stdout:3/552: creat d0/d51/d5e/da4/fba x:0 0 0 2024-04-23T10:17:56.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/464: truncate d4/d7/f2a 799230 0 2024-04-23T10:17:56.780 INFO:tasks.workunit.client.0.smithi026.stdout:9/737: dwrite d13/d3e/fcb [0,4194304] 0 2024-04-23T10:17:56.786 INFO:tasks.workunit.client.0.smithi026.stdout:5/517: chown d0/d12/c44 0 1 2024-04-23T10:17:56.787 INFO:tasks.workunit.client.0.smithi026.stdout:9/738: chown d13/d31/d87/dce 122891845 1 2024-04-23T10:17:56.788 INFO:tasks.workunit.client.0.smithi026.stdout:3/553: chown d0/d1e/d30/d43/df/d72/fb2 1073285 1 2024-04-23T10:17:56.788 INFO:tasks.workunit.client.0.smithi026.stdout:4/465: chown d4/d7/d61/c76 0 1 2024-04-23T10:17:56.789 INFO:tasks.workunit.client.0.smithi026.stdout:6/705: sync 2024-04-23T10:17:56.789 INFO:tasks.workunit.client.0.smithi026.stdout:0/716: rmdir d7/d8/d2d/d60/d62/db2/db4/de2 39 2024-04-23T10:17:56.790 INFO:tasks.workunit.client.0.smithi026.stdout:4/466: stat d4/d1b/c93 0 2024-04-23T10:17:56.791 INFO:tasks.workunit.client.0.smithi026.stdout:9/739: write d13/d3b/d68/dd6/d45/d3a/d6b/f55 [2581569,28459] 0 2024-04-23T10:17:56.794 INFO:tasks.workunit.client.0.smithi026.stdout:9/740: write d13/d3b/d68/dd6/d45/d6d/fdb [675427,129439] 0 2024-04-23T10:17:56.794 INFO:tasks.workunit.client.0.smithi026.stdout:5/518: rename d0/d3c/d84/d89/f9f to d0/d3c/d84/d89/d8d/fa2 0 2024-04-23T10:17:56.795 INFO:tasks.workunit.client.0.smithi026.stdout:0/717: creat d7/d8/d2d/d60/d77/f107 x:0 0 0 2024-04-23T10:17:56.798 INFO:tasks.workunit.client.0.smithi026.stdout:4/467: write d4/d22/d2e/f7d [837657,113397] 0 2024-04-23T10:17:56.802 INFO:tasks.workunit.client.0.smithi026.stdout:5/519: symlink d0/d3c/d5d/d3a/la3 0 2024-04-23T10:17:56.804 INFO:tasks.workunit.client.0.smithi026.stdout:0/718: write d7/d8/f9 [3544111,38104] 0 2024-04-23T10:17:56.805 INFO:tasks.workunit.client.0.smithi026.stdout:4/468: mknod d4/d5b/d7b/d36/c9a 0 2024-04-23T10:17:56.806 INFO:tasks.workunit.client.0.smithi026.stdout:5/520: dread - d0/d3c/f97 zero size 2024-04-23T10:17:56.808 INFO:tasks.workunit.client.0.smithi026.stdout:3/554: getdents d0/d1e/d30/d43/df 0 2024-04-23T10:17:56.812 INFO:tasks.workunit.client.0.smithi026.stdout:5/521: stat d0/d3c/d5d/d3a/f72 0 2024-04-23T10:17:56.814 INFO:tasks.workunit.client.0.smithi026.stdout:4/469: creat d4/d5b/d7b/d36/d90/f9b x:0 0 0 2024-04-23T10:17:56.815 INFO:tasks.workunit.client.0.smithi026.stdout:6/706: dread d6/d33/fc8 [0,4194304] 0 2024-04-23T10:17:56.815 INFO:tasks.workunit.client.0.smithi026.stdout:0/719: creat d7/d8/d2d/d60/d62/f108 x:0 0 0 2024-04-23T10:17:56.815 INFO:tasks.workunit.client.0.smithi026.stdout:9/741: dwrite d13/d3b/d4e/d76/f8f [4194304,4194304] 0 2024-04-23T10:17:56.816 INFO:tasks.workunit.client.0.smithi026.stdout:5/522: write d0/d3c/d5d/f4b [2897562,11439] 0 2024-04-23T10:17:56.819 INFO:tasks.workunit.client.0.smithi026.stdout:3/555: creat d0/fbb x:0 0 0 2024-04-23T10:17:56.820 INFO:tasks.workunit.client.0.smithi026.stdout:9/742: write d13/d1b/d26/d88/dcf/dd1/fd5 [985748,8053] 0 2024-04-23T10:17:56.822 INFO:tasks.workunit.client.0.smithi026.stdout:0/720: mknod d7/d8/d2d/d60/d62/d96/c109 0 2024-04-23T10:17:56.823 INFO:tasks.workunit.client.0.smithi026.stdout:9/743: creat d13/d36/fe4 x:0 0 0 2024-04-23T10:17:56.826 INFO:tasks.workunit.client.0.smithi026.stdout:0/721: unlink d7/d5b/cbe 0 2024-04-23T10:17:56.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/707: dread d6/d21/d58/fad [0,4194304] 0 2024-04-23T10:17:56.827 INFO:tasks.workunit.client.0.smithi026.stdout:9/744: chown d13/d3b/d5b/c5f 15 1 2024-04-23T10:17:56.828 INFO:tasks.workunit.client.0.smithi026.stdout:3/556: unlink d0/d1e/d30/d43/d6c/d79/c24 0 2024-04-23T10:17:56.829 INFO:tasks.workunit.client.0.smithi026.stdout:4/470: dread d4/d14/d3d/d73/f7a [0,4194304] 0 2024-04-23T10:17:56.829 INFO:tasks.workunit.client.0.smithi026.stdout:9/745: dread - d13/d36/fe4 zero size 2024-04-23T10:17:56.831 INFO:tasks.workunit.client.0.smithi026.stdout:6/708: unlink d6/d21/d2f/d32/f89 0 2024-04-23T10:17:56.833 INFO:tasks.workunit.client.0.smithi026.stdout:3/557: unlink d0/d1e/d30/d77/fa0 0 2024-04-23T10:17:56.836 INFO:tasks.workunit.client.0.smithi026.stdout:3/558: symlink d0/d1e/d30/d43/d6c/lbc 0 2024-04-23T10:17:56.836 INFO:tasks.workunit.client.0.smithi026.stdout:6/709: chown d6/d33/la1 7163 1 2024-04-23T10:17:56.838 INFO:tasks.workunit.client.0.smithi026.stdout:4/471: creat d4/d7/f9c x:0 0 0 2024-04-23T10:17:56.840 INFO:tasks.workunit.client.0.smithi026.stdout:5/523: dread d0/f1a [0,4194304] 0 2024-04-23T10:17:56.841 INFO:tasks.workunit.client.0.smithi026.stdout:4/472: chown d4/d7/d61/d74/c3a 36 1 2024-04-23T10:17:56.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/559: write d0/d1e/d30/d43/df/d63/f7b [4636603,118650] 0 2024-04-23T10:17:56.843 INFO:tasks.workunit.client.0.smithi026.stdout:6/710: symlink d6/d21/ld0 0 2024-04-23T10:17:56.844 INFO:tasks.workunit.client.0.smithi026.stdout:9/746: dwrite d13/d3b/d68/dd6/f2f [0,4194304] 0 2024-04-23T10:17:56.846 INFO:tasks.workunit.client.0.smithi026.stdout:3/560: dread - d0/d1e/d23/fb9 zero size 2024-04-23T10:17:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:5/524: truncate d0/d3c/d84/f9d 693294 0 2024-04-23T10:17:56.847 INFO:tasks.workunit.client.0.smithi026.stdout:4/473: unlink d4/c31 0 2024-04-23T10:17:56.849 INFO:tasks.workunit.client.0.smithi026.stdout:4/474: stat d4/d7/f1d 0 2024-04-23T10:17:56.850 INFO:tasks.workunit.client.0.smithi026.stdout:5/525: symlink d0/d3c/d57/la4 0 2024-04-23T10:17:56.851 INFO:tasks.workunit.client.0.smithi026.stdout:6/711: creat d6/d21/d2f/d32/fd1 x:0 0 0 2024-04-23T10:17:56.852 INFO:tasks.workunit.client.0.smithi026.stdout:3/561: creat d0/d1e/d23/fbd x:0 0 0 2024-04-23T10:17:56.853 INFO:tasks.workunit.client.0.smithi026.stdout:4/475: rename d4/d7/d61/f8b to d4/d1b/f9d 0 2024-04-23T10:17:56.855 INFO:tasks.workunit.client.0.smithi026.stdout:9/747: link d13/d3b/d68/dd6/d45/d67/f95 d13/d31/d87/fe5 0 2024-04-23T10:17:56.856 INFO:tasks.workunit.client.0.smithi026.stdout:5/526: symlink d0/d3c/d84/d89/d8d/la5 0 2024-04-23T10:17:56.857 INFO:tasks.workunit.client.0.smithi026.stdout:0/722: dread d7/d8/d1e/d2a/f71 [0,4194304] 0 2024-04-23T10:17:56.857 INFO:tasks.workunit.client.0.smithi026.stdout:4/476: rmdir d4/d14/d3d 39 2024-04-23T10:17:56.860 INFO:tasks.workunit.client.0.smithi026.stdout:4/477: chown d4/d7/f7c 0 1 2024-04-23T10:17:56.860 INFO:tasks.workunit.client.0.smithi026.stdout:5/527: creat d0/d3c/d84/d89/d8d/d8f/fa6 x:0 0 0 2024-04-23T10:17:56.861 INFO:tasks.workunit.client.0.smithi026.stdout:9/748: getdents d13/d3b/d68/dd6/d45/d6d/d99 0 2024-04-23T10:17:56.863 INFO:tasks.workunit.client.0.smithi026.stdout:4/478: fdatasync d4/d22/f47 0 2024-04-23T10:17:56.866 INFO:tasks.workunit.client.0.smithi026.stdout:9/749: write d13/d1b/d26/d88/db5/fda [925847,78557] 0 2024-04-23T10:17:56.866 INFO:tasks.workunit.client.0.smithi026.stdout:4/479: creat d4/d22/d2e/f9e x:0 0 0 2024-04-23T10:17:56.867 INFO:tasks.workunit.client.0.smithi026.stdout:6/712: truncate d6/d21/d58/f75 201261 0 2024-04-23T10:17:56.867 INFO:tasks.workunit.client.0.smithi026.stdout:3/562: write d0/f11 [684556,109776] 0 2024-04-23T10:17:56.869 INFO:tasks.workunit.client.0.smithi026.stdout:4/480: stat d4/d7/f13 0 2024-04-23T10:17:56.873 INFO:tasks.workunit.client.0.smithi026.stdout:0/723: dwrite d7/d8/d1e/d1d/d2f/f52 [0,4194304] 0 2024-04-23T10:17:56.874 INFO:tasks.workunit.client.0.smithi026.stdout:3/563: write d0/d1e/d30/f8a [973221,90008] 0 2024-04-23T10:17:56.874 INFO:tasks.workunit.client.0.smithi026.stdout:5/528: dread d0/d3c/f51 [0,4194304] 0 2024-04-23T10:17:56.874 INFO:tasks.workunit.client.0.smithi026.stdout:6/713: mknod d6/d21/d58/d8d/d64/cd2 0 2024-04-23T10:17:56.875 INFO:tasks.workunit.client.0.smithi026.stdout:9/750: symlink d13/d3b/d68/dd6/d45/d6d/le6 0 2024-04-23T10:17:56.876 INFO:tasks.workunit.client.0.smithi026.stdout:3/564: chown d0/d1e/d30/d43/d6c/d79/d73 1737050 1 2024-04-23T10:17:56.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/751: stat d13/d31/d87 0 2024-04-23T10:17:56.878 INFO:tasks.workunit.client.0.smithi026.stdout:4/481: creat d4/d5b/d7b/f9f x:0 0 0 2024-04-23T10:17:56.885 INFO:tasks.workunit.client.0.smithi026.stdout:0/724: mknod d7/d8/d2d/c10a 0 2024-04-23T10:17:56.886 INFO:tasks.workunit.client.0.smithi026.stdout:5/529: rename d0/d3c/l52 to d0/d68/d91/d9a/la7 0 2024-04-23T10:17:56.888 INFO:tasks.workunit.client.0.smithi026.stdout:6/714: getdents d6/d13/d15 0 2024-04-23T10:17:56.888 INFO:tasks.workunit.client.0.smithi026.stdout:0/725: stat d7/d8/d2d/d60/d77/feb 0 2024-04-23T10:17:56.889 INFO:tasks.workunit.client.0.smithi026.stdout:5/530: mkdir d0/d3c/d57/da8 0 2024-04-23T10:17:56.892 INFO:tasks.workunit.client.0.smithi026.stdout:6/715: mkdir d6/dd3 0 2024-04-23T10:17:56.893 INFO:tasks.workunit.client.0.smithi026.stdout:4/482: dwrite d4/d7/f15 [0,4194304] 0 2024-04-23T10:17:56.893 INFO:tasks.workunit.client.0.smithi026.stdout:5/531: unlink d0/d12/l37 0 2024-04-23T10:17:56.896 INFO:tasks.workunit.client.0.smithi026.stdout:0/726: creat d7/d8/f10b x:0 0 0 2024-04-23T10:17:56.896 INFO:tasks.workunit.client.0.smithi026.stdout:4/483: chown d4/d5b/d7b/d36 3098 1 2024-04-23T10:17:56.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/752: dwrite d13/f5c [0,4194304] 0 2024-04-23T10:17:56.899 INFO:tasks.workunit.client.0.smithi026.stdout:9/753: truncate d13/d19/fb7 5016839 0 2024-04-23T10:17:56.904 INFO:tasks.workunit.client.0.smithi026.stdout:4/484: mkdir d4/d1b/da0 0 2024-04-23T10:17:56.906 INFO:tasks.workunit.client.0.smithi026.stdout:3/565: dread d0/d1e/d30/d43/f5f [0,4194304] 0 2024-04-23T10:17:56.908 INFO:tasks.workunit.client.0.smithi026.stdout:3/566: chown d0/d1e/d30/d43/ld 15384 1 2024-04-23T10:17:56.914 INFO:tasks.workunit.client.0.smithi026.stdout:5/532: creat d0/d3c/fa9 x:0 0 0 2024-04-23T10:17:56.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/567: fsync d0/d1e/d30/d43/f7e 0 2024-04-23T10:17:56.914 INFO:tasks.workunit.client.0.smithi026.stdout:5/533: write d0/d3c/d84/d89/d8d/fa2 [942768,47038] 0 2024-04-23T10:17:56.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/568: read - d0/d1e/d23/fb9 zero size 2024-04-23T10:17:56.916 INFO:tasks.workunit.client.0.smithi026.stdout:3/569: read - d0/d1e/d30/d43/df/d72/d8c/fb5 zero size 2024-04-23T10:17:56.920 INFO:tasks.workunit.client.0.smithi026.stdout:3/570: rename d0/d1e/d30/d43/d29/d39/c66 to d0/d4c/cbe 0 2024-04-23T10:17:56.924 INFO:tasks.workunit.client.0.smithi026.stdout:3/571: unlink d0/d1e/d30/d43/df/d17/f46 0 2024-04-23T10:17:56.927 INFO:tasks.workunit.client.0.smithi026.stdout:3/572: read d0/d51/d5e/f68 [439459,46942] 0 2024-04-23T10:17:56.929 INFO:tasks.workunit.client.0.smithi026.stdout:4/485: truncate d4/d5b/f60 3103235 0 2024-04-23T10:17:56.930 INFO:tasks.workunit.client.0.smithi026.stdout:5/534: write d0/f1a [186010,64868] 0 2024-04-23T10:17:56.932 INFO:tasks.workunit.client.0.smithi026.stdout:6/716: dwrite d6/d21/d2f/d32/fce [0,4194304] 0 2024-04-23T10:17:56.934 INFO:tasks.workunit.client.0.smithi026.stdout:5/535: symlink d0/d3c/d84/d89/laa 0 2024-04-23T10:17:56.935 INFO:tasks.workunit.client.0.smithi026.stdout:4/486: rename d4/d14/d3d/d73/f7a to d4/d7/d51/fa1 0 2024-04-23T10:17:56.937 INFO:tasks.workunit.client.0.smithi026.stdout:8/673: sync 2024-04-23T10:17:56.939 INFO:tasks.workunit.client.0.smithi026.stdout:8/674: fsync d5/d56/fb7 0 2024-04-23T10:17:56.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/573: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:56.943 INFO:tasks.workunit.client.0.smithi026.stdout:8/675: chown d5/d9/d22/c25 48266 1 2024-04-23T10:17:56.944 INFO:tasks.workunit.client.0.smithi026.stdout:4/487: mkdir d4/d14/d30/da2 0 2024-04-23T10:17:56.946 INFO:tasks.workunit.client.0.smithi026.stdout:3/574: write d0/d1e/d23/d52/f61 [5138157,124551] 0 2024-04-23T10:17:56.947 INFO:tasks.workunit.client.0.smithi026.stdout:6/717: rename d6/fd to d6/d21/fd4 0 2024-04-23T10:17:56.948 INFO:tasks.workunit.client.0.smithi026.stdout:1/529: dread dd/f95 [0,4194304] 0 2024-04-23T10:17:56.950 INFO:tasks.workunit.client.0.smithi026.stdout:0/727: dread d7/d8/d1e/d1d/d2f/f34 [0,4194304] 0 2024-04-23T10:17:56.951 INFO:tasks.workunit.client.0.smithi026.stdout:5/536: dwrite d0/f3 [0,4194304] 0 2024-04-23T10:17:56.953 INFO:tasks.workunit.client.0.smithi026.stdout:0/728: chown d7/d8/d1e/d1d/d2f/dd1 11829 1 2024-04-23T10:17:56.958 INFO:tasks.workunit.client.0.smithi026.stdout:0/729: chown d7/d8/d2d/d60/d62/l63 1 1 2024-04-23T10:17:56.959 INFO:tasks.workunit.client.0.smithi026.stdout:8/676: rename d5/d9/d22/d65/d78/d3e/fb9 to d5/d56/d15/fe6 0 2024-04-23T10:17:56.963 INFO:tasks.workunit.client.0.smithi026.stdout:0/730: creat d7/d8/d1e/d57/da9/f10c x:0 0 0 2024-04-23T10:17:56.964 INFO:tasks.workunit.client.0.smithi026.stdout:3/575: dwrite d0/f3c [0,4194304] 0 2024-04-23T10:17:56.969 INFO:tasks.workunit.client.0.smithi026.stdout:0/731: chown d7/d8/d2d/d60/d62/db2/db4/de2 1012918215 1 2024-04-23T10:17:56.971 INFO:tasks.workunit.client.0.smithi026.stdout:3/576: mknod d0/d1e/d30/d43/d6c/d79/d73/cbf 0 2024-04-23T10:17:56.972 INFO:tasks.workunit.client.0.smithi026.stdout:0/732: chown d7/d8/d1e/d1d/d2f/dd1/fe0 17161169 1 2024-04-23T10:17:56.973 INFO:tasks.workunit.client.0.smithi026.stdout:5/537: dread d0/d12/f2b [0,4194304] 0 2024-04-23T10:17:56.975 INFO:tasks.workunit.client.0.smithi026.stdout:1/530: write dd/d1a/d23/f44 [1997349,96842] 0 2024-04-23T10:17:56.977 INFO:tasks.workunit.client.0.smithi026.stdout:5/538: fsync d0/d12/f59 0 2024-04-23T10:17:56.980 INFO:tasks.workunit.client.0.smithi026.stdout:5/539: write d0/d12/f59 [2014986,64004] 0 2024-04-23T10:17:56.981 INFO:tasks.workunit.client.0.smithi026.stdout:4/488: dread d4/d14/f25 [0,4194304] 0 2024-04-23T10:17:56.982 INFO:tasks.workunit.client.0.smithi026.stdout:0/733: mknod d7/d8/d2d/d60/d62/c10d 0 2024-04-23T10:17:56.984 INFO:tasks.workunit.client.0.smithi026.stdout:5/540: creat d0/d3c/d84/fab x:0 0 0 2024-04-23T10:17:56.984 INFO:tasks.workunit.client.0.smithi026.stdout:0/734: fsync d7/d8/d1e/d1d/d2f/d6c/fd2 0 2024-04-23T10:17:56.985 INFO:tasks.workunit.client.0.smithi026.stdout:3/577: getdents d0/d1e/d30/d43/d29/d39/d93 0 2024-04-23T10:17:56.985 INFO:tasks.workunit.client.0.smithi026.stdout:4/489: chown d4/d5b/f60 343955105 1 2024-04-23T10:17:56.985 INFO:tasks.workunit.client.0.smithi026.stdout:3/578: fsync d0/fbb 0 2024-04-23T10:17:56.990 INFO:tasks.workunit.client.0.smithi026.stdout:5/541: link d0/fe d0/d3c/d84/d89/d8d/d8f/fac 0 2024-04-23T10:17:56.991 INFO:tasks.workunit.client.0.smithi026.stdout:3/579: symlink d0/d1e/d23/d87/db6/lc0 0 2024-04-23T10:17:56.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/490: getdents d4/d14 0 2024-04-23T10:17:56.996 INFO:tasks.workunit.client.0.smithi026.stdout:1/531: truncate dd/d15/d7d/d98/f9b 2625689 0 2024-04-23T10:17:56.996 INFO:tasks.workunit.client.0.smithi026.stdout:5/542: write d0/f25 [3969857,108029] 0 2024-04-23T10:17:56.996 INFO:tasks.workunit.client.0.smithi026.stdout:4/491: chown d4/d7/f13 2453 1 2024-04-23T10:17:56.999 INFO:tasks.workunit.client.0.smithi026.stdout:6/718: dread d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:17:57.001 INFO:tasks.workunit.client.0.smithi026.stdout:5/543: mknod d0/d3c/d57/cad 0 2024-04-23T10:17:57.001 INFO:tasks.workunit.client.0.smithi026.stdout:0/735: dwrite d7/f39 [0,4194304] 0 2024-04-23T10:17:57.003 INFO:tasks.workunit.client.0.smithi026.stdout:4/492: chown d4/d5b/d7b/d36/d38/f58 7252 1 2024-04-23T10:17:57.003 INFO:tasks.workunit.client.0.smithi026.stdout:1/532: symlink dd/d1a/d20/d25/d35/lbb 0 2024-04-23T10:17:57.005 INFO:tasks.workunit.client.0.smithi026.stdout:8/677: dread d5/d56/d15/d8b/fa9 [0,4194304] 0 2024-04-23T10:17:57.007 INFO:tasks.workunit.client.0.smithi026.stdout:6/719: write d6/d13/d15/f71 [397485,9606] 0 2024-04-23T10:17:57.007 INFO:tasks.workunit.client.0.smithi026.stdout:4/493: chown d4/d7/d61/f91 4046665 1 2024-04-23T10:17:57.008 INFO:tasks.workunit.client.0.smithi026.stdout:5/544: truncate d0/d3c/f97 921164 0 2024-04-23T10:17:57.010 INFO:tasks.workunit.client.0.smithi026.stdout:5/545: fsync d0/f16 0 2024-04-23T10:17:57.011 INFO:tasks.workunit.client.0.smithi026.stdout:4/494: write d4/d22/f29 [1716862,71197] 0 2024-04-23T10:17:57.012 INFO:tasks.workunit.client.0.smithi026.stdout:3/580: dwrite d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:57.015 INFO:tasks.workunit.client.0.smithi026.stdout:8/678: creat d5/d9/d64/fe7 x:0 0 0 2024-04-23T10:17:57.017 INFO:tasks.workunit.client.0.smithi026.stdout:5/546: mknod d0/d6f/cae 0 2024-04-23T10:17:57.017 INFO:tasks.workunit.client.0.smithi026.stdout:8/679: chown d5/d56/d15/f5d 25776 1 2024-04-23T10:17:57.019 INFO:tasks.workunit.client.0.smithi026.stdout:5/547: chown d0/d3c/d5d/c60 562709 1 2024-04-23T10:17:57.020 INFO:tasks.workunit.client.0.smithi026.stdout:1/533: dwrite dd/d1a/d23/f89 [0,4194304] 0 2024-04-23T10:17:57.021 INFO:tasks.workunit.client.0.smithi026.stdout:0/736: link d7/d8/d2d/d60/d77/lb5 d7/d8/d1e/d2a/d6a/d70/l10e 0 2024-04-23T10:17:57.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/581: getdents d0/d1e/d30/d43/d29/d39/d93 0 2024-04-23T10:17:57.038 INFO:tasks.workunit.client.0.smithi026.stdout:1/534: mknod dd/d1a/d23/d3f/d9a/d9e/cbc 0 2024-04-23T10:17:57.039 INFO:tasks.workunit.client.0.smithi026.stdout:3/582: mkdir d0/d1e/d30/d43/dc1 0 2024-04-23T10:17:57.041 INFO:tasks.workunit.client.0.smithi026.stdout:5/548: dread d0/f54 [0,4194304] 0 2024-04-23T10:17:57.042 INFO:tasks.workunit.client.0.smithi026.stdout:1/535: readlink dd/d1a/d20/l6e 0 2024-04-23T10:17:57.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/583: write d0/d1e/f8b [1713740,28503] 0 2024-04-23T10:17:57.050 INFO:tasks.workunit.client.0.smithi026.stdout:0/737: dwrite d7/d8/f10b [0,4194304] 0 2024-04-23T10:17:57.052 INFO:tasks.workunit.client.0.smithi026.stdout:4/495: dwrite d4/d7/f84 [0,4194304] 0 2024-04-23T10:17:57.057 INFO:tasks.workunit.client.0.smithi026.stdout:3/584: unlink d0/d1e/d30/d43/d6c/d79/d73/d99/lad 0 2024-04-23T10:17:57.057 INFO:tasks.workunit.client.0.smithi026.stdout:8/680: dread d5/d9/d22/d65/f87 [0,4194304] 0 2024-04-23T10:17:57.060 INFO:tasks.workunit.client.0.smithi026.stdout:5/549: getdents d0/d3c/d84/d89 0 2024-04-23T10:17:57.063 INFO:tasks.workunit.client.0.smithi026.stdout:0/738: creat d7/d8/d1e/f10f x:0 0 0 2024-04-23T10:17:57.065 INFO:tasks.workunit.client.0.smithi026.stdout:3/585: unlink d0/d1e/d30/d43/d29/f3f 0 2024-04-23T10:17:57.065 INFO:tasks.workunit.client.0.smithi026.stdout:6/720: dread d6/d21/d58/d8d/f92 [0,4194304] 0 2024-04-23T10:17:57.065 INFO:tasks.workunit.client.0.smithi026.stdout:5/550: read d0/fe [1054560,120484] 0 2024-04-23T10:17:57.067 INFO:tasks.workunit.client.0.smithi026.stdout:1/536: dread dd/d1a/d20/f4d [0,4194304] 0 2024-04-23T10:17:57.070 INFO:tasks.workunit.client.0.smithi026.stdout:4/496: write d4/d14/d30/d52/f64 [408810,33060] 0 2024-04-23T10:17:57.071 INFO:tasks.workunit.client.0.smithi026.stdout:3/586: creat d0/d51/d5e/fc2 x:0 0 0 2024-04-23T10:17:57.073 INFO:tasks.workunit.client.0.smithi026.stdout:6/721: mkdir d6/dd5 0 2024-04-23T10:17:57.074 INFO:tasks.workunit.client.0.smithi026.stdout:0/739: mknod d7/d8/d1e/d1d/d2f/dd1/dd6/c110 0 2024-04-23T10:17:57.075 INFO:tasks.workunit.client.0.smithi026.stdout:1/537: write dd/d1a/d20/f5f [1034838,71257] 0 2024-04-23T10:17:57.076 INFO:tasks.workunit.client.0.smithi026.stdout:8/681: rename d5/d56/d33/ddc/de1/dc2 to d5/d56/de8 0 2024-04-23T10:17:57.077 INFO:tasks.workunit.client.0.smithi026.stdout:4/497: creat d4/d5b/d7b/d86/fa3 x:0 0 0 2024-04-23T10:17:57.078 INFO:tasks.workunit.client.0.smithi026.stdout:8/682: readlink d5/d56/d47/l52 0 2024-04-23T10:17:57.079 INFO:tasks.workunit.client.0.smithi026.stdout:1/538: symlink dd/d48/lbd 0 2024-04-23T10:17:57.079 INFO:tasks.workunit.client.0.smithi026.stdout:6/722: write d6/d21/d58/d8d/d64/f83 [3729589,37527] 0 2024-04-23T10:17:57.080 INFO:tasks.workunit.client.0.smithi026.stdout:5/551: creat d0/d3c/faf x:0 0 0 2024-04-23T10:17:57.080 INFO:tasks.workunit.client.0.smithi026.stdout:4/498: write d4/d7/f15 [3191067,4873] 0 2024-04-23T10:17:57.083 INFO:tasks.workunit.client.0.smithi026.stdout:0/740: mknod d7/d8/d2d/d60/d62/db2/db4/c111 0 2024-04-23T10:17:57.085 INFO:tasks.workunit.client.0.smithi026.stdout:1/539: write dd/d1a/d6a/f86 [1989852,138] 0 2024-04-23T10:17:57.088 INFO:tasks.workunit.client.0.smithi026.stdout:0/741: write d7/d8/d1e/d1d/f6d [1942443,61509] 0 2024-04-23T10:17:57.088 INFO:tasks.workunit.client.0.smithi026.stdout:4/499: symlink d4/d14/d30/d52/la4 0 2024-04-23T10:17:57.089 INFO:tasks.workunit.client.0.smithi026.stdout:3/587: dwrite d0/d1e/d30/fa5 [0,4194304] 0 2024-04-23T10:17:57.091 INFO:tasks.workunit.client.0.smithi026.stdout:5/552: symlink d0/d3c/d84/d89/d8d/d8f/lb0 0 2024-04-23T10:17:57.096 INFO:tasks.workunit.client.0.smithi026.stdout:0/742: fdatasync d7/d8/d1e/d2a/f47 0 2024-04-23T10:17:57.097 INFO:tasks.workunit.client.0.smithi026.stdout:8/683: dwrite d5/d9/f8f [0,4194304] 0 2024-04-23T10:17:57.109 INFO:tasks.workunit.client.0.smithi026.stdout:6/723: dwrite d6/d21/d2f/d31/d52/d82/fba [0,4194304] 0 2024-04-23T10:17:57.118 INFO:tasks.workunit.client.0.smithi026.stdout:5/553: dwrite d0/d3c/d57/f99 [0,4194304] 0 2024-04-23T10:17:57.120 INFO:tasks.workunit.client.0.smithi026.stdout:3/588: read d0/d1e/d30/f8a [811106,65194] 0 2024-04-23T10:17:57.122 INFO:tasks.workunit.client.0.smithi026.stdout:6/724: getdents d6/d21/d58/d8d 0 2024-04-23T10:17:57.126 INFO:tasks.workunit.client.0.smithi026.stdout:6/725: write d6/d21/d58/d8d/f84 [1769141,107145] 0 2024-04-23T10:17:57.126 INFO:tasks.workunit.client.0.smithi026.stdout:4/500: dread d4/f5 [0,4194304] 0 2024-04-23T10:17:57.127 INFO:tasks.workunit.client.0.smithi026.stdout:0/743: dwrite d7/f14 [0,4194304] 0 2024-04-23T10:17:57.149 INFO:tasks.workunit.client.0.smithi026.stdout:2/543: sync 2024-04-23T10:17:57.149 INFO:tasks.workunit.client.0.smithi026.stdout:7/520: sync 2024-04-23T10:17:57.154 INFO:tasks.workunit.client.0.smithi026.stdout:6/726: mkdir d6/d13/dcf/dd6 0 2024-04-23T10:17:57.156 INFO:tasks.workunit.client.0.smithi026.stdout:2/544: mknod d3/d19/d21/d23/cc0 0 2024-04-23T10:17:57.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/545: chown d3/d19/d21/d23 1888432135 1 2024-04-23T10:17:57.164 INFO:tasks.workunit.client.0.smithi026.stdout:2/546: creat d3/d19/d21/d23/fc1 x:0 0 0 2024-04-23T10:17:57.164 INFO:tasks.workunit.client.0.smithi026.stdout:4/501: getdents d4/d5b/d7b/d86 0 2024-04-23T10:17:57.184 INFO:tasks.workunit.client.0.smithi026.stdout:7/521: getdents dd/d6c/d72 0 2024-04-23T10:17:57.187 INFO:tasks.workunit.client.0.smithi026.stdout:4/502: mknod d4/d14/d30/d52/ca5 0 2024-04-23T10:17:57.190 INFO:tasks.workunit.client.0.smithi026.stdout:7/522: read dd/d1d/d78/f54 [2216893,19911] 0 2024-04-23T10:17:57.192 INFO:tasks.workunit.client.0.smithi026.stdout:7/523: creat dd/d1d/d7d/f98 x:0 0 0 2024-04-23T10:17:57.193 INFO:tasks.workunit.client.0.smithi026.stdout:4/503: creat d4/d7/fa6 x:0 0 0 2024-04-23T10:17:57.194 INFO:tasks.workunit.client.0.smithi026.stdout:4/504: read d4/d7/d51/fa1 [2537914,50819] 0 2024-04-23T10:17:57.194 INFO:tasks.workunit.client.0.smithi026.stdout:3/589: truncate d0/d1e/d30/d43/d29/f84 3474963 0 2024-04-23T10:17:57.196 INFO:tasks.workunit.client.0.smithi026.stdout:3/590: mknod d0/d1e/d30/d43/d6c/d79/d73/cc3 0 2024-04-23T10:17:57.199 INFO:tasks.workunit.client.0.smithi026.stdout:3/591: creat d0/d1e/d23/d87/fc4 x:0 0 0 2024-04-23T10:17:57.201 INFO:tasks.workunit.client.0.smithi026.stdout:0/744: creat d7/d8/d2d/d60/d62/f112 x:0 0 0 2024-04-23T10:17:57.202 INFO:tasks.workunit.client.0.smithi026.stdout:3/592: creat d0/d1e/d30/d43/d29/fc5 x:0 0 0 2024-04-23T10:17:57.202 INFO:tasks.workunit.client.0.smithi026.stdout:4/505: dwrite d4/d5b/d7b/f41 [0,4194304] 0 2024-04-23T10:17:57.204 INFO:tasks.workunit.client.0.smithi026.stdout:6/727: rename d6/d21/d58/d8d/la5 to d6/d21/d2f/d37/d4f/ld7 0 2024-04-23T10:17:57.205 INFO:tasks.workunit.client.0.smithi026.stdout:4/506: mkdir d4/d5b/da7 0 2024-04-23T10:17:57.207 INFO:tasks.workunit.client.0.smithi026.stdout:0/745: unlink d7/d8/d1e/d57/da9/lc6 0 2024-04-23T10:17:57.208 INFO:tasks.workunit.client.0.smithi026.stdout:3/593: rename d0/d1e/d30/d43/d29/d39/c50 to d0/d1e/d30/d43/d6c/d79/d64/cc6 0 2024-04-23T10:17:57.210 INFO:tasks.workunit.client.0.smithi026.stdout:6/728: creat d6/fd8 x:0 0 0 2024-04-23T10:17:57.211 INFO:tasks.workunit.client.0.smithi026.stdout:6/729: fsync d6/d13/fa0 0 2024-04-23T10:17:57.211 INFO:tasks.workunit.client.0.smithi026.stdout:0/746: unlink d7/d8/d2d/d60/d62/da2/ff7 0 2024-04-23T10:17:57.213 INFO:tasks.workunit.client.0.smithi026.stdout:3/594: dread d0/f3c [0,4194304] 0 2024-04-23T10:17:57.216 INFO:tasks.workunit.client.0.smithi026.stdout:3/595: write d0/d1e/d23/d52/f61 [3681343,72190] 0 2024-04-23T10:17:57.217 INFO:tasks.workunit.client.0.smithi026.stdout:6/730: creat d6/d21/d58/d8d/fd9 x:0 0 0 2024-04-23T10:17:57.219 INFO:tasks.workunit.client.0.smithi026.stdout:3/596: unlink d0/d1e/d30/l80 0 2024-04-23T10:17:57.220 INFO:tasks.workunit.client.0.smithi026.stdout:6/731: rmdir d6/db8 39 2024-04-23T10:17:57.225 INFO:tasks.workunit.client.0.smithi026.stdout:0/747: dwrite d7/d8/d1e/d2a/f2e [4194304,4194304] 0 2024-04-23T10:17:57.226 INFO:tasks.workunit.client.0.smithi026.stdout:3/597: unlink d0/d1e/d30/d43/d29/f8e 0 2024-04-23T10:17:57.226 INFO:tasks.workunit.client.0.smithi026.stdout:2/547: dwrite d3/d19/d21/d23/d3a/d3c/f47 [0,4194304] 0 2024-04-23T10:17:57.229 INFO:tasks.workunit.client.0.smithi026.stdout:6/732: readlink d6/d21/d2f/d32/d53/la4 0 2024-04-23T10:17:57.231 INFO:tasks.workunit.client.0.smithi026.stdout:2/548: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/fc2 x:0 0 0 2024-04-23T10:17:57.232 INFO:tasks.workunit.client.0.smithi026.stdout:2/549: dread - d3/dd/fb4 zero size 2024-04-23T10:17:57.233 INFO:tasks.workunit.client.0.smithi026.stdout:2/550: fsync d3/f13 0 2024-04-23T10:17:57.236 INFO:tasks.workunit.client.0.smithi026.stdout:4/507: truncate d4/d7/f1d 3593678 0 2024-04-23T10:17:57.243 INFO:tasks.workunit.client.0.smithi026.stdout:2/551: creat d3/fc3 x:0 0 0 2024-04-23T10:17:57.244 INFO:tasks.workunit.client.0.smithi026.stdout:4/508: getdents d4/d14/d30/da2 0 2024-04-23T10:17:57.245 INFO:tasks.workunit.client.0.smithi026.stdout:2/552: dread d3/d19/f5a [0,4194304] 0 2024-04-23T10:17:57.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/553: chown d3/d19/d21/c41 7865331 1 2024-04-23T10:17:57.249 INFO:tasks.workunit.client.0.smithi026.stdout:4/509: read d4/d7/d51/f56 [837626,14453] 0 2024-04-23T10:17:57.249 INFO:tasks.workunit.client.0.smithi026.stdout:2/554: readlink d3/d19/lb2 0 2024-04-23T10:17:57.252 INFO:tasks.workunit.client.0.smithi026.stdout:4/510: creat d4/d5b/d7b/d36/d38/fa8 x:0 0 0 2024-04-23T10:17:57.252 INFO:tasks.workunit.client.0.smithi026.stdout:3/598: dwrite d0/d1e/d30/d43/f7e [0,4194304] 0 2024-04-23T10:17:57.256 INFO:tasks.workunit.client.0.smithi026.stdout:2/555: truncate d3/dd/f32 2002799 0 2024-04-23T10:17:57.259 INFO:tasks.workunit.client.0.smithi026.stdout:2/556: truncate d3/d19/d21/d23/d3a/d3c/d5d/f9b 949758 0 2024-04-23T10:17:57.261 INFO:tasks.workunit.client.0.smithi026.stdout:4/511: rename d4/d7/l16 to d4/d7/d61/la9 0 2024-04-23T10:17:57.261 INFO:tasks.workunit.client.0.smithi026.stdout:2/557: write d3/d19/d21/d23/f33 [500285,69906] 0 2024-04-23T10:17:57.262 INFO:tasks.workunit.client.0.smithi026.stdout:3/599: write d0/d1e/d30/d43/d82/fab [4151873,11089] 0 2024-04-23T10:17:57.263 INFO:tasks.workunit.client.0.smithi026.stdout:4/512: write d4/f35 [2365452,5091] 0 2024-04-23T10:17:57.265 INFO:tasks.workunit.client.0.smithi026.stdout:3/600: chown d0/d1e/d23 28049 1 2024-04-23T10:17:57.270 INFO:tasks.workunit.client.0.smithi026.stdout:2/558: truncate d3/d35/d4c/f6a 1841380 0 2024-04-23T10:17:57.271 INFO:tasks.workunit.client.0.smithi026.stdout:2/559: chown d3/d19/d21/d23/fc1 40356705 1 2024-04-23T10:17:57.274 INFO:tasks.workunit.client.0.smithi026.stdout:4/513: creat d4/d22/faa x:0 0 0 2024-04-23T10:17:57.275 INFO:tasks.workunit.client.0.smithi026.stdout:2/560: creat d3/d19/d21/d23/fc4 x:0 0 0 2024-04-23T10:17:57.275 INFO:tasks.workunit.client.0.smithi026.stdout:3/601: dwrite d0/d1e/d30/d43/d29/f5c [0,4194304] 0 2024-04-23T10:17:57.279 INFO:tasks.workunit.client.0.smithi026.stdout:2/561: fdatasync d3/d19/d21/d23/d3a/d3c/f6e 0 2024-04-23T10:17:57.282 INFO:tasks.workunit.client.0.smithi026.stdout:2/562: write d3/dd/f43 [1134462,106020] 0 2024-04-23T10:17:57.283 INFO:tasks.workunit.client.0.smithi026.stdout:4/514: dwrite d4/d14/d3d/f8c [0,4194304] 0 2024-04-23T10:17:57.284 INFO:tasks.workunit.client.0.smithi026.stdout:4/515: write d4/d5b/d7b/d36/d38/fa8 [707859,21332] 0 2024-04-23T10:17:57.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/563: chown d3/d19/d1d/c71 746789586 1 2024-04-23T10:17:57.294 INFO:tasks.workunit.client.0.smithi026.stdout:3/602: truncate d0/d1e/d30/d43/d29/f34 1598539 0 2024-04-23T10:17:57.298 INFO:tasks.workunit.client.0.smithi026.stdout:2/564: getdents d3/d19/d21/d23/daf 0 2024-04-23T10:17:57.301 INFO:tasks.workunit.client.0.smithi026.stdout:4/516: dwrite d4/d7/d61/f91 [0,4194304] 0 2024-04-23T10:17:57.301 INFO:tasks.workunit.client.0.smithi026.stdout:2/565: dread d3/d35/d4c/f76 [0,4194304] 0 2024-04-23T10:17:57.303 INFO:tasks.workunit.client.0.smithi026.stdout:2/566: fsync d3/d19/d21/d23/d3a/d3c/d5d/fb7 0 2024-04-23T10:17:57.304 INFO:tasks.workunit.client.0.smithi026.stdout:3/603: creat d0/d1e/fc7 x:0 0 0 2024-04-23T10:17:57.305 INFO:tasks.workunit.client.0.smithi026.stdout:4/517: unlink d4/d7/d61/f91 0 2024-04-23T10:17:57.306 INFO:tasks.workunit.client.0.smithi026.stdout:3/604: stat d0/d1e/d30/d43/df/d63/f7b 0 2024-04-23T10:17:57.307 INFO:tasks.workunit.client.0.smithi026.stdout:2/567: chown d3/d19/d21/d23/d3a/f69 135791240 1 2024-04-23T10:17:57.308 INFO:tasks.workunit.client.0.smithi026.stdout:4/518: chown d4/d7/f1d 199237 1 2024-04-23T10:17:57.310 INFO:tasks.workunit.client.0.smithi026.stdout:4/519: symlink d4/d14/lab 0 2024-04-23T10:17:57.311 INFO:tasks.workunit.client.0.smithi026.stdout:2/568: rename d3/d35/fa6 to d3/d19/d21/d23/d3a/d3c/fc5 0 2024-04-23T10:17:57.312 INFO:tasks.workunit.client.0.smithi026.stdout:3/605: creat d0/d1e/d23/d87/db3/fc8 x:0 0 0 2024-04-23T10:17:57.316 INFO:tasks.workunit.client.0.smithi026.stdout:3/606: dread d0/d1e/f31 [0,4194304] 0 2024-04-23T10:17:57.318 INFO:tasks.workunit.client.0.smithi026.stdout:3/607: truncate d0/d4c/f67 572339 0 2024-04-23T10:17:57.328 INFO:tasks.workunit.client.0.smithi026.stdout:3/608: rename d0/l40 to d0/d1e/d30/d43/d29/lc9 0 2024-04-23T10:17:57.328 INFO:tasks.workunit.client.0.smithi026.stdout:3/609: fdatasync d0/d1e/d23/d87/f8d 0 2024-04-23T10:17:57.330 INFO:tasks.workunit.client.0.smithi026.stdout:3/610: mknod d0/d1e/d30/d43/df/d72/cca 0 2024-04-23T10:17:57.332 INFO:tasks.workunit.client.0.smithi026.stdout:4/520: symlink d4/d14/d30/d98/lac 0 2024-04-23T10:17:57.333 INFO:tasks.workunit.client.0.smithi026.stdout:4/521: chown d4/d7/d61/d74/c3a 209753 1 2024-04-23T10:17:57.335 INFO:tasks.workunit.client.0.smithi026.stdout:3/611: rename d0/d1e/d23/d52/d75 to d0/d1e/d30/d43/df/dcb 0 2024-04-23T10:17:57.336 INFO:tasks.workunit.client.0.smithi026.stdout:4/522: fsync d4/f5 0 2024-04-23T10:17:57.352 INFO:tasks.workunit.client.0.smithi026.stdout:4/523: dread d4/d7/f13 [4194304,4194304] 0 2024-04-23T10:17:57.354 INFO:tasks.workunit.client.0.smithi026.stdout:3/612: creat d0/d1e/d23/d52/fcc x:0 0 0 2024-04-23T10:17:57.356 INFO:tasks.workunit.client.0.smithi026.stdout:4/524: rename d4/d7/d51/d6c/d78 to d4/d5b/d7b/d4d/dad 0 2024-04-23T10:17:57.357 INFO:tasks.workunit.client.0.smithi026.stdout:3/613: mknod d0/d1e/ccd 0 2024-04-23T10:17:57.360 INFO:tasks.workunit.client.0.smithi026.stdout:3/614: creat d0/d1e/d30/d43/d29/d39/fce x:0 0 0 2024-04-23T10:17:57.363 INFO:tasks.workunit.client.0.smithi026.stdout:3/615: creat d0/d1e/d30/d43/d82/fcf x:0 0 0 2024-04-23T10:17:57.366 INFO:tasks.workunit.client.0.smithi026.stdout:3/616: symlink d0/d1e/d23/d52/ld0 0 2024-04-23T10:17:57.373 INFO:tasks.workunit.client.0.smithi026.stdout:3/617: dread d0/fc [0,4194304] 0 2024-04-23T10:17:57.375 INFO:tasks.workunit.client.0.smithi026.stdout:3/618: unlink d0/d1e/d23/d52/ld0 0 2024-04-23T10:17:57.376 INFO:tasks.workunit.client.0.smithi026.stdout:3/619: chown d0/d1e/d30/d77 3047 1 2024-04-23T10:17:57.377 INFO:tasks.workunit.client.0.smithi026.stdout:3/620: read - d0/d1e/d30/d43/d82/fcf zero size 2024-04-23T10:17:57.380 INFO:tasks.workunit.client.0.smithi026.stdout:9/754: sync 2024-04-23T10:17:57.382 INFO:tasks.workunit.client.0.smithi026.stdout:4/525: rename d4/d42/c54 to d4/d14/d3d/cae 0 2024-04-23T10:17:57.388 INFO:tasks.workunit.client.0.smithi026.stdout:4/526: dwrite d4/d14/d3d/f8c [0,4194304] 0 2024-04-23T10:17:57.389 INFO:tasks.workunit.client.0.smithi026.stdout:9/755: unlink d13/d1b/l27 0 2024-04-23T10:17:57.389 INFO:tasks.workunit.client.0.smithi026.stdout:9/756: chown d13/d3e/fcb 693811 1 2024-04-23T10:17:57.463 INFO:tasks.workunit.client.0.smithi026.stdout:8/684: read d5/d56/f1c [3755658,96682] 0 2024-04-23T10:17:57.467 INFO:tasks.workunit.client.0.smithi026.stdout:4/527: creat d4/d22/d4e/d57/faf x:0 0 0 2024-04-23T10:17:57.469 INFO:tasks.workunit.client.0.smithi026.stdout:4/528: chown d4/d7/f9c 1639569 1 2024-04-23T10:17:57.473 INFO:tasks.workunit.client.0.smithi026.stdout:8/685: creat d5/d9/d22/d65/d78/d3e/fe9 x:0 0 0 2024-04-23T10:17:57.476 INFO:tasks.workunit.client.0.smithi026.stdout:4/529: creat d4/d7/d61/d74/fb0 x:0 0 0 2024-04-23T10:17:57.477 INFO:tasks.workunit.client.0.smithi026.stdout:8/686: read d5/f84 [1008451,59412] 0 2024-04-23T10:17:57.478 INFO:tasks.workunit.client.0.smithi026.stdout:4/530: stat d4/d14/d30/d98 0 2024-04-23T10:17:57.484 INFO:tasks.workunit.client.0.smithi026.stdout:8/687: mknod d5/d9/d22/d65/cea 0 2024-04-23T10:17:57.494 INFO:tasks.workunit.client.0.smithi026.stdout:4/531: rename d4/d7/f2a to d4/d22/d4e/d57/fb1 0 2024-04-23T10:17:57.533 INFO:tasks.workunit.client.0.smithi026.stdout:1/540: sync 2024-04-23T10:17:57.538 INFO:tasks.workunit.client.0.smithi026.stdout:8/688: symlink d5/d56/d33/leb 0 2024-04-23T10:17:57.540 INFO:tasks.workunit.client.0.smithi026.stdout:8/689: stat d5/d9/d22/d65/d78/f7d 0 2024-04-23T10:17:57.550 INFO:tasks.workunit.client.0.smithi026.stdout:1/541: mknod dd/d1a/d20/d25/d35/d74/d93/cbe 0 2024-04-23T10:17:57.565 INFO:tasks.workunit.client.0.smithi026.stdout:8/690: rename d5/d9/d22/ld9 to d5/d56/d33/lec 0 2024-04-23T10:17:57.566 INFO:tasks.workunit.client.0.smithi026.stdout:8/691: fsync d5/d56/d33/faa 0 2024-04-23T10:17:57.570 INFO:tasks.workunit.client.0.smithi026.stdout:1/542: creat dd/d1a/d20/d25/d35/fbf x:0 0 0 2024-04-23T10:17:57.576 INFO:tasks.workunit.client.0.smithi026.stdout:8/692: symlink d5/d9/d64/dc5/led 0 2024-04-23T10:17:57.579 INFO:tasks.workunit.client.0.smithi026.stdout:1/543: mknod dd/d1a/d20/d25/d35/cc0 0 2024-04-23T10:17:57.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/544: write dd/d1a/d20/d25/d35/d74/fb4 [462710,15099] 0 2024-04-23T10:17:57.589 INFO:tasks.workunit.client.0.smithi026.stdout:1/545: creat dd/d1a/d20/d25/d35/d74/fc1 x:0 0 0 2024-04-23T10:17:57.592 INFO:tasks.workunit.client.0.smithi026.stdout:8/693: mkdir d5/d56/d15/dee 0 2024-04-23T10:17:57.597 INFO:tasks.workunit.client.0.smithi026.stdout:8/694: symlink d5/d56/d47/d99/lef 0 2024-04-23T10:17:57.602 INFO:tasks.workunit.client.0.smithi026.stdout:8/695: creat d5/d56/de8/ff0 x:0 0 0 2024-04-23T10:17:57.625 INFO:tasks.workunit.client.0.smithi026.stdout:8/696: dread d5/d56/f1c [0,4194304] 0 2024-04-23T10:17:57.631 INFO:tasks.workunit.client.0.smithi026.stdout:8/697: symlink d5/d56/d33/ddc/de1/lf1 0 2024-04-23T10:17:57.635 INFO:tasks.workunit.client.0.smithi026.stdout:1/546: getdents dd 0 2024-04-23T10:17:57.636 INFO:tasks.workunit.client.0.smithi026.stdout:5/554: sync 2024-04-23T10:17:57.638 INFO:tasks.workunit.client.0.smithi026.stdout:8/698: write d5/d56/d15/d8b/fa9 [1182156,34616] 0 2024-04-23T10:17:57.641 INFO:tasks.workunit.client.0.smithi026.stdout:5/555: mknod d0/d3c/d84/d89/d8d/d8f/cb1 0 2024-04-23T10:17:57.650 INFO:tasks.workunit.client.0.smithi026.stdout:5/556: mkdir d0/d3c/d5d/db2 0 2024-04-23T10:17:57.674 INFO:tasks.workunit.client.0.smithi026.stdout:8/699: getdents d5/d50/d9a 0 2024-04-23T10:17:57.675 INFO:tasks.workunit.client.0.smithi026.stdout:1/547: dwrite dd/d15/f32 [0,4194304] 0 2024-04-23T10:17:57.676 INFO:tasks.workunit.client.0.smithi026.stdout:1/548: readlink dd/d1a/d20/l64 0 2024-04-23T10:17:57.685 INFO:tasks.workunit.client.0.smithi026.stdout:5/557: dread d0/d12/f1f [0,4194304] 0 2024-04-23T10:17:57.688 INFO:tasks.workunit.client.0.smithi026.stdout:1/549: truncate dd/d1a/d20/f39 635915 0 2024-04-23T10:17:57.695 INFO:tasks.workunit.client.0.smithi026.stdout:8/700: creat d5/d56/d15/ff2 x:0 0 0 2024-04-23T10:17:57.699 INFO:tasks.workunit.client.0.smithi026.stdout:5/558: dwrite d0/d3c/d5d/f4b [0,4194304] 0 2024-04-23T10:17:57.701 INFO:tasks.workunit.client.0.smithi026.stdout:7/524: sync 2024-04-23T10:17:57.706 INFO:tasks.workunit.client.0.smithi026.stdout:8/701: mkdir d5/d50/df3 0 2024-04-23T10:17:57.707 INFO:tasks.workunit.client.0.smithi026.stdout:7/525: write dd/d3f/d47/d4c/d60/d75/f92 [876440,92313] 0 2024-04-23T10:17:57.710 INFO:tasks.workunit.client.0.smithi026.stdout:1/550: dwrite dd/d1a/d20/d25/d35/d74/fb4 [0,4194304] 0 2024-04-23T10:17:57.711 INFO:tasks.workunit.client.0.smithi026.stdout:8/702: dread - d5/d50/fba zero size 2024-04-23T10:17:57.716 INFO:tasks.workunit.client.0.smithi026.stdout:8/703: write d5/d9/d64/fe7 [483520,75656] 0 2024-04-23T10:17:57.717 INFO:tasks.workunit.client.0.smithi026.stdout:8/704: dread - d5/d9/f96 zero size 2024-04-23T10:17:57.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/526: creat dd/d2c/d48/d8d/f99 x:0 0 0 2024-04-23T10:17:57.723 INFO:tasks.workunit.client.0.smithi026.stdout:5/559: creat d0/d3c/d5d/db2/fb3 x:0 0 0 2024-04-23T10:17:57.729 INFO:tasks.workunit.client.0.smithi026.stdout:8/705: mknod d5/d56/d33/ddc/de1/cf4 0 2024-04-23T10:17:57.729 INFO:tasks.workunit.client.0.smithi026.stdout:7/527: fsync dd/d46/f77 0 2024-04-23T10:17:57.736 INFO:tasks.workunit.client.0.smithi026.stdout:8/706: mknod d5/d9/d22/d65/d78/d3e/cf5 0 2024-04-23T10:17:57.738 INFO:tasks.workunit.client.0.smithi026.stdout:8/707: dread - d5/d56/d33/ddc/de1/fe5 zero size 2024-04-23T10:17:57.743 INFO:tasks.workunit.client.0.smithi026.stdout:5/560: rename d0/d3c/d5d/c43 to d0/d3c/d57/cb4 0 2024-04-23T10:17:57.745 INFO:tasks.workunit.client.0.smithi026.stdout:1/551: dread dd/d1a/d23/d92/fa3 [0,4194304] 0 2024-04-23T10:17:57.752 INFO:tasks.workunit.client.0.smithi026.stdout:7/528: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:17:57.754 INFO:tasks.workunit.client.0.smithi026.stdout:7/529: chown dd/d44/f86 98 1 2024-04-23T10:17:57.756 INFO:tasks.workunit.client.0.smithi026.stdout:1/552: creat dd/fc2 x:0 0 0 2024-04-23T10:17:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:6/733: sync 2024-04-23T10:17:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:0/748: sync 2024-04-23T10:17:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:3/621: sync 2024-04-23T10:17:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:2/569: sync 2024-04-23T10:17:57.759 INFO:tasks.workunit.client.0.smithi026.stdout:4/532: sync 2024-04-23T10:17:57.760 INFO:tasks.workunit.client.0.smithi026.stdout:9/757: sync 2024-04-23T10:17:57.763 INFO:tasks.workunit.client.0.smithi026.stdout:7/530: symlink dd/l9a 0 2024-04-23T10:17:57.763 INFO:tasks.workunit.client.0.smithi026.stdout:7/531: dread - dd/d1d/d50/f8b zero size 2024-04-23T10:17:57.765 INFO:tasks.workunit.client.0.smithi026.stdout:9/758: rmdir d13/d1b 39 2024-04-23T10:17:57.768 INFO:tasks.workunit.client.0.smithi026.stdout:8/708: dread d5/d9/dac/fae [0,4194304] 0 2024-04-23T10:17:57.772 INFO:tasks.workunit.client.0.smithi026.stdout:4/533: creat d4/d22/d4e/d57/fb2 x:0 0 0 2024-04-23T10:17:57.773 INFO:tasks.workunit.client.0.smithi026.stdout:4/534: stat d4/d7/d51/d6c/c8d 0 2024-04-23T10:17:57.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/749: write d7/d8/d2d/d60/d62/db2/db4/fc3 [550689,33613] 0 2024-04-23T10:17:57.776 INFO:tasks.workunit.client.0.smithi026.stdout:0/750: write d7/d8/d2d/d60/d62/f112 [279610,120833] 0 2024-04-23T10:17:57.776 INFO:tasks.workunit.client.0.smithi026.stdout:7/532: creat dd/d1d/d78/f9b x:0 0 0 2024-04-23T10:17:57.777 INFO:tasks.workunit.client.0.smithi026.stdout:6/734: dwrite d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:17:57.779 INFO:tasks.workunit.client.0.smithi026.stdout:9/759: readlink d13/d1b/d26/d88/lb4 0 2024-04-23T10:17:57.780 INFO:tasks.workunit.client.0.smithi026.stdout:0/751: dread - d7/d8/d1e/d57/da9/ffc zero size 2024-04-23T10:17:57.782 INFO:tasks.workunit.client.0.smithi026.stdout:2/570: mkdir d3/d19/d21/dc6 0 2024-04-23T10:17:57.782 INFO:tasks.workunit.client.0.smithi026.stdout:9/760: dread - d13/d1b/d26/d88/dcf/fd8 zero size 2024-04-23T10:17:57.788 INFO:tasks.workunit.client.0.smithi026.stdout:6/735: dwrite d6/d21/d58/d8d/f80 [0,4194304] 0 2024-04-23T10:17:57.796 INFO:tasks.workunit.client.0.smithi026.stdout:7/533: unlink dd/d3f/d47/d4c/d60/c8f 0 2024-04-23T10:17:57.798 INFO:tasks.workunit.client.0.smithi026.stdout:9/761: mkdir d13/d36/d66/dc2/de7 0 2024-04-23T10:17:57.799 INFO:tasks.workunit.client.0.smithi026.stdout:2/571: mknod d3/dd/d4b/d9c/cc7 0 2024-04-23T10:17:57.800 INFO:tasks.workunit.client.0.smithi026.stdout:3/622: symlink d0/d1e/d30/d43/df/ld1 0 2024-04-23T10:17:57.803 INFO:tasks.workunit.client.0.smithi026.stdout:8/709: link d5/d9/f2e d5/d9/d22/ff6 0 2024-04-23T10:17:57.805 INFO:tasks.workunit.client.0.smithi026.stdout:6/736: symlink d6/d21/d2f/d31/d52/lda 0 2024-04-23T10:17:57.808 INFO:tasks.workunit.client.0.smithi026.stdout:7/534: creat dd/d6c/f9c x:0 0 0 2024-04-23T10:17:57.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/623: dread d0/d51/d5e/f68 [0,4194304] 0 2024-04-23T10:17:57.814 INFO:tasks.workunit.client.0.smithi026.stdout:8/710: truncate d5/f2a 3251173 0 2024-04-23T10:17:57.814 INFO:tasks.workunit.client.0.smithi026.stdout:2/572: dread d3/d19/d21/d23/f33 [0,4194304] 0 2024-04-23T10:17:57.814 INFO:tasks.workunit.client.0.smithi026.stdout:8/711: chown d5/d56/fa4 113 1 2024-04-23T10:17:57.818 INFO:tasks.workunit.client.0.smithi026.stdout:7/535: creat dd/d6c/f9d x:0 0 0 2024-04-23T10:17:57.818 INFO:tasks.workunit.client.0.smithi026.stdout:4/535: getdents d4/d7/d51/d6c 0 2024-04-23T10:17:57.819 INFO:tasks.workunit.client.0.smithi026.stdout:4/536: dread - d4/d5b/d7b/d36/d38/f85 zero size 2024-04-23T10:17:57.820 INFO:tasks.workunit.client.0.smithi026.stdout:1/553: rename dd/d15/l22 to dd/d1a/d23/d69/d9d/lc3 0 2024-04-23T10:17:57.821 INFO:tasks.workunit.client.0.smithi026.stdout:3/624: mknod d0/d1e/d30/d43/d6c/cd2 0 2024-04-23T10:17:57.822 INFO:tasks.workunit.client.0.smithi026.stdout:6/737: getdents d6/d21/d58/d8d/d90 0 2024-04-23T10:17:57.822 INFO:tasks.workunit.client.0.smithi026.stdout:6/738: chown d6/d21/d2f/d31/l76 27218 1 2024-04-23T10:17:57.823 INFO:tasks.workunit.client.0.smithi026.stdout:2/573: fdatasync d3/d35/d4c/f81 0 2024-04-23T10:17:57.823 INFO:tasks.workunit.client.0.smithi026.stdout:0/752: getdents d7/d8/d1e/dd3/de7 0 2024-04-23T10:17:57.824 INFO:tasks.workunit.client.0.smithi026.stdout:0/753: stat d7/d5b/f65 0 2024-04-23T10:17:57.825 INFO:tasks.workunit.client.0.smithi026.stdout:7/536: write dd/f67 [752070,112728] 0 2024-04-23T10:17:57.825 INFO:tasks.workunit.client.0.smithi026.stdout:0/754: write d7/d8/d1e/d2a/f47 [4413908,113338] 0 2024-04-23T10:17:57.829 INFO:tasks.workunit.client.0.smithi026.stdout:8/712: rename d5/d56/d3f/f82 to d5/d56/d33/ddc/de1/ff7 0 2024-04-23T10:17:57.831 INFO:tasks.workunit.client.0.smithi026.stdout:1/554: creat dd/d15/d7d/fc4 x:0 0 0 2024-04-23T10:17:57.834 INFO:tasks.workunit.client.0.smithi026.stdout:7/537: dwrite dd/d46/f8c [0,4194304] 0 2024-04-23T10:17:57.836 INFO:tasks.workunit.client.0.smithi026.stdout:9/762: getdents d13/d3b/d5b/dc9 0 2024-04-23T10:17:57.837 INFO:tasks.workunit.client.0.smithi026.stdout:1/555: dread dd/d1a/d6a/f86 [0,4194304] 0 2024-04-23T10:17:57.838 INFO:tasks.workunit.client.0.smithi026.stdout:4/537: symlink d4/d14/d3d/lb3 0 2024-04-23T10:17:57.839 INFO:tasks.workunit.client.0.smithi026.stdout:0/755: truncate d7/d8/d1e/d1d/d2f/f34 3197399 0 2024-04-23T10:17:57.842 INFO:tasks.workunit.client.0.smithi026.stdout:6/739: unlink d6/db8/cbf 0 2024-04-23T10:17:57.844 INFO:tasks.workunit.client.0.smithi026.stdout:2/574: fsync d3/d35/d4c/f6a 0 2024-04-23T10:17:57.845 INFO:tasks.workunit.client.0.smithi026.stdout:2/575: write d3/dd/f56 [817305,116558] 0 2024-04-23T10:17:57.845 INFO:tasks.workunit.client.0.smithi026.stdout:3/625: chown d0/d1e/d30/d43/df/d72/fb2 886437 1 2024-04-23T10:17:57.845 INFO:tasks.workunit.client.0.smithi026.stdout:1/556: fdatasync dd/d1a/d20/f4d 0 2024-04-23T10:17:57.847 INFO:tasks.workunit.client.0.smithi026.stdout:3/626: write d0/d1e/d30/d43/f7e [3101407,45275] 0 2024-04-23T10:17:57.848 INFO:tasks.workunit.client.0.smithi026.stdout:4/538: creat d4/d22/d2e/fb4 x:0 0 0 2024-04-23T10:17:57.854 INFO:tasks.workunit.client.0.smithi026.stdout:8/713: mknod d5/d56/d15/cf8 0 2024-04-23T10:17:57.854 INFO:tasks.workunit.client.0.smithi026.stdout:4/539: dread d4/f5 [0,4194304] 0 2024-04-23T10:17:57.854 INFO:tasks.workunit.client.0.smithi026.stdout:8/714: stat d5/d56/d15/dee 0 2024-04-23T10:17:57.854 INFO:tasks.workunit.client.0.smithi026.stdout:4/540: chown d4/d1b/d95 1 1 2024-04-23T10:17:57.857 INFO:tasks.workunit.client.0.smithi026.stdout:2/576: chown d3/d19/d1d/l8f 12993 1 2024-04-23T10:17:57.858 INFO:tasks.workunit.client.0.smithi026.stdout:2/577: write d3/d19/d31/f9d [526411,122633] 0 2024-04-23T10:17:57.861 INFO:tasks.workunit.client.0.smithi026.stdout:1/557: creat dd/d1a/d20/d25/d35/d74/d93/fc5 x:0 0 0 2024-04-23T10:17:57.863 INFO:tasks.workunit.client.0.smithi026.stdout:3/627: symlink d0/d1e/d23/d87/db6/ld3 0 2024-04-23T10:17:57.864 INFO:tasks.workunit.client.0.smithi026.stdout:9/763: creat d13/d36/d66/db6/fe8 x:0 0 0 2024-04-23T10:17:57.865 INFO:tasks.workunit.client.0.smithi026.stdout:9/764: write d13/d3b/d5b/dc9/fe1 [481562,126643] 0 2024-04-23T10:17:57.866 INFO:tasks.workunit.client.0.smithi026.stdout:9/765: write d13/d3e/f80 [4452497,81616] 0 2024-04-23T10:17:57.866 INFO:tasks.workunit.client.0.smithi026.stdout:8/715: chown d5/d50/cbe 13 1 2024-04-23T10:17:57.868 INFO:tasks.workunit.client.0.smithi026.stdout:1/558: mkdir dd/d15/d7d/da1/dc6 0 2024-04-23T10:17:57.872 INFO:tasks.workunit.client.0.smithi026.stdout:6/740: rename d6/d21/d58/d8d/fd9 to d6/d21/fdb 0 2024-04-23T10:17:57.873 INFO:tasks.workunit.client.0.smithi026.stdout:8/716: dread d5/d56/d47/f48 [0,4194304] 0 2024-04-23T10:17:57.873 INFO:tasks.workunit.client.0.smithi026.stdout:0/756: truncate d7/d8/d2d/d60/d77/f95 384263 0 2024-04-23T10:17:57.876 INFO:tasks.workunit.client.0.smithi026.stdout:8/717: fsync d5/d56/d33/ddc/de1/fc7 0 2024-04-23T10:17:57.876 INFO:tasks.workunit.client.0.smithi026.stdout:0/757: dread d7/d5b/fc7 [0,4194304] 0 2024-04-23T10:17:57.876 INFO:tasks.workunit.client.0.smithi026.stdout:1/559: rename dd/d1a/d23/d3f/caf to dd/d15/d7d/cc7 0 2024-04-23T10:17:57.878 INFO:tasks.workunit.client.0.smithi026.stdout:1/560: write dd/d1a/d23/f67 [2906151,15497] 0 2024-04-23T10:17:57.878 INFO:tasks.workunit.client.0.smithi026.stdout:2/578: getdents d3/d19/d21/d23/d3a/d3c/d5d 0 2024-04-23T10:17:57.881 INFO:tasks.workunit.client.0.smithi026.stdout:6/741: mkdir d6/d21/d2f/d32/d53/dca/ddc 0 2024-04-23T10:17:57.886 INFO:tasks.workunit.client.0.smithi026.stdout:8/718: dread d5/d9/dac/fae [0,4194304] 0 2024-04-23T10:17:57.888 INFO:tasks.workunit.client.0.smithi026.stdout:0/758: creat d7/d8/d1e/d1d/d2f/d6c/d7f/f113 x:0 0 0 2024-04-23T10:17:57.891 INFO:tasks.workunit.client.0.smithi026.stdout:9/766: dread d13/d3b/d68/dd6/d45/d6d/f71 [0,4194304] 0 2024-04-23T10:17:57.894 INFO:tasks.workunit.client.0.smithi026.stdout:3/628: dwrite d0/d1e/d30/d43/df/f85 [0,4194304] 0 2024-04-23T10:17:57.900 INFO:tasks.workunit.client.0.smithi026.stdout:1/561: dwrite dd/d1a/d20/d25/d35/d74/fb4 [0,4194304] 0 2024-04-23T10:17:57.900 INFO:tasks.workunit.client.0.smithi026.stdout:3/629: write d0/d1e/d30/fa5 [4980127,43442] 0 2024-04-23T10:17:57.904 INFO:tasks.workunit.client.0.smithi026.stdout:6/742: dwrite d6/d13/d15/f7c [0,4194304] 0 2024-04-23T10:17:57.908 INFO:tasks.workunit.client.0.smithi026.stdout:9/767: symlink d13/d36/d66/dc2/le9 0 2024-04-23T10:17:57.910 INFO:tasks.workunit.client.0.smithi026.stdout:5/561: sync 2024-04-23T10:17:57.911 INFO:tasks.workunit.client.0.smithi026.stdout:6/743: chown d6/d21/d2f/d37 329506 1 2024-04-23T10:17:57.913 INFO:tasks.workunit.client.0.smithi026.stdout:2/579: dread d3/d19/d21/d23/f94 [0,4194304] 0 2024-04-23T10:17:57.917 INFO:tasks.workunit.client.0.smithi026.stdout:1/562: dread dd/d15/f32 [0,4194304] 0 2024-04-23T10:17:57.919 INFO:tasks.workunit.client.0.smithi026.stdout:5/562: creat d0/d12/fb5 x:0 0 0 2024-04-23T10:17:57.921 INFO:tasks.workunit.client.0.smithi026.stdout:6/744: unlink d6/d21/fdb 0 2024-04-23T10:17:57.921 INFO:tasks.workunit.client.0.smithi026.stdout:3/630: unlink d0/d1e/d30/d43/df/d63/f95 0 2024-04-23T10:17:57.923 INFO:tasks.workunit.client.0.smithi026.stdout:2/580: creat d3/d19/d21/d23/d3a/d3c/d80/d96/fc8 x:0 0 0 2024-04-23T10:17:57.924 INFO:tasks.workunit.client.0.smithi026.stdout:8/719: dread d5/f28 [0,4194304] 0 2024-04-23T10:17:57.924 INFO:tasks.workunit.client.0.smithi026.stdout:1/563: creat dd/d1a/d23/d69/fc8 x:0 0 0 2024-04-23T10:17:57.926 INFO:tasks.workunit.client.0.smithi026.stdout:3/631: write d0/d1e/d30/d43/f7e [3446199,69959] 0 2024-04-23T10:17:57.929 INFO:tasks.workunit.client.0.smithi026.stdout:9/768: getdents d13/d19/da7 0 2024-04-23T10:17:57.931 INFO:tasks.workunit.client.0.smithi026.stdout:6/745: mknod d6/d13/dcf/dd6/cdd 0 2024-04-23T10:17:57.933 INFO:tasks.workunit.client.0.smithi026.stdout:5/563: getdents d0/d3c/d84/d89 0 2024-04-23T10:17:57.937 INFO:tasks.workunit.client.0.smithi026.stdout:1/564: symlink dd/d1a/d20/d25/d35/d7f/da5/lc9 0 2024-04-23T10:17:57.937 INFO:tasks.workunit.client.0.smithi026.stdout:6/746: chown d6/d21/d2f/d31/d52/l60 15097 1 2024-04-23T10:17:57.941 INFO:tasks.workunit.client.0.smithi026.stdout:3/632: dwrite d0/d1e/d23/fb9 [0,4194304] 0 2024-04-23T10:17:57.943 INFO:tasks.workunit.client.0.smithi026.stdout:5/564: fdatasync d0/d3c/d5d/f14 0 2024-04-23T10:17:57.944 INFO:tasks.workunit.client.0.smithi026.stdout:0/759: dread d7/d8/d1e/d1d/d2f/d6c/fb7 [0,4194304] 0 2024-04-23T10:17:57.944 INFO:tasks.workunit.client.0.smithi026.stdout:8/720: dwrite d5/d56/d15/fcd [0,4194304] 0 2024-04-23T10:17:57.947 INFO:tasks.workunit.client.0.smithi026.stdout:2/581: dwrite d3/dd/d4b/f7a [0,4194304] 0 2024-04-23T10:17:57.948 INFO:tasks.workunit.client.0.smithi026.stdout:1/565: creat dd/d48/dab/fca x:0 0 0 2024-04-23T10:17:57.957 INFO:tasks.workunit.client.0.smithi026.stdout:2/582: chown d3/d19/d31/d83 23658 1 2024-04-23T10:17:57.957 INFO:tasks.workunit.client.0.smithi026.stdout:5/565: creat d0/d12/fb6 x:0 0 0 2024-04-23T10:17:57.959 INFO:tasks.workunit.client.0.smithi026.stdout:6/747: getdents d6/d13/dcf 0 2024-04-23T10:17:57.962 INFO:tasks.workunit.client.0.smithi026.stdout:8/721: mkdir d5/d9/d22/d65/d78/d3e/df9 0 2024-04-23T10:17:57.969 INFO:tasks.workunit.client.0.smithi026.stdout:5/566: creat d0/d3c/d84/d89/d8d/fb7 x:0 0 0 2024-04-23T10:17:57.972 INFO:tasks.workunit.client.0.smithi026.stdout:2/583: mknod d3/d19/d21/d88/cc9 0 2024-04-23T10:17:57.973 INFO:tasks.workunit.client.0.smithi026.stdout:1/566: dwrite f2 [4194304,4194304] 0 2024-04-23T10:17:57.973 INFO:tasks.workunit.client.0.smithi026.stdout:3/633: dwrite d0/d1e/d30/d43/df/d72/d8c/fb5 [0,4194304] 0 2024-04-23T10:17:57.974 INFO:tasks.workunit.client.0.smithi026.stdout:5/567: write d0/d12/f28 [596328,104898] 0 2024-04-23T10:17:57.978 INFO:tasks.workunit.client.0.smithi026.stdout:6/748: rename d6/d21/ld0 to d6/d21/d58/lde 0 2024-04-23T10:17:57.978 INFO:tasks.workunit.client.0.smithi026.stdout:5/568: chown d0/d12/l7e 1 1 2024-04-23T10:17:57.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/722: creat d5/d56/d15/dee/ffa x:0 0 0 2024-04-23T10:17:57.981 INFO:tasks.workunit.client.0.smithi026.stdout:5/569: creat d0/d3c/d84/d89/fb8 x:0 0 0 2024-04-23T10:17:57.982 INFO:tasks.workunit.client.0.smithi026.stdout:8/723: chown d5/d56/de8/fd5 165858 1 2024-04-23T10:17:57.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/634: fdatasync d0/d1e/d30/d43/df/f1b 0 2024-04-23T10:17:57.988 INFO:tasks.workunit.client.0.smithi026.stdout:2/584: dread d3/d19/d1d/f25 [0,4194304] 0 2024-04-23T10:17:57.989 INFO:tasks.workunit.client.0.smithi026.stdout:5/570: creat d0/d3c/d84/d89/fb9 x:0 0 0 2024-04-23T10:17:57.989 INFO:tasks.workunit.client.0.smithi026.stdout:6/749: symlink d6/d21/d58/d8d/d90/ldf 0 2024-04-23T10:17:57.991 INFO:tasks.workunit.client.0.smithi026.stdout:0/760: dread d7/d8/d2d/d60/d62/fbf [0,4194304] 0 2024-04-23T10:17:57.991 INFO:tasks.workunit.client.0.smithi026.stdout:1/567: dwrite dd/fc2 [0,4194304] 0 2024-04-23T10:17:57.991 INFO:tasks.workunit.client.0.smithi026.stdout:5/571: readlink d0/d3c/d84/d89/laa 0 2024-04-23T10:17:57.993 INFO:tasks.workunit.client.0.smithi026.stdout:2/585: chown d3/d19/d21/d23/d3a/d3c/d5d/c8e 814417 1 2024-04-23T10:17:57.994 INFO:tasks.workunit.client.0.smithi026.stdout:2/586: read d3/dd/d4b/f7a [3826752,36166] 0 2024-04-23T10:17:57.996 INFO:tasks.workunit.client.0.smithi026.stdout:5/572: symlink d0/d3c/d5d/d3a/lba 0 2024-04-23T10:17:57.999 INFO:tasks.workunit.client.0.smithi026.stdout:2/587: symlink d3/d19/d21/d88/lca 0 2024-04-23T10:17:58.001 INFO:tasks.workunit.client.0.smithi026.stdout:2/588: write d3/dd/f43 [786030,34132] 0 2024-04-23T10:17:58.002 INFO:tasks.workunit.client.0.smithi026.stdout:8/724: write d5/d56/de8/fd5 [838755,15773] 0 2024-04-23T10:17:58.002 INFO:tasks.workunit.client.0.smithi026.stdout:6/750: rmdir d6/dd5 0 2024-04-23T10:17:58.004 INFO:tasks.workunit.client.0.smithi026.stdout:5/573: creat d0/d68/d91/fbb x:0 0 0 2024-04-23T10:17:58.004 INFO:tasks.workunit.client.0.smithi026.stdout:8/725: stat d5/d56/d47/d99/lef 0 2024-04-23T10:17:58.004 INFO:tasks.workunit.client.0.smithi026.stdout:3/635: write d0/d1e/d30/d43/d6c/d79/d73/f8f [757106,44688] 0 2024-04-23T10:17:58.004 INFO:tasks.workunit.client.0.smithi026.stdout:2/589: fdatasync d3/d19/d21/d23/d3a/d3c/d80/fbd 0 2024-04-23T10:17:58.006 INFO:tasks.workunit.client.0.smithi026.stdout:2/590: read d3/d19/d21/d23/d3a/d3c/f47 [2368185,62016] 0 2024-04-23T10:17:58.008 INFO:tasks.workunit.client.0.smithi026.stdout:1/568: rename dd/d1a/d20/l64 to dd/d1a/d20/lcb 0 2024-04-23T10:17:58.010 INFO:tasks.workunit.client.0.smithi026.stdout:8/726: symlink d5/d9/d22/d65/lfb 0 2024-04-23T10:17:58.011 INFO:tasks.workunit.client.0.smithi026.stdout:5/574: mkdir d0/d3c/d5d/dbc 0 2024-04-23T10:17:58.012 INFO:tasks.workunit.client.0.smithi026.stdout:2/591: rename d3/d19/d21/d23/d3a/d3c/f63 to d3/d19/d21/d88/fcb 0 2024-04-23T10:17:58.015 INFO:tasks.workunit.client.0.smithi026.stdout:2/592: readlink d3/d19/d21/d23/d3a/d65/l75 0 2024-04-23T10:17:58.015 INFO:tasks.workunit.client.0.smithi026.stdout:1/569: creat dd/d1a/d23/d3f/d9a/fcc x:0 0 0 2024-04-23T10:17:58.016 INFO:tasks.workunit.client.0.smithi026.stdout:8/727: creat d5/d9/d22/d65/d78/d3e/ffc x:0 0 0 2024-04-23T10:17:58.017 INFO:tasks.workunit.client.0.smithi026.stdout:5/575: mkdir d0/d3c/d5d/db2/dbd 0 2024-04-23T10:17:58.018 INFO:tasks.workunit.client.0.smithi026.stdout:6/751: dwrite d6/d21/d2f/d32/f55 [0,4194304] 0 2024-04-23T10:17:58.018 INFO:tasks.workunit.client.0.smithi026.stdout:5/576: chown d0/d3c/d5d/f4b 11973 1 2024-04-23T10:17:58.020 INFO:tasks.workunit.client.0.smithi026.stdout:8/728: mkdir d5/d9/dac/dfd 0 2024-04-23T10:17:58.021 INFO:tasks.workunit.client.0.smithi026.stdout:2/593: creat d3/d19/d21/d23/d3a/d65/fcc x:0 0 0 2024-04-23T10:17:58.023 INFO:tasks.workunit.client.0.smithi026.stdout:6/752: creat d6/d21/d58/fe0 x:0 0 0 2024-04-23T10:17:58.025 INFO:tasks.workunit.client.0.smithi026.stdout:1/570: creat dd/d1a/d20/fcd x:0 0 0 2024-04-23T10:17:58.027 INFO:tasks.workunit.client.0.smithi026.stdout:8/729: symlink d5/d9/d22/d65/d78/d3e/dcc/lfe 0 2024-04-23T10:17:58.030 INFO:tasks.workunit.client.0.smithi026.stdout:8/730: chown d5/d56/d33/ddc/de1 0 1 2024-04-23T10:17:58.031 INFO:tasks.workunit.client.0.smithi026.stdout:0/761: dread d7/d8/d1e/d1d/d2f/d6c/fe1 [0,4194304] 0 2024-04-23T10:17:58.032 INFO:tasks.workunit.client.0.smithi026.stdout:1/571: truncate dd/d1a/d20/d25/f5c 1538815 0 2024-04-23T10:17:58.032 INFO:tasks.workunit.client.0.smithi026.stdout:5/577: dwrite d0/f42 [0,4194304] 0 2024-04-23T10:17:58.033 INFO:tasks.workunit.client.0.smithi026.stdout:6/753: rename d6/l42 to d6/d21/d2f/d32/d87/d8e/le1 0 2024-04-23T10:17:58.034 INFO:tasks.workunit.client.0.smithi026.stdout:2/594: getdents d3/d19/d1d 0 2024-04-23T10:17:58.034 INFO:tasks.workunit.client.0.smithi026.stdout:1/572: creat dd/d1a/d23/d69/fce x:0 0 0 2024-04-23T10:17:58.035 INFO:tasks.workunit.client.0.smithi026.stdout:8/731: truncate d5/d56/d3f/fcf 35276 0 2024-04-23T10:17:58.036 INFO:tasks.workunit.client.0.smithi026.stdout:0/762: dread - d7/d8/d1e/d57/da9/fc5 zero size 2024-04-23T10:17:58.036 INFO:tasks.workunit.client.0.smithi026.stdout:5/578: creat d0/d3c/d84/fbe x:0 0 0 2024-04-23T10:17:58.037 INFO:tasks.workunit.client.0.smithi026.stdout:1/573: mkdir dd/d48/dcf 0 2024-04-23T10:17:58.038 INFO:tasks.workunit.client.0.smithi026.stdout:8/732: symlink d5/d56/d33/ddc/lff 0 2024-04-23T10:17:58.039 INFO:tasks.workunit.client.0.smithi026.stdout:5/579: mknod d0/d12/cbf 0 2024-04-23T10:17:58.040 INFO:tasks.workunit.client.0.smithi026.stdout:8/733: write d5/d50/fba [227045,36161] 0 2024-04-23T10:17:58.040 INFO:tasks.workunit.client.0.smithi026.stdout:2/595: creat d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fcd x:0 0 0 2024-04-23T10:17:58.041 INFO:tasks.workunit.client.0.smithi026.stdout:5/580: chown d0/d68/d91/fa1 234512 1 2024-04-23T10:17:58.042 INFO:tasks.workunit.client.0.smithi026.stdout:0/763: mkdir d7/d8/d1e/d57/d114 0 2024-04-23T10:17:58.042 INFO:tasks.workunit.client.0.smithi026.stdout:2/596: write d3/f13 [4469541,101291] 0 2024-04-23T10:17:58.043 INFO:tasks.workunit.client.0.smithi026.stdout:6/754: link d6/d21/d2f/d32/d87/f9d d6/d21/d2f/d37/fe2 0 2024-04-23T10:17:58.047 INFO:tasks.workunit.client.0.smithi026.stdout:8/734: write d5/d56/d3f/fcf [208611,45577] 0 2024-04-23T10:17:58.049 INFO:tasks.workunit.client.0.smithi026.stdout:5/581: dread - d0/d3c/d84/d89/fb9 zero size 2024-04-23T10:17:58.051 INFO:tasks.workunit.client.0.smithi026.stdout:1/574: rename dd/d1a/d20/lcb to dd/d1a/d20/d25/d35/d43/d7b/ld0 0 2024-04-23T10:17:58.051 INFO:tasks.workunit.client.0.smithi026.stdout:0/764: chown d7/d8/d1e/d2a/d6a/d70/fd0 50 1 2024-04-23T10:17:58.052 INFO:tasks.workunit.client.0.smithi026.stdout:5/582: fdatasync d0/f1a 0 2024-04-23T10:17:58.053 INFO:tasks.workunit.client.0.smithi026.stdout:2/597: creat d3/d19/d21/d23/d3a/d3c/d5d/fce x:0 0 0 2024-04-23T10:17:58.056 INFO:tasks.workunit.client.0.smithi026.stdout:1/575: read dd/d1a/f5e [1048309,82412] 0 2024-04-23T10:17:58.056 INFO:tasks.workunit.client.0.smithi026.stdout:8/735: getdents d5/d56 0 2024-04-23T10:17:58.059 INFO:tasks.workunit.client.0.smithi026.stdout:5/583: rename d0/d12/fb5 to d0/d3c/fc0 0 2024-04-23T10:17:58.059 INFO:tasks.workunit.client.0.smithi026.stdout:0/765: dread d7/d8/d1e/f51 [0,4194304] 0 2024-04-23T10:17:58.059 INFO:tasks.workunit.client.0.smithi026.stdout:7/538: sync 2024-04-23T10:17:58.060 INFO:tasks.workunit.client.0.smithi026.stdout:0/766: fdatasync d7/d8/d2d/d60/d62/f5c 0 2024-04-23T10:17:58.060 INFO:tasks.workunit.client.0.smithi026.stdout:7/539: chown dd/d2c/d48/f85 56916 1 2024-04-23T10:17:58.061 INFO:tasks.workunit.client.0.smithi026.stdout:1/576: symlink dd/d15/d7d/d98/ld1 0 2024-04-23T10:17:58.066 INFO:tasks.workunit.client.0.smithi026.stdout:0/767: dwrite d7/f39 [0,4194304] 0 2024-04-23T10:17:58.068 INFO:tasks.workunit.client.0.smithi026.stdout:5/584: creat d0/d3c/d57/da8/fc1 x:0 0 0 2024-04-23T10:17:58.069 INFO:tasks.workunit.client.0.smithi026.stdout:5/585: chown d0/d68/c8e 114172056 1 2024-04-23T10:17:58.071 INFO:tasks.workunit.client.0.smithi026.stdout:2/598: link d3/d19/d4d/fb6 d3/d19/d21/fcf 0 2024-04-23T10:17:58.071 INFO:tasks.workunit.client.0.smithi026.stdout:2/599: readlink d3/dd/lb0 0 2024-04-23T10:17:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:2/600: fdatasync d3/dd/f56 0 2024-04-23T10:17:58.077 INFO:tasks.workunit.client.0.smithi026.stdout:7/540: creat dd/f9e x:0 0 0 2024-04-23T10:17:58.080 INFO:tasks.workunit.client.0.smithi026.stdout:6/755: dwrite d6/d13/f4d [0,4194304] 0 2024-04-23T10:17:58.080 INFO:tasks.workunit.client.0.smithi026.stdout:0/768: mkdir d7/d8/d1e/d1d/d115 0 2024-04-23T10:17:58.081 INFO:tasks.workunit.client.0.smithi026.stdout:5/586: dwrite d0/d3c/f88 [4194304,4194304] 0 2024-04-23T10:17:58.083 INFO:tasks.workunit.client.0.smithi026.stdout:5/587: dread - d0/d68/d91/fbb zero size 2024-04-23T10:17:58.086 INFO:tasks.workunit.client.0.smithi026.stdout:8/736: dwrite d5/d56/d33/f58 [4194304,4194304] 0 2024-04-23T10:17:58.091 INFO:tasks.workunit.client.0.smithi026.stdout:1/577: truncate f2 2348037 0 2024-04-23T10:17:58.092 INFO:tasks.workunit.client.0.smithi026.stdout:7/541: mkdir dd/d1d/d7d/d9f 0 2024-04-23T10:17:58.092 INFO:tasks.workunit.client.0.smithi026.stdout:6/756: mknod d6/d21/d58/d8d/ce3 0 2024-04-23T10:17:58.092 INFO:tasks.workunit.client.0.smithi026.stdout:2/601: mknod d3/d19/cd0 0 2024-04-23T10:17:58.093 INFO:tasks.workunit.client.0.smithi026.stdout:5/588: creat d0/d68/d91/fc2 x:0 0 0 2024-04-23T10:17:58.094 INFO:tasks.workunit.client.0.smithi026.stdout:1/578: rmdir dd/d1a/d23/d3f/d9a 39 2024-04-23T10:17:58.095 INFO:tasks.workunit.client.0.smithi026.stdout:2/602: write d3/d19/d31/f9d [1049392,6880] 0 2024-04-23T10:17:58.096 INFO:tasks.workunit.client.0.smithi026.stdout:0/769: mknod d7/d8/d1e/d2a/c116 0 2024-04-23T10:17:58.097 INFO:tasks.workunit.client.0.smithi026.stdout:2/603: truncate d3/f22 4961979 0 2024-04-23T10:17:58.097 INFO:tasks.workunit.client.0.smithi026.stdout:0/770: chown d7/d8/d2d/fd7 532787 1 2024-04-23T10:17:58.098 INFO:tasks.workunit.client.0.smithi026.stdout:7/542: fdatasync dd/d1d/d50/f6a 0 2024-04-23T10:17:58.105 INFO:tasks.workunit.client.0.smithi026.stdout:8/737: mknod d5/d56/d33/c100 0 2024-04-23T10:17:58.107 INFO:tasks.workunit.client.0.smithi026.stdout:7/543: chown dd/d6c/d72/c94 3 1 2024-04-23T10:17:58.108 INFO:tasks.workunit.client.0.smithi026.stdout:6/757: dwrite d6/d21/d2f/d37/d68/da8/fcc [0,4194304] 0 2024-04-23T10:17:58.108 INFO:tasks.workunit.client.0.smithi026.stdout:5/589: dread - d0/d3c/f7c zero size 2024-04-23T10:17:58.109 INFO:tasks.workunit.client.0.smithi026.stdout:1/579: unlink dd/d1a/f41 0 2024-04-23T10:17:58.111 INFO:tasks.workunit.client.0.smithi026.stdout:5/590: fdatasync d0/f70 0 2024-04-23T10:17:58.112 INFO:tasks.workunit.client.0.smithi026.stdout:1/580: write dd/d15/f81 [128315,30842] 0 2024-04-23T10:17:58.114 INFO:tasks.workunit.client.0.smithi026.stdout:2/604: symlink d3/d19/d31/ld1 0 2024-04-23T10:17:58.115 INFO:tasks.workunit.client.0.smithi026.stdout:1/581: write dd/fc2 [508150,22857] 0 2024-04-23T10:17:58.115 INFO:tasks.workunit.client.0.smithi026.stdout:6/758: read - d6/d33/f67 zero size 2024-04-23T10:17:58.116 INFO:tasks.workunit.client.0.smithi026.stdout:8/738: truncate d5/d9/dac/fae 494429 0 2024-04-23T10:17:58.118 INFO:tasks.workunit.client.0.smithi026.stdout:5/591: write d0/d3c/d84/d89/d8d/fa2 [1526214,54418] 0 2024-04-23T10:17:58.118 INFO:tasks.workunit.client.0.smithi026.stdout:1/582: dread - dd/d15/d7d/d98/fa0 zero size 2024-04-23T10:17:58.122 INFO:tasks.workunit.client.0.smithi026.stdout:2/605: creat d3/d19/d4d/fd2 x:0 0 0 2024-04-23T10:17:58.123 INFO:tasks.workunit.client.0.smithi026.stdout:8/739: fdatasync d5/f84 0 2024-04-23T10:17:58.123 INFO:tasks.workunit.client.0.smithi026.stdout:6/759: readlink d6/d21/d2f/d37/d4f/l9e 0 2024-04-23T10:17:58.125 INFO:tasks.workunit.client.0.smithi026.stdout:0/771: dwrite d7/d8/d1e/d2a/f2e [4194304,4194304] 0 2024-04-23T10:17:58.128 INFO:tasks.workunit.client.0.smithi026.stdout:6/760: write d6/d21/d2f/d37/d68/f6a [395117,62018] 0 2024-04-23T10:17:58.131 INFO:tasks.workunit.client.0.smithi026.stdout:8/740: symlink d5/d56/d33/ddc/l101 0 2024-04-23T10:17:58.131 INFO:tasks.workunit.client.0.smithi026.stdout:2/606: mknod d3/dd/d4b/d9c/cd3 0 2024-04-23T10:17:58.134 INFO:tasks.workunit.client.0.smithi026.stdout:2/607: truncate d3/f84 595179 0 2024-04-23T10:17:58.134 INFO:tasks.workunit.client.0.smithi026.stdout:1/583: dread dd/d48/f63 [0,4194304] 0 2024-04-23T10:17:58.134 INFO:tasks.workunit.client.0.smithi026.stdout:2/608: stat d3/d19/d21/d23/d3a/d3c/d80/d96/lb9 0 2024-04-23T10:17:58.137 INFO:tasks.workunit.client.0.smithi026.stdout:6/761: unlink d6/d21/d2f/d32/lb3 0 2024-04-23T10:17:58.142 INFO:tasks.workunit.client.0.smithi026.stdout:8/741: mknod d5/d56/d47/c102 0 2024-04-23T10:17:58.142 INFO:tasks.workunit.client.0.smithi026.stdout:5/592: link d0/d3c/d5d/c60 d0/d3c/cc3 0 2024-04-23T10:17:58.143 INFO:tasks.workunit.client.0.smithi026.stdout:2/609: creat d3/d19/d21/d23/d3a/d3c/d80/fd4 x:0 0 0 2024-04-23T10:17:58.144 INFO:tasks.workunit.client.0.smithi026.stdout:8/742: truncate d5/d9/d22/d65/d78/fa2 303720 0 2024-04-23T10:17:58.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/762: mknod d6/d21/d2f/d32/d53/dca/ce4 0 2024-04-23T10:17:58.144 INFO:tasks.workunit.client.0.smithi026.stdout:5/593: symlink d0/d3c/d84/lc4 0 2024-04-23T10:17:58.145 INFO:tasks.workunit.client.0.smithi026.stdout:2/610: mknod d3/d19/d31/cd5 0 2024-04-23T10:17:58.145 INFO:tasks.workunit.client.0.smithi026.stdout:5/594: chown d0/d3c/d84/c8b 1159 1 2024-04-23T10:17:58.146 INFO:tasks.workunit.client.0.smithi026.stdout:1/584: creat dd/d1a/d23/d3f/fd2 x:0 0 0 2024-04-23T10:17:58.147 INFO:tasks.workunit.client.0.smithi026.stdout:0/772: dread d7/d8/d2d/d60/d77/feb [0,4194304] 0 2024-04-23T10:17:58.148 INFO:tasks.workunit.client.0.smithi026.stdout:2/611: write d3/d19/d21/d23/d3a/d3c/d80/fbd [976228,47409] 0 2024-04-23T10:17:58.149 INFO:tasks.workunit.client.0.smithi026.stdout:6/763: read d6/d33/f2c [2713963,40939] 0 2024-04-23T10:17:58.150 INFO:tasks.workunit.client.0.smithi026.stdout:5/595: creat d0/d68/d91/d9a/fc5 x:0 0 0 2024-04-23T10:17:58.151 INFO:tasks.workunit.client.0.smithi026.stdout:5/596: chown d0/d3c/d5d/f6b 3 1 2024-04-23T10:17:58.152 INFO:tasks.workunit.client.0.smithi026.stdout:1/585: chown dd/d15/d7d/d98/f9b 3 1 2024-04-23T10:17:58.153 INFO:tasks.workunit.client.0.smithi026.stdout:0/773: mknod d7/d8/d1e/c117 0 2024-04-23T10:17:58.154 INFO:tasks.workunit.client.0.smithi026.stdout:0/774: fdatasync d7/d8/d1e/d2a/f2e 0 2024-04-23T10:17:58.155 INFO:tasks.workunit.client.0.smithi026.stdout:1/586: symlink dd/d48/dab/ld3 0 2024-04-23T10:17:58.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/612: creat d3/d19/d21/d23/d3a/d3c/d80/da7/fd6 x:0 0 0 2024-04-23T10:17:58.158 INFO:tasks.workunit.client.0.smithi026.stdout:0/775: creat d7/d8/d2d/d60/d62/da2/dd9/f118 x:0 0 0 2024-04-23T10:17:58.158 INFO:tasks.workunit.client.0.smithi026.stdout:5/597: dwrite d0/d12/f32 [0,4194304] 0 2024-04-23T10:17:58.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/764: creat d6/d33/fe5 x:0 0 0 2024-04-23T10:17:58.161 INFO:tasks.workunit.client.0.smithi026.stdout:2/613: rmdir d3/d19/d4d 39 2024-04-23T10:17:58.161 INFO:tasks.workunit.client.0.smithi026.stdout:8/743: write d5/d56/d33/f8c [1683427,10123] 0 2024-04-23T10:17:58.162 INFO:tasks.workunit.client.0.smithi026.stdout:1/587: getdents dd/d1a/d23/d92 0 2024-04-23T10:17:58.163 INFO:tasks.workunit.client.0.smithi026.stdout:6/765: unlink d6/d21/d2f/d31/l44 0 2024-04-23T10:17:58.167 INFO:tasks.workunit.client.0.smithi026.stdout:0/776: mkdir d7/d8/d2d/d60/d62/d119 0 2024-04-23T10:17:58.169 INFO:tasks.workunit.client.0.smithi026.stdout:2/614: mknod d3/d19/d21/d23/d3a/d3c/d80/d96/cd7 0 2024-04-23T10:17:58.171 INFO:tasks.workunit.client.0.smithi026.stdout:1/588: unlink dd/d48/l4e 0 2024-04-23T10:17:58.173 INFO:tasks.workunit.client.0.smithi026.stdout:8/744: creat d5/d56/d33/ddc/de1/da8/f103 x:0 0 0 2024-04-23T10:17:58.176 INFO:tasks.workunit.client.0.smithi026.stdout:8/745: readlink d5/d56/d47/l52 0 2024-04-23T10:17:58.177 INFO:tasks.workunit.client.0.smithi026.stdout:5/598: write d0/d3c/d5d/f14 [2938624,94690] 0 2024-04-23T10:17:58.179 INFO:tasks.workunit.client.0.smithi026.stdout:0/777: dwrite d7/dc2/dcc/fff [0,4194304] 0 2024-04-23T10:17:58.191 INFO:tasks.workunit.client.0.smithi026.stdout:2/615: mkdir d3/d19/d21/d88/dd8 0 2024-04-23T10:17:58.193 INFO:tasks.workunit.client.0.smithi026.stdout:1/589: creat dd/d1a/d20/d25/d35/d43/d7b/fd4 x:0 0 0 2024-04-23T10:17:58.194 INFO:tasks.workunit.client.0.smithi026.stdout:8/746: mknod d5/d9/d22/d65/c104 0 2024-04-23T10:17:58.196 INFO:tasks.workunit.client.0.smithi026.stdout:2/616: mkdir d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9 0 2024-04-23T10:17:58.197 INFO:tasks.workunit.client.0.smithi026.stdout:1/590: write dd/d48/f63 [1484744,26518] 0 2024-04-23T10:17:58.200 INFO:tasks.workunit.client.0.smithi026.stdout:1/591: chown dd/d1a/d20/d25/d35 16918668 1 2024-04-23T10:17:58.207 INFO:tasks.workunit.client.0.smithi026.stdout:5/599: dwrite d0/d3c/fc0 [0,4194304] 0 2024-04-23T10:17:58.207 INFO:tasks.workunit.client.0.smithi026.stdout:1/592: mkdir dd/d1a/d20/d25/d35/d7f/dd5 0 2024-04-23T10:17:58.210 INFO:tasks.workunit.client.0.smithi026.stdout:5/600: rmdir d0/d3c/d5d/d3a 39 2024-04-23T10:17:58.211 INFO:tasks.workunit.client.0.smithi026.stdout:5/601: readlink d0/d3c/d84/d89/d8d/la5 0 2024-04-23T10:17:58.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/593: mkdir dd/d15/d7d/da1/dd6 0 2024-04-23T10:17:58.216 INFO:tasks.workunit.client.0.smithi026.stdout:5/602: mkdir d0/d3c/d5d/db2/dc6 0 2024-04-23T10:17:58.220 INFO:tasks.workunit.client.0.smithi026.stdout:8/747: dread d5/d56/fad [0,4194304] 0 2024-04-23T10:17:58.223 INFO:tasks.workunit.client.0.smithi026.stdout:6/766: dwrite d6/d21/d2f/d32/d53/f62 [0,4194304] 0 2024-04-23T10:17:58.224 INFO:tasks.workunit.client.0.smithi026.stdout:5/603: dread - d0/d12/f4f zero size 2024-04-23T10:17:58.225 INFO:tasks.workunit.client.0.smithi026.stdout:0/778: dread d7/d8/d1e/d1d/f73 [0,4194304] 0 2024-04-23T10:17:58.225 INFO:tasks.workunit.client.0.smithi026.stdout:2/617: dwrite d3/d19/d21/d23/d3a/d3c/f47 [0,4194304] 0 2024-04-23T10:17:58.227 INFO:tasks.workunit.client.0.smithi026.stdout:2/618: chown d3/d19/f5a 116 1 2024-04-23T10:17:58.228 INFO:tasks.workunit.client.0.smithi026.stdout:2/619: chown d3/d19/d21/d23/d3a/d65 247609789 1 2024-04-23T10:17:58.228 INFO:tasks.workunit.client.0.smithi026.stdout:1/594: dread dd/f2b [0,4194304] 0 2024-04-23T10:17:58.229 INFO:tasks.workunit.client.0.smithi026.stdout:6/767: mkdir d6/db8/de6 0 2024-04-23T10:17:58.229 INFO:tasks.workunit.client.0.smithi026.stdout:5/604: creat d0/d3c/d84/d89/fc7 x:0 0 0 2024-04-23T10:17:58.230 INFO:tasks.workunit.client.0.smithi026.stdout:0/779: fsync d7/d8/d1e/f18 0 2024-04-23T10:17:58.234 INFO:tasks.workunit.client.0.smithi026.stdout:2/620: symlink d3/lda 0 2024-04-23T10:17:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:4/541: sync 2024-04-23T10:17:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:1/595: link dd/d15/d7d/d98/fa0 dd/d1a/d20/d25/d35/d43/fd7 0 2024-04-23T10:17:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:5/605: getdents d0/d3c/d5d/db2/dc6 0 2024-04-23T10:17:58.249 INFO:tasks.workunit.client.0.smithi026.stdout:6/768: rename d6/d21/d2f/d32/lb9 to d6/d21/d2f/d37/d68/da8/le7 0 2024-04-23T10:17:58.251 INFO:tasks.workunit.client.0.smithi026.stdout:0/780: write d7/d8/f78 [770229,100510] 0 2024-04-23T10:17:58.251 INFO:tasks.workunit.client.0.smithi026.stdout:1/596: truncate dd/d15/d7d/d98/fa0 286377 0 2024-04-23T10:17:58.252 INFO:tasks.workunit.client.0.smithi026.stdout:5/606: symlink d0/d3c/d57/da8/lc8 0 2024-04-23T10:17:58.252 INFO:tasks.workunit.client.0.smithi026.stdout:8/748: dwrite d5/d56/d15/f5d [0,4194304] 0 2024-04-23T10:17:58.253 INFO:tasks.workunit.client.0.smithi026.stdout:6/769: write d6/d21/d2f/d32/fd1 [777035,128235] 0 2024-04-23T10:17:58.254 INFO:tasks.workunit.client.0.smithi026.stdout:8/749: chown d5/d56/d3f/f8d 13 1 2024-04-23T10:17:58.256 INFO:tasks.workunit.client.0.smithi026.stdout:1/597: write dd/d1a/d20/d25/f4a [687234,122045] 0 2024-04-23T10:17:58.257 INFO:tasks.workunit.client.0.smithi026.stdout:8/750: dread - d5/d56/d33/ddc/de1/fe4 zero size 2024-04-23T10:17:58.258 INFO:tasks.workunit.client.0.smithi026.stdout:4/542: getdents d4/d7/d61 0 2024-04-23T10:17:58.260 INFO:tasks.workunit.client.0.smithi026.stdout:0/781: symlink d7/d8/d1e/d1d/d115/l11a 0 2024-04-23T10:17:58.261 INFO:tasks.workunit.client.0.smithi026.stdout:6/770: symlink d6/d21/d2f/d31/d52/d82/le8 0 2024-04-23T10:17:58.264 INFO:tasks.workunit.client.0.smithi026.stdout:2/621: rename d3/d19/d21/d23/d3a/d3c/d80/lb3 to d3/dd/ldb 0 2024-04-23T10:17:58.265 INFO:tasks.workunit.client.0.smithi026.stdout:1/598: symlink dd/d1a/d20/d25/d35/d7f/ld8 0 2024-04-23T10:17:58.266 INFO:tasks.workunit.client.0.smithi026.stdout:1/599: dread - dd/d1a/d23/fad zero size 2024-04-23T10:17:58.266 INFO:tasks.workunit.client.0.smithi026.stdout:5/607: rename d0/d3c/d5d/d3a/f4c to d0/d3c/d5d/db2/dbd/fc9 0 2024-04-23T10:17:58.267 INFO:tasks.workunit.client.0.smithi026.stdout:4/543: symlink d4/d7/d51/d6c/d6f/d80/lb5 0 2024-04-23T10:17:58.268 INFO:tasks.workunit.client.0.smithi026.stdout:0/782: mknod d7/d8/c11b 0 2024-04-23T10:17:58.271 INFO:tasks.workunit.client.0.smithi026.stdout:0/783: chown d7/d8/f9 182 1 2024-04-23T10:17:58.271 INFO:tasks.workunit.client.0.smithi026.stdout:5/608: mkdir d0/d3c/d5d/db2/dca 0 2024-04-23T10:17:58.272 INFO:tasks.workunit.client.0.smithi026.stdout:8/751: rename d5/d56/d15/c61 to d5/d56/d15/d8b/c105 0 2024-04-23T10:17:58.272 INFO:tasks.workunit.client.0.smithi026.stdout:1/600: dread dd/d15/f81 [0,4194304] 0 2024-04-23T10:17:58.274 INFO:tasks.workunit.client.0.smithi026.stdout:4/544: mknod d4/d7/d51/d6c/d6f/d80/cb6 0 2024-04-23T10:17:58.274 INFO:tasks.workunit.client.0.smithi026.stdout:0/784: dread - d7/d8/d1e/d57/da9/fc5 zero size 2024-04-23T10:17:58.276 INFO:tasks.workunit.client.0.smithi026.stdout:6/771: dwrite d6/d21/f72 [0,4194304] 0 2024-04-23T10:17:58.276 INFO:tasks.workunit.client.0.smithi026.stdout:4/545: fsync d4/d22/d4e/d57/faf 0 2024-04-23T10:17:58.276 INFO:tasks.workunit.client.0.smithi026.stdout:8/752: mkdir d5/d9/d22/d106 0 2024-04-23T10:17:58.281 INFO:tasks.workunit.client.0.smithi026.stdout:0/785: dread d7/d8/d1e/d2a/f2e [4194304,4194304] 0 2024-04-23T10:17:58.282 INFO:tasks.workunit.client.0.smithi026.stdout:4/546: creat d4/d5b/d7b/d86/fb7 x:0 0 0 2024-04-23T10:17:58.288 INFO:tasks.workunit.client.0.smithi026.stdout:6/772: dwrite d6/d21/d2f/d32/f55 [0,4194304] 0 2024-04-23T10:17:58.288 INFO:tasks.workunit.client.0.smithi026.stdout:1/601: symlink dd/d15/d7d/da1/dc6/ld9 0 2024-04-23T10:17:58.288 INFO:tasks.workunit.client.0.smithi026.stdout:8/753: unlink d5/d9/d64/dc5/cd0 0 2024-04-23T10:17:58.291 INFO:tasks.workunit.client.0.smithi026.stdout:8/754: stat d5/d56/d15/f5d 0 2024-04-23T10:17:58.292 INFO:tasks.workunit.client.0.smithi026.stdout:0/786: mkdir d7/d8/d2d/d60/d62/db2/dca/d11c 0 2024-04-23T10:17:58.293 INFO:tasks.workunit.client.0.smithi026.stdout:8/755: fsync d5/d56/fc1 0 2024-04-23T10:17:58.293 INFO:tasks.workunit.client.0.smithi026.stdout:4/547: dwrite d4/d7/fa6 [0,4194304] 0 2024-04-23T10:17:58.293 INFO:tasks.workunit.client.0.smithi026.stdout:6/773: truncate d6/d21/d2f/d31/faa 1278826 0 2024-04-23T10:17:58.298 INFO:tasks.workunit.client.0.smithi026.stdout:6/774: fsync d6/d21/d2f/fc1 0 2024-04-23T10:17:58.301 INFO:tasks.workunit.client.0.smithi026.stdout:0/787: rmdir d7/d8/d2d/d60/d62/db2/dca 39 2024-04-23T10:17:58.302 INFO:tasks.workunit.client.0.smithi026.stdout:0/788: write d7/da1/faf [169213,73933] 0 2024-04-23T10:17:58.304 INFO:tasks.workunit.client.0.smithi026.stdout:5/609: dread d0/d3c/d84/d89/d8d/d8f/fac [0,4194304] 0 2024-04-23T10:17:58.305 INFO:tasks.workunit.client.0.smithi026.stdout:5/610: chown d0/ld 12054382 1 2024-04-23T10:17:58.305 INFO:tasks.workunit.client.0.smithi026.stdout:4/548: write d4/d22/d2e/f32 [3752712,67145] 0 2024-04-23T10:17:58.308 INFO:tasks.workunit.client.0.smithi026.stdout:6/775: creat d6/d21/d2f/d32/d87/fe9 x:0 0 0 2024-04-23T10:17:58.310 INFO:tasks.workunit.client.0.smithi026.stdout:0/789: unlink d7/d8/d2d/l4f 0 2024-04-23T10:17:58.311 INFO:tasks.workunit.client.0.smithi026.stdout:5/611: creat d0/d3c/d5d/db2/fcb x:0 0 0 2024-04-23T10:17:58.311 INFO:tasks.workunit.client.0.smithi026.stdout:0/790: chown d7/d8/f78 3 1 2024-04-23T10:17:58.312 INFO:tasks.workunit.client.0.smithi026.stdout:4/549: write d4/d7/d51/fa1 [1973095,59025] 0 2024-04-23T10:17:58.314 INFO:tasks.workunit.client.0.smithi026.stdout:8/756: rename d5/d9/d22/d65/lfb to d5/d9/d22/d65/d78/l107 0 2024-04-23T10:17:58.316 INFO:tasks.workunit.client.0.smithi026.stdout:0/791: creat d7/da1/f11d x:0 0 0 2024-04-23T10:17:58.318 INFO:tasks.workunit.client.0.smithi026.stdout:5/612: rename d0/d3c/d57/da8 to d0/d68/dcc 0 2024-04-23T10:17:58.320 INFO:tasks.workunit.client.0.smithi026.stdout:5/613: truncate d0/d3c/f7c 514194 0 2024-04-23T10:17:58.320 INFO:tasks.workunit.client.0.smithi026.stdout:8/757: unlink d5/d50/d9a/cd8 0 2024-04-23T10:17:58.321 INFO:tasks.workunit.client.0.smithi026.stdout:8/758: chown d5/d9/d22/d65/d78/dc9/f73 7443 1 2024-04-23T10:17:58.322 INFO:tasks.workunit.client.0.smithi026.stdout:6/776: link d6/d21/lc0 d6/d13/d15/lea 0 2024-04-23T10:17:58.324 INFO:tasks.workunit.client.0.smithi026.stdout:5/614: creat d0/d6f/fcd x:0 0 0 2024-04-23T10:17:58.324 INFO:tasks.workunit.client.0.smithi026.stdout:5/615: stat d0/d12/f3f 0 2024-04-23T10:17:58.324 INFO:tasks.workunit.client.0.smithi026.stdout:0/792: mkdir d7/d8/d1e/d11e 0 2024-04-23T10:17:58.326 INFO:tasks.workunit.client.0.smithi026.stdout:1/602: dread dd/d1a/d23/d3f/f58 [0,4194304] 0 2024-04-23T10:17:58.328 INFO:tasks.workunit.client.0.smithi026.stdout:0/793: rmdir d7/d8 39 2024-04-23T10:17:58.330 INFO:tasks.workunit.client.0.smithi026.stdout:1/603: symlink dd/d1a/d23/lda 0 2024-04-23T10:17:58.331 INFO:tasks.workunit.client.0.smithi026.stdout:4/550: dwrite d4/d7/f8 [0,4194304] 0 2024-04-23T10:17:58.332 INFO:tasks.workunit.client.0.smithi026.stdout:6/777: write f3 [4778843,18405] 0 2024-04-23T10:17:58.335 INFO:tasks.workunit.client.0.smithi026.stdout:8/759: getdents d5/d56/d33/ddc/de1 0 2024-04-23T10:17:58.337 INFO:tasks.workunit.client.0.smithi026.stdout:1/604: truncate dd/d1a/d6a/d7c/f8a 565875 0 2024-04-23T10:17:58.340 INFO:tasks.workunit.client.0.smithi026.stdout:6/778: creat d6/d21/d2f/d37/d68/feb x:0 0 0 2024-04-23T10:17:58.344 INFO:tasks.workunit.client.0.smithi026.stdout:5/616: dread d0/d3c/f51 [0,4194304] 0 2024-04-23T10:17:58.345 INFO:tasks.workunit.client.0.smithi026.stdout:0/794: link d7/d8/d1e/f7a d7/d8/d2d/d60/d77/f11f 0 2024-04-23T10:17:58.346 INFO:tasks.workunit.client.0.smithi026.stdout:5/617: dread - d0/d3c/d5d/f86 zero size 2024-04-23T10:17:58.346 INFO:tasks.workunit.client.0.smithi026.stdout:4/551: dwrite d4/d7/f3e [0,4194304] 0 2024-04-23T10:17:58.348 INFO:tasks.workunit.client.0.smithi026.stdout:0/795: fsync d7/d8/d1e/d1d/d2f/f52 0 2024-04-23T10:17:58.348 INFO:tasks.workunit.client.0.smithi026.stdout:1/605: dwrite dd/d48/f72 [0,4194304] 0 2024-04-23T10:17:58.351 INFO:tasks.workunit.client.0.smithi026.stdout:4/552: rmdir d4/d5b/d7b/d36/d38/d83 39 2024-04-23T10:17:58.353 INFO:tasks.workunit.client.0.smithi026.stdout:6/779: rename d6/d21/d2f/d37/d68/da8/le7 to d6/d21/d58/lec 0 2024-04-23T10:17:58.354 INFO:tasks.workunit.client.0.smithi026.stdout:0/796: mknod d7/d8/d1e/d1d/d115/c120 0 2024-04-23T10:17:58.356 INFO:tasks.workunit.client.0.smithi026.stdout:6/780: stat d6/d21/d58 0 2024-04-23T10:17:58.356 INFO:tasks.workunit.client.0.smithi026.stdout:0/797: write d7/d8/f10b [761347,38537] 0 2024-04-23T10:17:58.361 INFO:tasks.workunit.client.0.smithi026.stdout:4/553: creat d4/d14/d30/fb8 x:0 0 0 2024-04-23T10:17:58.361 INFO:tasks.workunit.client.0.smithi026.stdout:5/618: rename d0/d12/f28 to d0/d3c/d5d/dbc/fce 0 2024-04-23T10:17:58.362 INFO:tasks.workunit.client.0.smithi026.stdout:0/798: write d7/d8/d2d/d60/d62/fea [4279589,100873] 0 2024-04-23T10:17:58.363 INFO:tasks.workunit.client.0.smithi026.stdout:6/781: rmdir d6/d21/d2f/d31/d52 39 2024-04-23T10:17:58.368 INFO:tasks.workunit.client.0.smithi026.stdout:5/619: unlink d0/d68/d91/fa1 0 2024-04-23T10:17:58.372 INFO:tasks.workunit.client.0.smithi026.stdout:4/554: creat d4/d14/d30/d52/fb9 x:0 0 0 2024-04-23T10:17:58.372 INFO:tasks.workunit.client.0.smithi026.stdout:1/606: creat dd/d1a/d20/d25/d35/fdb x:0 0 0 2024-04-23T10:17:58.374 INFO:tasks.workunit.client.0.smithi026.stdout:4/555: rmdir d4/d7/d61 39 2024-04-23T10:17:58.376 INFO:tasks.workunit.client.0.smithi026.stdout:8/760: dread d5/d56/de8/fd5 [0,4194304] 0 2024-04-23T10:17:58.379 INFO:tasks.workunit.client.0.smithi026.stdout:0/799: link d7/d8/d1e/d2a/l9b d7/d8/d1e/d1d/l121 0 2024-04-23T10:17:58.380 INFO:tasks.workunit.client.0.smithi026.stdout:4/556: mkdir d4/d5b/da7/dba 0 2024-04-23T10:17:58.381 INFO:tasks.workunit.client.0.smithi026.stdout:1/607: dwrite dd/d1a/d20/d25/fb3 [0,4194304] 0 2024-04-23T10:17:58.382 INFO:tasks.workunit.client.0.smithi026.stdout:1/608: write f9 [1759569,48473] 0 2024-04-23T10:17:58.383 INFO:tasks.workunit.client.0.smithi026.stdout:8/761: mkdir d5/d9/d22/d108 0 2024-04-23T10:17:58.386 INFO:tasks.workunit.client.0.smithi026.stdout:4/557: symlink d4/d42/lbb 0 2024-04-23T10:17:58.387 INFO:tasks.workunit.client.0.smithi026.stdout:4/558: read d4/f5 [2252592,70796] 0 2024-04-23T10:17:58.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/620: truncate d0/d3c/d84/f87 348132 0 2024-04-23T10:17:58.389 INFO:tasks.workunit.client.0.smithi026.stdout:8/762: readlink d5/d9/d64/lb6 0 2024-04-23T10:17:58.390 INFO:tasks.workunit.client.0.smithi026.stdout:5/621: symlink d0/lcf 0 2024-04-23T10:17:58.390 INFO:tasks.workunit.client.0.smithi026.stdout:8/763: fdatasync d5/d56/de8/ff0 0 2024-04-23T10:17:58.391 INFO:tasks.workunit.client.0.smithi026.stdout:8/764: fsync d5/d56/d33/ddc/de1/fc7 0 2024-04-23T10:17:58.392 INFO:tasks.workunit.client.0.smithi026.stdout:8/765: chown d5/d50/f7a 0 1 2024-04-23T10:17:58.392 INFO:tasks.workunit.client.0.smithi026.stdout:4/559: rename d4/d7/d51/d6c/f79 to d4/d22/d4e/d57/fbc 0 2024-04-23T10:17:58.392 INFO:tasks.workunit.client.0.smithi026.stdout:8/766: chown d5/d9/l7f 10583 1 2024-04-23T10:17:58.393 INFO:tasks.workunit.client.0.smithi026.stdout:1/609: getdents dd/d1a/d20/d25/d35/d73 0 2024-04-23T10:17:58.394 INFO:tasks.workunit.client.0.smithi026.stdout:4/560: write d4/f35 [6375595,87121] 0 2024-04-23T10:17:58.394 INFO:tasks.workunit.client.0.smithi026.stdout:8/767: readlink d5/d9/d64/lb6 0 2024-04-23T10:17:58.396 INFO:tasks.workunit.client.0.smithi026.stdout:4/561: write d4/d22/d2e/f9e [892215,49003] 0 2024-04-23T10:17:58.399 INFO:tasks.workunit.client.0.smithi026.stdout:1/610: mkdir dd/d15/d7d/da1/dc6/ddc 0 2024-04-23T10:17:58.401 INFO:tasks.workunit.client.0.smithi026.stdout:6/782: dread d6/d21/d2f/d31/d52/d82/fba [0,4194304] 0 2024-04-23T10:17:58.404 INFO:tasks.workunit.client.0.smithi026.stdout:1/611: symlink dd/d48/ldd 0 2024-04-23T10:17:58.409 INFO:tasks.workunit.client.0.smithi026.stdout:0/800: dread d7/d43/f8d [0,4194304] 0 2024-04-23T10:17:58.411 INFO:tasks.workunit.client.0.smithi026.stdout:1/612: mkdir dd/d1a/d20/d25/d35/d7f/dd5/dde 0 2024-04-23T10:17:58.416 INFO:tasks.workunit.client.0.smithi026.stdout:4/562: dwrite d4/d22/d4e/d57/faf [0,4194304] 0 2024-04-23T10:17:58.417 INFO:tasks.workunit.client.0.smithi026.stdout:5/622: truncate d0/d3c/d84/d89/d8d/d8f/fa6 748224 0 2024-04-23T10:17:58.419 INFO:tasks.workunit.client.0.smithi026.stdout:1/613: truncate dd/d1a/d20/d25/d35/d43/f50 579146 0 2024-04-23T10:17:58.419 INFO:tasks.workunit.client.0.smithi026.stdout:8/768: dwrite d5/d56/d15/d76/f7c [0,4194304] 0 2024-04-23T10:17:58.421 INFO:tasks.workunit.client.0.smithi026.stdout:0/801: truncate d7/d8/d1e/d1d/d2f/dd1/dd6/fdf 1506750 0 2024-04-23T10:17:58.422 INFO:tasks.workunit.client.0.smithi026.stdout:0/802: fsync d7/d8/d1e/d1d/f67 0 2024-04-23T10:17:58.422 INFO:tasks.workunit.client.0.smithi026.stdout:5/623: creat d0/d6f/fd0 x:0 0 0 2024-04-23T10:17:58.427 INFO:tasks.workunit.client.0.smithi026.stdout:5/624: truncate d0/d12/f98 253629 0 2024-04-23T10:17:58.427 INFO:tasks.workunit.client.0.smithi026.stdout:0/803: fdatasync d7/d8/d2d/d60/d62/db2/db4/fc8 0 2024-04-23T10:17:58.428 INFO:tasks.workunit.client.0.smithi026.stdout:8/769: rmdir d5/d9/dac/dfd 0 2024-04-23T10:17:58.429 INFO:tasks.workunit.client.0.smithi026.stdout:4/563: dread d4/d5b/f75 [0,4194304] 0 2024-04-23T10:17:58.429 INFO:tasks.workunit.client.0.smithi026.stdout:6/783: dread d6/d21/d58/fad [0,4194304] 0 2024-04-23T10:17:58.430 INFO:tasks.workunit.client.0.smithi026.stdout:4/564: read - d4/d5b/d7b/d86/fa3 zero size 2024-04-23T10:17:58.433 INFO:tasks.workunit.client.0.smithi026.stdout:5/625: mknod d0/d3c/cd1 0 2024-04-23T10:17:58.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/804: creat d7/d8/d1e/d1d/d2f/dd1/dd6/f122 x:0 0 0 2024-04-23T10:17:58.435 INFO:tasks.workunit.client.0.smithi026.stdout:8/770: mknod d5/d56/d47/c109 0 2024-04-23T10:17:58.439 INFO:tasks.workunit.client.0.smithi026.stdout:6/784: unlink d6/d21/d58/d8d/f80 0 2024-04-23T10:17:58.440 INFO:tasks.workunit.client.0.smithi026.stdout:4/565: chown d4/d22/d4e/d57/fbc 43550490 1 2024-04-23T10:17:58.444 INFO:tasks.workunit.client.0.smithi026.stdout:6/785: mknod d6/d21/d58/d8d/d90/ced 0 2024-04-23T10:17:58.445 INFO:tasks.workunit.client.0.smithi026.stdout:6/786: read - d6/d21/d2f/d37/d9a/fb6 zero size 2024-04-23T10:17:58.447 INFO:tasks.workunit.client.0.smithi026.stdout:6/787: write d6/d21/d2f/d31/fcb [119363,128421] 0 2024-04-23T10:17:58.450 INFO:tasks.workunit.client.0.smithi026.stdout:0/805: link d7/d8/d1e/d57/l7e d7/d8/d1e/dd3/de7/l123 0 2024-04-23T10:17:58.452 INFO:tasks.workunit.client.0.smithi026.stdout:6/788: unlink d6/d21/d58/d8d/ce3 0 2024-04-23T10:17:58.452 INFO:tasks.workunit.client.0.smithi026.stdout:1/614: dread dd/d1a/f83 [0,4194304] 0 2024-04-23T10:17:58.454 INFO:tasks.workunit.client.0.smithi026.stdout:4/566: creat d4/d22/fbd x:0 0 0 2024-04-23T10:17:58.454 INFO:tasks.workunit.client.0.smithi026.stdout:1/615: read dd/d1a/d20/d25/f38 [3153613,10149] 0 2024-04-23T10:17:58.455 INFO:tasks.workunit.client.0.smithi026.stdout:0/806: creat d7/d8/d2d/d60/d62/da2/f124 x:0 0 0 2024-04-23T10:17:58.456 INFO:tasks.workunit.client.0.smithi026.stdout:6/789: symlink d6/d21/d2f/d37/lee 0 2024-04-23T10:17:58.457 INFO:tasks.workunit.client.0.smithi026.stdout:5/626: write d0/d68/f76 [907342,89653] 0 2024-04-23T10:17:58.457 INFO:tasks.workunit.client.0.smithi026.stdout:8/771: dread d5/d9/dac/faf [0,4194304] 0 2024-04-23T10:17:58.458 INFO:tasks.workunit.client.0.smithi026.stdout:4/567: fdatasync d4/d5b/f60 0 2024-04-23T10:17:58.459 INFO:tasks.workunit.client.0.smithi026.stdout:6/790: write d6/d21/d2f/d32/f55 [2389244,68660] 0 2024-04-23T10:17:58.460 INFO:tasks.workunit.client.0.smithi026.stdout:1/616: read dd/f21 [324749,83490] 0 2024-04-23T10:17:58.461 INFO:tasks.workunit.client.0.smithi026.stdout:4/568: chown d4/d22/d2e 88666 1 2024-04-23T10:17:58.462 INFO:tasks.workunit.client.0.smithi026.stdout:0/807: creat d7/d8/d1e/dd3/de7/dfe/f125 x:0 0 0 2024-04-23T10:17:58.462 INFO:tasks.workunit.client.0.smithi026.stdout:6/791: readlink d6/d21/d58/d8d/d90/ldf 0 2024-04-23T10:17:58.463 INFO:tasks.workunit.client.0.smithi026.stdout:5/627: dread d0/d3c/d84/f9d [0,4194304] 0 2024-04-23T10:17:58.464 INFO:tasks.workunit.client.0.smithi026.stdout:8/772: unlink d5/d56/de8/fd5 0 2024-04-23T10:17:58.464 INFO:tasks.workunit.client.0.smithi026.stdout:0/808: write d7/d8/d2d/d60/d77/f107 [220810,35520] 0 2024-04-23T10:17:58.466 INFO:tasks.workunit.client.0.smithi026.stdout:8/773: write d5/d9/d22/d65/d78/d3e/ffc [955576,37875] 0 2024-04-23T10:17:58.466 INFO:tasks.workunit.client.0.smithi026.stdout:9/769: sync 2024-04-23T10:17:58.467 INFO:tasks.workunit.client.0.smithi026.stdout:1/617: creat dd/d15/d7d/d98/fdf x:0 0 0 2024-04-23T10:17:58.467 INFO:tasks.workunit.client.0.smithi026.stdout:0/809: write d7/d8/d1e/d1d/d2f/dd1/dd6/f122 [756885,92148] 0 2024-04-23T10:17:58.471 INFO:tasks.workunit.client.0.smithi026.stdout:5/628: dread - d0/f2a zero size 2024-04-23T10:17:58.474 INFO:tasks.workunit.client.0.smithi026.stdout:0/810: rmdir d7/d8/d2d/d60/d62/db2 39 2024-04-23T10:17:58.474 INFO:tasks.workunit.client.0.smithi026.stdout:9/770: read d13/d3b/d5b/f63 [421933,123635] 0 2024-04-23T10:17:58.475 INFO:tasks.workunit.client.0.smithi026.stdout:9/771: dread - d13/d19/f8b zero size 2024-04-23T10:17:58.476 INFO:tasks.workunit.client.0.smithi026.stdout:6/792: mkdir d6/d21/d2f/def 0 2024-04-23T10:17:58.478 INFO:tasks.workunit.client.0.smithi026.stdout:5/629: rmdir d0/d68/d91 39 2024-04-23T10:17:58.478 INFO:tasks.workunit.client.0.smithi026.stdout:6/793: write d6/d21/d58/fad [2097806,97075] 0 2024-04-23T10:17:58.478 INFO:tasks.workunit.client.0.smithi026.stdout:4/569: write d4/d7/f1f [5542020,21933] 0 2024-04-23T10:17:58.481 INFO:tasks.workunit.client.0.smithi026.stdout:6/794: read - d6/d21/d2f/fc1 zero size 2024-04-23T10:17:58.482 INFO:tasks.workunit.client.0.smithi026.stdout:5/630: dread - d0/d6f/fd0 zero size 2024-04-23T10:17:58.482 INFO:tasks.workunit.client.0.smithi026.stdout:0/811: mkdir d7/d8/d2d/d60/d62/db2/d126 0 2024-04-23T10:17:58.483 INFO:tasks.workunit.client.0.smithi026.stdout:8/774: dread d5/d9/d22/d65/f87 [0,4194304] 0 2024-04-23T10:17:58.485 INFO:tasks.workunit.client.0.smithi026.stdout:4/570: creat d4/d5b/d7b/d4d/dad/fbe x:0 0 0 2024-04-23T10:17:58.487 INFO:tasks.workunit.client.0.smithi026.stdout:6/795: symlink d6/d13/dcf/dd6/lf0 0 2024-04-23T10:17:58.487 INFO:tasks.workunit.client.0.smithi026.stdout:0/812: fsync d7/d8/d1e/d1d/d2f/f44 0 2024-04-23T10:17:58.489 INFO:tasks.workunit.client.0.smithi026.stdout:4/571: mkdir d4/d1b/dbf 0 2024-04-23T10:17:58.490 INFO:tasks.workunit.client.0.smithi026.stdout:6/796: chown d6/c6f 52 1 2024-04-23T10:17:58.491 INFO:tasks.workunit.client.0.smithi026.stdout:1/618: dread dd/d1a/d20/d25/f38 [0,4194304] 0 2024-04-23T10:17:58.492 INFO:tasks.workunit.client.0.smithi026.stdout:5/631: creat d0/d3c/fd2 x:0 0 0 2024-04-23T10:17:58.493 INFO:tasks.workunit.client.0.smithi026.stdout:5/632: readlink d0/d3c/d5d/l31 0 2024-04-23T10:17:58.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/619: write dd/d15/f68 [1141069,57903] 0 2024-04-23T10:17:58.493 INFO:tasks.workunit.client.0.smithi026.stdout:4/572: symlink d4/d7/d51/d6c/d6f/lc0 0 2024-04-23T10:17:58.495 INFO:tasks.workunit.client.0.smithi026.stdout:9/772: truncate d13/d3e/f80 193544 0 2024-04-23T10:17:58.500 INFO:tasks.workunit.client.0.smithi026.stdout:4/573: rename d4/d5b/d7b/f41 to d4/d1b/fc1 0 2024-04-23T10:17:58.501 INFO:tasks.workunit.client.0.smithi026.stdout:4/574: chown d4/d5b/d7b/d4d/dad 2 1 2024-04-23T10:17:58.501 INFO:tasks.workunit.client.0.smithi026.stdout:4/575: stat d4/d1b/da0 0 2024-04-23T10:17:58.502 INFO:tasks.workunit.client.0.smithi026.stdout:6/797: link d6/d21/d58/f9b d6/d21/d58/d8d/ff1 0 2024-04-23T10:17:58.504 INFO:tasks.workunit.client.0.smithi026.stdout:5/633: chown d0/d68/d91/d9a/la7 409 1 2024-04-23T10:17:58.510 INFO:tasks.workunit.client.0.smithi026.stdout:4/576: creat d4/d1b/fc2 x:0 0 0 2024-04-23T10:17:58.510 INFO:tasks.workunit.client.0.smithi026.stdout:9/773: rmdir d13/d1b/d98/dc7 0 2024-04-23T10:17:58.512 INFO:tasks.workunit.client.0.smithi026.stdout:8/775: dread d5/d56/d47/d99/fa3 [0,4194304] 0 2024-04-23T10:17:58.513 INFO:tasks.workunit.client.0.smithi026.stdout:4/577: stat d4/d5b/d7b/c70 0 2024-04-23T10:17:58.516 INFO:tasks.workunit.client.0.smithi026.stdout:9/774: symlink d13/d19/da7/dc1/lea 0 2024-04-23T10:17:58.517 INFO:tasks.workunit.client.0.smithi026.stdout:9/775: readlink l3 0 2024-04-23T10:17:58.519 INFO:tasks.workunit.client.0.smithi026.stdout:6/798: dwrite d6/d21/d2f/d32/fd1 [0,4194304] 0 2024-04-23T10:17:58.519 INFO:tasks.workunit.client.0.smithi026.stdout:4/578: mknod d4/d22/d4e/cc3 0 2024-04-23T10:17:58.520 INFO:tasks.workunit.client.0.smithi026.stdout:0/813: dwrite d7/d8/d1e/d1d/d2f/dd1/dd6/fdf [0,4194304] 0 2024-04-23T10:17:58.522 INFO:tasks.workunit.client.0.smithi026.stdout:5/634: dwrite d0/d3c/d84/fab [0,4194304] 0 2024-04-23T10:17:58.524 INFO:tasks.workunit.client.0.smithi026.stdout:8/776: truncate d5/d9/d22/d65/d78/d3e/fc6 446235 0 2024-04-23T10:17:58.526 INFO:tasks.workunit.client.0.smithi026.stdout:8/777: read d5/d50/fba [253205,19333] 0 2024-04-23T10:17:58.526 INFO:tasks.workunit.client.0.smithi026.stdout:8/778: chown d5/d56/d15/fe6 3321 1 2024-04-23T10:17:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/579: creat d4/d7/d51/d6c/fc4 x:0 0 0 2024-04-23T10:17:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:9/776: mknod d13/d3b/d68/dd6/d45/d3a/ceb 0 2024-04-23T10:17:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:9/777: fdatasync d13/d19/f8b 0 2024-04-23T10:17:58.535 INFO:tasks.workunit.client.0.smithi026.stdout:8/779: dread - d5/d9/d22/d65/d78/dc9/f72 zero size 2024-04-23T10:17:58.540 INFO:tasks.workunit.client.0.smithi026.stdout:9/778: readlink d13/d31/d87/l8e 0 2024-04-23T10:17:58.540 INFO:tasks.workunit.client.0.smithi026.stdout:5/635: link d0/d3c/f74 d0/d3c/d84/d89/d8d/fd3 0 2024-04-23T10:17:58.543 INFO:tasks.workunit.client.0.smithi026.stdout:0/814: write d7/d8/d1e/f41 [1573454,86136] 0 2024-04-23T10:17:58.544 INFO:tasks.workunit.client.0.smithi026.stdout:6/799: dwrite d6/d21/d2f/d31/d52/d82/fba [0,4194304] 0 2024-04-23T10:17:58.545 INFO:tasks.workunit.client.0.smithi026.stdout:4/580: symlink d4/d14/lc5 0 2024-04-23T10:17:58.545 INFO:tasks.workunit.client.0.smithi026.stdout:8/780: write d5/d50/f7a [4108262,70329] 0 2024-04-23T10:17:58.546 INFO:tasks.workunit.client.0.smithi026.stdout:8/781: chown d5/d9/d22 248462258 1 2024-04-23T10:17:58.547 INFO:tasks.workunit.client.0.smithi026.stdout:8/782: chown d5/d9/d22/lc3 479 1 2024-04-23T10:17:58.547 INFO:tasks.workunit.client.0.smithi026.stdout:9/779: mknod d13/d1b/d26/d88/dcf/cec 0 2024-04-23T10:17:58.549 INFO:tasks.workunit.client.0.smithi026.stdout:5/636: mkdir d0/d3c/d5d/db2/dc6/dd4 0 2024-04-23T10:17:58.551 INFO:tasks.workunit.client.0.smithi026.stdout:8/783: write d5/d9/d22/d65/d78/d3e/fe9 [193277,31907] 0 2024-04-23T10:17:58.561 INFO:tasks.workunit.client.0.smithi026.stdout:0/815: symlink d7/d8/d2d/d60/d62/l127 0 2024-04-23T10:17:58.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/581: dwrite d4/d5b/d7b/d36/f55 [0,4194304] 0 2024-04-23T10:17:58.562 INFO:tasks.workunit.client.0.smithi026.stdout:5/637: mknod d0/d68/d91/d9a/cd5 0 2024-04-23T10:17:58.564 INFO:tasks.workunit.client.0.smithi026.stdout:9/780: dwrite d13/d3b/d4e/fdf [0,4194304] 0 2024-04-23T10:17:58.566 INFO:tasks.workunit.client.0.smithi026.stdout:9/781: write d13/d1b/d26/fb2 [2245950,25488] 0 2024-04-23T10:17:58.570 INFO:tasks.workunit.client.0.smithi026.stdout:6/800: dread d6/d21/d58/f75 [0,4194304] 0 2024-04-23T10:17:58.571 INFO:tasks.workunit.client.0.smithi026.stdout:0/816: read d7/d8/d2d/f4e [179013,101063] 0 2024-04-23T10:17:58.572 INFO:tasks.workunit.client.0.smithi026.stdout:4/582: symlink d4/d5b/d7b/d36/d38/lc6 0 2024-04-23T10:17:58.574 INFO:tasks.workunit.client.0.smithi026.stdout:5/638: dread d0/d3c/d5d/f94 [0,4194304] 0 2024-04-23T10:17:58.574 INFO:tasks.workunit.client.0.smithi026.stdout:6/801: unlink d6/d13/l1a 0 2024-04-23T10:17:58.577 INFO:tasks.workunit.client.0.smithi026.stdout:4/583: mkdir d4/d5b/d7b/d4d/dc7 0 2024-04-23T10:17:58.579 INFO:tasks.workunit.client.0.smithi026.stdout:9/782: dwrite d13/d1b/d26/d88/db5/fe0 [0,4194304] 0 2024-04-23T10:17:58.579 INFO:tasks.workunit.client.0.smithi026.stdout:8/784: write d5/d9/dac/fe3 [1962482,28145] 0 2024-04-23T10:17:58.581 INFO:tasks.workunit.client.0.smithi026.stdout:8/785: dread - d5/d56/d33/faa zero size 2024-04-23T10:17:58.581 INFO:tasks.workunit.client.0.smithi026.stdout:5/639: readlink d0/ld 0 2024-04-23T10:17:58.584 INFO:tasks.workunit.client.0.smithi026.stdout:8/786: fdatasync d5/d56/d15/ff2 0 2024-04-23T10:17:58.590 INFO:tasks.workunit.client.0.smithi026.stdout:5/640: mkdir d0/d68/d91/dd6 0 2024-04-23T10:17:58.590 INFO:tasks.workunit.client.0.smithi026.stdout:8/787: creat d5/d9/d22/d65/f10a x:0 0 0 2024-04-23T10:17:58.593 INFO:tasks.workunit.client.0.smithi026.stdout:9/783: write d13/d3b/d68/f75 [1475759,113969] 0 2024-04-23T10:17:58.596 INFO:tasks.workunit.client.0.smithi026.stdout:0/817: truncate d7/d43/f8d 1243420 0 2024-04-23T10:17:58.597 INFO:tasks.workunit.client.0.smithi026.stdout:5/641: dread d0/d3c/d84/fab [0,4194304] 0 2024-04-23T10:17:58.599 INFO:tasks.workunit.client.0.smithi026.stdout:9/784: symlink d13/d3b/d68/dd6/d45/d6d/led 0 2024-04-23T10:17:58.599 INFO:tasks.workunit.client.0.smithi026.stdout:4/584: getdents d4/d7/d51/d6c/d6f/d80 0 2024-04-23T10:17:58.600 INFO:tasks.workunit.client.0.smithi026.stdout:9/785: chown d13/d3e/l5d 23 1 2024-04-23T10:17:58.600 INFO:tasks.workunit.client.0.smithi026.stdout:4/585: chown d4/d7 29 1 2024-04-23T10:17:58.600 INFO:tasks.workunit.client.0.smithi026.stdout:5/642: mknod d0/d3c/d84/cd7 0 2024-04-23T10:17:58.602 INFO:tasks.workunit.client.0.smithi026.stdout:8/788: truncate d5/d56/d15/f31 3368006 0 2024-04-23T10:17:58.602 INFO:tasks.workunit.client.0.smithi026.stdout:9/786: write d13/d1b/fa9 [37785,24878] 0 2024-04-23T10:17:58.602 INFO:tasks.workunit.client.0.smithi026.stdout:5/643: write d0/d3c/d5d/d3a/f7f [3280981,72803] 0 2024-04-23T10:17:58.603 INFO:tasks.workunit.client.0.smithi026.stdout:0/818: rename d7/d8/d2d/d60/d62/f108 to d7/d8/d1e/d1d/d115/f128 0 2024-04-23T10:17:58.608 INFO:tasks.workunit.client.0.smithi026.stdout:8/789: stat d5/l6d 0 2024-04-23T10:17:58.609 INFO:tasks.workunit.client.0.smithi026.stdout:6/802: dread d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:17:58.614 INFO:tasks.workunit.client.0.smithi026.stdout:6/803: rmdir d6/d21/d2f/d32 39 2024-04-23T10:17:58.617 INFO:tasks.workunit.client.0.smithi026.stdout:4/586: creat d4/d14/d3d/fc8 x:0 0 0 2024-04-23T10:17:58.618 INFO:tasks.workunit.client.0.smithi026.stdout:6/804: stat d6/d21/d2f/d32/fd1 0 2024-04-23T10:17:58.620 INFO:tasks.workunit.client.0.smithi026.stdout:6/805: stat d6/d21/d2f/d31/d52/lda 0 2024-04-23T10:17:58.621 INFO:tasks.workunit.client.0.smithi026.stdout:9/787: truncate d13/f5c 3582818 0 2024-04-23T10:17:58.621 INFO:tasks.workunit.client.0.smithi026.stdout:8/790: write d5/d9/d22/d65/d78/dc9/f72 [504497,116025] 0 2024-04-23T10:17:58.624 INFO:tasks.workunit.client.0.smithi026.stdout:4/587: link d4/d7/d61/f62 d4/d22/d4e/d57/fc9 0 2024-04-23T10:17:58.626 INFO:tasks.workunit.client.0.smithi026.stdout:6/806: creat d6/d21/d2f/d37/ff2 x:0 0 0 2024-04-23T10:17:58.626 INFO:tasks.workunit.client.0.smithi026.stdout:0/819: dwrite d7/d8/d1e/d2a/d6a/d70/fd0 [0,4194304] 0 2024-04-23T10:17:58.627 INFO:tasks.workunit.client.0.smithi026.stdout:9/788: unlink d13/l50 0 2024-04-23T10:17:58.628 INFO:tasks.workunit.client.0.smithi026.stdout:5/644: dwrite d0/d3c/d84/d89/d8d/d8f/fac [0,4194304] 0 2024-04-23T10:17:58.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/807: readlink d6/d13/l28 0 2024-04-23T10:17:58.634 INFO:tasks.workunit.client.0.smithi026.stdout:4/588: rename d4/d7/d51 to d4/d5b/dca 0 2024-04-23T10:17:58.635 INFO:tasks.workunit.client.0.smithi026.stdout:4/589: write d4/d22/d2e/f6d [683532,40942] 0 2024-04-23T10:17:58.637 INFO:tasks.workunit.client.0.smithi026.stdout:0/820: truncate d7/d8/d1e/d2a/d6a/d70/fcd 999628 0 2024-04-23T10:17:58.639 INFO:tasks.workunit.client.0.smithi026.stdout:6/808: mkdir d6/d21/d2f/d32/df3 0 2024-04-23T10:17:58.639 INFO:tasks.workunit.client.0.smithi026.stdout:0/821: fsync d7/d8/d1e/d57/da9/ffc 0 2024-04-23T10:17:58.640 INFO:tasks.workunit.client.0.smithi026.stdout:4/590: write d4/d7/f84 [1746909,62155] 0 2024-04-23T10:17:58.642 INFO:tasks.workunit.client.0.smithi026.stdout:6/809: stat d6/d21/d2f/d31/d52/d82 0 2024-04-23T10:17:58.643 INFO:tasks.workunit.client.0.smithi026.stdout:5/645: creat d0/d68/fd8 x:0 0 0 2024-04-23T10:17:58.643 INFO:tasks.workunit.client.0.smithi026.stdout:4/591: write d4/d5b/d7b/d36/f55 [2119892,17870] 0 2024-04-23T10:17:58.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/646: mkdir d0/d6f/dd9 0 2024-04-23T10:17:58.647 INFO:tasks.workunit.client.0.smithi026.stdout:4/592: dread - d4/d1b/f9d zero size 2024-04-23T10:17:58.649 INFO:tasks.workunit.client.0.smithi026.stdout:4/593: fsync d4/d22/fbd 0 2024-04-23T10:17:58.656 INFO:tasks.workunit.client.0.smithi026.stdout:8/791: dread d5/d56/d15/d8b/fa9 [0,4194304] 0 2024-04-23T10:17:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:9/789: truncate d13/d3b/d68/dd6/d45/d6d/f71 3454950 0 2024-04-23T10:17:58.658 INFO:tasks.workunit.client.0.smithi026.stdout:0/822: dwrite d7/d8/d2d/d60/d62/db2/fe9 [0,4194304] 0 2024-04-23T10:17:58.663 INFO:tasks.workunit.client.0.smithi026.stdout:6/810: write d6/d21/d2f/d32/d53/f61 [542228,76102] 0 2024-04-23T10:17:58.664 INFO:tasks.workunit.client.0.smithi026.stdout:9/790: readlink d13/d3b/d68/dd6/d45/d3a/d6b/l6a 0 2024-04-23T10:17:58.665 INFO:tasks.workunit.client.0.smithi026.stdout:6/811: readlink d6/d33/lcd 0 2024-04-23T10:17:58.665 INFO:tasks.workunit.client.0.smithi026.stdout:0/823: stat d7/d8/d2d/d60/d77/ca6 0 2024-04-23T10:17:58.672 INFO:tasks.workunit.client.0.smithi026.stdout:4/594: dwrite d4/d14/d30/d52/f64 [0,4194304] 0 2024-04-23T10:17:58.676 INFO:tasks.workunit.client.0.smithi026.stdout:8/792: write d5/d9/d22/d65/f83 [4603693,117873] 0 2024-04-23T10:17:58.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/824: rmdir d7/d8/d2d/d60/d62/da2/d101 0 2024-04-23T10:17:58.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/825: chown d7/d8/d2d 6 1 2024-04-23T10:17:58.676 INFO:tasks.workunit.client.0.smithi026.stdout:8/793: mknod d5/d9/d22/c10b 0 2024-04-23T10:17:58.682 INFO:tasks.workunit.client.0.smithi026.stdout:0/826: rename d7/d8/d1e/d2a/f71 to d7/d8/d1e/dd3/de7/dee/f129 0 2024-04-23T10:17:58.684 INFO:tasks.workunit.client.0.smithi026.stdout:4/595: dwrite d4/f5 [0,4194304] 0 2024-04-23T10:17:58.689 INFO:tasks.workunit.client.0.smithi026.stdout:0/827: fsync d7/d8/d1e/d1d/f73 0 2024-04-23T10:17:58.690 INFO:tasks.workunit.client.0.smithi026.stdout:6/812: dread d6/d21/d58/d8d/f92 [0,4194304] 0 2024-04-23T10:17:58.690 INFO:tasks.workunit.client.0.smithi026.stdout:4/596: rename d4/d5b/dca/c71 to d4/d5b/dca/d6c/ccb 0 2024-04-23T10:17:58.693 INFO:tasks.workunit.client.0.smithi026.stdout:5/647: dread d0/d3c/d5d/f4b [0,4194304] 0 2024-04-23T10:17:58.696 INFO:tasks.workunit.client.0.smithi026.stdout:8/794: dwrite d5/d56/de8/ff0 [0,4194304] 0 2024-04-23T10:17:58.704 INFO:tasks.workunit.client.0.smithi026.stdout:5/648: creat d0/d3c/d5d/db2/dc6/fda x:0 0 0 2024-04-23T10:17:58.704 INFO:tasks.workunit.client.0.smithi026.stdout:0/828: getdents d7/d8/d2d/d60 0 2024-04-23T10:17:58.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/829: mknod d7/d8/d1e/d2a/d6a/c12a 0 2024-04-23T10:17:58.705 INFO:tasks.workunit.client.0.smithi026.stdout:6/813: write d6/d21/d2f/f8f [760376,30030] 0 2024-04-23T10:17:58.708 INFO:tasks.workunit.client.0.smithi026.stdout:5/649: rename d0/d3c/fa9 to d0/d3c/d5d/dbc/fdb 0 2024-04-23T10:17:58.709 INFO:tasks.workunit.client.0.smithi026.stdout:6/814: creat d6/d21/d2f/d37/ff4 x:0 0 0 2024-04-23T10:17:58.716 INFO:tasks.workunit.client.0.smithi026.stdout:8/795: dwrite d5/d9/f5b [4194304,4194304] 0 2024-04-23T10:17:58.717 INFO:tasks.workunit.client.0.smithi026.stdout:8/796: fsync d5/d9/d22/f60 0 2024-04-23T10:17:58.718 INFO:tasks.workunit.client.0.smithi026.stdout:8/797: chown d5/d56/d3f/l42 56517 1 2024-04-23T10:17:58.720 INFO:tasks.workunit.client.0.smithi026.stdout:0/830: read d7/d8/f82 [1242270,7601] 0 2024-04-23T10:17:58.720 INFO:tasks.workunit.client.0.smithi026.stdout:6/815: link d6/d21/d2f/d31/d52/l60 d6/d21/d2f/d32/d53/lf5 0 2024-04-23T10:17:58.722 INFO:tasks.workunit.client.0.smithi026.stdout:5/650: truncate d0/d3c/d5d/d3a/f72 3790661 0 2024-04-23T10:17:58.723 INFO:tasks.workunit.client.0.smithi026.stdout:6/816: write d6/d21/d2f/d37/d9a/fb6 [232865,8533] 0 2024-04-23T10:17:58.724 INFO:tasks.workunit.client.0.smithi026.stdout:4/597: dread d4/d14/f25 [0,4194304] 0 2024-04-23T10:17:58.725 INFO:tasks.workunit.client.0.smithi026.stdout:4/598: fdatasync d4/d7/fa6 0 2024-04-23T10:17:58.726 INFO:tasks.workunit.client.0.smithi026.stdout:8/798: symlink d5/d56/d33/l10c 0 2024-04-23T10:17:58.730 INFO:tasks.workunit.client.0.smithi026.stdout:8/799: chown d5/d56/d15/d8b/c105 14176 1 2024-04-23T10:17:58.732 INFO:tasks.workunit.client.0.smithi026.stdout:0/831: write d7/d8/d1e/f51 [849308,81833] 0 2024-04-23T10:17:58.737 INFO:tasks.workunit.client.0.smithi026.stdout:6/817: getdents d6/d21/d2f/d32/d53/dca/ddc 0 2024-04-23T10:17:58.739 INFO:tasks.workunit.client.0.smithi026.stdout:5/651: link d0/d12/f59 d0/fdc 0 2024-04-23T10:17:58.739 INFO:tasks.workunit.client.0.smithi026.stdout:8/800: dwrite d5/d56/d33/f8c [0,4194304] 0 2024-04-23T10:17:58.740 INFO:tasks.workunit.client.0.smithi026.stdout:8/801: chown d5/d9/d22/f36 443085506 1 2024-04-23T10:17:58.740 INFO:tasks.workunit.client.0.smithi026.stdout:0/832: rename d7/d8/d2d/f8c to d7/d8/d2d/d60/f12b 0 2024-04-23T10:17:58.741 INFO:tasks.workunit.client.0.smithi026.stdout:0/833: write d7/f39 [1855878,109168] 0 2024-04-23T10:17:58.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/599: dread d4/d7/f15 [0,4194304] 0 2024-04-23T10:17:58.750 INFO:tasks.workunit.client.0.smithi026.stdout:6/818: dwrite d6/d21/d2f/d31/faa [0,4194304] 0 2024-04-23T10:17:58.751 INFO:tasks.workunit.client.0.smithi026.stdout:4/600: write d4/d5b/d7b/d36/d38/f58 [852665,31357] 0 2024-04-23T10:17:58.753 INFO:tasks.workunit.client.0.smithi026.stdout:5/652: creat d0/d68/d91/d9a/fdd x:0 0 0 2024-04-23T10:17:58.757 INFO:tasks.workunit.client.0.smithi026.stdout:7/544: sync 2024-04-23T10:17:58.757 INFO:tasks.workunit.client.0.smithi026.stdout:3/636: sync 2024-04-23T10:17:58.758 INFO:tasks.workunit.client.0.smithi026.stdout:7/545: readlink dd/l9a 0 2024-04-23T10:17:58.760 INFO:tasks.workunit.client.0.smithi026.stdout:6/819: write d6/d21/d2f/d32/f97 [787660,130953] 0 2024-04-23T10:17:58.760 INFO:tasks.workunit.client.0.smithi026.stdout:7/546: write dd/d3f/f73 [1625870,43178] 0 2024-04-23T10:17:58.767 INFO:tasks.workunit.client.0.smithi026.stdout:8/802: dwrite d5/d9/d22/d65/d78/dc9/f27 [4194304,4194304] 0 2024-04-23T10:17:58.768 INFO:tasks.workunit.client.0.smithi026.stdout:3/637: symlink d0/d1e/d30/d77/ld4 0 2024-04-23T10:17:58.770 INFO:tasks.workunit.client.0.smithi026.stdout:8/803: fdatasync d5/d9/d22/d65/d78/dc9/f66 0 2024-04-23T10:17:58.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/547: creat dd/d3f/fa0 x:0 0 0 2024-04-23T10:17:58.771 INFO:tasks.workunit.client.0.smithi026.stdout:4/601: rename d4/d1b/c93 to d4/d7/ccc 0 2024-04-23T10:17:58.772 INFO:tasks.workunit.client.0.smithi026.stdout:6/820: symlink d6/d21/d2f/d37/d4f/lf6 0 2024-04-23T10:17:58.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/834: creat d7/d8/d2d/d60/d62/db2/db4/f12c x:0 0 0 2024-04-23T10:17:58.778 INFO:tasks.workunit.client.0.smithi026.stdout:4/602: fdatasync d4/d5b/f75 0 2024-04-23T10:17:58.779 INFO:tasks.workunit.client.0.smithi026.stdout:5/653: dwrite d0/d3c/f97 [0,4194304] 0 2024-04-23T10:17:58.783 INFO:tasks.workunit.client.0.smithi026.stdout:3/638: dwrite d0/d1e/d23/d52/f61 [0,4194304] 0 2024-04-23T10:17:58.783 INFO:tasks.workunit.client.0.smithi026.stdout:4/603: mknod d4/d7/d61/d74/ccd 0 2024-04-23T10:17:58.787 INFO:tasks.workunit.client.0.smithi026.stdout:6/821: write d6/f1d [3997272,95515] 0 2024-04-23T10:17:58.792 INFO:tasks.workunit.client.0.smithi026.stdout:0/835: dwrite d7/d8/f82 [0,4194304] 0 2024-04-23T10:17:58.796 INFO:tasks.workunit.client.0.smithi026.stdout:5/654: fsync d0/d3c/f41 0 2024-04-23T10:17:58.799 INFO:tasks.workunit.client.0.smithi026.stdout:3/639: mknod d0/d1e/d30/d43/d29/d39/db7/cd5 0 2024-04-23T10:17:58.800 INFO:tasks.workunit.client.0.smithi026.stdout:6/822: mknod d6/d21/d2f/d32/d87/d8e/cf7 0 2024-04-23T10:17:58.803 INFO:tasks.workunit.client.0.smithi026.stdout:4/604: mkdir d4/d1b/da0/dce 0 2024-04-23T10:17:58.804 INFO:tasks.workunit.client.0.smithi026.stdout:3/640: dread d0/d1e/d30/d43/d29/d39/db7/fa6 [0,4194304] 0 2024-04-23T10:17:58.804 INFO:tasks.workunit.client.0.smithi026.stdout:4/605: fdatasync d4/d7/fa6 0 2024-04-23T10:17:58.806 INFO:tasks.workunit.client.0.smithi026.stdout:5/655: creat d0/d3c/d5d/db2/dca/fde x:0 0 0 2024-04-23T10:17:58.810 INFO:tasks.workunit.client.0.smithi026.stdout:0/836: dread d7/d8/d1e/d1d/d2f/f10 [0,4194304] 0 2024-04-23T10:17:58.811 INFO:tasks.workunit.client.0.smithi026.stdout:6/823: truncate d6/f19 5137006 0 2024-04-23T10:17:58.814 INFO:tasks.workunit.client.0.smithi026.stdout:3/641: read d0/d1e/d30/d43/df/f44 [1095539,101092] 0 2024-04-23T10:17:58.816 INFO:tasks.workunit.client.0.smithi026.stdout:6/824: rename d6/d21/d58/fe0 to d6/d21/d2f/d37/d9a/db1/ff8 0 2024-04-23T10:17:58.817 INFO:tasks.workunit.client.0.smithi026.stdout:3/642: chown d0/d4c/f67 647361 1 2024-04-23T10:17:58.819 INFO:tasks.workunit.client.0.smithi026.stdout:4/606: getdents d4/d5b/da7 0 2024-04-23T10:17:58.820 INFO:tasks.workunit.client.0.smithi026.stdout:6/825: unlink d6/d21/d2f/d37/f39 0 2024-04-23T10:17:58.820 INFO:tasks.workunit.client.0.smithi026.stdout:6/826: readlink d6/lbe 0 2024-04-23T10:17:58.820 INFO:tasks.workunit.client.0.smithi026.stdout:3/643: mknod d0/d1e/d30/d43/d6c/d79/d73/cd6 0 2024-04-23T10:17:58.822 INFO:tasks.workunit.client.0.smithi026.stdout:0/837: rmdir d7/d8/d2d/d60/d62/db2/dca/d11c 0 2024-04-23T10:17:58.825 INFO:tasks.workunit.client.0.smithi026.stdout:4/607: creat d4/d1b/fcf x:0 0 0 2024-04-23T10:17:58.825 INFO:tasks.workunit.client.0.smithi026.stdout:4/608: fdatasync d4/d22/fbd 0 2024-04-23T10:17:58.827 INFO:tasks.workunit.client.0.smithi026.stdout:6/827: dwrite d6/d21/d2f/d31/f79 [0,4194304] 0 2024-04-23T10:17:58.832 INFO:tasks.workunit.client.0.smithi026.stdout:0/838: truncate d7/d8/d1e/d1d/d2f/d6c/fd2 3850769 0 2024-04-23T10:17:58.832 INFO:tasks.workunit.client.0.smithi026.stdout:4/609: mknod d4/d7/cd0 0 2024-04-23T10:17:58.833 INFO:tasks.workunit.client.0.smithi026.stdout:4/610: write d4/d14/d3d/f8c [151504,52676] 0 2024-04-23T10:17:58.843 INFO:tasks.workunit.client.0.smithi026.stdout:6/828: rename d6/d21/d2f/d32/d53/la4 to d6/d21/lf9 0 2024-04-23T10:17:58.843 INFO:tasks.workunit.client.0.smithi026.stdout:0/839: dwrite d7/d8/d1e/d2a/d6a/d70/fd0 [0,4194304] 0 2024-04-23T10:17:58.844 INFO:tasks.workunit.client.0.smithi026.stdout:4/611: dwrite d4/d22/fbd [0,4194304] 0 2024-04-23T10:17:58.846 INFO:tasks.workunit.client.0.smithi026.stdout:6/829: dread - d6/d21/d2f/d37/d68/fc5 zero size 2024-04-23T10:17:58.848 INFO:tasks.workunit.client.0.smithi026.stdout:6/830: write d6/d21/d2f/d32/f91 [4468227,19622] 0 2024-04-23T10:17:58.849 INFO:tasks.workunit.client.0.smithi026.stdout:0/840: mknod d7/d8/d1e/d1d/d2f/dd1/c12d 0 2024-04-23T10:17:58.851 INFO:tasks.workunit.client.0.smithi026.stdout:4/612: truncate d4/d14/d30/d52/fb9 890692 0 2024-04-23T10:17:58.852 INFO:tasks.workunit.client.0.smithi026.stdout:0/841: chown d7/d8/d2d/d60/d62/db2/db4/c104 13460944 1 2024-04-23T10:17:58.859 INFO:tasks.workunit.client.0.smithi026.stdout:4/613: creat d4/d5b/d7b/d4d/fd1 x:0 0 0 2024-04-23T10:17:58.868 INFO:tasks.workunit.client.0.smithi026.stdout:4/614: dwrite d4/d1b/f67 [0,4194304] 0 2024-04-23T10:17:58.869 INFO:tasks.workunit.client.0.smithi026.stdout:4/615: write d4/d5b/d7b/d36/d38/f58 [808280,70327] 0 2024-04-23T10:17:58.870 INFO:tasks.workunit.client.0.smithi026.stdout:4/616: chown d4/d5b/d7b/d86/fa3 11075 1 2024-04-23T10:17:58.872 INFO:tasks.workunit.client.0.smithi026.stdout:0/842: symlink d7/d8/d2d/d60/d77/l12e 0 2024-04-23T10:17:58.886 INFO:tasks.workunit.client.0.smithi026.stdout:4/617: dread d4/d14/d30/d52/f64 [4194304,4194304] 0 2024-04-23T10:17:58.893 INFO:tasks.workunit.client.0.smithi026.stdout:0/843: dread d7/d8/d2d/d60/f98 [0,4194304] 0 2024-04-23T10:17:58.895 INFO:tasks.workunit.client.0.smithi026.stdout:6/831: dwrite d6/d21/d58/f75 [0,4194304] 0 2024-04-23T10:17:58.896 INFO:tasks.workunit.client.0.smithi026.stdout:0/844: fsync d7/d8/d2d/d60/d62/f89 0 2024-04-23T10:17:58.901 INFO:tasks.workunit.client.0.smithi026.stdout:0/845: chown d7/d8/d2d/d60/d77/f11f 938 1 2024-04-23T10:17:58.902 INFO:tasks.workunit.client.0.smithi026.stdout:4/618: write d4/d7/d61/f62 [1897356,126134] 0 2024-04-23T10:17:58.902 INFO:tasks.workunit.client.0.smithi026.stdout:0/846: write d7/f39 [2936800,108346] 0 2024-04-23T10:17:58.904 INFO:tasks.workunit.client.0.smithi026.stdout:0/847: dread d7/d8/d1e/d2a/fd5 [0,4194304] 0 2024-04-23T10:17:58.904 INFO:tasks.workunit.client.0.smithi026.stdout:4/619: mknod d4/d1b/d95/cd2 0 2024-04-23T10:17:58.911 INFO:tasks.workunit.client.0.smithi026.stdout:0/848: truncate d7/d8/d1e/d1d/d2f/f34 3990709 0 2024-04-23T10:17:58.915 INFO:tasks.workunit.client.0.smithi026.stdout:0/849: unlink d7/d8/d1e/d1d/d2f/dd1/c12d 0 2024-04-23T10:17:58.916 INFO:tasks.workunit.client.0.smithi026.stdout:4/620: dwrite d4/d14/f1c [0,4194304] 0 2024-04-23T10:17:58.917 INFO:tasks.workunit.client.0.smithi026.stdout:0/850: write d7/d8/d1e/dd3/de7/dfe/f125 [261898,25351] 0 2024-04-23T10:17:58.920 INFO:tasks.workunit.client.0.smithi026.stdout:4/621: creat d4/d7/d61/fd3 x:0 0 0 2024-04-23T10:17:58.922 INFO:tasks.workunit.client.0.smithi026.stdout:4/622: creat d4/d22/d4e/fd4 x:0 0 0 2024-04-23T10:17:58.923 INFO:tasks.workunit.client.0.smithi026.stdout:4/623: mknod d4/d14/d30/cd5 0 2024-04-23T10:17:58.924 INFO:tasks.workunit.client.0.smithi026.stdout:4/624: chown d4/d14/d30/da2 0 1 2024-04-23T10:17:58.925 INFO:tasks.workunit.client.0.smithi026.stdout:4/625: write d4/d1b/f9d [1018972,70294] 0 2024-04-23T10:17:58.925 INFO:tasks.workunit.client.0.smithi026.stdout:4/626: chown d4/d14/d30/d52/l97 1816 1 2024-04-23T10:17:58.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/627: rmdir d4/d5b/d7b/d36 39 2024-04-23T10:17:58.930 INFO:tasks.workunit.client.0.smithi026.stdout:4/628: truncate d4/d5b/d7b/d36/d90/f9b 874537 0 2024-04-23T10:17:59.051 INFO:tasks.workunit.client.0.smithi026.stdout:2/622: sync 2024-04-23T10:17:59.055 INFO:tasks.workunit.client.0.smithi026.stdout:2/623: symlink d3/d19/d21/d23/da2/ldc 0 2024-04-23T10:17:59.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/624: fdatasync d3/dd/fb4 0 2024-04-23T10:17:59.058 INFO:tasks.workunit.client.0.smithi026.stdout:2/625: stat d3/d19/d31/c46 0 2024-04-23T10:17:59.063 INFO:tasks.workunit.client.0.smithi026.stdout:2/626: truncate d3/dd/f30 1426225 0 2024-04-23T10:17:59.070 INFO:tasks.workunit.client.0.smithi026.stdout:2/627: truncate d3/d19/d21/d23/d3a/d3c/f5f 5153345 0 2024-04-23T10:17:59.072 INFO:tasks.workunit.client.0.smithi026.stdout:2/628: stat d3/d19/d4d/l58 0 2024-04-23T10:17:59.074 INFO:tasks.workunit.client.0.smithi026.stdout:2/629: truncate d3/d35/fa9 628624 0 2024-04-23T10:17:59.078 INFO:tasks.workunit.client.0.smithi026.stdout:2/630: mknod d3/d19/d21/d23/d3a/d3c/d80/da7/dac/cdd 0 2024-04-23T10:17:59.081 INFO:tasks.workunit.client.0.smithi026.stdout:2/631: mknod d3/d19/d4d/cde 0 2024-04-23T10:17:59.095 INFO:tasks.workunit.client.0.smithi026.stdout:6/832: dwrite d6/d21/d2f/d32/f41 [0,4194304] 0 2024-04-23T10:17:59.098 INFO:tasks.workunit.client.0.smithi026.stdout:6/833: chown d6/l14 21078 1 2024-04-23T10:17:59.099 INFO:tasks.workunit.client.0.smithi026.stdout:6/834: fsync d6/d21/d2f/d37/d9a/fb6 0 2024-04-23T10:17:59.108 INFO:tasks.workunit.client.0.smithi026.stdout:2/632: dread d3/f6 [0,4194304] 0 2024-04-23T10:17:59.110 INFO:tasks.workunit.client.0.smithi026.stdout:6/835: read d6/d13/d15/fae [338874,114131] 0 2024-04-23T10:17:59.113 INFO:tasks.workunit.client.0.smithi026.stdout:2/633: creat d3/d19/d21/d23/d3a/d3c/fdf x:0 0 0 2024-04-23T10:17:59.116 INFO:tasks.workunit.client.0.smithi026.stdout:2/634: symlink d3/d19/d21/d88/le0 0 2024-04-23T10:17:59.118 INFO:tasks.workunit.client.0.smithi026.stdout:6/836: link d6/d21/d2f/d37/d68/feb d6/d21/d2f/d37/d9a/db1/ffa 0 2024-04-23T10:17:59.123 INFO:tasks.workunit.client.0.smithi026.stdout:2/635: rename d3/d19/d21/d23/d3a/d3c/d80/fd4 to d3/d19/d21/d23/d3a/d3c/d80/da7/fe1 0 2024-04-23T10:17:59.126 INFO:tasks.workunit.client.0.smithi026.stdout:6/837: rename d6/d21/d2f/d31/d52/la9 to d6/d21/d2f/d31/d52/lfb 0 2024-04-23T10:17:59.128 INFO:tasks.workunit.client.0.smithi026.stdout:2/636: mkdir d3/d19/d21/d23/d3a/d3c/d5d/de2 0 2024-04-23T10:17:59.131 INFO:tasks.workunit.client.0.smithi026.stdout:6/838: symlink d6/lfc 0 2024-04-23T10:17:59.138 INFO:tasks.workunit.client.0.smithi026.stdout:6/839: rename d6/d13/d15/fae to d6/d21/d2f/d37/d4f/ffd 0 2024-04-23T10:17:59.143 INFO:tasks.workunit.client.0.smithi026.stdout:6/840: creat d6/d13/dcf/dd6/ffe x:0 0 0 2024-04-23T10:17:59.145 INFO:tasks.workunit.client.0.smithi026.stdout:2/637: dread d3/d19/d21/f85 [0,4194304] 0 2024-04-23T10:17:59.147 INFO:tasks.workunit.client.0.smithi026.stdout:2/638: read - d3/d19/d21/d23/d3a/d3c/d5d/fb7 zero size 2024-04-23T10:17:59.155 INFO:tasks.workunit.client.0.smithi026.stdout:6/841: dwrite d6/d21/d2f/d37/d9a/db1/ff8 [0,4194304] 0 2024-04-23T10:17:59.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/639: rename d3/d19/d4d/l52 to d3/d19/d21/d23/d3a/d3c/d80/d96/le3 0 2024-04-23T10:17:59.157 INFO:tasks.workunit.client.0.smithi026.stdout:2/640: chown d3/d19/d21/d88/lca 1 1 2024-04-23T10:17:59.160 INFO:tasks.workunit.client.0.smithi026.stdout:6/842: creat d6/d21/d58/fff x:0 0 0 2024-04-23T10:17:59.165 INFO:tasks.workunit.client.0.smithi026.stdout:6/843: rename d6/d21/lc0 to d6/d21/d2f/def/l100 0 2024-04-23T10:17:59.167 INFO:tasks.workunit.client.0.smithi026.stdout:2/641: mknod d3/d19/d21/d23/d3a/d3c/d5d/de2/ce4 0 2024-04-23T10:17:59.174 INFO:tasks.workunit.client.0.smithi026.stdout:6/844: creat d6/d21/d2f/d37/d4f/f101 x:0 0 0 2024-04-23T10:17:59.174 INFO:tasks.workunit.client.0.smithi026.stdout:2/642: read d3/d19/d21/d88/fcb [850797,103512] 0 2024-04-23T10:17:59.175 INFO:tasks.workunit.client.0.smithi026.stdout:2/643: write d3/f22 [5507758,58973] 0 2024-04-23T10:17:59.175 INFO:tasks.workunit.client.0.smithi026.stdout:6/845: chown d6/d21/d2f/d37/d4f/l9e 113114243 1 2024-04-23T10:17:59.209 INFO:tasks.workunit.client.0.smithi026.stdout:1/620: sync 2024-04-23T10:17:59.226 INFO:tasks.workunit.client.0.smithi026.stdout:6/846: rename d6/d21/d58/f9b to d6/d21/d58/d8d/d90/f102 0 2024-04-23T10:17:59.227 INFO:tasks.workunit.client.0.smithi026.stdout:6/847: fsync d6/d21/d2f/d32/f41 0 2024-04-23T10:17:59.228 INFO:tasks.workunit.client.0.smithi026.stdout:1/621: creat dd/d1a/d20/d25/d35/d74/d93/fe0 x:0 0 0 2024-04-23T10:17:59.229 INFO:tasks.workunit.client.0.smithi026.stdout:2/644: creat d3/d19/d21/d88/dd8/fe5 x:0 0 0 2024-04-23T10:17:59.232 INFO:tasks.workunit.client.0.smithi026.stdout:2/645: dread d3/d35/d4c/f76 [0,4194304] 0 2024-04-23T10:17:59.233 INFO:tasks.workunit.client.0.smithi026.stdout:1/622: link dd/d1a/d20/d25/d35/d43/f50 dd/d48/dcf/fe1 0 2024-04-23T10:17:59.234 INFO:tasks.workunit.client.0.smithi026.stdout:1/623: readlink dd/d1a/d20/d25/d35/d74/l88 0 2024-04-23T10:17:59.235 INFO:tasks.workunit.client.0.smithi026.stdout:2/646: write d3/d19/d21/d23/d3a/f95 [7461546,67349] 0 2024-04-23T10:17:59.236 INFO:tasks.workunit.client.0.smithi026.stdout:1/624: fdatasync dd/d1a/d20/d25/d35/fbf 0 2024-04-23T10:17:59.236 INFO:tasks.workunit.client.0.smithi026.stdout:2/647: dread - d3/dd/fb4 zero size 2024-04-23T10:17:59.239 INFO:tasks.workunit.client.0.smithi026.stdout:2/648: truncate d3/d19/d31/d83/fae 1041885 0 2024-04-23T10:17:59.242 INFO:tasks.workunit.client.0.smithi026.stdout:6/848: dwrite d6/d21/d58/d8d/f92 [0,4194304] 0 2024-04-23T10:17:59.254 INFO:tasks.workunit.client.0.smithi026.stdout:2/649: dwrite d3/d19/f55 [0,4194304] 0 2024-04-23T10:17:59.260 INFO:tasks.workunit.client.0.smithi026.stdout:2/650: getdents d3/d19/d21/dc6 0 2024-04-23T10:17:59.329 INFO:tasks.workunit.client.0.smithi026.stdout:9/791: sync 2024-04-23T10:17:59.331 INFO:tasks.workunit.client.0.smithi026.stdout:9/792: chown d13/d36/d66/db6/fe8 12098501 1 2024-04-23T10:17:59.336 INFO:tasks.workunit.client.0.smithi026.stdout:9/793: truncate d13/f5c 485744 0 2024-04-23T10:17:59.338 INFO:tasks.workunit.client.0.smithi026.stdout:9/794: truncate d13/d36/fe4 353799 0 2024-04-23T10:17:59.344 INFO:tasks.workunit.client.0.smithi026.stdout:9/795: creat d13/d3b/fee x:0 0 0 2024-04-23T10:17:59.353 INFO:tasks.workunit.client.0.smithi026.stdout:9/796: link d13/d31/d87/l8e d13/d36/d66/dbf/lef 0 2024-04-23T10:17:59.355 INFO:tasks.workunit.client.0.smithi026.stdout:9/797: chown d13/d19/f4d 261247 1 2024-04-23T10:17:59.359 INFO:tasks.workunit.client.0.smithi026.stdout:9/798: mkdir d13/d36/d66/d72/df0 0 2024-04-23T10:17:59.360 INFO:tasks.workunit.client.0.smithi026.stdout:9/799: readlink d13/d1b/d26/lbc 0 2024-04-23T10:17:59.423 INFO:tasks.workunit.client.0.smithi026.stdout:7/548: sync 2024-04-23T10:17:59.423 INFO:tasks.workunit.client.0.smithi026.stdout:8/804: sync 2024-04-23T10:17:59.428 INFO:tasks.workunit.client.0.smithi026.stdout:7/549: creat dd/d2c/d48/d8d/fa1 x:0 0 0 2024-04-23T10:17:59.430 INFO:tasks.workunit.client.0.smithi026.stdout:7/550: write dd/d6c/f9d [1004900,20102] 0 2024-04-23T10:17:59.433 INFO:tasks.workunit.client.0.smithi026.stdout:8/805: link d5/d9/d22/d65/d78/dc9/f73 d5/f10d 0 2024-04-23T10:17:59.435 INFO:tasks.workunit.client.0.smithi026.stdout:8/806: stat d5/d56/d15/d8b/l94 0 2024-04-23T10:17:59.437 INFO:tasks.workunit.client.0.smithi026.stdout:8/807: chown d5/f84 16117 1 2024-04-23T10:17:59.440 INFO:tasks.workunit.client.0.smithi026.stdout:7/551: getdents dd/d3f/d47/d4c/d60/d75 0 2024-04-23T10:17:59.442 INFO:tasks.workunit.client.0.smithi026.stdout:8/808: mknod d5/d56/c10e 0 2024-04-23T10:17:59.445 INFO:tasks.workunit.client.0.smithi026.stdout:8/809: symlink d5/l10f 0 2024-04-23T10:17:59.454 INFO:tasks.workunit.client.0.smithi026.stdout:1/625: write dd/d15/d7d/d98/f9b [42471,10878] 0 2024-04-23T10:17:59.455 INFO:tasks.workunit.client.0.smithi026.stdout:1/626: readlink dd/d48/ldd 0 2024-04-23T10:17:59.497 INFO:tasks.workunit.client.0.smithi026.stdout:9/800: dwrite d13/d3b/d68/dd6/d45/d67/f82 [0,4194304] 0 2024-04-23T10:17:59.498 INFO:tasks.workunit.client.0.smithi026.stdout:8/810: symlink d5/d56/d15/d8b/l110 0 2024-04-23T10:17:59.504 INFO:tasks.workunit.client.0.smithi026.stdout:8/811: truncate d5/d9/d22/d65/d78/dc9/f27 8390615 0 2024-04-23T10:17:59.512 INFO:tasks.workunit.client.0.smithi026.stdout:9/801: dwrite d13/d3b/d4e/fdf [0,4194304] 0 2024-04-23T10:17:59.513 INFO:tasks.workunit.client.0.smithi026.stdout:8/812: rename d5/d9/d64/lb6 to d5/d9/d22/l111 0 2024-04-23T10:17:59.515 INFO:tasks.workunit.client.0.smithi026.stdout:9/802: chown d13/d36/fe4 6112189 1 2024-04-23T10:17:59.518 INFO:tasks.workunit.client.0.smithi026.stdout:8/813: symlink d5/d9/d64/l112 0 2024-04-23T10:17:59.521 INFO:tasks.workunit.client.0.smithi026.stdout:8/814: truncate d5/d9/d22/d65/d78/f7d 1035403 0 2024-04-23T10:17:59.529 INFO:tasks.workunit.client.0.smithi026.stdout:8/815: mkdir d5/d56/d33/d113 0 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:5/656: sync 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:3/644: sync 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:0/851: sync 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:2/651: sync 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:4/629: sync 2024-04-23T10:17:59.533 INFO:tasks.workunit.client.0.smithi026.stdout:6/849: sync 2024-04-23T10:17:59.538 INFO:tasks.workunit.client.0.smithi026.stdout:6/850: dread - d6/d21/d58/fbb zero size 2024-04-23T10:17:59.540 INFO:tasks.workunit.client.0.smithi026.stdout:2/652: dread - d3/d19/d21/d23/d3a/d65/fcc zero size 2024-04-23T10:17:59.542 INFO:tasks.workunit.client.0.smithi026.stdout:6/851: write d6/d21/d2f/d31/d52/d82/fba [4705218,23883] 0 2024-04-23T10:17:59.543 INFO:tasks.workunit.client.0.smithi026.stdout:2/653: chown d3/d19/d21/d23/lbc 121892152 1 2024-04-23T10:17:59.544 INFO:tasks.workunit.client.0.smithi026.stdout:6/852: stat d6/d21/d2f/d32/f91 0 2024-04-23T10:17:59.544 INFO:tasks.workunit.client.0.smithi026.stdout:8/816: link d5/d50/c6f d5/d9/d22/d106/c114 0 2024-04-23T10:17:59.547 INFO:tasks.workunit.client.0.smithi026.stdout:5/657: rename d0/d6f/dd9 to d0/d6f/ddf 0 2024-04-23T10:17:59.548 INFO:tasks.workunit.client.0.smithi026.stdout:5/658: stat d0/d3c/f74 0 2024-04-23T10:17:59.553 INFO:tasks.workunit.client.0.smithi026.stdout:2/654: creat d3/d19/d1d/fe6 x:0 0 0 2024-04-23T10:17:59.554 INFO:tasks.workunit.client.0.smithi026.stdout:3/645: dwrite d0/d1e/d30/f8a [0,4194304] 0 2024-04-23T10:17:59.556 INFO:tasks.workunit.client.0.smithi026.stdout:8/817: dread d5/d9/d22/d65/d78/dc9/f72 [0,4194304] 0 2024-04-23T10:17:59.557 INFO:tasks.workunit.client.0.smithi026.stdout:4/630: creat d4/d14/fd6 x:0 0 0 2024-04-23T10:17:59.558 INFO:tasks.workunit.client.0.smithi026.stdout:4/631: chown d4/d7/fa6 14 1 2024-04-23T10:17:59.558 INFO:tasks.workunit.client.0.smithi026.stdout:5/659: rmdir d0/d3c/d5d/db2/dbd 39 2024-04-23T10:17:59.563 INFO:tasks.workunit.client.0.smithi026.stdout:0/852: rename d7/d5b/f65 to d7/f12f 0 2024-04-23T10:17:59.572 INFO:tasks.workunit.client.0.smithi026.stdout:6/853: dread d6/d33/fc8 [0,4194304] 0 2024-04-23T10:17:59.574 INFO:tasks.workunit.client.0.smithi026.stdout:8/818: stat d5/f2a 0 2024-04-23T10:17:59.574 INFO:tasks.workunit.client.0.smithi026.stdout:6/854: chown d6/d21/d58/f96 0 1 2024-04-23T10:17:59.575 INFO:tasks.workunit.client.0.smithi026.stdout:8/819: read - d5/d56/d15/ff2 zero size 2024-04-23T10:17:59.577 INFO:tasks.workunit.client.0.smithi026.stdout:5/660: creat d0/d6f/fe0 x:0 0 0 2024-04-23T10:17:59.577 INFO:tasks.workunit.client.0.smithi026.stdout:5/661: dread - d0/d3c/faf zero size 2024-04-23T10:17:59.578 INFO:tasks.workunit.client.0.smithi026.stdout:0/853: fdatasync d7/d8/d1e/dd3/ff0 0 2024-04-23T10:17:59.580 INFO:tasks.workunit.client.0.smithi026.stdout:5/662: write d0/d3c/d84/f8c [921541,52008] 0 2024-04-23T10:17:59.581 INFO:tasks.workunit.client.0.smithi026.stdout:2/655: creat d3/d19/d21/d23/daf/fe7 x:0 0 0 2024-04-23T10:17:59.583 INFO:tasks.workunit.client.0.smithi026.stdout:6/855: creat d6/d21/d2f/d37/d9a/f103 x:0 0 0 2024-04-23T10:17:59.586 INFO:tasks.workunit.client.0.smithi026.stdout:0/854: dread d7/d8/d2d/d60/d62/db2/fe9 [0,4194304] 0 2024-04-23T10:17:59.590 INFO:tasks.workunit.client.0.smithi026.stdout:5/663: unlink d0/d3c/d84/fbe 0 2024-04-23T10:17:59.591 INFO:tasks.workunit.client.0.smithi026.stdout:5/664: write d0/d3c/d5d/db2/dca/fde [749485,5901] 0 2024-04-23T10:17:59.593 INFO:tasks.workunit.client.0.smithi026.stdout:4/632: getdents d4/d5b 0 2024-04-23T10:17:59.595 INFO:tasks.workunit.client.0.smithi026.stdout:0/855: unlink d7/d8/d2d/d60/d62/fea 0 2024-04-23T10:17:59.595 INFO:tasks.workunit.client.0.smithi026.stdout:4/633: write d4/d14/d3d/fc8 [191884,66797] 0 2024-04-23T10:17:59.598 INFO:tasks.workunit.client.0.smithi026.stdout:0/856: readlink d7/d8/d2d/d60/d77/l12e 0 2024-04-23T10:17:59.601 INFO:tasks.workunit.client.0.smithi026.stdout:4/634: dread - d4/d14/f6e zero size 2024-04-23T10:17:59.601 INFO:tasks.workunit.client.0.smithi026.stdout:5/665: dread d0/d3c/d84/d89/d8d/d8f/fac [0,4194304] 0 2024-04-23T10:17:59.601 INFO:tasks.workunit.client.0.smithi026.stdout:0/857: truncate d7/d8/d1e/d57/da9/ffc 797618 0 2024-04-23T10:17:59.605 INFO:tasks.workunit.client.0.smithi026.stdout:4/635: mkdir d4/d5b/dca/d6c/dd7 0 2024-04-23T10:17:59.608 INFO:tasks.workunit.client.0.smithi026.stdout:0/858: creat d7/d8/d1e/d1d/d2f/dd1/dd6/f130 x:0 0 0 2024-04-23T10:17:59.611 INFO:tasks.workunit.client.0.smithi026.stdout:2/656: dread d3/d19/d21/d23/d3a/d65/f87 [0,4194304] 0 2024-04-23T10:17:59.612 INFO:tasks.workunit.client.0.smithi026.stdout:6/856: write d6/d21/d2f/d37/d9a/db1/ffa [300464,75683] 0 2024-04-23T10:17:59.612 INFO:tasks.workunit.client.0.smithi026.stdout:0/859: read - d7/d8/d1e/d57/da9/fdd zero size 2024-04-23T10:17:59.615 INFO:tasks.workunit.client.0.smithi026.stdout:5/666: link d0/fdc d0/d12/fe1 0 2024-04-23T10:17:59.615 INFO:tasks.workunit.client.0.smithi026.stdout:0/860: read d7/dc2/dcc/fff [1632178,28119] 0 2024-04-23T10:17:59.616 INFO:tasks.workunit.client.0.smithi026.stdout:5/667: truncate d0/d3c/fd2 901362 0 2024-04-23T10:17:59.617 INFO:tasks.workunit.client.0.smithi026.stdout:5/668: truncate d0/d6f/fcd 238459 0 2024-04-23T10:17:59.618 INFO:tasks.workunit.client.0.smithi026.stdout:2/657: write d3/d19/d1d/fe6 [782459,82115] 0 2024-04-23T10:17:59.625 INFO:tasks.workunit.client.0.smithi026.stdout:4/636: dwrite d4/d5b/f60 [0,4194304] 0 2024-04-23T10:17:59.626 INFO:tasks.workunit.client.0.smithi026.stdout:5/669: rename d0/d6f/cae to d0/d6f/ddf/ce2 0 2024-04-23T10:17:59.626 INFO:tasks.workunit.client.0.smithi026.stdout:6/857: truncate d6/d21/d2f/d31/d52/d82/fba 22793 0 2024-04-23T10:17:59.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/861: creat d7/dc2/dec/f131 x:0 0 0 2024-04-23T10:17:59.630 INFO:tasks.workunit.client.0.smithi026.stdout:6/858: creat d6/d21/d2f/d32/d87/d8e/f104 x:0 0 0 2024-04-23T10:17:59.632 INFO:tasks.workunit.client.0.smithi026.stdout:0/862: fsync d7/d8/d1e/f7a 0 2024-04-23T10:17:59.634 INFO:tasks.workunit.client.0.smithi026.stdout:0/863: dread - d7/d8/d1e/d1d/d2f/dd1/dd6/f130 zero size 2024-04-23T10:17:59.638 INFO:tasks.workunit.client.0.smithi026.stdout:2/658: write d3/d19/d21/d23/d3a/d3c/f6e [520018,35445] 0 2024-04-23T10:17:59.642 INFO:tasks.workunit.client.0.smithi026.stdout:2/659: mknod d3/d19/d4d/ce8 0 2024-04-23T10:17:59.643 INFO:tasks.workunit.client.0.smithi026.stdout:0/864: mknod d7/d8/d2d/d60/d62/db9/c132 0 2024-04-23T10:17:59.644 INFO:tasks.workunit.client.0.smithi026.stdout:0/865: stat d7/d8/d2d/d60/d62/l68 0 2024-04-23T10:17:59.645 INFO:tasks.workunit.client.0.smithi026.stdout:0/866: chown d7/d43/fbc 57 1 2024-04-23T10:17:59.652 INFO:tasks.workunit.client.0.smithi026.stdout:5/670: dread d0/d3c/f74 [0,4194304] 0 2024-04-23T10:17:59.652 INFO:tasks.workunit.client.0.smithi026.stdout:0/867: rmdir d7/d8/d1e/d11e 0 2024-04-23T10:17:59.654 INFO:tasks.workunit.client.0.smithi026.stdout:5/671: creat d0/d6f/fe3 x:0 0 0 2024-04-23T10:17:59.654 INFO:tasks.workunit.client.0.smithi026.stdout:2/660: write d3/d19/d21/d23/d3a/d3c/d5d/f7b [38790,123152] 0 2024-04-23T10:17:59.657 INFO:tasks.workunit.client.0.smithi026.stdout:2/661: fsync d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/fbf 0 2024-04-23T10:17:59.657 INFO:tasks.workunit.client.0.smithi026.stdout:5/672: symlink d0/d3c/d5d/db2/le4 0 2024-04-23T10:17:59.659 INFO:tasks.workunit.client.0.smithi026.stdout:2/662: mkdir d3/d35/d4c/de9 0 2024-04-23T10:17:59.660 INFO:tasks.workunit.client.0.smithi026.stdout:5/673: mknod d0/d3c/d84/ce5 0 2024-04-23T10:17:59.664 INFO:tasks.workunit.client.0.smithi026.stdout:0/868: dwrite d7/d5b/f76 [0,4194304] 0 2024-04-23T10:17:59.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/663: truncate d3/d19/d21/d23/d3a/d3c/fc5 203493 0 2024-04-23T10:17:59.666 INFO:tasks.workunit.client.0.smithi026.stdout:0/869: symlink d7/d8/d1e/d57/da9/l133 0 2024-04-23T10:17:59.669 INFO:tasks.workunit.client.0.smithi026.stdout:7/552: sync 2024-04-23T10:17:59.669 INFO:tasks.workunit.client.0.smithi026.stdout:0/870: chown d7/d8/d2d/c10a 10 1 2024-04-23T10:17:59.669 INFO:tasks.workunit.client.0.smithi026.stdout:7/553: chown dd/d46/f77 55929 1 2024-04-23T10:17:59.669 INFO:tasks.workunit.client.0.smithi026.stdout:2/664: rename d3/d19/d1d/c57 to d3/d35/d4c/cea 0 2024-04-23T10:17:59.672 INFO:tasks.workunit.client.0.smithi026.stdout:7/554: getdents dd/d3f/d47/d4c/d60/d75 0 2024-04-23T10:17:59.673 INFO:tasks.workunit.client.0.smithi026.stdout:2/665: mknod d3/d19/d21/d23/da2/db8/ceb 0 2024-04-23T10:17:59.676 INFO:tasks.workunit.client.0.smithi026.stdout:7/555: rename dd/f9e to dd/d6c/fa2 0 2024-04-23T10:17:59.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/871: dwrite d7/d8/f78 [0,4194304] 0 2024-04-23T10:17:59.678 INFO:tasks.workunit.client.0.smithi026.stdout:0/872: chown d7/d8/d2d/d60/d62/db2/cc9 14761 1 2024-04-23T10:17:59.680 INFO:tasks.workunit.client.0.smithi026.stdout:0/873: creat d7/da1/f134 x:0 0 0 2024-04-23T10:17:59.687 INFO:tasks.workunit.client.0.smithi026.stdout:2/666: dwrite d3/d19/d21/d23/f29 [0,4194304] 0 2024-04-23T10:17:59.688 INFO:tasks.workunit.client.0.smithi026.stdout:7/556: dwrite dd/d1d/d50/f62 [0,4194304] 0 2024-04-23T10:17:59.691 INFO:tasks.workunit.client.0.smithi026.stdout:7/557: symlink dd/d44/d38/la3 0 2024-04-23T10:17:59.694 INFO:tasks.workunit.client.0.smithi026.stdout:0/874: dwrite d7/d8/d2d/d60/d62/db2/db4/fc3 [0,4194304] 0 2024-04-23T10:17:59.704 INFO:tasks.workunit.client.0.smithi026.stdout:0/875: symlink d7/d8/d2d/d60/d62/db2/l135 0 2024-04-23T10:17:59.710 INFO:tasks.workunit.client.0.smithi026.stdout:7/558: dread dd/f41 [0,4194304] 0 2024-04-23T10:17:59.720 INFO:tasks.workunit.client.0.smithi026.stdout:7/559: dwrite dd/d3f/d47/d4c/f64 [0,4194304] 0 2024-04-23T10:17:59.722 INFO:tasks.workunit.client.0.smithi026.stdout:2/667: dread d3/d19/d21/d23/d3a/d3c/f5f [0,4194304] 0 2024-04-23T10:17:59.723 INFO:tasks.workunit.client.0.smithi026.stdout:7/560: mknod dd/d3f/d47/ca4 0 2024-04-23T10:17:59.724 INFO:tasks.workunit.client.0.smithi026.stdout:7/561: chown dd/d2c/d48/d7e/f93 6406 1 2024-04-23T10:17:59.724 INFO:tasks.workunit.client.0.smithi026.stdout:2/668: mkdir d3/d19/d21/d23/dec 0 2024-04-23T10:17:59.725 INFO:tasks.workunit.client.0.smithi026.stdout:7/562: rename dd/d1d/d50 to dd/d1d/d50/d58/da5 22 2024-04-23T10:17:59.728 INFO:tasks.workunit.client.0.smithi026.stdout:2/669: symlink d3/d19/d1d/led 0 2024-04-23T10:17:59.734 INFO:tasks.workunit.client.0.smithi026.stdout:2/670: write d3/dd/f2d [2370635,19356] 0 2024-04-23T10:17:59.736 INFO:tasks.workunit.client.0.smithi026.stdout:2/671: chown d3/d19/d21/d23/d3a/d3c/d5d/de2 723741 1 2024-04-23T10:17:59.742 INFO:tasks.workunit.client.0.smithi026.stdout:7/563: dread dd/d2c/d48/f59 [0,4194304] 0 2024-04-23T10:17:59.743 INFO:tasks.workunit.client.0.smithi026.stdout:7/564: chown dd/d3f/c95 11430 1 2024-04-23T10:17:59.746 INFO:tasks.workunit.client.0.smithi026.stdout:7/565: creat dd/d1d/d50/fa6 x:0 0 0 2024-04-23T10:17:59.748 INFO:tasks.workunit.client.0.smithi026.stdout:7/566: creat dd/d3f/fa7 x:0 0 0 2024-04-23T10:17:59.748 INFO:tasks.workunit.client.0.smithi026.stdout:7/567: readlink dd/d3f/d47/d4c/d60/l6d 0 2024-04-23T10:17:59.763 INFO:tasks.workunit.client.0.smithi026.stdout:7/568: dread dd/f13 [0,4194304] 0 2024-04-23T10:17:59.766 INFO:tasks.workunit.client.0.smithi026.stdout:7/569: creat dd/d6c/fa8 x:0 0 0 2024-04-23T10:17:59.768 INFO:tasks.workunit.client.0.smithi026.stdout:7/570: creat dd/d2c/d48/d7e/fa9 x:0 0 0 2024-04-23T10:17:59.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/571: mknod dd/d6c/d72/caa 0 2024-04-23T10:17:59.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/572: chown dd/d3f/f73 31178 1 2024-04-23T10:17:59.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/573: chown l8 220025145 1 2024-04-23T10:17:59.774 INFO:tasks.workunit.client.0.smithi026.stdout:7/574: link dd/d3f/d47/d4c/f4a dd/d1d/d78/fab 0 2024-04-23T10:17:59.777 INFO:tasks.workunit.client.0.smithi026.stdout:7/575: read dd/d2c/f70 [2643810,32726] 0 2024-04-23T10:17:59.779 INFO:tasks.workunit.client.0.smithi026.stdout:7/576: unlink dd/d44/d38/l39 0 2024-04-23T10:17:59.781 INFO:tasks.workunit.client.0.smithi026.stdout:7/577: dread - dd/d2c/d48/f85 zero size 2024-04-23T10:17:59.783 INFO:tasks.workunit.client.0.smithi026.stdout:7/578: mknod dd/d3f/d47/d4c/d60/cac 0 2024-04-23T10:17:59.783 INFO:tasks.workunit.client.0.smithi026.stdout:7/579: chown dd/d3f/d47/d4c 1 1 2024-04-23T10:17:59.786 INFO:tasks.workunit.client.0.smithi026.stdout:7/580: link dd/d2c/d48/d7e/f93 dd/d1d/d50/d58/fad 0 2024-04-23T10:17:59.787 INFO:tasks.workunit.client.0.smithi026.stdout:7/581: chown dd/d44/c33 187897194 1 2024-04-23T10:17:59.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/582: dwrite dd/d6c/d72/f80 [0,4194304] 0 2024-04-23T10:17:59.800 INFO:tasks.workunit.client.0.smithi026.stdout:7/583: fsync dd/d46/f77 0 2024-04-23T10:17:59.806 INFO:tasks.workunit.client.0.smithi026.stdout:7/584: link dd/d1d/d50/l81 dd/d2c/d48/d7e/lae 0 2024-04-23T10:17:59.813 INFO:tasks.workunit.client.0.smithi026.stdout:9/803: sync 2024-04-23T10:17:59.813 INFO:tasks.workunit.client.0.smithi026.stdout:1/627: sync 2024-04-23T10:17:59.821 INFO:tasks.workunit.client.0.smithi026.stdout:7/585: dread dd/d1d/d50/f5c [0,4194304] 0 2024-04-23T10:17:59.822 INFO:tasks.workunit.client.0.smithi026.stdout:1/628: rename dd/c10 to dd/d1a/d20/ce2 0 2024-04-23T10:17:59.822 INFO:tasks.workunit.client.0.smithi026.stdout:9/804: link d13/d36/d66/f93 d13/d36/d66/dc2/dc3/ff1 0 2024-04-23T10:17:59.829 INFO:tasks.workunit.client.0.smithi026.stdout:9/805: symlink d13/d36/d66/dc2/de7/lf2 0 2024-04-23T10:17:59.830 INFO:tasks.workunit.client.0.smithi026.stdout:7/586: link dd/d6c/d72/caa dd/d2c/d48/caf 0 2024-04-23T10:17:59.833 INFO:tasks.workunit.client.0.smithi026.stdout:7/587: chown dd/d44/c1f 19704 1 2024-04-23T10:17:59.834 INFO:tasks.workunit.client.0.smithi026.stdout:1/629: readlink dd/d15/d7d/d98/ld1 0 2024-04-23T10:17:59.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/588: truncate dd/d3f/f73 2101440 0 2024-04-23T10:17:59.837 INFO:tasks.workunit.client.0.smithi026.stdout:9/806: dwrite d13/d1b/fa9 [0,4194304] 0 2024-04-23T10:17:59.841 INFO:tasks.workunit.client.0.smithi026.stdout:1/630: link dd/d1a/d23/d69/c6d dd/d48/ce3 0 2024-04-23T10:17:59.842 INFO:tasks.workunit.client.0.smithi026.stdout:1/631: fsync dd/d1a/f55 0 2024-04-23T10:17:59.844 INFO:tasks.workunit.client.0.smithi026.stdout:7/589: write dd/d1d/d50/f5c [423510,42840] 0 2024-04-23T10:17:59.844 INFO:tasks.workunit.client.0.smithi026.stdout:9/807: link d13/d3b/d68/dd6/d45/d3a/d4f/c7f d13/d1b/d26/d88/dcf/cf3 0 2024-04-23T10:17:59.845 INFO:tasks.workunit.client.0.smithi026.stdout:9/808: chown d13/d3b/d68/dd6/d45/fcc 0 1 2024-04-23T10:17:59.850 INFO:tasks.workunit.client.0.smithi026.stdout:1/632: rename dd/d1a/d20/d25/d35/l82 to dd/d15/d7d/da1/le4 0 2024-04-23T10:17:59.852 INFO:tasks.workunit.client.0.smithi026.stdout:1/633: symlink dd/le5 0 2024-04-23T10:17:59.854 INFO:tasks.workunit.client.0.smithi026.stdout:9/809: dwrite d13/faf [0,4194304] 0 2024-04-23T10:17:59.856 INFO:tasks.workunit.client.0.smithi026.stdout:9/810: write d13/d3b/d4e/d76/f91 [812699,78595] 0 2024-04-23T10:17:59.861 INFO:tasks.workunit.client.0.smithi026.stdout:9/811: truncate d13/d3b/d68/dd6/d45/d3a/f56 4618228 0 2024-04-23T10:17:59.864 INFO:tasks.workunit.client.0.smithi026.stdout:1/634: dwrite dd/d1a/d23/f89 [0,4194304] 0 2024-04-23T10:17:59.873 INFO:tasks.workunit.client.0.smithi026.stdout:1/635: link dd/d1a/d23/d3f/d9a/fcc dd/d1a/d23/d3f/fe6 0 2024-04-23T10:17:59.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/812: dwrite d13/d3b/d68/dd6/d45/d3a/d4f/f59 [0,4194304] 0 2024-04-23T10:17:59.877 INFO:tasks.workunit.client.0.smithi026.stdout:1/636: symlink dd/d1a/d23/d69/d9d/le7 0 2024-04-23T10:17:59.880 INFO:tasks.workunit.client.0.smithi026.stdout:9/813: creat d13/d3b/d4e/d76/ff4 x:0 0 0 2024-04-23T10:17:59.881 INFO:tasks.workunit.client.0.smithi026.stdout:1/637: fdatasync dd/d15/f81 0 2024-04-23T10:17:59.881 INFO:tasks.workunit.client.0.smithi026.stdout:9/814: symlink d13/d1b/d26/lf5 0 2024-04-23T10:17:59.907 INFO:tasks.workunit.client.0.smithi026.stdout:9/815: dread d13/d1b/d26/fcd [0,4194304] 0 2024-04-23T10:17:59.908 INFO:tasks.workunit.client.0.smithi026.stdout:1/638: dread dd/d15/f32 [0,4194304] 0 2024-04-23T10:17:59.909 INFO:tasks.workunit.client.0.smithi026.stdout:9/816: mkdir d13/d3b/d5b/dc9/df6 0 2024-04-23T10:17:59.909 INFO:tasks.workunit.client.0.smithi026.stdout:1/639: mkdir dd/d15/d7d/d98/de8 0 2024-04-23T10:17:59.912 INFO:tasks.workunit.client.0.smithi026.stdout:9/817: truncate d13/d3b/d68/dd6/d45/d3a/f56 60159 0 2024-04-23T10:17:59.917 INFO:tasks.workunit.client.0.smithi026.stdout:9/818: truncate d13/d3b/d68/f75 11543621 0 2024-04-23T10:17:59.920 INFO:tasks.workunit.client.0.smithi026.stdout:9/819: rename d13/d3b/d68/c84 to d13/d36/d66/dc2/cf7 0 2024-04-23T10:17:59.923 INFO:tasks.workunit.client.0.smithi026.stdout:9/820: truncate d13/d1b/f33 12183017 0 2024-04-23T10:17:59.936 INFO:tasks.workunit.client.0.smithi026.stdout:9/821: dwrite d13/d3e/f64 [0,4194304] 0 2024-04-23T10:17:59.955 INFO:tasks.workunit.client.0.smithi026.stdout:8/820: sync 2024-04-23T10:17:59.955 INFO:tasks.workunit.client.0.smithi026.stdout:3/646: sync 2024-04-23T10:17:59.957 INFO:tasks.workunit.client.0.smithi026.stdout:8/821: rename d5/d9 to d5/d115 0 2024-04-23T10:17:59.958 INFO:tasks.workunit.client.0.smithi026.stdout:8/822: chown d5/d56/d15/d8b/c105 383853 1 2024-04-23T10:17:59.958 INFO:tasks.workunit.client.0.smithi026.stdout:3/647: creat d0/d1e/d30/fd7 x:0 0 0 2024-04-23T10:17:59.964 INFO:tasks.workunit.client.0.smithi026.stdout:3/648: write d0/d1e/d30/d43/d29/d39/db7/fa6 [826545,101141] 0 2024-04-23T10:17:59.972 INFO:tasks.workunit.client.0.smithi026.stdout:3/649: dwrite d0/f3c [0,4194304] 0 2024-04-23T10:17:59.978 INFO:tasks.workunit.client.0.smithi026.stdout:8/823: dread d5/d115/d22/d65/d78/dc9/f66 [0,4194304] 0 2024-04-23T10:17:59.981 INFO:tasks.workunit.client.0.smithi026.stdout:8/824: mkdir d5/d115/d64/dc5/d116 0 2024-04-23T10:17:59.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/650: dwrite d0/d1e/d30/d43/d6c/d79/d64/f98 [0,4194304] 0 2024-04-23T10:17:59.984 INFO:tasks.workunit.client.0.smithi026.stdout:3/651: write d0/fbb [654066,88201] 0 2024-04-23T10:17:59.989 INFO:tasks.workunit.client.0.smithi026.stdout:3/652: creat d0/d1e/d30/d43/df/dcb/fd8 x:0 0 0 2024-04-23T10:17:59.990 INFO:tasks.workunit.client.0.smithi026.stdout:3/653: chown d0/d1e/d30/d43/f38 56 1 2024-04-23T10:17:59.998 INFO:tasks.workunit.client.0.smithi026.stdout:8/825: dwrite d5/d50/fba [0,4194304] 0 2024-04-23T10:17:59.998 INFO:tasks.workunit.client.0.smithi026.stdout:3/654: link d0/d1e/d30/d43/df/dcb/fd8 d0/d1e/d30/d43/df/dcb/d97/fd9 0 2024-04-23T10:18:00.006 INFO:tasks.workunit.client.0.smithi026.stdout:3/655: dwrite d0/d1e/d30/fd7 [0,4194304] 0 2024-04-23T10:18:00.007 INFO:tasks.workunit.client.0.smithi026.stdout:3/656: write d0/d1e/fc7 [654090,33115] 0 2024-04-23T10:18:00.011 INFO:tasks.workunit.client.0.smithi026.stdout:3/657: mkdir d0/d1e/d30/d43/d29/d39/dda 0 2024-04-23T10:18:00.016 INFO:tasks.workunit.client.0.smithi026.stdout:3/658: creat d0/d1e/d30/d43/d6c/d79/d73/d99/fdb x:0 0 0 2024-04-23T10:18:00.019 INFO:tasks.workunit.client.0.smithi026.stdout:3/659: symlink d0/d1e/d30/d43/df/d63/ldc 0 2024-04-23T10:18:00.021 INFO:tasks.workunit.client.0.smithi026.stdout:3/660: symlink d0/d1e/d30/d43/df/d63/ldd 0 2024-04-23T10:18:00.023 INFO:tasks.workunit.client.0.smithi026.stdout:3/661: write d0/d1e/d30/d43/df/f85 [1164505,83014] 0 2024-04-23T10:18:00.025 INFO:tasks.workunit.client.0.smithi026.stdout:3/662: symlink d0/d1e/d30/d43/d6c/d79/lde 0 2024-04-23T10:18:00.028 INFO:tasks.workunit.client.0.smithi026.stdout:3/663: dread - d0/d1e/d30/d43/df/d17/fa1 zero size 2024-04-23T10:18:00.030 INFO:tasks.workunit.client.0.smithi026.stdout:3/664: mknod d0/d1e/d30/d43/d29/cdf 0 2024-04-23T10:18:00.032 INFO:tasks.workunit.client.0.smithi026.stdout:3/665: creat d0/d1e/d30/d43/df/fe0 x:0 0 0 2024-04-23T10:18:00.037 INFO:tasks.workunit.client.0.smithi026.stdout:3/666: dread d0/d1e/d30/d43/df/dcb/f88 [0,4194304] 0 2024-04-23T10:18:00.044 INFO:tasks.workunit.client.0.smithi026.stdout:3/667: dwrite d0/d51/d5e/da4/fba [0,4194304] 0 2024-04-23T10:18:00.046 INFO:tasks.workunit.client.0.smithi026.stdout:3/668: chown d0/d1e/d30/d43/df/d17/c9a 0 1 2024-04-23T10:18:00.047 INFO:tasks.workunit.client.0.smithi026.stdout:3/669: readlink d0/d1e/d30/d43/ld 0 2024-04-23T10:18:00.052 INFO:tasks.workunit.client.0.smithi026.stdout:3/670: link d0/d1e/d30/d43/df/f4b d0/d1e/d30/d43/d6c/d79/fe1 0 2024-04-23T10:18:00.055 INFO:tasks.workunit.client.0.smithi026.stdout:3/671: symlink d0/d1e/d30/d77/le2 0 2024-04-23T10:18:00.059 INFO:tasks.workunit.client.0.smithi026.stdout:3/672: mkdir d0/d1e/d30/d43/df/de3 0 2024-04-23T10:18:00.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/673: rmdir d0/d1e/d30/d43/d29/d39/db7 39 2024-04-23T10:18:00.061 INFO:tasks.workunit.client.0.smithi026.stdout:3/674: dread - d0/d1e/d30/d43/df/fe0 zero size 2024-04-23T10:18:00.062 INFO:tasks.workunit.client.0.smithi026.stdout:3/675: stat d0/d1e/d30/d43/df/d72/cca 0 2024-04-23T10:18:00.069 INFO:tasks.workunit.client.0.smithi026.stdout:3/676: dwrite d0/d1e/d23/fbd [0,4194304] 0 2024-04-23T10:18:00.073 INFO:tasks.workunit.client.0.smithi026.stdout:3/677: unlink d0/l58 0 2024-04-23T10:18:00.078 INFO:tasks.workunit.client.0.smithi026.stdout:3/678: link d0/d1e/d30/d43/df/d63/c78 d0/d1e/d30/d43/d6c/d79/d73/d99/ce4 0 2024-04-23T10:18:00.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/679: dwrite d0/d1e/d30/d43/d6c/d79/f62 [8388608,4194304] 0 2024-04-23T10:18:00.096 INFO:tasks.workunit.client.0.smithi026.stdout:3/680: rename d0/d1e/d30/d43/d29/l59 to d0/d1e/d30/d43/df/de3/le5 0 2024-04-23T10:18:00.097 INFO:tasks.workunit.client.0.smithi026.stdout:3/681: write d0/d4c/fb8 [727253,11804] 0 2024-04-23T10:18:00.097 INFO:tasks.workunit.client.0.smithi026.stdout:3/682: readlink d0/d1e/d23/d87/db6/ld3 0 2024-04-23T10:18:00.098 INFO:tasks.workunit.client.0.smithi026.stdout:3/683: chown d0/d1e/d30/d43/d6c/d79/d64/f98 22012 1 2024-04-23T10:18:00.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/859: sync 2024-04-23T10:18:00.117 INFO:tasks.workunit.client.0.smithi026.stdout:4/637: sync 2024-04-23T10:18:00.117 INFO:tasks.workunit.client.0.smithi026.stdout:6/860: stat d6/d21/d2f/d31/d52/l5e 0 2024-04-23T10:18:00.120 INFO:tasks.workunit.client.0.smithi026.stdout:4/638: unlink d4/d5b/d7b/d4d/c5d 0 2024-04-23T10:18:00.121 INFO:tasks.workunit.client.0.smithi026.stdout:6/861: rename d6/d21/lf9 to d6/d21/d2f/def/l105 0 2024-04-23T10:18:00.128 INFO:tasks.workunit.client.0.smithi026.stdout:4/639: truncate d4/d5b/d7b/d36/f55 1608469 0 2024-04-23T10:18:00.128 INFO:tasks.workunit.client.0.smithi026.stdout:6/862: dwrite d6/d21/d2f/d37/ff4 [0,4194304] 0 2024-04-23T10:18:00.130 INFO:tasks.workunit.client.0.smithi026.stdout:4/640: write d4/d22/d4e/d57/fb2 [821800,117771] 0 2024-04-23T10:18:00.130 INFO:tasks.workunit.client.0.smithi026.stdout:6/863: rmdir d6/d21/d2f/d37/d68 39 2024-04-23T10:18:00.132 INFO:tasks.workunit.client.0.smithi026.stdout:4/641: write d4/d22/d2e/f32 [845467,118082] 0 2024-04-23T10:18:00.134 INFO:tasks.workunit.client.0.smithi026.stdout:4/642: mkdir d4/d22/dd8 0 2024-04-23T10:18:00.136 INFO:tasks.workunit.client.0.smithi026.stdout:4/643: write d4/d1b/fcf [66374,124397] 0 2024-04-23T10:18:00.142 INFO:tasks.workunit.client.0.smithi026.stdout:6/864: mknod d6/d21/d2f/d32/d87/c106 0 2024-04-23T10:18:00.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/865: mknod d6/d21/d2f/d32/d53/c107 0 2024-04-23T10:18:00.144 INFO:tasks.workunit.client.0.smithi026.stdout:4/644: link d4/d42/c5f d4/d22/d2e/cd9 0 2024-04-23T10:18:00.145 INFO:tasks.workunit.client.0.smithi026.stdout:4/645: read d4/d5b/d7b/f37 [4979347,44935] 0 2024-04-23T10:18:00.146 INFO:tasks.workunit.client.0.smithi026.stdout:4/646: readlink d4/d14/d30/d52/la4 0 2024-04-23T10:18:00.147 INFO:tasks.workunit.client.0.smithi026.stdout:4/647: write d4/d22/d4e/d57/fbc [1748284,94363] 0 2024-04-23T10:18:00.151 INFO:tasks.workunit.client.0.smithi026.stdout:4/648: rename d4/d5b/dca to d4/d1b/dbf/dda 0 2024-04-23T10:18:00.153 INFO:tasks.workunit.client.0.smithi026.stdout:6/866: dwrite d6/d21/d2f/d37/d68/feb [0,4194304] 0 2024-04-23T10:18:00.154 INFO:tasks.workunit.client.0.smithi026.stdout:4/649: mknod d4/d14/cdb 0 2024-04-23T10:18:00.154 INFO:tasks.workunit.client.0.smithi026.stdout:6/867: write d6/f10 [1064744,126953] 0 2024-04-23T10:18:00.159 INFO:tasks.workunit.client.0.smithi026.stdout:6/868: mkdir d6/d108 0 2024-04-23T10:18:00.160 INFO:tasks.workunit.client.0.smithi026.stdout:4/650: getdents d4/d5b/d7b 0 2024-04-23T10:18:00.162 INFO:tasks.workunit.client.0.smithi026.stdout:4/651: fsync d4/d5b/d7b/d4d/dad/fbe 0 2024-04-23T10:18:00.164 INFO:tasks.workunit.client.0.smithi026.stdout:4/652: creat d4/d5b/da7/fdc x:0 0 0 2024-04-23T10:18:00.165 INFO:tasks.workunit.client.0.smithi026.stdout:4/653: fsync d4/d14/f1c 0 2024-04-23T10:18:00.167 INFO:tasks.workunit.client.0.smithi026.stdout:4/654: creat d4/d22/d2e/fdd x:0 0 0 2024-04-23T10:18:00.169 INFO:tasks.workunit.client.0.smithi026.stdout:4/655: truncate d4/d7/f1d 3249414 0 2024-04-23T10:18:00.171 INFO:tasks.workunit.client.0.smithi026.stdout:4/656: creat d4/fde x:0 0 0 2024-04-23T10:18:00.190 INFO:tasks.workunit.client.0.smithi026.stdout:6/869: dwrite d6/d21/d2f/d32/d87/f9d [0,4194304] 0 2024-04-23T10:18:00.191 INFO:tasks.workunit.client.0.smithi026.stdout:6/870: chown d6/d13/f4d 47600 1 2024-04-23T10:18:00.193 INFO:tasks.workunit.client.0.smithi026.stdout:6/871: truncate d6/d13/d15/f71 1289359 0 2024-04-23T10:18:00.198 INFO:tasks.workunit.client.0.smithi026.stdout:4/657: creat d4/d22/d2e/fdf x:0 0 0 2024-04-23T10:18:00.199 INFO:tasks.workunit.client.0.smithi026.stdout:4/658: dread - d4/d14/f6e zero size 2024-04-23T10:18:00.199 INFO:tasks.workunit.client.0.smithi026.stdout:4/659: write d4/fde [12546,125746] 0 2024-04-23T10:18:00.201 INFO:tasks.workunit.client.0.smithi026.stdout:4/660: truncate d4/d22/d4e/d57/fb2 1795903 0 2024-04-23T10:18:00.205 INFO:tasks.workunit.client.0.smithi026.stdout:6/872: mkdir d6/d21/d2f/d37/d68/d109 0 2024-04-23T10:18:00.209 INFO:tasks.workunit.client.0.smithi026.stdout:4/661: creat d4/d22/dd8/fe0 x:0 0 0 2024-04-23T10:18:00.211 INFO:tasks.workunit.client.0.smithi026.stdout:6/873: mknod d6/d21/d2f/d37/c10a 0 2024-04-23T10:18:00.213 INFO:tasks.workunit.client.0.smithi026.stdout:6/874: truncate d6/d21/d2f/d37/d9a/fa3 1201794 0 2024-04-23T10:18:00.214 INFO:tasks.workunit.client.0.smithi026.stdout:6/875: chown d6/d21/d2f/d37/ff2 169 1 2024-04-23T10:18:00.216 INFO:tasks.workunit.client.0.smithi026.stdout:4/662: dwrite d4/d5b/d7b/d36/d90/f9b [0,4194304] 0 2024-04-23T10:18:00.220 INFO:tasks.workunit.client.0.smithi026.stdout:4/663: mkdir d4/d22/dd8/de1 0 2024-04-23T10:18:00.221 INFO:tasks.workunit.client.0.smithi026.stdout:6/876: symlink d6/d33/l10b 0 2024-04-23T10:18:00.223 INFO:tasks.workunit.client.0.smithi026.stdout:4/664: write d4/d1b/fc1 [4161881,102748] 0 2024-04-23T10:18:00.232 INFO:tasks.workunit.client.0.smithi026.stdout:4/665: dwrite d4/d7/f84 [4194304,4194304] 0 2024-04-23T10:18:00.234 INFO:tasks.workunit.client.0.smithi026.stdout:4/666: write d4/fde [876744,129426] 0 2024-04-23T10:18:00.238 INFO:tasks.workunit.client.0.smithi026.stdout:6/877: creat d6/d33/f10c x:0 0 0 2024-04-23T10:18:00.239 INFO:tasks.workunit.client.0.smithi026.stdout:6/878: write d6/f1d [3936120,100704] 0 2024-04-23T10:18:00.240 INFO:tasks.workunit.client.0.smithi026.stdout:6/879: write d6/d21/d2f/d37/d68/f6a [608330,38406] 0 2024-04-23T10:18:00.241 INFO:tasks.workunit.client.0.smithi026.stdout:4/667: creat d4/d22/fe2 x:0 0 0 2024-04-23T10:18:00.245 INFO:tasks.workunit.client.0.smithi026.stdout:4/668: write d4/d5b/d7b/f37 [271700,85664] 0 2024-04-23T10:18:00.248 INFO:tasks.workunit.client.0.smithi026.stdout:4/669: rmdir d4/d14/d3d 39 2024-04-23T10:18:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:1/640: sync 2024-04-23T10:18:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:2/672: sync 2024-04-23T10:18:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:5/674: sync 2024-04-23T10:18:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:0/876: sync 2024-04-23T10:18:00.286 INFO:tasks.workunit.client.0.smithi026.stdout:6/880: getdents d6/d21/d2f/d31 0 2024-04-23T10:18:00.286 INFO:tasks.workunit.client.0.smithi026.stdout:2/673: rmdir d3/d19/d1d 39 2024-04-23T10:18:00.286 INFO:tasks.workunit.client.0.smithi026.stdout:4/670: dread d4/d14/f40 [0,4194304] 0 2024-04-23T10:18:00.288 INFO:tasks.workunit.client.0.smithi026.stdout:2/674: dread - d3/d19/d21/d23/d3a/d65/fcc zero size 2024-04-23T10:18:00.290 INFO:tasks.workunit.client.0.smithi026.stdout:5/675: creat d0/d3c/d5d/dbc/fe6 x:0 0 0 2024-04-23T10:18:00.293 INFO:tasks.workunit.client.0.smithi026.stdout:0/877: unlink d7/d8/d2d/fd7 0 2024-04-23T10:18:00.294 INFO:tasks.workunit.client.0.smithi026.stdout:2/675: creat d3/dd/d4b/d9c/fee x:0 0 0 2024-04-23T10:18:00.296 INFO:tasks.workunit.client.0.smithi026.stdout:0/878: dread - d7/d8/d1e/d1d/d2f/dd1/dd6/f130 zero size 2024-04-23T10:18:00.298 INFO:tasks.workunit.client.0.smithi026.stdout:0/879: fdatasync d7/da1/f134 0 2024-04-23T10:18:00.299 INFO:tasks.workunit.client.0.smithi026.stdout:4/671: dwrite d4/d5b/d7b/d4d/dad/fbe [0,4194304] 0 2024-04-23T10:18:00.301 INFO:tasks.workunit.client.0.smithi026.stdout:5/676: write d0/f54 [430995,28384] 0 2024-04-23T10:18:00.302 INFO:tasks.workunit.client.0.smithi026.stdout:5/677: write d0/d3c/fc0 [2320952,116541] 0 2024-04-23T10:18:00.304 INFO:tasks.workunit.client.0.smithi026.stdout:5/678: dread - d0/d3c/d5d/db2/fb3 zero size 2024-04-23T10:18:00.305 INFO:tasks.workunit.client.0.smithi026.stdout:0/880: fsync f4 0 2024-04-23T10:18:00.312 INFO:tasks.workunit.client.0.smithi026.stdout:4/672: unlink d4/d5b/d7b/d36/c9a 0 2024-04-23T10:18:00.313 INFO:tasks.workunit.client.0.smithi026.stdout:4/673: truncate d4/d5b/d7b/d36/d90/f9b 5151415 0 2024-04-23T10:18:00.314 INFO:tasks.workunit.client.0.smithi026.stdout:2/676: dread d3/d19/d21/d23/d3a/d3c/f7c [0,4194304] 0 2024-04-23T10:18:00.314 INFO:tasks.workunit.client.0.smithi026.stdout:4/674: dread - d4/d5b/da7/fdc zero size 2024-04-23T10:18:00.318 INFO:tasks.workunit.client.0.smithi026.stdout:0/881: rmdir d7/d8/d1e/dd3/de7/dfe 39 2024-04-23T10:18:00.321 INFO:tasks.workunit.client.0.smithi026.stdout:6/881: truncate d6/d21/d58/f75 184924 0 2024-04-23T10:18:00.322 INFO:tasks.workunit.client.0.smithi026.stdout:4/675: fsync d4/d7/d61/d74/f2d 0 2024-04-23T10:18:00.326 INFO:tasks.workunit.client.0.smithi026.stdout:6/882: chown d6/d21/d2f/l43 91302 1 2024-04-23T10:18:00.328 INFO:tasks.workunit.client.0.smithi026.stdout:6/883: write d6/d21/d2f/d32/d53/f62 [3245667,83383] 0 2024-04-23T10:18:00.332 INFO:tasks.workunit.client.0.smithi026.stdout:6/884: dread d6/d33/f2c [0,4194304] 0 2024-04-23T10:18:00.333 INFO:tasks.workunit.client.0.smithi026.stdout:6/885: chown d6/d21/d58/fbb 15803517 1 2024-04-23T10:18:00.334 INFO:tasks.workunit.client.0.smithi026.stdout:5/679: truncate d0/d3c/d84/d89/d8d/fd3 2030316 0 2024-04-23T10:18:00.338 INFO:tasks.workunit.client.0.smithi026.stdout:4/676: mknod d4/d5b/da7/dba/ce3 0 2024-04-23T10:18:00.339 INFO:tasks.workunit.client.0.smithi026.stdout:0/882: creat d7/d8/d2d/d60/f136 x:0 0 0 2024-04-23T10:18:00.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/677: getdents d3/d19/d21/d23/d3a/d3c/d5d/da0 0 2024-04-23T10:18:00.349 INFO:tasks.workunit.client.0.smithi026.stdout:0/883: dwrite d7/d8/f10b [0,4194304] 0 2024-04-23T10:18:00.350 INFO:tasks.workunit.client.0.smithi026.stdout:4/677: dwrite d4/d7/d61/fd3 [0,4194304] 0 2024-04-23T10:18:00.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/678: mkdir d3/dd/def 0 2024-04-23T10:18:00.357 INFO:tasks.workunit.client.0.smithi026.stdout:5/680: dwrite d0/d3c/d5d/d3a/f72 [0,4194304] 0 2024-04-23T10:18:00.358 INFO:tasks.workunit.client.0.smithi026.stdout:5/681: stat d0/d12/c7b 0 2024-04-23T10:18:00.359 INFO:tasks.workunit.client.0.smithi026.stdout:5/682: chown d0/d68/d91/d9a/la7 24426758 1 2024-04-23T10:18:00.360 INFO:tasks.workunit.client.0.smithi026.stdout:2/679: symlink d3/d35/d4c/lf0 0 2024-04-23T10:18:00.362 INFO:tasks.workunit.client.0.smithi026.stdout:4/678: creat d4/d5b/d7b/d4d/fe4 x:0 0 0 2024-04-23T10:18:00.365 INFO:tasks.workunit.client.0.smithi026.stdout:0/884: chown d7/d8/d2d/d60/d62/f40 31698 1 2024-04-23T10:18:00.366 INFO:tasks.workunit.client.0.smithi026.stdout:5/683: truncate d0/fe 4485634 0 2024-04-23T10:18:00.369 INFO:tasks.workunit.client.0.smithi026.stdout:0/885: creat d7/da1/f137 x:0 0 0 2024-04-23T10:18:00.370 INFO:tasks.workunit.client.0.smithi026.stdout:5/684: chown d0/fdc 1 1 2024-04-23T10:18:00.370 INFO:tasks.workunit.client.0.smithi026.stdout:0/886: stat d7/d8/d2d/d60/d62/db9/c132 0 2024-04-23T10:18:00.371 INFO:tasks.workunit.client.0.smithi026.stdout:5/685: fsync d0/d3c/d5d/db2/dca/fde 0 2024-04-23T10:18:00.376 INFO:tasks.workunit.client.0.smithi026.stdout:0/887: rename d7/d8/d1e/d2a/l3d to d7/d8/d1e/d1d/d2f/l138 0 2024-04-23T10:18:00.384 INFO:tasks.workunit.client.0.smithi026.stdout:0/888: dwrite d7/d8/d1e/d1d/d2f/dd1/dd6/fdf [0,4194304] 0 2024-04-23T10:18:00.390 INFO:tasks.workunit.client.0.smithi026.stdout:2/680: dread d3/d19/d31/f9d [0,4194304] 0 2024-04-23T10:18:00.391 INFO:tasks.workunit.client.0.smithi026.stdout:5/686: truncate d0/d3c/d84/d89/d8d/fa2 956571 0 2024-04-23T10:18:00.395 INFO:tasks.workunit.client.0.smithi026.stdout:0/889: unlink d7/d8/d2d/d60/d62/da2/dd9/cf3 0 2024-04-23T10:18:00.397 INFO:tasks.workunit.client.0.smithi026.stdout:2/681: mkdir d3/d19/d21/d23/d3a/d3c/df1 0 2024-04-23T10:18:00.398 INFO:tasks.workunit.client.0.smithi026.stdout:4/679: getdents d4/d14/d92 0 2024-04-23T10:18:00.399 INFO:tasks.workunit.client.0.smithi026.stdout:4/680: read - d4/d22/d2e/fdf zero size 2024-04-23T10:18:00.401 INFO:tasks.workunit.client.0.smithi026.stdout:0/890: chown d7/d8/d2d/d60/d77/ca6 630069871 1 2024-04-23T10:18:00.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/681: creat d4/d5b/fe5 x:0 0 0 2024-04-23T10:18:00.409 INFO:tasks.workunit.client.0.smithi026.stdout:4/682: dwrite d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:00.411 INFO:tasks.workunit.client.0.smithi026.stdout:4/683: write d4/d5b/d7b/d36/d38/f58 [249694,4619] 0 2024-04-23T10:18:00.412 INFO:tasks.workunit.client.0.smithi026.stdout:4/684: write d4/d22/d2e/f7d [1181826,7652] 0 2024-04-23T10:18:00.413 INFO:tasks.workunit.client.0.smithi026.stdout:0/891: truncate d7/d8/d1e/d1d/f73 545419 0 2024-04-23T10:18:00.416 INFO:tasks.workunit.client.0.smithi026.stdout:2/682: mkdir d3/dd/df2 0 2024-04-23T10:18:00.416 INFO:tasks.workunit.client.0.smithi026.stdout:4/685: dread - d4/d5b/d7b/d4d/fd1 zero size 2024-04-23T10:18:00.419 INFO:tasks.workunit.client.0.smithi026.stdout:0/892: mknod d7/d8/d1e/d1d/d2f/c139 0 2024-04-23T10:18:00.426 INFO:tasks.workunit.client.0.smithi026.stdout:4/686: rename d4/d14/lc5 to d4/d1b/dbf/dda/d6c/d6f/d80/le6 0 2024-04-23T10:18:00.429 INFO:tasks.workunit.client.0.smithi026.stdout:0/893: fsync d7/d8/d1e/d1d/d2f/dd1/fe0 0 2024-04-23T10:18:00.434 INFO:tasks.workunit.client.0.smithi026.stdout:4/687: dwrite d4/d1b/fc1 [4194304,4194304] 0 2024-04-23T10:18:00.440 INFO:tasks.workunit.client.0.smithi026.stdout:0/894: dwrite d7/d8/d2d/d60/d62/db2/db4/fc8 [0,4194304] 0 2024-04-23T10:18:00.442 INFO:tasks.workunit.client.0.smithi026.stdout:9/822: sync 2024-04-23T10:18:00.442 INFO:tasks.workunit.client.0.smithi026.stdout:8/826: sync 2024-04-23T10:18:00.442 INFO:tasks.workunit.client.0.smithi026.stdout:7/590: sync 2024-04-23T10:18:00.443 INFO:tasks.workunit.client.0.smithi026.stdout:2/683: dwrite d3/d19/d31/f3b [0,4194304] 0 2024-04-23T10:18:00.448 INFO:tasks.workunit.client.0.smithi026.stdout:7/591: symlink dd/d2c/d48/lb0 0 2024-04-23T10:18:00.449 INFO:tasks.workunit.client.0.smithi026.stdout:7/592: dread - dd/d6c/f9c zero size 2024-04-23T10:18:00.456 INFO:tasks.workunit.client.0.smithi026.stdout:4/688: truncate d4/d5b/f60 3710364 0 2024-04-23T10:18:00.458 INFO:tasks.workunit.client.0.smithi026.stdout:7/593: read dd/d44/f23 [372016,66553] 0 2024-04-23T10:18:00.459 INFO:tasks.workunit.client.0.smithi026.stdout:8/827: fsync d5/d56/de8/fd1 0 2024-04-23T10:18:00.464 INFO:tasks.workunit.client.0.smithi026.stdout:4/689: chown d4/d7/l23 3 1 2024-04-23T10:18:00.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/684: dwrite d3/d19/d21/d23/fc4 [0,4194304] 0 2024-04-23T10:18:00.468 INFO:tasks.workunit.client.0.smithi026.stdout:8/828: dread d5/d56/d15/d76/f85 [0,4194304] 0 2024-04-23T10:18:00.473 INFO:tasks.workunit.client.0.smithi026.stdout:9/823: dread d13/d1b/f33 [4194304,4194304] 0 2024-04-23T10:18:00.475 INFO:tasks.workunit.client.0.smithi026.stdout:7/594: truncate dd/d1d/d50/f5c 4262769 0 2024-04-23T10:18:00.476 INFO:tasks.workunit.client.0.smithi026.stdout:4/690: mknod d4/d14/d30/da2/ce7 0 2024-04-23T10:18:00.478 INFO:tasks.workunit.client.0.smithi026.stdout:4/691: chown d4/d22/d2e/fdd 11511 1 2024-04-23T10:18:00.479 INFO:tasks.workunit.client.0.smithi026.stdout:2/685: truncate d3/d19/d1d/fab 632493 0 2024-04-23T10:18:00.480 INFO:tasks.workunit.client.0.smithi026.stdout:9/824: truncate d13/d3b/d68/dd6/d45/d6d/fa5 1011648 0 2024-04-23T10:18:00.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/595: creat dd/d1d/d50/fb1 x:0 0 0 2024-04-23T10:18:00.483 INFO:tasks.workunit.client.0.smithi026.stdout:7/596: chown dd/d3f/c43 703 1 2024-04-23T10:18:00.484 INFO:tasks.workunit.client.0.smithi026.stdout:8/829: dread d5/d56/d47/f4f [0,4194304] 0 2024-04-23T10:18:00.484 INFO:tasks.workunit.client.0.smithi026.stdout:7/597: chown dd/d46 1 1 2024-04-23T10:18:00.493 INFO:tasks.workunit.client.0.smithi026.stdout:9/825: link d13/d19/f4d d13/d3e/ff8 0 2024-04-23T10:18:00.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/686: link d3/dd/c1e d3/d19/d21/d23/dec/cf3 0 2024-04-23T10:18:00.495 INFO:tasks.workunit.client.0.smithi026.stdout:4/692: truncate d4/d7/f84 4932407 0 2024-04-23T10:18:00.495 INFO:tasks.workunit.client.0.smithi026.stdout:2/687: write d3/d19/d21/d23/d3a/d3c/d5d/f9b [568211,4727] 0 2024-04-23T10:18:00.500 INFO:tasks.workunit.client.0.smithi026.stdout:4/693: creat d4/d14/d30/d52/fe8 x:0 0 0 2024-04-23T10:18:00.502 INFO:tasks.workunit.client.0.smithi026.stdout:2/688: creat d3/d35/d4c/ff4 x:0 0 0 2024-04-23T10:18:00.503 INFO:tasks.workunit.client.0.smithi026.stdout:8/830: dwrite d5/d115/f2e [0,4194304] 0 2024-04-23T10:18:00.503 INFO:tasks.workunit.client.0.smithi026.stdout:2/689: fdatasync d3/d35/fa9 0 2024-04-23T10:18:00.506 INFO:tasks.workunit.client.0.smithi026.stdout:7/598: dwrite dd/d1d/d78/fab [4194304,4194304] 0 2024-04-23T10:18:00.508 INFO:tasks.workunit.client.0.smithi026.stdout:9/826: rename d13/f1c to d13/d3b/ff9 0 2024-04-23T10:18:00.510 INFO:tasks.workunit.client.0.smithi026.stdout:4/694: link d4/d5b/d7b/d36/d38/lc6 d4/d42/le9 0 2024-04-23T10:18:00.512 INFO:tasks.workunit.client.0.smithi026.stdout:2/690: rename d3/d19/d21/d23/daf/fe7 to d3/d19/d31/ff5 0 2024-04-23T10:18:00.513 INFO:tasks.workunit.client.0.smithi026.stdout:2/691: dread - d3/d19/d21/d23/d3a/d3c/d80/da7/fe1 zero size 2024-04-23T10:18:00.513 INFO:tasks.workunit.client.0.smithi026.stdout:4/695: truncate d4/d7/d61/d74/f21 623653 0 2024-04-23T10:18:00.515 INFO:tasks.workunit.client.0.smithi026.stdout:8/831: getdents d5/d115/d22 0 2024-04-23T10:18:00.516 INFO:tasks.workunit.client.0.smithi026.stdout:2/692: chown d3/d19/d31/f9d 487 1 2024-04-23T10:18:00.520 INFO:tasks.workunit.client.0.smithi026.stdout:4/696: read d4/d22/d2e/f9e [90278,58603] 0 2024-04-23T10:18:00.523 INFO:tasks.workunit.client.0.smithi026.stdout:9/827: link d13/d1b/d26/f58 d13/d36/d66/ffa 0 2024-04-23T10:18:00.532 INFO:tasks.workunit.client.0.smithi026.stdout:4/697: dwrite d4/d5b/d7b/d36/d38/fa8 [0,4194304] 0 2024-04-23T10:18:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:7/599: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:18:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:8/832: write d5/d56/fa4 [4795781,92073] 0 2024-04-23T10:18:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:2/693: getdents d3/d19/d21/d88/dd8 0 2024-04-23T10:18:00.537 INFO:tasks.workunit.client.0.smithi026.stdout:7/600: read - dd/d1d/d78/f9b zero size 2024-04-23T10:18:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:9/828: write d13/d1b/d26/f30 [4926937,55610] 0 2024-04-23T10:18:00.538 INFO:tasks.workunit.client.0.smithi026.stdout:9/829: readlink l3 0 2024-04-23T10:18:00.540 INFO:tasks.workunit.client.0.smithi026.stdout:2/694: chown d3/d19/d21/c41 14685 1 2024-04-23T10:18:00.542 INFO:tasks.workunit.client.0.smithi026.stdout:4/698: creat d4/d5b/d7b/d36/d38/d83/fea x:0 0 0 2024-04-23T10:18:00.545 INFO:tasks.workunit.client.0.smithi026.stdout:9/830: creat d13/d3e/ffb x:0 0 0 2024-04-23T10:18:00.548 INFO:tasks.workunit.client.0.smithi026.stdout:8/833: fdatasync d5/d115/d64/dc5/fce 0 2024-04-23T10:18:00.552 INFO:tasks.workunit.client.0.smithi026.stdout:4/699: dread d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:9/831: write d13/d1b/d26/d88/dcf/dd1/fd5 [2033253,31982] 0 2024-04-23T10:18:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:8/834: stat d5/d115/d22/d65/d78/dc9/l32 0 2024-04-23T10:18:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:7/601: dwrite dd/d3f/fa7 [0,4194304] 0 2024-04-23T10:18:00.562 INFO:tasks.workunit.client.0.smithi026.stdout:2/695: write d3/dd/d4b/f7a [4708085,611] 0 2024-04-23T10:18:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:7/602: creat dd/d1d/d7d/fb2 x:0 0 0 2024-04-23T10:18:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:2/696: chown d3/dd/d4b/d9c/cad 18628309 1 2024-04-23T10:18:00.565 INFO:tasks.workunit.client.0.smithi026.stdout:4/700: dwrite d4/d5b/d7b/d36/d90/f9b [4194304,4194304] 0 2024-04-23T10:18:00.571 INFO:tasks.workunit.client.0.smithi026.stdout:8/835: creat d5/d56/d15/f117 x:0 0 0 2024-04-23T10:18:00.572 INFO:tasks.workunit.client.0.smithi026.stdout:7/603: symlink dd/d1d/lb3 0 2024-04-23T10:18:00.573 INFO:tasks.workunit.client.0.smithi026.stdout:2/697: mknod d3/d19/d21/dc6/cf6 0 2024-04-23T10:18:00.574 INFO:tasks.workunit.client.0.smithi026.stdout:4/701: getdents d4/d22/dd8/de1 0 2024-04-23T10:18:00.576 INFO:tasks.workunit.client.0.smithi026.stdout:2/698: rmdir d3/d19 39 2024-04-23T10:18:00.579 INFO:tasks.workunit.client.0.smithi026.stdout:4/702: chown d4/d5b/d7b/d36 1695905 1 2024-04-23T10:18:00.582 INFO:tasks.workunit.client.0.smithi026.stdout:2/699: truncate d3/d19/d1d/fe6 1152865 0 2024-04-23T10:18:00.582 INFO:tasks.workunit.client.0.smithi026.stdout:4/703: symlink d4/d42/leb 0 2024-04-23T10:18:00.583 INFO:tasks.workunit.client.0.smithi026.stdout:9/832: dwrite d13/d3b/d68/f75 [8388608,4194304] 0 2024-04-23T10:18:00.585 INFO:tasks.workunit.client.0.smithi026.stdout:4/704: chown d4/d22/d2e/c44 111129 1 2024-04-23T10:18:00.587 INFO:tasks.workunit.client.0.smithi026.stdout:9/833: mknod d13/d19/da7/dc1/cfc 0 2024-04-23T10:18:00.588 INFO:tasks.workunit.client.0.smithi026.stdout:8/836: dwrite d5/d56/d3f/f6b [0,4194304] 0 2024-04-23T10:18:00.589 INFO:tasks.workunit.client.0.smithi026.stdout:4/705: fsync d4/d1b/dbf/dda/f56 0 2024-04-23T10:18:00.592 INFO:tasks.workunit.client.0.smithi026.stdout:7/604: dread dd/d44/d38/f3d [0,4194304] 0 2024-04-23T10:18:00.595 INFO:tasks.workunit.client.0.smithi026.stdout:8/837: symlink d5/d56/d33/l118 0 2024-04-23T10:18:00.595 INFO:tasks.workunit.client.0.smithi026.stdout:2/700: getdents d3/d19/d31 0 2024-04-23T10:18:00.595 INFO:tasks.workunit.client.0.smithi026.stdout:9/834: symlink d13/d1b/d26/d88/db5/dd9/lfd 0 2024-04-23T10:18:00.598 INFO:tasks.workunit.client.0.smithi026.stdout:8/838: stat d5/f10d 0 2024-04-23T10:18:00.599 INFO:tasks.workunit.client.0.smithi026.stdout:9/835: chown d13/d1b/d26/lbc 1677 1 2024-04-23T10:18:00.601 INFO:tasks.workunit.client.0.smithi026.stdout:9/836: readlink d13/d1b/d26/lbc 0 2024-04-23T10:18:00.602 INFO:tasks.workunit.client.0.smithi026.stdout:2/701: fsync d3/d19/d21/d23/d3a/d65/f87 0 2024-04-23T10:18:00.603 INFO:tasks.workunit.client.0.smithi026.stdout:8/839: creat d5/d50/f119 x:0 0 0 2024-04-23T10:18:00.606 INFO:tasks.workunit.client.0.smithi026.stdout:7/605: dwrite dd/d44/f23 [4194304,4194304] 0 2024-04-23T10:18:00.608 INFO:tasks.workunit.client.0.smithi026.stdout:4/706: dwrite d4/d22/d4e/fd4 [0,4194304] 0 2024-04-23T10:18:00.610 INFO:tasks.workunit.client.0.smithi026.stdout:8/840: symlink d5/d56/d33/ddc/l11a 0 2024-04-23T10:18:00.611 INFO:tasks.workunit.client.0.smithi026.stdout:9/837: creat d13/d3b/d68/dd6/d45/d3a/ffe x:0 0 0 2024-04-23T10:18:00.612 INFO:tasks.workunit.client.0.smithi026.stdout:8/841: chown d5/d56/d47/d99/lef 51 1 2024-04-23T10:18:00.615 INFO:tasks.workunit.client.0.smithi026.stdout:9/838: symlink d13/d3b/d5b/dc9/lff 0 2024-04-23T10:18:00.616 INFO:tasks.workunit.client.0.smithi026.stdout:2/702: dwrite d3/f13 [0,4194304] 0 2024-04-23T10:18:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:8/842: creat d5/d56/d33/ddc/de1/f11b x:0 0 0 2024-04-23T10:18:00.620 INFO:tasks.workunit.client.0.smithi026.stdout:2/703: chown d3/d19/d31/cd5 54038022 1 2024-04-23T10:18:00.623 INFO:tasks.workunit.client.0.smithi026.stdout:4/707: dwrite d4/d7/fa6 [4194304,4194304] 0 2024-04-23T10:18:00.623 INFO:tasks.workunit.client.0.smithi026.stdout:8/843: symlink d5/d56/d47/d99/l11c 0 2024-04-23T10:18:00.625 INFO:tasks.workunit.client.0.smithi026.stdout:8/844: fdatasync d5/d56/d33/f8c 0 2024-04-23T10:18:00.626 INFO:tasks.workunit.client.0.smithi026.stdout:4/708: creat d4/d5b/da7/fec x:0 0 0 2024-04-23T10:18:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:2/704: getdents d3/d19/d21/d23/da2/db8 0 2024-04-23T10:18:00.632 INFO:tasks.workunit.client.0.smithi026.stdout:3/684: sync 2024-04-23T10:18:00.633 INFO:tasks.workunit.client.0.smithi026.stdout:7/606: dread dd/d1d/f37 [0,4194304] 0 2024-04-23T10:18:00.633 INFO:tasks.workunit.client.0.smithi026.stdout:2/705: unlink d3/d19/d21/d23/d3a/d3c/d80/da7/dac/cdd 0 2024-04-23T10:18:00.634 INFO:tasks.workunit.client.0.smithi026.stdout:4/709: dread d4/d1b/fcf [0,4194304] 0 2024-04-23T10:18:00.641 INFO:tasks.workunit.client.0.smithi026.stdout:2/706: write d3/d19/d21/d23/d3a/d3c/d5d/f7b [508822,123890] 0 2024-04-23T10:18:00.644 INFO:tasks.workunit.client.0.smithi026.stdout:8/845: dwrite d5/d50/d9a/fda [0,4194304] 0 2024-04-23T10:18:00.646 INFO:tasks.workunit.client.0.smithi026.stdout:7/607: rename dd/d1d/d50/f7f to dd/d2c/d48/d8d/fb4 0 2024-04-23T10:18:00.647 INFO:tasks.workunit.client.0.smithi026.stdout:7/608: stat dd 0 2024-04-23T10:18:00.651 INFO:tasks.workunit.client.0.smithi026.stdout:2/707: creat d3/d19/d1d/d49/ff7 x:0 0 0 2024-04-23T10:18:00.653 INFO:tasks.workunit.client.0.smithi026.stdout:7/609: creat dd/d1d/d7d/fb5 x:0 0 0 2024-04-23T10:18:00.657 INFO:tasks.workunit.client.0.smithi026.stdout:9/839: dwrite d13/f2d [0,4194304] 0 2024-04-23T10:18:00.657 INFO:tasks.workunit.client.0.smithi026.stdout:7/610: read - dd/d2c/d48/f85 zero size 2024-04-23T10:18:00.658 INFO:tasks.workunit.client.0.smithi026.stdout:3/685: dwrite d0/d1e/f5d [0,4194304] 0 2024-04-23T10:18:00.661 INFO:tasks.workunit.client.0.smithi026.stdout:4/710: link d4/d22/d2e/cd9 d4/d1b/dbf/dda/d6c/d6f/d80/ced 0 2024-04-23T10:18:00.661 INFO:tasks.workunit.client.0.smithi026.stdout:2/708: truncate d3/dd/f15 552407 0 2024-04-23T10:18:00.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/846: dwrite d5/d115/d22/d65/d78/fa2 [0,4194304] 0 2024-04-23T10:18:00.663 INFO:tasks.workunit.client.0.smithi026.stdout:9/840: mkdir d13/d19/da7/dc1/d100 0 2024-04-23T10:18:00.666 INFO:tasks.workunit.client.0.smithi026.stdout:8/847: write d5/f28 [2147034,118859] 0 2024-04-23T10:18:00.667 INFO:tasks.workunit.client.0.smithi026.stdout:7/611: symlink dd/d3f/d47/d4c/d60/d75/lb6 0 2024-04-23T10:18:00.676 INFO:tasks.workunit.client.0.smithi026.stdout:4/711: dread d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:00.676 INFO:tasks.workunit.client.0.smithi026.stdout:3/686: creat d0/d1e/d30/d43/d29/d39/d93/fe6 x:0 0 0 2024-04-23T10:18:00.676 INFO:tasks.workunit.client.0.smithi026.stdout:7/612: symlink dd/d2c/lb7 0 2024-04-23T10:18:00.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/848: mkdir d5/d11d 0 2024-04-23T10:18:00.687 INFO:tasks.workunit.client.0.smithi026.stdout:2/709: dwrite d3/d19/d21/d23/fc1 [0,4194304] 0 2024-04-23T10:18:00.687 INFO:tasks.workunit.client.0.smithi026.stdout:7/613: dread - dd/d2c/d48/d8d/fa1 zero size 2024-04-23T10:18:00.687 INFO:tasks.workunit.client.0.smithi026.stdout:9/841: fsync d13/d36/d66/dc2/dc3/ff1 0 2024-04-23T10:18:00.687 INFO:tasks.workunit.client.0.smithi026.stdout:4/712: readlink d4/d7/d61/la9 0 2024-04-23T10:18:00.688 INFO:tasks.workunit.client.0.smithi026.stdout:4/713: dread - d4/d7/d61/d74/fb0 zero size 2024-04-23T10:18:00.689 INFO:tasks.workunit.client.0.smithi026.stdout:8/849: unlink d5/d115/d22/lb2 0 2024-04-23T10:18:00.691 INFO:tasks.workunit.client.0.smithi026.stdout:3/687: symlink d0/d1e/d30/le7 0 2024-04-23T10:18:00.692 INFO:tasks.workunit.client.0.smithi026.stdout:9/842: rmdir d13/d3e 39 2024-04-23T10:18:00.692 INFO:tasks.workunit.client.0.smithi026.stdout:7/614: symlink dd/d3f/lb8 0 2024-04-23T10:18:00.695 INFO:tasks.workunit.client.0.smithi026.stdout:7/615: chown dd/l18 43494887 1 2024-04-23T10:18:00.699 INFO:tasks.workunit.client.0.smithi026.stdout:4/714: dread d4/d22/d2e/f9e [0,4194304] 0 2024-04-23T10:18:00.699 INFO:tasks.workunit.client.0.smithi026.stdout:9/843: getdents d13/d3b/d68/dd6/d45/d3a/d4f 0 2024-04-23T10:18:00.701 INFO:tasks.workunit.client.0.smithi026.stdout:2/710: dwrite d3/f84 [0,4194304] 0 2024-04-23T10:18:00.701 INFO:tasks.workunit.client.0.smithi026.stdout:7/616: mkdir dd/d1d/d78/db9 0 2024-04-23T10:18:00.702 INFO:tasks.workunit.client.0.smithi026.stdout:8/850: dwrite d5/d115/dac/fe3 [0,4194304] 0 2024-04-23T10:18:00.704 INFO:tasks.workunit.client.0.smithi026.stdout:7/617: creat dd/d44/d38/fba x:0 0 0 2024-04-23T10:18:00.705 INFO:tasks.workunit.client.0.smithi026.stdout:9/844: truncate d13/d3b/d68/dd6/d45/d3a/ffe 244725 0 2024-04-23T10:18:00.705 INFO:tasks.workunit.client.0.smithi026.stdout:4/715: mknod d4/d22/dd8/de1/cee 0 2024-04-23T10:18:00.706 INFO:tasks.workunit.client.0.smithi026.stdout:4/716: dread - d4/d5b/fe5 zero size 2024-04-23T10:18:00.707 INFO:tasks.workunit.client.0.smithi026.stdout:2/711: rename d3/dd/l14 to d3/d19/d21/d23/d3a/d65/lf8 0 2024-04-23T10:18:00.707 INFO:tasks.workunit.client.0.smithi026.stdout:8/851: rmdir d5/d115/d64/dc5 39 2024-04-23T10:18:00.708 INFO:tasks.workunit.client.0.smithi026.stdout:9/845: creat d13/d3b/d4e/d76/f101 x:0 0 0 2024-04-23T10:18:00.711 INFO:tasks.workunit.client.0.smithi026.stdout:7/618: dread dd/d1d/f31 [0,4194304] 0 2024-04-23T10:18:00.716 INFO:tasks.workunit.client.0.smithi026.stdout:4/717: creat d4/d14/fef x:0 0 0 2024-04-23T10:18:00.718 INFO:tasks.workunit.client.0.smithi026.stdout:7/619: write dd/d1d/d50/f8b [92308,124080] 0 2024-04-23T10:18:00.721 INFO:tasks.workunit.client.0.smithi026.stdout:8/852: dwrite d5/d56/d33/f4e [0,4194304] 0 2024-04-23T10:18:00.721 INFO:tasks.workunit.client.0.smithi026.stdout:2/712: rename d3/d35 to d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9 0 2024-04-23T10:18:00.721 INFO:tasks.workunit.client.0.smithi026.stdout:4/718: mkdir d4/d5b/df0 0 2024-04-23T10:18:00.724 INFO:tasks.workunit.client.0.smithi026.stdout:4/719: creat d4/d5b/d7b/d4d/dc7/ff1 x:0 0 0 2024-04-23T10:18:00.726 INFO:tasks.workunit.client.0.smithi026.stdout:8/853: unlink d5/d56/d33/lec 0 2024-04-23T10:18:00.727 INFO:tasks.workunit.client.0.smithi026.stdout:8/854: write d5/d56/d3f/fcf [157432,5785] 0 2024-04-23T10:18:00.729 INFO:tasks.workunit.client.0.smithi026.stdout:8/855: write d5/d56/d33/ddc/de1/fc7 [828346,67674] 0 2024-04-23T10:18:00.731 INFO:tasks.workunit.client.0.smithi026.stdout:8/856: readlink d5/d50/ld2 0 2024-04-23T10:18:00.735 INFO:tasks.workunit.client.0.smithi026.stdout:2/713: truncate d3/d19/d21/d23/f94 2021099 0 2024-04-23T10:18:00.740 INFO:tasks.workunit.client.0.smithi026.stdout:7/620: dwrite dd/d1d/d50/f6a [0,4194304] 0 2024-04-23T10:18:00.742 INFO:tasks.workunit.client.0.smithi026.stdout:7/621: fdatasync dd/d1d/d50/f8b 0 2024-04-23T10:18:00.744 INFO:tasks.workunit.client.0.smithi026.stdout:9/846: dread d13/d3e/f41 [0,4194304] 0 2024-04-23T10:18:00.747 INFO:tasks.workunit.client.0.smithi026.stdout:8/857: write d5/d115/d22/d65/d78/f5a [25740,122806] 0 2024-04-23T10:18:00.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/720: getdents d4/d1b/dbf/dda/d6c 0 2024-04-23T10:18:00.750 INFO:tasks.workunit.client.0.smithi026.stdout:9/847: creat d13/d3b/d4e/d76/f102 x:0 0 0 2024-04-23T10:18:00.753 INFO:tasks.workunit.client.0.smithi026.stdout:4/721: unlink d4/d7/f7c 0 2024-04-23T10:18:00.756 INFO:tasks.workunit.client.0.smithi026.stdout:7/622: creat dd/d1d/fbb x:0 0 0 2024-04-23T10:18:00.759 INFO:tasks.workunit.client.0.smithi026.stdout:7/623: unlink dd/d3f/fa7 0 2024-04-23T10:18:00.760 INFO:tasks.workunit.client.0.smithi026.stdout:2/714: dread d3/d19/d21/d23/f29 [0,4194304] 0 2024-04-23T10:18:00.762 INFO:tasks.workunit.client.0.smithi026.stdout:9/848: getdents d13/d36/d66/dbf 0 2024-04-23T10:18:00.762 INFO:tasks.workunit.client.0.smithi026.stdout:2/715: read d3/dd/d4b/f64 [1153975,65111] 0 2024-04-23T10:18:00.763 INFO:tasks.workunit.client.0.smithi026.stdout:9/849: chown d13/d3b/d68/dd6/d45/d6d/l9c 9186 1 2024-04-23T10:18:00.764 INFO:tasks.workunit.client.0.smithi026.stdout:9/850: truncate d13/d3e/f44 9356556 0 2024-04-23T10:18:00.767 INFO:tasks.workunit.client.0.smithi026.stdout:7/624: mkdir dd/dbc 0 2024-04-23T10:18:00.768 INFO:tasks.workunit.client.0.smithi026.stdout:8/858: write d5/d115/fc [678606,128648] 0 2024-04-23T10:18:00.769 INFO:tasks.workunit.client.0.smithi026.stdout:7/625: readlink dd/l28 0 2024-04-23T10:18:00.771 INFO:tasks.workunit.client.0.smithi026.stdout:4/722: truncate d4/d22/d2e/f7d 734166 0 2024-04-23T10:18:00.772 INFO:tasks.workunit.client.0.smithi026.stdout:9/851: mknod d13/d3e/dd7/c103 0 2024-04-23T10:18:00.776 INFO:tasks.workunit.client.0.smithi026.stdout:9/852: creat d13/d3b/d68/dd6/d45/d67/f104 x:0 0 0 2024-04-23T10:18:00.776 INFO:tasks.workunit.client.0.smithi026.stdout:2/716: dread d3/d19/d21/d88/fcb [0,4194304] 0 2024-04-23T10:18:00.778 INFO:tasks.workunit.client.0.smithi026.stdout:8/859: dread d5/d56/d15/d8b/fa5 [0,4194304] 0 2024-04-23T10:18:00.778 INFO:tasks.workunit.client.0.smithi026.stdout:7/626: unlink dd/d1d/l82 0 2024-04-23T10:18:00.780 INFO:tasks.workunit.client.0.smithi026.stdout:2/717: mknod d3/d19/d21/d23/d3a/d3c/cfa 0 2024-04-23T10:18:00.780 INFO:tasks.workunit.client.0.smithi026.stdout:9/853: mkdir d13/d105 0 2024-04-23T10:18:00.781 INFO:tasks.workunit.client.0.smithi026.stdout:8/860: symlink d5/d56/d33/ddc/l11e 0 2024-04-23T10:18:00.782 INFO:tasks.workunit.client.0.smithi026.stdout:4/723: getdents d4/d5b/d7b/d86 0 2024-04-23T10:18:00.783 INFO:tasks.workunit.client.0.smithi026.stdout:2/718: unlink d3/fc3 0 2024-04-23T10:18:00.784 INFO:tasks.workunit.client.0.smithi026.stdout:8/861: rmdir d5/d115/d64 39 2024-04-23T10:18:00.785 INFO:tasks.workunit.client.0.smithi026.stdout:8/862: fsync d5/d56/d15/fcd 0 2024-04-23T10:18:00.785 INFO:tasks.workunit.client.0.smithi026.stdout:9/854: symlink d13/d31/d87/dce/l106 0 2024-04-23T10:18:00.787 INFO:tasks.workunit.client.0.smithi026.stdout:7/627: dwrite dd/d44/d38/fba [0,4194304] 0 2024-04-23T10:18:00.789 INFO:tasks.workunit.client.0.smithi026.stdout:7/628: write dd/d1d/d78/fab [4923759,73897] 0 2024-04-23T10:18:00.789 INFO:tasks.workunit.client.0.smithi026.stdout:8/863: mkdir d5/d56/d33/ddc/de1/da8/d11f 0 2024-04-23T10:18:00.790 INFO:tasks.workunit.client.0.smithi026.stdout:9/855: creat d13/d3b/d68/dd6/d45/d3a/d4f/f107 x:0 0 0 2024-04-23T10:18:00.790 INFO:tasks.workunit.client.0.smithi026.stdout:7/629: dread - dd/d1d/d7d/f98 zero size 2024-04-23T10:18:00.791 INFO:tasks.workunit.client.0.smithi026.stdout:4/724: creat d4/d5b/d7b/d36/d38/ff2 x:0 0 0 2024-04-23T10:18:00.797 INFO:tasks.workunit.client.0.smithi026.stdout:7/630: rmdir dd/d1d/d78 39 2024-04-23T10:18:00.800 INFO:tasks.workunit.client.0.smithi026.stdout:8/864: chown d5/d115/d22/d65/f87 3 1 2024-04-23T10:18:00.800 INFO:tasks.workunit.client.0.smithi026.stdout:4/725: dwrite d4/d22/d2e/fb4 [0,4194304] 0 2024-04-23T10:18:00.817 INFO:tasks.workunit.client.0.smithi026.stdout:4/726: unlink d4/c2c 0 2024-04-23T10:18:00.819 INFO:tasks.workunit.client.0.smithi026.stdout:7/631: dwrite dd/d1d/d50/f63 [0,4194304] 0 2024-04-23T10:18:00.819 INFO:tasks.workunit.client.0.smithi026.stdout:9/856: dwrite d13/f5c [0,4194304] 0 2024-04-23T10:18:00.820 INFO:tasks.workunit.client.0.smithi026.stdout:7/632: dread - dd/d6c/fa2 zero size 2024-04-23T10:18:00.824 INFO:tasks.workunit.client.0.smithi026.stdout:4/727: rename d4/d7/d61 to d4/d5b/d7b/d4d/df3 0 2024-04-23T10:18:00.828 INFO:tasks.workunit.client.0.smithi026.stdout:7/633: rename dd/d6c/f9d to dd/d6c/fbd 0 2024-04-23T10:18:00.829 INFO:tasks.workunit.client.0.smithi026.stdout:7/634: dread - dd/d3f/fa0 zero size 2024-04-23T10:18:00.830 INFO:tasks.workunit.client.0.smithi026.stdout:9/857: dwrite d13/d1b/d26/d88/db5/fe2 [0,4194304] 0 2024-04-23T10:18:00.835 INFO:tasks.workunit.client.0.smithi026.stdout:8/865: getdents d5/d115/dac 0 2024-04-23T10:18:00.836 INFO:tasks.workunit.client.0.smithi026.stdout:7/635: rmdir dd/d2c/d48 39 2024-04-23T10:18:00.843 INFO:tasks.workunit.client.0.smithi026.stdout:9/858: unlink d13/d3b/d4e/fdf 0 2024-04-23T10:18:00.843 INFO:tasks.workunit.client.0.smithi026.stdout:4/728: dwrite d4/d22/f47 [0,4194304] 0 2024-04-23T10:18:00.846 INFO:tasks.workunit.client.0.smithi026.stdout:4/729: dread - d4/d14/d30/d52/fe8 zero size 2024-04-23T10:18:00.847 INFO:tasks.workunit.client.0.smithi026.stdout:4/730: stat d4/d5b/d7b/f4f 0 2024-04-23T10:18:00.860 INFO:tasks.workunit.client.0.smithi026.stdout:9/859: dread d13/d1b/d26/fcd [0,4194304] 0 2024-04-23T10:18:00.866 INFO:tasks.workunit.client.0.smithi026.stdout:8/866: symlink d5/d115/d22/d106/l120 0 2024-04-23T10:18:00.866 INFO:tasks.workunit.client.0.smithi026.stdout:9/860: dwrite d13/d19/f8b [0,4194304] 0 2024-04-23T10:18:00.866 INFO:tasks.workunit.client.0.smithi026.stdout:9/861: stat d13/d3b/d4e 0 2024-04-23T10:18:00.868 INFO:tasks.workunit.client.0.smithi026.stdout:4/731: mkdir d4/d5b/df4 0 2024-04-23T10:18:00.869 INFO:tasks.workunit.client.0.smithi026.stdout:4/732: readlink d4/d5b/d7b/d36/d38/l39 0 2024-04-23T10:18:00.876 INFO:tasks.workunit.client.0.smithi026.stdout:9/862: dwrite d13/d1b/d26/d88/db5/fda [0,4194304] 0 2024-04-23T10:18:00.878 INFO:tasks.workunit.client.0.smithi026.stdout:4/733: rmdir d4/d5b/d7b/d36/d38 39 2024-04-23T10:18:00.881 INFO:tasks.workunit.client.0.smithi026.stdout:9/863: mknod d13/d36/d66/db6/c108 0 2024-04-23T10:18:00.883 INFO:tasks.workunit.client.0.smithi026.stdout:4/734: rmdir d4/d1b/dbf 39 2024-04-23T10:18:00.885 INFO:tasks.workunit.client.0.smithi026.stdout:8/867: fdatasync d5/d115/d64/dc5/fce 0 2024-04-23T10:18:00.886 INFO:tasks.workunit.client.0.smithi026.stdout:8/868: fdatasync d5/d56/d15/dee/ffa 0 2024-04-23T10:18:00.888 INFO:tasks.workunit.client.0.smithi026.stdout:4/735: symlink d4/d5b/da7/dba/lf5 0 2024-04-23T10:18:00.895 INFO:tasks.workunit.client.0.smithi026.stdout:9/864: write d13/d3b/d68/dd6/d45/d6d/f71 [2263560,33924] 0 2024-04-23T10:18:00.896 INFO:tasks.workunit.client.0.smithi026.stdout:9/865: chown d13/d3b/d4e/l69 870891957 1 2024-04-23T10:18:00.898 INFO:tasks.workunit.client.0.smithi026.stdout:1/641: sync 2024-04-23T10:18:00.899 INFO:tasks.workunit.client.0.smithi026.stdout:8/869: mkdir d5/d56/d33/ddc/de1/da8/d11f/d121 0 2024-04-23T10:18:00.901 INFO:tasks.workunit.client.0.smithi026.stdout:4/736: mkdir d4/d14/d3d/d73/df6 0 2024-04-23T10:18:00.904 INFO:tasks.workunit.client.0.smithi026.stdout:1/642: read dd/f3b [4117905,61358] 0 2024-04-23T10:18:00.905 INFO:tasks.workunit.client.0.smithi026.stdout:9/866: dwrite d13/d3e/fde [0,4194304] 0 2024-04-23T10:18:00.906 INFO:tasks.workunit.client.0.smithi026.stdout:1/643: stat dd/d1a/d20/d25/d35/d74/fb4 0 2024-04-23T10:18:00.920 INFO:tasks.workunit.client.0.smithi026.stdout:8/870: dread d5/d56/de8/ff0 [0,4194304] 0 2024-04-23T10:18:00.924 INFO:tasks.workunit.client.0.smithi026.stdout:4/737: dread d4/d14/f25 [0,4194304] 0 2024-04-23T10:18:00.929 INFO:tasks.workunit.client.0.smithi026.stdout:8/871: mknod d5/d50/d9a/c122 0 2024-04-23T10:18:00.930 INFO:tasks.workunit.client.0.smithi026.stdout:9/867: getdents d13/d19 0 2024-04-23T10:18:00.931 INFO:tasks.workunit.client.0.smithi026.stdout:1/644: dread dd/d1a/d20/d25/d35/d7f/f8d [0,4194304] 0 2024-04-23T10:18:00.932 INFO:tasks.workunit.client.0.smithi026.stdout:8/872: rmdir d5/d56/de8 39 2024-04-23T10:18:00.933 INFO:tasks.workunit.client.0.smithi026.stdout:9/868: mknod d13/d19/da7/dc1/c109 0 2024-04-23T10:18:00.934 INFO:tasks.workunit.client.0.smithi026.stdout:4/738: creat d4/d1b/dbf/dda/d6c/dd7/ff7 x:0 0 0 2024-04-23T10:18:00.936 INFO:tasks.workunit.client.0.smithi026.stdout:8/873: write d5/d115/d22/d65/f87 [4005239,34704] 0 2024-04-23T10:18:00.936 INFO:tasks.workunit.client.0.smithi026.stdout:4/739: truncate d4/d5b/d7b/d4d/fd1 288629 0 2024-04-23T10:18:00.937 INFO:tasks.workunit.client.0.smithi026.stdout:4/740: fdatasync d4/d5b/d7b/d86/fa3 0 2024-04-23T10:18:00.939 INFO:tasks.workunit.client.0.smithi026.stdout:1/645: rename dd/d1a/d23/d3f/fd2 to dd/d48/fe9 0 2024-04-23T10:18:00.941 INFO:tasks.workunit.client.0.smithi026.stdout:1/646: fsync dd/d15/d7d/da1/fb7 0 2024-04-23T10:18:00.943 INFO:tasks.workunit.client.0.smithi026.stdout:4/741: mkdir d4/d5b/d7b/d4d/df8 0 2024-04-23T10:18:00.949 INFO:tasks.workunit.client.0.smithi026.stdout:4/742: truncate d4/d22/d4e/d57/f72 5229462 0 2024-04-23T10:18:00.951 INFO:tasks.workunit.client.0.smithi026.stdout:9/869: dread d13/d3b/d68/dd6/d45/d67/f82 [0,4194304] 0 2024-04-23T10:18:00.952 INFO:tasks.workunit.client.0.smithi026.stdout:1/647: creat dd/d15/d7d/da1/dc6/ddc/fea x:0 0 0 2024-04-23T10:18:00.952 INFO:tasks.workunit.client.0.smithi026.stdout:4/743: mknod d4/d22/dd8/de1/cf9 0 2024-04-23T10:18:00.953 INFO:tasks.workunit.client.0.smithi026.stdout:8/874: creat d5/d56/d33/ddc/de1/da8/d11f/d121/f123 x:0 0 0 2024-04-23T10:18:00.955 INFO:tasks.workunit.client.0.smithi026.stdout:9/870: mkdir d13/d3b/d68/dd6/d45/d3a/d4f/d10a 0 2024-04-23T10:18:00.957 INFO:tasks.workunit.client.0.smithi026.stdout:9/871: write d13/d3b/d4e/d76/f91 [935232,20789] 0 2024-04-23T10:18:00.959 INFO:tasks.workunit.client.0.smithi026.stdout:1/648: mkdir dd/deb 0 2024-04-23T10:18:00.960 INFO:tasks.workunit.client.0.smithi026.stdout:8/875: creat d5/d56/d15/dee/f124 x:0 0 0 2024-04-23T10:18:00.961 INFO:tasks.workunit.client.0.smithi026.stdout:1/649: fdatasync dd/d1a/d23/f67 0 2024-04-23T10:18:00.961 INFO:tasks.workunit.client.0.smithi026.stdout:4/744: dwrite d4/d22/d2e/fdd [0,4194304] 0 2024-04-23T10:18:00.962 INFO:tasks.workunit.client.0.smithi026.stdout:9/872: mknod d13/d36/d66/d72/c10b 0 2024-04-23T10:18:00.963 INFO:tasks.workunit.client.0.smithi026.stdout:1/650: write dd/d1a/d20/fa8 [477720,68199] 0 2024-04-23T10:18:00.969 INFO:tasks.workunit.client.0.smithi026.stdout:4/745: mknod d4/d5b/d7b/d4d/df3/d74/cfa 0 2024-04-23T10:18:00.973 INFO:tasks.workunit.client.0.smithi026.stdout:9/873: dwrite d13/d1b/d26/d88/db5/fe0 [0,4194304] 0 2024-04-23T10:18:00.973 INFO:tasks.workunit.client.0.smithi026.stdout:4/746: dread - d4/d1b/dbf/dda/d6c/fc4 zero size 2024-04-23T10:18:00.976 INFO:tasks.workunit.client.0.smithi026.stdout:1/651: creat dd/d1a/d20/d25/d35/d43/d7b/fec x:0 0 0 2024-04-23T10:18:00.977 INFO:tasks.workunit.client.0.smithi026.stdout:8/876: rename d5/d56/d47/fa0 to d5/d56/d15/dee/f125 0 2024-04-23T10:18:00.979 INFO:tasks.workunit.client.0.smithi026.stdout:4/747: mknod d4/d1b/dbf/dda/d6c/d6f/d80/cfb 0 2024-04-23T10:18:00.981 INFO:tasks.workunit.client.0.smithi026.stdout:1/652: mkdir dd/d1a/d23/d3f/ded 0 2024-04-23T10:18:00.983 INFO:tasks.workunit.client.0.smithi026.stdout:9/874: write d13/d31/f53 [2947547,120006] 0 2024-04-23T10:18:00.986 INFO:tasks.workunit.client.0.smithi026.stdout:8/877: creat d5/d56/d33/d113/f126 x:0 0 0 2024-04-23T10:18:00.992 INFO:tasks.workunit.client.0.smithi026.stdout:4/748: dread d4/d5b/d7b/d4d/df3/d74/f21 [0,4194304] 0 2024-04-23T10:18:00.995 INFO:tasks.workunit.client.0.smithi026.stdout:9/875: mknod d13/d3b/d68/dd6/d45/d6d/d99/c10c 0 2024-04-23T10:18:00.997 INFO:tasks.workunit.client.0.smithi026.stdout:4/749: mknod d4/d5b/d7b/d4d/df8/cfc 0 2024-04-23T10:18:00.997 INFO:tasks.workunit.client.0.smithi026.stdout:8/878: dread d5/d56/d3f/f6b [0,4194304] 0 2024-04-23T10:18:00.998 INFO:tasks.workunit.client.0.smithi026.stdout:4/750: write d4/d5b/d7b/d4d/df3/f62 [3441603,4203] 0 2024-04-23T10:18:00.999 INFO:tasks.workunit.client.0.smithi026.stdout:9/876: rmdir d13/d36/d66/d78 39 2024-04-23T10:18:01.000 INFO:tasks.workunit.client.0.smithi026.stdout:4/751: chown d4/d22/d2e/c44 11138039 1 2024-04-23T10:18:01.005 INFO:tasks.workunit.client.0.smithi026.stdout:9/877: mkdir d13/d105/d10d 0 2024-04-23T10:18:01.007 INFO:tasks.workunit.client.0.smithi026.stdout:4/752: truncate d4/d1b/dbf/dda/f56 1204488 0 2024-04-23T10:18:01.013 INFO:tasks.workunit.client.0.smithi026.stdout:8/879: dread d5/d50/f79 [0,4194304] 0 2024-04-23T10:18:01.015 INFO:tasks.workunit.client.0.smithi026.stdout:4/753: dwrite d4/d5b/d7b/d36/d90/f9b [0,4194304] 0 2024-04-23T10:18:01.019 INFO:tasks.workunit.client.0.smithi026.stdout:8/880: rmdir d5/d115/d22/d106 39 2024-04-23T10:18:01.023 INFO:tasks.workunit.client.0.smithi026.stdout:8/881: write d5/d115/d22/d65/f83 [55145,6588] 0 2024-04-23T10:18:01.026 INFO:tasks.workunit.client.0.smithi026.stdout:8/882: write d5/d50/fba [2362711,80000] 0 2024-04-23T10:18:01.027 INFO:tasks.workunit.client.0.smithi026.stdout:4/754: truncate d4/d14/d30/d52/f64 6667239 0 2024-04-23T10:18:01.029 INFO:tasks.workunit.client.0.smithi026.stdout:4/755: write d4/d22/d4e/d57/faf [41448,118924] 0 2024-04-23T10:18:01.031 INFO:tasks.workunit.client.0.smithi026.stdout:9/878: dread d13/f1e [0,4194304] 0 2024-04-23T10:18:01.034 INFO:tasks.workunit.client.0.smithi026.stdout:4/756: mknod d4/d5b/da7/dba/cfd 0 2024-04-23T10:18:01.039 INFO:tasks.workunit.client.0.smithi026.stdout:9/879: dread d13/d3b/d68/dd6/d45/d6d/fa5 [0,4194304] 0 2024-04-23T10:18:01.040 INFO:tasks.workunit.client.0.smithi026.stdout:9/880: write d13/d3b/d4e/d76/f91 [556717,17704] 0 2024-04-23T10:18:01.042 INFO:tasks.workunit.client.0.smithi026.stdout:8/883: link d5/d56/d15/d8b/fa9 d5/f127 0 2024-04-23T10:18:01.044 INFO:tasks.workunit.client.0.smithi026.stdout:4/757: mkdir d4/d1b/dbf/dda/d6c/dd7/dfe 0 2024-04-23T10:18:01.046 INFO:tasks.workunit.client.0.smithi026.stdout:9/881: fdatasync d13/d3b/d5b/f63 0 2024-04-23T10:18:01.048 INFO:tasks.workunit.client.0.smithi026.stdout:9/882: write d13/d1b/d26/d88/dcf/dd1/fd5 [44205,89037] 0 2024-04-23T10:18:01.049 INFO:tasks.workunit.client.0.smithi026.stdout:4/758: mkdir d4/d14/d92/dff 0 2024-04-23T10:18:01.050 INFO:tasks.workunit.client.0.smithi026.stdout:9/883: write d13/d3b/d68/dd6/d45/d3a/ffe [324902,90827] 0 2024-04-23T10:18:01.055 INFO:tasks.workunit.client.0.smithi026.stdout:8/884: creat d5/d56/d15/f128 x:0 0 0 2024-04-23T10:18:01.056 INFO:tasks.workunit.client.0.smithi026.stdout:9/884: rename d13/d31/d87/fc0 to d13/d1b/d26/d88/dcf/dd1/f10e 0 2024-04-23T10:18:01.056 INFO:tasks.workunit.client.0.smithi026.stdout:8/885: dread d5/d56/d15/d76/f85 [0,4194304] 0 2024-04-23T10:18:01.061 INFO:tasks.workunit.client.0.smithi026.stdout:4/759: truncate d4/d7/f1f 8353128 0 2024-04-23T10:18:01.062 INFO:tasks.workunit.client.0.smithi026.stdout:4/760: chown d4/d14/d30/d52/fb9 0 1 2024-04-23T10:18:01.065 INFO:tasks.workunit.client.0.smithi026.stdout:9/885: rename d13/d3b/d68/dd6/d45/d6d/d99/c10c to d13/d1b/d26/d88/db5/c10f 0 2024-04-23T10:18:01.067 INFO:tasks.workunit.client.0.smithi026.stdout:4/761: write d4/d7/f13 [6617319,86551] 0 2024-04-23T10:18:01.069 INFO:tasks.workunit.client.0.smithi026.stdout:8/886: mkdir d5/d50/d9a/d129 0 2024-04-23T10:18:01.071 INFO:tasks.workunit.client.0.smithi026.stdout:4/762: creat d4/d1b/dbf/dda/d6c/d6f/d80/f100 x:0 0 0 2024-04-23T10:18:01.072 INFO:tasks.workunit.client.0.smithi026.stdout:8/887: truncate d5/d56/fa4 5327562 0 2024-04-23T10:18:01.073 INFO:tasks.workunit.client.0.smithi026.stdout:9/886: symlink d13/d105/d10d/l110 0 2024-04-23T10:18:01.073 INFO:tasks.workunit.client.0.smithi026.stdout:9/887: stat d13/d36/c5a 0 2024-04-23T10:18:01.076 INFO:tasks.workunit.client.0.smithi026.stdout:8/888: write d5/d115/f2e [5036835,42036] 0 2024-04-23T10:18:01.080 INFO:tasks.workunit.client.0.smithi026.stdout:8/889: rename d5/d115/d22/d65/cea to d5/d56/d33/ddc/de1/da8/d11f/d121/c12a 0 2024-04-23T10:18:01.083 INFO:tasks.workunit.client.0.smithi026.stdout:4/763: getdents d4 0 2024-04-23T10:18:01.085 INFO:tasks.workunit.client.0.smithi026.stdout:8/890: chown d5/d56/d33/c8a 100032262 1 2024-04-23T10:18:01.086 INFO:tasks.workunit.client.0.smithi026.stdout:9/888: link d13/d3b/d5b/c5f d13/d36/d66/d78/c111 0 2024-04-23T10:18:01.142 INFO:tasks.workunit.client.0.smithi026.stdout:6/886: sync 2024-04-23T10:18:01.143 INFO:tasks.workunit.client.0.smithi026.stdout:6/887: chown d6/l2a 167287272 1 2024-04-23T10:18:01.151 INFO:tasks.workunit.client.0.smithi026.stdout:8/891: creat d5/d56/d15/d76/f12b x:0 0 0 2024-04-23T10:18:01.165 INFO:tasks.workunit.client.0.smithi026.stdout:8/892: dwrite d5/fe2 [0,4194304] 0 2024-04-23T10:18:01.179 INFO:tasks.workunit.client.0.smithi026.stdout:4/764: truncate d4/d1b/dbf/dda/f56 493969 0 2024-04-23T10:18:01.276 INFO:tasks.workunit.client.0.smithi026.stdout:6/888: truncate d6/d13/d15/f1c 1863895 0 2024-04-23T10:18:01.278 INFO:tasks.workunit.client.0.smithi026.stdout:8/893: write d5/d56/d3f/fcf [1183050,44019] 0 2024-04-23T10:18:01.279 INFO:tasks.workunit.client.0.smithi026.stdout:9/889: creat d13/d3b/d68/dd6/d45/f112 x:0 0 0 2024-04-23T10:18:01.282 INFO:tasks.workunit.client.0.smithi026.stdout:4/765: symlink d4/d1b/dbf/dda/d6c/d6f/d80/l101 0 2024-04-23T10:18:01.285 INFO:tasks.workunit.client.0.smithi026.stdout:4/766: chown d4/d22/d4e/fd4 29983 1 2024-04-23T10:18:01.287 INFO:tasks.workunit.client.0.smithi026.stdout:4/767: dread - d4/d14/f6e zero size 2024-04-23T10:18:01.296 INFO:tasks.workunit.client.0.smithi026.stdout:4/768: stat d4/d14/d3d/cae 0 2024-04-23T10:18:01.308 INFO:tasks.workunit.client.0.smithi026.stdout:8/894: rename d5/d115/d22/d65/d78/d3e/fe9 to d5/d56/f12c 0 2024-04-23T10:18:01.316 INFO:tasks.workunit.client.0.smithi026.stdout:8/895: mkdir d5/d12d 0 2024-04-23T10:18:01.323 INFO:tasks.workunit.client.0.smithi026.stdout:9/890: rename d13/c16 to d13/d3b/d5b/dc9/df6/c113 0 2024-04-23T10:18:01.325 INFO:tasks.workunit.client.0.smithi026.stdout:9/891: chown d13/d1b/d2b/cb3 3272 1 2024-04-23T10:18:01.327 INFO:tasks.workunit.client.0.smithi026.stdout:8/896: fdatasync d5/d56/d47/d99/fa3 0 2024-04-23T10:18:01.328 INFO:tasks.workunit.client.0.smithi026.stdout:9/892: write d13/f25 [1890404,54634] 0 2024-04-23T10:18:01.335 INFO:tasks.workunit.client.0.smithi026.stdout:8/897: write d5/d115/d64/fe7 [453736,89941] 0 2024-04-23T10:18:01.338 INFO:tasks.workunit.client.0.smithi026.stdout:4/769: dread d4/d14/d3d/f8c [0,4194304] 0 2024-04-23T10:18:01.343 INFO:tasks.workunit.client.0.smithi026.stdout:6/889: dwrite d6/d21/d58/d8d/ff1 [0,4194304] 0 2024-04-23T10:18:01.347 INFO:tasks.workunit.client.0.smithi026.stdout:4/770: read - d4/d1b/dbf/dda/d6c/d6f/d80/f100 zero size 2024-04-23T10:18:01.350 INFO:tasks.workunit.client.0.smithi026.stdout:4/771: read d4/d22/d2e/f9e [853877,118418] 0 2024-04-23T10:18:01.352 INFO:tasks.workunit.client.0.smithi026.stdout:5/687: sync 2024-04-23T10:18:01.357 INFO:tasks.workunit.client.0.smithi026.stdout:5/688: unlink d0/d6f/l81 0 2024-04-23T10:18:01.360 INFO:tasks.workunit.client.0.smithi026.stdout:5/689: write d0/d3c/d5d/f6b [4810235,35790] 0 2024-04-23T10:18:01.361 INFO:tasks.workunit.client.0.smithi026.stdout:4/772: creat d4/d7/f102 x:0 0 0 2024-04-23T10:18:01.361 INFO:tasks.workunit.client.0.smithi026.stdout:6/890: dwrite d6/d21/f72 [0,4194304] 0 2024-04-23T10:18:01.363 INFO:tasks.workunit.client.0.smithi026.stdout:6/891: readlink d6/lbe 0 2024-04-23T10:18:01.364 INFO:tasks.workunit.client.0.smithi026.stdout:5/690: write d0/d12/f1f [2963571,23844] 0 2024-04-23T10:18:01.368 INFO:tasks.workunit.client.0.smithi026.stdout:6/892: write d6/d21/d2f/d32/fd1 [3067693,80359] 0 2024-04-23T10:18:01.380 INFO:tasks.workunit.client.0.smithi026.stdout:4/773: creat d4/d5b/d7b/d36/d90/f103 x:0 0 0 2024-04-23T10:18:01.381 INFO:tasks.workunit.client.0.smithi026.stdout:5/691: rename d0/d68/d91/d9a/la7 to d0/d3c/d5d/db2/dc6/le7 0 2024-04-23T10:18:01.386 INFO:tasks.workunit.client.0.smithi026.stdout:4/774: creat d4/d5b/da7/dba/f104 x:0 0 0 2024-04-23T10:18:01.387 INFO:tasks.workunit.client.0.smithi026.stdout:6/893: creat d6/f10d x:0 0 0 2024-04-23T10:18:01.390 INFO:tasks.workunit.client.0.smithi026.stdout:4/775: mknod d4/d14/d3d/d73/c105 0 2024-04-23T10:18:01.391 INFO:tasks.workunit.client.0.smithi026.stdout:4/776: write d4/fde [834406,124401] 0 2024-04-23T10:18:01.392 INFO:tasks.workunit.client.0.smithi026.stdout:5/692: link d0/l64 d0/d3c/d84/le8 0 2024-04-23T10:18:01.393 INFO:tasks.workunit.client.0.smithi026.stdout:5/693: chown d0/d12/c33 1151 1 2024-04-23T10:18:01.394 INFO:tasks.workunit.client.0.smithi026.stdout:6/894: mkdir d6/d33/d10e 0 2024-04-23T10:18:01.400 INFO:tasks.workunit.client.0.smithi026.stdout:5/694: rename d0/d68/fd8 to d0/d12/fe9 0 2024-04-23T10:18:01.409 INFO:tasks.workunit.client.0.smithi026.stdout:5/695: mkdir d0/d68/dea 0 2024-04-23T10:18:01.409 INFO:tasks.workunit.client.0.smithi026.stdout:6/895: getdents d6/d13/dcf 0 2024-04-23T10:18:01.409 INFO:tasks.workunit.client.0.smithi026.stdout:5/696: stat d0/d3c/d5d/d3a/l61 0 2024-04-23T10:18:01.409 INFO:tasks.workunit.client.0.smithi026.stdout:4/777: truncate d4/f5 751841 0 2024-04-23T10:18:01.410 INFO:tasks.workunit.client.0.smithi026.stdout:6/896: write d6/d21/d2f/d32/d53/fb0 [3041045,59423] 0 2024-04-23T10:18:01.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/697: chown d0/l64 224617690 1 2024-04-23T10:18:01.416 INFO:tasks.workunit.client.0.smithi026.stdout:4/778: rename d4/d5b/d7b/d4d/df3/d74/f21 to d4/d14/d92/f106 0 2024-04-23T10:18:01.417 INFO:tasks.workunit.client.0.smithi026.stdout:4/779: chown d4/d22/d4e/d57/faf 1172484 1 2024-04-23T10:18:01.418 INFO:tasks.workunit.client.0.smithi026.stdout:5/698: symlink d0/d3c/d5d/db2/dca/leb 0 2024-04-23T10:18:01.419 INFO:tasks.workunit.client.0.smithi026.stdout:6/897: getdents d6/d33 0 2024-04-23T10:18:01.424 INFO:tasks.workunit.client.0.smithi026.stdout:6/898: rename d6/d13/dcf/dd6/cdd to d6/d21/d2f/d32/d53/dca/ddc/c10f 0 2024-04-23T10:18:01.481 INFO:tasks.workunit.client.0.smithi026.stdout:0/895: sync 2024-04-23T10:18:01.486 INFO:tasks.workunit.client.0.smithi026.stdout:4/780: dwrite d4/d7/f13 [0,4194304] 0 2024-04-23T10:18:01.487 INFO:tasks.workunit.client.0.smithi026.stdout:0/896: dread - d7/d8/d1e/d1d/d2f/dd1/fe0 zero size 2024-04-23T10:18:01.489 INFO:tasks.workunit.client.0.smithi026.stdout:6/899: creat d6/d21/d2f/f110 x:0 0 0 2024-04-23T10:18:01.556 INFO:tasks.workunit.client.0.smithi026.stdout:0/897: read - d7/d8/d2d/d60/d62/da2/dd9/f102 zero size 2024-04-23T10:18:01.561 INFO:tasks.workunit.client.0.smithi026.stdout:0/898: chown d7/d8/f78 244611 1 2024-04-23T10:18:01.561 INFO:tasks.workunit.client.0.smithi026.stdout:5/699: dwrite d0/d12/f2b [0,4194304] 0 2024-04-23T10:18:01.564 INFO:tasks.workunit.client.0.smithi026.stdout:6/900: mknod d6/d21/d2f/d37/d9a/db1/c111 0 2024-04-23T10:18:01.581 INFO:tasks.workunit.client.0.smithi026.stdout:4/781: dwrite d4/d7/f84 [4194304,4194304] 0 2024-04-23T10:18:01.582 INFO:tasks.workunit.client.0.smithi026.stdout:5/700: dwrite d0/d3c/d84/d89/fb8 [0,4194304] 0 2024-04-23T10:18:01.586 INFO:tasks.workunit.client.0.smithi026.stdout:4/782: fdatasync d4/d5b/d7b/f9f 0 2024-04-23T10:18:01.593 INFO:tasks.workunit.client.0.smithi026.stdout:4/783: creat d4/d1b/dbf/f107 x:0 0 0 2024-04-23T10:18:01.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/899: dread d7/d8/d1e/d1d/d2f/f52 [0,4194304] 0 2024-04-23T10:18:01.602 INFO:tasks.workunit.client.0.smithi026.stdout:0/900: rename d7/d8/f10b to d7/d8/d1e/d57/f13a 0 2024-04-23T10:18:01.610 INFO:tasks.workunit.client.0.smithi026.stdout:0/901: mkdir d7/d8/d1e/d1d/d115/d13b 0 2024-04-23T10:18:01.614 INFO:tasks.workunit.client.0.smithi026.stdout:5/701: write d0/d3c/d57/f5a [1230416,95537] 0 2024-04-23T10:18:01.616 INFO:tasks.workunit.client.0.smithi026.stdout:0/902: mknod d7/d8/d2d/d60/d62/db9/c13c 0 2024-04-23T10:18:01.619 INFO:tasks.workunit.client.0.smithi026.stdout:0/903: write d7/d8/d1e/f41 [2052225,35472] 0 2024-04-23T10:18:01.623 INFO:tasks.workunit.client.0.smithi026.stdout:0/904: fsync d7/d8/f82 0 2024-04-23T10:18:01.628 INFO:tasks.workunit.client.0.smithi026.stdout:0/905: fsync d7/d8/d1e/d1d/f67 0 2024-04-23T10:18:01.629 INFO:tasks.workunit.client.0.smithi026.stdout:3/688: sync 2024-04-23T10:18:01.630 INFO:tasks.workunit.client.0.smithi026.stdout:5/702: dwrite d0/d3c/f88 [0,4194304] 0 2024-04-23T10:18:01.635 INFO:tasks.workunit.client.0.smithi026.stdout:3/689: creat d0/d51/d5e/da4/fe8 x:0 0 0 2024-04-23T10:18:01.639 INFO:tasks.workunit.client.0.smithi026.stdout:0/906: creat d7/d8/d2d/d60/d62/f13d x:0 0 0 2024-04-23T10:18:01.640 INFO:tasks.workunit.client.0.smithi026.stdout:3/690: symlink d0/d1e/d30/d43/d29/d39/d93/le9 0 2024-04-23T10:18:01.646 INFO:tasks.workunit.client.0.smithi026.stdout:3/691: creat d0/d1e/d30/d77/fea x:0 0 0 2024-04-23T10:18:01.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/703: truncate d0/d3c/fd2 194171 0 2024-04-23T10:18:01.650 INFO:tasks.workunit.client.0.smithi026.stdout:0/907: getdents d7/d8/d1e/d1d/d2f/dd1 0 2024-04-23T10:18:01.655 INFO:tasks.workunit.client.0.smithi026.stdout:3/692: link d0/d1e/d30/d43/df/d63/f65 d0/d4c/feb 0 2024-04-23T10:18:01.656 INFO:tasks.workunit.client.0.smithi026.stdout:5/704: link d0/la d0/d68/d91/dd6/lec 0 2024-04-23T10:18:01.659 INFO:tasks.workunit.client.0.smithi026.stdout:3/693: creat d0/d1e/d30/d43/dc1/fec x:0 0 0 2024-04-23T10:18:01.662 INFO:tasks.workunit.client.0.smithi026.stdout:3/694: rmdir d0/d1e/d30 39 2024-04-23T10:18:01.668 INFO:tasks.workunit.client.0.smithi026.stdout:0/908: dread d7/f84 [0,4194304] 0 2024-04-23T10:18:01.669 INFO:tasks.workunit.client.0.smithi026.stdout:5/705: dwrite d0/d3c/d84/fab [0,4194304] 0 2024-04-23T10:18:01.674 INFO:tasks.workunit.client.0.smithi026.stdout:5/706: truncate d0/d3c/d5d/db2/fcb 530055 0 2024-04-23T10:18:01.676 INFO:tasks.workunit.client.0.smithi026.stdout:3/695: dwrite d0/d1e/fc7 [0,4194304] 0 2024-04-23T10:18:01.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/909: dwrite d7/fbb [0,4194304] 0 2024-04-23T10:18:01.697 INFO:tasks.workunit.client.0.smithi026.stdout:0/910: dwrite d7/f14 [0,4194304] 0 2024-04-23T10:18:01.699 INFO:tasks.workunit.client.0.smithi026.stdout:0/911: chown d7/d8/d1e/l1b 0 1 2024-04-23T10:18:01.700 INFO:tasks.workunit.client.0.smithi026.stdout:5/707: rename d0/d68/d91/d9a/fc5 to d0/d3c/d5d/db2/dca/fed 0 2024-04-23T10:18:01.723 INFO:tasks.workunit.client.0.smithi026.stdout:0/912: mknod d7/d43/c13e 0 2024-04-23T10:18:01.727 INFO:tasks.workunit.client.0.smithi026.stdout:4/784: fdatasync d4/d7/f84 0 2024-04-23T10:18:01.728 INFO:tasks.workunit.client.0.smithi026.stdout:3/696: creat d0/d1e/d30/d43/d29/d39/fed x:0 0 0 2024-04-23T10:18:01.733 INFO:tasks.workunit.client.0.smithi026.stdout:3/697: unlink d0/d1e/d30/d43/d29/d39/d93/le9 0 2024-04-23T10:18:01.734 INFO:tasks.workunit.client.0.smithi026.stdout:3/698: readlink d0/d1e/d30/d77/le2 0 2024-04-23T10:18:01.746 INFO:tasks.workunit.client.0.smithi026.stdout:3/699: rename d0/d1e/d30/d43/d29 to d0/d1e/d23/d87/db3/dee 0 2024-04-23T10:18:01.750 INFO:tasks.workunit.client.0.smithi026.stdout:3/700: getdents d0/d1e/d23/d87/db3/dee/d39/dda 0 2024-04-23T10:18:01.751 INFO:tasks.workunit.client.0.smithi026.stdout:0/913: dwrite d7/d8/d1e/d1d/d2f/d6c/fd2 [0,4194304] 0 2024-04-23T10:18:01.752 INFO:tasks.workunit.client.0.smithi026.stdout:3/701: mkdir d0/d51/d5e/da4/def 0 2024-04-23T10:18:01.757 INFO:tasks.workunit.client.0.smithi026.stdout:3/702: fdatasync d0/f6a 0 2024-04-23T10:18:01.758 INFO:tasks.workunit.client.0.smithi026.stdout:3/703: stat d0/d1e/d30/d43/df/dcb/d97 0 2024-04-23T10:18:01.762 INFO:tasks.workunit.client.0.smithi026.stdout:3/704: creat d0/d1e/d23/d87/db6/ff0 x:0 0 0 2024-04-23T10:18:01.766 INFO:tasks.workunit.client.0.smithi026.stdout:3/705: read d0/f11 [15332,28656] 0 2024-04-23T10:18:01.767 INFO:tasks.workunit.client.0.smithi026.stdout:2/719: sync 2024-04-23T10:18:01.767 INFO:tasks.workunit.client.0.smithi026.stdout:7/636: sync 2024-04-23T10:18:01.768 INFO:tasks.workunit.client.0.smithi026.stdout:3/706: fdatasync d0/d1e/d30/d43/d82/fcf 0 2024-04-23T10:18:01.769 INFO:tasks.workunit.client.0.smithi026.stdout:2/720: readlink d3/d19/l2f 0 2024-04-23T10:18:01.772 INFO:tasks.workunit.client.0.smithi026.stdout:7/637: fsync dd/d3f/d47/d4c/f6f 0 2024-04-23T10:18:01.773 INFO:tasks.workunit.client.0.smithi026.stdout:7/638: readlink dd/d2c/lb7 0 2024-04-23T10:18:01.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/914: dwrite d7/d8/d2d/d60/f66 [0,4194304] 0 2024-04-23T10:18:01.775 INFO:tasks.workunit.client.0.smithi026.stdout:3/707: rename d0/f6a to d0/d51/d5e/ff1 0 2024-04-23T10:18:01.778 INFO:tasks.workunit.client.0.smithi026.stdout:2/721: symlink d3/d19/d21/lfb 0 2024-04-23T10:18:01.781 INFO:tasks.workunit.client.0.smithi026.stdout:3/708: mknod d0/d1e/d23/cf2 0 2024-04-23T10:18:01.785 INFO:tasks.workunit.client.0.smithi026.stdout:7/639: dwrite dd/d1d/fbb [0,4194304] 0 2024-04-23T10:18:01.788 INFO:tasks.workunit.client.0.smithi026.stdout:2/722: creat d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/ffc x:0 0 0 2024-04-23T10:18:01.790 INFO:tasks.workunit.client.0.smithi026.stdout:3/709: creat d0/d4c/ff3 x:0 0 0 2024-04-23T10:18:01.794 INFO:tasks.workunit.client.0.smithi026.stdout:3/710: mknod d0/d1e/d30/d43/df/d63/cf4 0 2024-04-23T10:18:01.796 INFO:tasks.workunit.client.0.smithi026.stdout:7/640: creat dd/d2c/d48/fbe x:0 0 0 2024-04-23T10:18:01.797 INFO:tasks.workunit.client.0.smithi026.stdout:5/708: read d0/f9 [451255,6406] 0 2024-04-23T10:18:01.797 INFO:tasks.workunit.client.0.smithi026.stdout:2/723: rename d3/d19/d21/d23/f94 to d3/d19/d21/d23/da2/db8/ffd 0 2024-04-23T10:18:01.800 INFO:tasks.workunit.client.0.smithi026.stdout:2/724: write d3/d19/d21/d23/d3a/d3c/f47 [2241307,8930] 0 2024-04-23T10:18:01.800 INFO:tasks.workunit.client.0.smithi026.stdout:5/709: creat d0/d68/d91/d9a/fee x:0 0 0 2024-04-23T10:18:01.802 INFO:tasks.workunit.client.0.smithi026.stdout:5/710: fdatasync d0/f90 0 2024-04-23T10:18:01.802 INFO:tasks.workunit.client.0.smithi026.stdout:2/725: truncate d3/d19/d21/d23/f33 1958800 0 2024-04-23T10:18:01.806 INFO:tasks.workunit.client.0.smithi026.stdout:2/726: read - d3/d19/d21/d23/d3a/d3c/d80/da7/fe1 zero size 2024-04-23T10:18:01.807 INFO:tasks.workunit.client.0.smithi026.stdout:2/727: fsync d3/d19/d31/f66 0 2024-04-23T10:18:01.812 INFO:tasks.workunit.client.0.smithi026.stdout:2/728: rename d3/dd/c42 to d3/d19/d21/dc6/cfe 0 2024-04-23T10:18:01.813 INFO:tasks.workunit.client.0.smithi026.stdout:5/711: truncate d0/d3c/d5d/f6b 2027349 0 2024-04-23T10:18:01.815 INFO:tasks.workunit.client.0.smithi026.stdout:2/729: mknod d3/d19/d21/d23/d3a/d3c/d80/da7/dac/cff 0 2024-04-23T10:18:01.817 INFO:tasks.workunit.client.0.smithi026.stdout:3/711: dread d0/d1e/d30/fd7 [0,4194304] 0 2024-04-23T10:18:01.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/712: creat d0/d68/fef x:0 0 0 2024-04-23T10:18:01.818 INFO:tasks.workunit.client.0.smithi026.stdout:3/712: chown d0/d1e/d30/d43/df/de3 90 1 2024-04-23T10:18:01.819 INFO:tasks.workunit.client.0.smithi026.stdout:3/713: chown d0/d1e/d23/d87/db3/dee/fb1 25899 1 2024-04-23T10:18:01.819 INFO:tasks.workunit.client.0.smithi026.stdout:2/730: symlink d3/d19/d21/d23/d3a/d3c/d80/da7/l100 0 2024-04-23T10:18:01.823 INFO:tasks.workunit.client.0.smithi026.stdout:3/714: unlink d0/d1e/d30/d43/df/de3/le5 0 2024-04-23T10:18:01.825 INFO:tasks.workunit.client.0.smithi026.stdout:3/715: fsync d0/d1e/d30/d43/f5f 0 2024-04-23T10:18:01.828 INFO:tasks.workunit.client.0.smithi026.stdout:2/731: dwrite d3/d19/d21/d88/dd8/fe5 [0,4194304] 0 2024-04-23T10:18:01.839 INFO:tasks.workunit.client.0.smithi026.stdout:2/732: rename d3/d19/d31/f5c to d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f101 0 2024-04-23T10:18:01.840 INFO:tasks.workunit.client.0.smithi026.stdout:3/716: write d0/d1e/d30/d43/df/d72/fb2 [95951,38069] 0 2024-04-23T10:18:01.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/717: fdatasync d0/d1e/d23/d87/db3/fc8 0 2024-04-23T10:18:01.843 INFO:tasks.workunit.client.0.smithi026.stdout:3/718: stat d0/d1e/d30/d43/d6c/d79/d73/faa 0 2024-04-23T10:18:01.848 INFO:tasks.workunit.client.0.smithi026.stdout:2/733: truncate d3/d19/d1d/fe6 401330 0 2024-04-23T10:18:01.852 INFO:tasks.workunit.client.0.smithi026.stdout:3/719: dwrite d0/d1e/d30/d77/fea [0,4194304] 0 2024-04-23T10:18:01.861 INFO:tasks.workunit.client.0.smithi026.stdout:2/734: dwrite d3/d19/d21/fcf [0,4194304] 0 2024-04-23T10:18:01.863 INFO:tasks.workunit.client.0.smithi026.stdout:2/735: write d3/d19/d31/f3b [4091464,84339] 0 2024-04-23T10:18:01.867 INFO:tasks.workunit.client.0.smithi026.stdout:2/736: truncate d3/d19/d31/f91 694167 0 2024-04-23T10:18:01.876 INFO:tasks.workunit.client.0.smithi026.stdout:2/737: creat d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/f102 x:0 0 0 2024-04-23T10:18:01.880 INFO:tasks.workunit.client.0.smithi026.stdout:3/720: dread d0/d1e/d30/d43/f7e [0,4194304] 0 2024-04-23T10:18:01.880 INFO:tasks.workunit.client.0.smithi026.stdout:2/738: creat d3/d19/d1d/f103 x:0 0 0 2024-04-23T10:18:01.882 INFO:tasks.workunit.client.0.smithi026.stdout:3/721: dread - d0/d4c/ff3 zero size 2024-04-23T10:18:01.883 INFO:tasks.workunit.client.0.smithi026.stdout:3/722: chown d0/d1e/d30/d43/d6c/d79/d64/f98 29916029 1 2024-04-23T10:18:01.883 INFO:tasks.workunit.client.0.smithi026.stdout:3/723: fdatasync d0/fbb 0 2024-04-23T10:18:01.884 INFO:tasks.workunit.client.0.smithi026.stdout:3/724: fdatasync d0/d1e/d23/d87/db3/dee/f5c 0 2024-04-23T10:18:01.885 INFO:tasks.workunit.client.0.smithi026.stdout:3/725: chown d0/d1e/d30/d43/d6c 29844637 1 2024-04-23T10:18:01.889 INFO:tasks.workunit.client.0.smithi026.stdout:2/739: write d3/d19/d21/d23/d3a/f8c [1081399,107514] 0 2024-04-23T10:18:01.890 INFO:tasks.workunit.client.0.smithi026.stdout:3/726: symlink d0/d1e/d23/lf5 0 2024-04-23T10:18:01.892 INFO:tasks.workunit.client.0.smithi026.stdout:3/727: creat d0/d1e/d30/d43/df/dcb/ff6 x:0 0 0 2024-04-23T10:18:01.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/728: chown d0/d1e/d30/d43/df/dcb/fd8 88 1 2024-04-23T10:18:01.893 INFO:tasks.workunit.client.0.smithi026.stdout:3/729: stat d0/d1e/d30/d43/f7e 0 2024-04-23T10:18:01.895 INFO:tasks.workunit.client.0.smithi026.stdout:3/730: write d0/f20 [6081738,70699] 0 2024-04-23T10:18:01.905 INFO:tasks.workunit.client.0.smithi026.stdout:3/731: dwrite d0/d1e/d23/d87/db3/fc8 [0,4194304] 0 2024-04-23T10:18:01.907 INFO:tasks.workunit.client.0.smithi026.stdout:3/732: fsync d0/d1e/d30/d43/df/f85 0 2024-04-23T10:18:01.913 INFO:tasks.workunit.client.0.smithi026.stdout:3/733: truncate d0/d1e/d23/fb9 1186189 0 2024-04-23T10:18:01.917 INFO:tasks.workunit.client.0.smithi026.stdout:3/734: creat d0/d1e/d30/d43/df/dcb/d97/ff7 x:0 0 0 2024-04-23T10:18:01.918 INFO:tasks.workunit.client.0.smithi026.stdout:3/735: write d0/d1e/f8b [4348311,116725] 0 2024-04-23T10:18:01.925 INFO:tasks.workunit.client.0.smithi026.stdout:3/736: dwrite d0/d1e/d30/fa5 [0,4194304] 0 2024-04-23T10:18:01.926 INFO:tasks.workunit.client.0.smithi026.stdout:1/653: sync 2024-04-23T10:18:01.929 INFO:tasks.workunit.client.0.smithi026.stdout:1/654: symlink dd/d48/dac/lee 0 2024-04-23T10:18:01.934 INFO:tasks.workunit.client.0.smithi026.stdout:1/655: creat dd/d1a/d20/d25/d35/d74/d93/fef x:0 0 0 2024-04-23T10:18:01.935 INFO:tasks.workunit.client.0.smithi026.stdout:1/656: fsync dd/d1a/d23/f67 0 2024-04-23T10:18:01.936 INFO:tasks.workunit.client.0.smithi026.stdout:3/737: write d0/f11 [1117730,102440] 0 2024-04-23T10:18:01.936 INFO:tasks.workunit.client.0.smithi026.stdout:1/657: dread - dd/d48/dab/fca zero size 2024-04-23T10:18:01.938 INFO:tasks.workunit.client.0.smithi026.stdout:1/658: dread - dd/d15/d7d/fc4 zero size 2024-04-23T10:18:01.940 INFO:tasks.workunit.client.0.smithi026.stdout:3/738: truncate d0/d1e/d30/d43/df/dcb/d97/ff7 612827 0 2024-04-23T10:18:01.947 INFO:tasks.workunit.client.0.smithi026.stdout:3/739: dwrite d0/d51/d5e/da4/fba [0,4194304] 0 2024-04-23T10:18:01.950 INFO:tasks.workunit.client.0.smithi026.stdout:3/740: mkdir d0/d1e/d23/d87/df8 0 2024-04-23T10:18:02.006 INFO:tasks.workunit.client.0.smithi026.stdout:3/741: symlink d0/d51/d5e/da4/lf9 0 2024-04-23T10:18:02.011 INFO:tasks.workunit.client.0.smithi026.stdout:1/659: dwrite dd/d1a/d20/d25/f71 [0,4194304] 0 2024-04-23T10:18:02.012 INFO:tasks.workunit.client.0.smithi026.stdout:3/742: mknod d0/d1e/d23/d87/db3/dee/d39/dda/cfa 0 2024-04-23T10:18:02.016 INFO:tasks.workunit.client.0.smithi026.stdout:3/743: mkdir d0/d1e/d30/d43/df/de3/dfb 0 2024-04-23T10:18:02.030 INFO:tasks.workunit.client.0.smithi026.stdout:1/660: dwrite f7 [0,4194304] 0 2024-04-23T10:18:02.033 INFO:tasks.workunit.client.0.smithi026.stdout:3/744: dwrite d0/d1e/d30/d43/df/d72/fb2 [0,4194304] 0 2024-04-23T10:18:02.045 INFO:tasks.workunit.client.0.smithi026.stdout:1/661: dwrite dd/d1a/d20/d25/d35/d74/d93/fc5 [0,4194304] 0 2024-04-23T10:18:02.063 INFO:tasks.workunit.client.0.smithi026.stdout:1/662: dwrite dd/d1a/f83 [0,4194304] 0 2024-04-23T10:18:02.071 INFO:tasks.workunit.client.0.smithi026.stdout:1/663: dread dd/d1a/d20/d25/d35/d74/d93/fc5 [0,4194304] 0 2024-04-23T10:18:02.091 INFO:tasks.workunit.client.0.smithi026.stdout:4/785: sync 2024-04-23T10:18:02.091 INFO:tasks.workunit.client.0.smithi026.stdout:9/893: sync 2024-04-23T10:18:02.092 INFO:tasks.workunit.client.0.smithi026.stdout:8/898: sync 2024-04-23T10:18:02.093 INFO:tasks.workunit.client.0.smithi026.stdout:4/786: chown d4/d5b/d7b/f4f 1 1 2024-04-23T10:18:02.094 INFO:tasks.workunit.client.0.smithi026.stdout:4/787: fsync d4/d5b/d7b/d4d/dad/fbe 0 2024-04-23T10:18:02.094 INFO:tasks.workunit.client.0.smithi026.stdout:9/894: rmdir d13/d3b/d5b/dc9 39 2024-04-23T10:18:02.101 INFO:tasks.workunit.client.0.smithi026.stdout:9/895: dread d13/d1b/d26/d88/db5/fda [0,4194304] 0 2024-04-23T10:18:02.107 INFO:tasks.workunit.client.0.smithi026.stdout:4/788: dwrite d4/d1b/dbf/dda/fa1 [4194304,4194304] 0 2024-04-23T10:18:02.108 INFO:tasks.workunit.client.0.smithi026.stdout:4/789: write d4/d22/d4e/d57/fb2 [448052,10763] 0 2024-04-23T10:18:02.110 INFO:tasks.workunit.client.0.smithi026.stdout:9/896: mknod d13/d3b/d5b/dc9/df6/c114 0 2024-04-23T10:18:02.110 INFO:tasks.workunit.client.0.smithi026.stdout:4/790: read - d4/d5b/d7b/f6b zero size 2024-04-23T10:18:02.116 INFO:tasks.workunit.client.0.smithi026.stdout:3/745: read d0/d1e/d30/f4f [1973292,97968] 0 2024-04-23T10:18:02.119 INFO:tasks.workunit.client.0.smithi026.stdout:9/897: link d13/d19/fb7 d13/d36/f115 0 2024-04-23T10:18:02.121 INFO:tasks.workunit.client.0.smithi026.stdout:9/898: write d13/d1b/d26/f30 [2215241,22597] 0 2024-04-23T10:18:02.124 INFO:tasks.workunit.client.0.smithi026.stdout:3/746: unlink d0/d1e/d23/d87/db3/dee/cdf 0 2024-04-23T10:18:02.132 INFO:tasks.workunit.client.0.smithi026.stdout:3/747: dread d0/d1e/d30/fa5 [0,4194304] 0 2024-04-23T10:18:02.135 INFO:tasks.workunit.client.0.smithi026.stdout:3/748: write d0/d1e/d23/d87/db3/dee/d39/fce [80251,31532] 0 2024-04-23T10:18:02.175 INFO:tasks.workunit.client.0.smithi026.stdout:4/791: getdents d4/d22/d2e 0 2024-04-23T10:18:02.186 INFO:tasks.workunit.client.0.smithi026.stdout:3/749: mknod d0/d1e/d30/d43/d6c/d79/d73/d99/da8/cfc 0 2024-04-23T10:18:02.189 INFO:tasks.workunit.client.0.smithi026.stdout:9/899: getdents d13/d3b/d5b/dc9/df6 0 2024-04-23T10:18:02.196 INFO:tasks.workunit.client.0.smithi026.stdout:3/750: rename d0/fbb to d0/d1e/d23/d87/db3/dee/d39/ffd 0 2024-04-23T10:18:02.196 INFO:tasks.workunit.client.0.smithi026.stdout:4/792: dread d4/d22/d2e/f32 [0,4194304] 0 2024-04-23T10:18:02.197 INFO:tasks.workunit.client.0.smithi026.stdout:3/751: dread - d0/d1e/d30/d43/d6c/d79/d73/d99/fdb zero size 2024-04-23T10:18:02.199 INFO:tasks.workunit.client.0.smithi026.stdout:3/752: dread - d0/d1e/d30/d43/df/dcb/ff6 zero size 2024-04-23T10:18:02.223 INFO:tasks.workunit.client.0.smithi026.stdout:6/901: sync 2024-04-23T10:18:02.232 INFO:tasks.workunit.client.0.smithi026.stdout:3/753: write d0/d1e/d23/d87/db3/dee/d39/ffd [467553,90039] 0 2024-04-23T10:18:02.233 INFO:tasks.workunit.client.0.smithi026.stdout:3/754: readlink d0/d51/d5e/da4/lf9 0 2024-04-23T10:18:02.234 INFO:tasks.workunit.client.0.smithi026.stdout:6/902: mknod d6/dd3/c112 0 2024-04-23T10:18:02.235 INFO:tasks.workunit.client.0.smithi026.stdout:4/793: getdents d4/d14/d3d/d73 0 2024-04-23T10:18:02.237 INFO:tasks.workunit.client.0.smithi026.stdout:4/794: write d4/d5b/d7b/d86/fb7 [637491,78986] 0 2024-04-23T10:18:02.248 INFO:tasks.workunit.client.0.smithi026.stdout:4/795: dwrite d4/d1b/fcf [0,4194304] 0 2024-04-23T10:18:02.249 INFO:tasks.workunit.client.0.smithi026.stdout:9/900: creat d13/d19/f116 x:0 0 0 2024-04-23T10:18:02.252 INFO:tasks.workunit.client.0.smithi026.stdout:9/901: write d13/d3e/fcb [233146,122226] 0 2024-04-23T10:18:02.254 INFO:tasks.workunit.client.0.smithi026.stdout:9/902: truncate d13/d3e/ffb 511917 0 2024-04-23T10:18:02.255 INFO:tasks.workunit.client.0.smithi026.stdout:9/903: fsync d13/d3b/d68/dd6/d45/d3a/d4f/f59 0 2024-04-23T10:18:02.258 INFO:tasks.workunit.client.0.smithi026.stdout:9/904: truncate d13/d36/d66/dc2/dc3/ff1 4702151 0 2024-04-23T10:18:02.265 INFO:tasks.workunit.client.0.smithi026.stdout:9/905: link d13/d3b/l97 d13/d3b/d68/dd6/d45/d67/l117 0 2024-04-23T10:18:02.278 INFO:tasks.workunit.client.0.smithi026.stdout:3/755: rename d0/d1e/d30/d43/d6c/d79/c5b to d0/cfe 0 2024-04-23T10:18:02.280 INFO:tasks.workunit.client.0.smithi026.stdout:3/756: mkdir d0/d1e/d30/d43/df/d72/dff 0 2024-04-23T10:18:02.286 INFO:tasks.workunit.client.0.smithi026.stdout:4/796: dwrite d4/f5 [0,4194304] 0 2024-04-23T10:18:02.287 INFO:tasks.workunit.client.0.smithi026.stdout:3/757: dread d0/d51/d5e/da4/fba [0,4194304] 0 2024-04-23T10:18:02.290 INFO:tasks.workunit.client.0.smithi026.stdout:3/758: unlink d0/d1e/d23/d87/db3/dee/lc9 0 2024-04-23T10:18:02.291 INFO:tasks.workunit.client.0.smithi026.stdout:3/759: chown d0/d1e/d30/d43/df/f85 9414367 1 2024-04-23T10:18:02.293 INFO:tasks.workunit.client.0.smithi026.stdout:3/760: mkdir d0/d1e/d30/d77/d100 0 2024-04-23T10:18:02.302 INFO:tasks.workunit.client.0.smithi026.stdout:3/761: dwrite d0/d4c/ff3 [0,4194304] 0 2024-04-23T10:18:02.305 INFO:tasks.workunit.client.0.smithi026.stdout:3/762: truncate d0/d1e/d30/d43/df/dcb/d97/ff7 845382 0 2024-04-23T10:18:02.308 INFO:tasks.workunit.client.0.smithi026.stdout:3/763: rename d0/d1e/d30/d43/f7e to d0/d1e/d30/d77/d100/f101 0 2024-04-23T10:18:02.311 INFO:tasks.workunit.client.0.smithi026.stdout:3/764: mknod d0/d1e/d23/d87/db3/dee/d39/d93/c102 0 2024-04-23T10:18:02.314 INFO:tasks.workunit.client.0.smithi026.stdout:3/765: creat d0/d1e/d30/d43/d6c/d79/d73/d99/da8/f103 x:0 0 0 2024-04-23T10:18:02.319 INFO:tasks.workunit.client.0.smithi026.stdout:3/766: link d0/d1e/d23/d87/db3/dee/d39/ffd d0/d1e/d30/d43/df/d63/f104 0 2024-04-23T10:18:02.322 INFO:tasks.workunit.client.0.smithi026.stdout:3/767: creat d0/d1e/d30/d43/f105 x:0 0 0 2024-04-23T10:18:02.408 INFO:tasks.workunit.client.0.smithi026.stdout:0/915: sync 2024-04-23T10:18:02.408 INFO:tasks.workunit.client.0.smithi026.stdout:7/641: sync 2024-04-23T10:18:02.413 INFO:tasks.workunit.client.0.smithi026.stdout:7/642: mknod dd/d1d/d50/cbf 0 2024-04-23T10:18:02.417 INFO:tasks.workunit.client.0.smithi026.stdout:0/916: truncate d7/d8/d1e/d1d/f67 2956099 0 2024-04-23T10:18:02.419 INFO:tasks.workunit.client.0.smithi026.stdout:7/643: fdatasync dd/d1d/d78/fab 0 2024-04-23T10:18:02.425 INFO:tasks.workunit.client.0.smithi026.stdout:0/917: unlink d7/d8/d1e/d1d/d2f/c139 0 2024-04-23T10:18:02.428 INFO:tasks.workunit.client.0.smithi026.stdout:7/644: symlink dd/d3f/d47/d4c/lc0 0 2024-04-23T10:18:02.431 INFO:tasks.workunit.client.0.smithi026.stdout:7/645: rmdir dd/d3f 39 2024-04-23T10:18:02.434 INFO:tasks.workunit.client.0.smithi026.stdout:0/918: getdents d7/d8/d1e/d1d/d2f/d6c 0 2024-04-23T10:18:02.436 INFO:tasks.workunit.client.0.smithi026.stdout:7/646: mkdir dd/dc1 0 2024-04-23T10:18:02.438 INFO:tasks.workunit.client.0.smithi026.stdout:7/647: write dd/d6c/f9c [532804,102373] 0 2024-04-23T10:18:02.438 INFO:tasks.workunit.client.0.smithi026.stdout:0/919: mknod d7/d43/c13f 0 2024-04-23T10:18:02.446 INFO:tasks.workunit.client.0.smithi026.stdout:7/648: symlink dd/d3f/d47/lc2 0 2024-04-23T10:18:02.450 INFO:tasks.workunit.client.0.smithi026.stdout:7/649: read - dd/d2c/d48/d7e/f93 zero size 2024-04-23T10:18:02.456 INFO:tasks.workunit.client.0.smithi026.stdout:7/650: truncate dd/d3f/d47/f83 1651382 0 2024-04-23T10:18:02.457 INFO:tasks.workunit.client.0.smithi026.stdout:0/920: dread d7/d8/d1e/d2a/d6a/d70/fcd [0,4194304] 0 2024-04-23T10:18:02.469 INFO:tasks.workunit.client.0.smithi026.stdout:3/768: write d0/d51/d5e/f68 [325415,112434] 0 2024-04-23T10:18:02.475 INFO:tasks.workunit.client.0.smithi026.stdout:3/769: creat d0/d1e/d23/d87/db3/dee/f106 x:0 0 0 2024-04-23T10:18:02.486 INFO:tasks.workunit.client.0.smithi026.stdout:3/770: link d0/d1e/c9c d0/d1e/d30/d43/df/de3/c107 0 2024-04-23T10:18:02.490 INFO:tasks.workunit.client.0.smithi026.stdout:3/771: symlink d0/d1e/d23/d87/db3/dee/l108 0 2024-04-23T10:18:02.494 INFO:tasks.workunit.client.0.smithi026.stdout:3/772: fsync d0/d1e/d23/d87/db3/dee/f35 0 2024-04-23T10:18:02.502 INFO:tasks.workunit.client.0.smithi026.stdout:0/921: truncate d7/d8/d2d/d60/d62/fbf 680079 0 2024-04-23T10:18:02.507 INFO:tasks.workunit.client.0.smithi026.stdout:0/922: symlink d7/d8/d2d/d60/d62/db9/l140 0 2024-04-23T10:18:02.514 INFO:tasks.workunit.client.0.smithi026.stdout:0/923: creat d7/d8/d2d/d60/d62/db2/db4/f141 x:0 0 0 2024-04-23T10:18:02.518 INFO:tasks.workunit.client.0.smithi026.stdout:3/773: dread d0/d1e/d23/d87/f8d [0,4194304] 0 2024-04-23T10:18:02.522 INFO:tasks.workunit.client.0.smithi026.stdout:0/924: creat d7/d8/d1e/d2a/d6a/d70/f142 x:0 0 0 2024-04-23T10:18:02.536 INFO:tasks.workunit.client.0.smithi026.stdout:7/651: write dd/d3f/d47/f83 [1314731,29882] 0 2024-04-23T10:18:02.541 INFO:tasks.workunit.client.0.smithi026.stdout:7/652: mkdir dd/d3f/d47/d4c/d60/d75/dc3 0 2024-04-23T10:18:02.545 INFO:tasks.workunit.client.0.smithi026.stdout:2/740: sync 2024-04-23T10:18:02.545 INFO:tasks.workunit.client.0.smithi026.stdout:1/664: sync 2024-04-23T10:18:02.546 INFO:tasks.workunit.client.0.smithi026.stdout:5/713: sync 2024-04-23T10:18:02.546 INFO:tasks.workunit.client.0.smithi026.stdout:7/653: rename dd/d2c/d48/f5b to dd/d3f/d47/d4c/d60/d75/fc4 0 2024-04-23T10:18:02.549 INFO:tasks.workunit.client.0.smithi026.stdout:1/665: mknod dd/d48/cf0 0 2024-04-23T10:18:02.553 INFO:tasks.workunit.client.0.smithi026.stdout:7/654: creat dd/d3f/d47/d4c/fc5 x:0 0 0 2024-04-23T10:18:02.555 INFO:tasks.workunit.client.0.smithi026.stdout:1/666: mkdir dd/d48/dac/df1 0 2024-04-23T10:18:02.562 INFO:tasks.workunit.client.0.smithi026.stdout:7/655: rename dd/d44/d38 to dd/d6c/dc6 0 2024-04-23T10:18:02.566 INFO:tasks.workunit.client.0.smithi026.stdout:1/667: creat dd/d1a/d23/d69/d9d/ff2 x:0 0 0 2024-04-23T10:18:02.568 INFO:tasks.workunit.client.0.smithi026.stdout:8/899: dread d5/d50/fba [0,4194304] 0 2024-04-23T10:18:02.569 INFO:tasks.workunit.client.0.smithi026.stdout:3/774: write d0/d4c/feb [2385930,47012] 0 2024-04-23T10:18:02.573 INFO:tasks.workunit.client.0.smithi026.stdout:7/656: unlink dd/d44/c40 0 2024-04-23T10:18:02.578 INFO:tasks.workunit.client.0.smithi026.stdout:3/775: truncate d0/d1e/d30/d43/df/d63/f7b 1228563 0 2024-04-23T10:18:02.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/668: dread dd/d1a/d23/d3f/f5b [0,4194304] 0 2024-04-23T10:18:02.583 INFO:tasks.workunit.client.0.smithi026.stdout:8/900: mkdir d5/d115/d22/d12e 0 2024-04-23T10:18:02.584 INFO:tasks.workunit.client.0.smithi026.stdout:1/669: chown dd/d15/f32 9 1 2024-04-23T10:18:02.587 INFO:tasks.workunit.client.0.smithi026.stdout:3/776: mknod d0/d1e/d30/d77/d100/c109 0 2024-04-23T10:18:02.590 INFO:tasks.workunit.client.0.smithi026.stdout:0/925: dwrite d7/d8/d1e/d2a/d6a/d70/f8e [0,4194304] 0 2024-04-23T10:18:02.590 INFO:tasks.workunit.client.0.smithi026.stdout:7/657: creat dd/d44/fc7 x:0 0 0 2024-04-23T10:18:02.592 INFO:tasks.workunit.client.0.smithi026.stdout:1/670: read dd/f3b [3568295,93533] 0 2024-04-23T10:18:02.593 INFO:tasks.workunit.client.0.smithi026.stdout:3/777: chown d0/d1e/d30/d43/d6c/d79/d73/cc3 0 1 2024-04-23T10:18:02.593 INFO:tasks.workunit.client.0.smithi026.stdout:7/658: stat dd/d1d/d50/d58/l66 0 2024-04-23T10:18:02.595 INFO:tasks.workunit.client.0.smithi026.stdout:7/659: stat dd/d3f/d47/c6e 0 2024-04-23T10:18:02.595 INFO:tasks.workunit.client.0.smithi026.stdout:0/926: creat d7/d43/f143 x:0 0 0 2024-04-23T10:18:02.597 INFO:tasks.workunit.client.0.smithi026.stdout:7/660: chown dd/d44/f5e 4814863 1 2024-04-23T10:18:02.598 INFO:tasks.workunit.client.0.smithi026.stdout:7/661: chown dd/d46/c61 1 1 2024-04-23T10:18:02.600 INFO:tasks.workunit.client.0.smithi026.stdout:5/714: write d0/d3c/f3d [2261668,63147] 0 2024-04-23T10:18:02.603 INFO:tasks.workunit.client.0.smithi026.stdout:7/662: chown dd/l12 89266 1 2024-04-23T10:18:02.605 INFO:tasks.workunit.client.0.smithi026.stdout:0/927: fsync d7/d8/d1e/d1d/f67 0 2024-04-23T10:18:02.610 INFO:tasks.workunit.client.0.smithi026.stdout:1/671: dwrite dd/d1a/d20/d25/f71 [0,4194304] 0 2024-04-23T10:18:02.610 INFO:tasks.workunit.client.0.smithi026.stdout:5/715: mknod d0/d6f/cf0 0 2024-04-23T10:18:02.611 INFO:tasks.workunit.client.0.smithi026.stdout:7/663: symlink dd/d2c/d48/d7e/lc8 0 2024-04-23T10:18:02.611 INFO:tasks.workunit.client.0.smithi026.stdout:3/778: dwrite d0/d1e/d30/d43/d82/fcf [0,4194304] 0 2024-04-23T10:18:02.623 INFO:tasks.workunit.client.0.smithi026.stdout:3/779: dread d0/d1e/d30/fd7 [0,4194304] 0 2024-04-23T10:18:02.623 INFO:tasks.workunit.client.0.smithi026.stdout:1/672: dwrite dd/d1a/d23/d69/fce [0,4194304] 0 2024-04-23T10:18:02.623 INFO:tasks.workunit.client.0.smithi026.stdout:7/664: creat dd/d1d/d78/db9/fc9 x:0 0 0 2024-04-23T10:18:02.624 INFO:tasks.workunit.client.0.smithi026.stdout:5/716: rename d0/d3c/d5d/db2/dca/fed to d0/d3c/d57/ff1 0 2024-04-23T10:18:02.629 INFO:tasks.workunit.client.0.smithi026.stdout:0/928: creat d7/f144 x:0 0 0 2024-04-23T10:18:02.634 INFO:tasks.workunit.client.0.smithi026.stdout:0/929: fsync d7/d5b/fc7 0 2024-04-23T10:18:02.636 INFO:tasks.workunit.client.0.smithi026.stdout:3/780: dwrite d0/d1e/d23/d52/f61 [0,4194304] 0 2024-04-23T10:18:02.638 INFO:tasks.workunit.client.0.smithi026.stdout:5/717: dwrite d0/d3c/d84/d89/d8d/fb7 [0,4194304] 0 2024-04-23T10:18:02.638 INFO:tasks.workunit.client.0.smithi026.stdout:3/781: fsync d0/d1e/fc7 0 2024-04-23T10:18:02.640 INFO:tasks.workunit.client.0.smithi026.stdout:3/782: fsync d0/d51/d5e/da4/fe8 0 2024-04-23T10:18:02.641 INFO:tasks.workunit.client.0.smithi026.stdout:5/718: read - d0/d6f/fe0 zero size 2024-04-23T10:18:02.643 INFO:tasks.workunit.client.0.smithi026.stdout:3/783: chown d0/d1e/d30/d43/df/dcb/c7c 44 1 2024-04-23T10:18:02.644 INFO:tasks.workunit.client.0.smithi026.stdout:1/673: mkdir dd/d1a/d20/d25/df3 0 2024-04-23T10:18:02.649 INFO:tasks.workunit.client.0.smithi026.stdout:7/665: link dd/d3f/d47/d4c/lc0 dd/d3f/d47/d4c/d60/d75/lca 0 2024-04-23T10:18:02.651 INFO:tasks.workunit.client.0.smithi026.stdout:6/903: sync 2024-04-23T10:18:02.651 INFO:tasks.workunit.client.0.smithi026.stdout:4/797: sync 2024-04-23T10:18:02.651 INFO:tasks.workunit.client.0.smithi026.stdout:9/906: sync 2024-04-23T10:18:02.653 INFO:tasks.workunit.client.0.smithi026.stdout:0/930: creat d7/d8/d2d/d60/d62/da2/d106/f145 x:0 0 0 2024-04-23T10:18:02.655 INFO:tasks.workunit.client.0.smithi026.stdout:4/798: chown d4/d22/l24 13821 1 2024-04-23T10:18:02.655 INFO:tasks.workunit.client.0.smithi026.stdout:5/719: creat d0/d68/dea/ff2 x:0 0 0 2024-04-23T10:18:02.656 INFO:tasks.workunit.client.0.smithi026.stdout:9/907: write d13/d3b/fee [690226,54920] 0 2024-04-23T10:18:02.657 INFO:tasks.workunit.client.0.smithi026.stdout:6/904: dread - d6/d21/d2f/f110 zero size 2024-04-23T10:18:02.660 INFO:tasks.workunit.client.0.smithi026.stdout:8/901: dwrite d5/d56/d47/f8e [4194304,4194304] 0 2024-04-23T10:18:02.662 INFO:tasks.workunit.client.0.smithi026.stdout:8/902: write d5/d115/d64/fe7 [3005,56108] 0 2024-04-23T10:18:02.663 INFO:tasks.workunit.client.0.smithi026.stdout:1/674: unlink dd/d1a/d20/d25/d35/d74/d93/fef 0 2024-04-23T10:18:02.663 INFO:tasks.workunit.client.0.smithi026.stdout:7/666: unlink dd/d3f/d47/d4c/d60/cac 0 2024-04-23T10:18:02.664 INFO:tasks.workunit.client.0.smithi026.stdout:4/799: mknod d4/d5b/da7/dba/c108 0 2024-04-23T10:18:02.668 INFO:tasks.workunit.client.0.smithi026.stdout:6/905: creat d6/d21/d2f/d31/d52/d82/f113 x:0 0 0 2024-04-23T10:18:02.670 INFO:tasks.workunit.client.0.smithi026.stdout:5/720: unlink d0/d3c/d5d/db2/le4 0 2024-04-23T10:18:02.671 INFO:tasks.workunit.client.0.smithi026.stdout:4/800: chown d4/d7/f8 681226044 1 2024-04-23T10:18:02.673 INFO:tasks.workunit.client.0.smithi026.stdout:7/667: mknod dd/d3f/d47/d4c/d60/ccb 0 2024-04-23T10:18:02.674 INFO:tasks.workunit.client.0.smithi026.stdout:6/906: rmdir d6/d21/d58/d8d/d64 39 2024-04-23T10:18:02.677 INFO:tasks.workunit.client.0.smithi026.stdout:1/675: write dd/d1a/d20/d25/d35/d74/fb4 [418585,58949] 0 2024-04-23T10:18:02.677 INFO:tasks.workunit.client.0.smithi026.stdout:5/721: creat d0/d3c/d57/ff3 x:0 0 0 2024-04-23T10:18:02.677 INFO:tasks.workunit.client.0.smithi026.stdout:0/931: dwrite d7/d8/d1e/d1d/d2f/d6c/d7f/f113 [0,4194304] 0 2024-04-23T10:18:02.679 INFO:tasks.workunit.client.0.smithi026.stdout:3/784: dread d0/d1e/d23/d87/db3/dee/f34 [0,4194304] 0 2024-04-23T10:18:02.682 INFO:tasks.workunit.client.0.smithi026.stdout:7/668: fdatasync dd/d44/f5e 0 2024-04-23T10:18:02.685 INFO:tasks.workunit.client.0.smithi026.stdout:6/907: chown d6/d21/d2f/d32/d53/dca/ce4 95590075 1 2024-04-23T10:18:02.686 INFO:tasks.workunit.client.0.smithi026.stdout:0/932: dread - d7/d8/d1e/d57/da9/fc5 zero size 2024-04-23T10:18:02.688 INFO:tasks.workunit.client.0.smithi026.stdout:8/903: dwrite d5/d115/d22/d65/d78/d3e/fc6 [0,4194304] 0 2024-04-23T10:18:02.689 INFO:tasks.workunit.client.0.smithi026.stdout:1/676: chown dd/d1a/d23/d69/c6d 183499 1 2024-04-23T10:18:02.691 INFO:tasks.workunit.client.0.smithi026.stdout:5/722: creat d0/d3c/d5d/dbc/ff4 x:0 0 0 2024-04-23T10:18:02.692 INFO:tasks.workunit.client.0.smithi026.stdout:3/785: creat d0/d1e/d30/d43/d82/f10a x:0 0 0 2024-04-23T10:18:02.695 INFO:tasks.workunit.client.0.smithi026.stdout:0/933: creat d7/dc2/dcc/f146 x:0 0 0 2024-04-23T10:18:02.695 INFO:tasks.workunit.client.0.smithi026.stdout:3/786: stat d0/d1e/d30/d43/df/d72/d8c/cb0 0 2024-04-23T10:18:02.699 INFO:tasks.workunit.client.0.smithi026.stdout:5/723: rename d0/d6f to d0/d3c/d5d/db2/dc6/df5 0 2024-04-23T10:18:02.699 INFO:tasks.workunit.client.0.smithi026.stdout:0/934: dread d7/d8/d1e/d2a/d6a/d70/fcd [0,4194304] 0 2024-04-23T10:18:02.701 INFO:tasks.workunit.client.0.smithi026.stdout:8/904: creat d5/d56/de8/f12f x:0 0 0 2024-04-23T10:18:02.702 INFO:tasks.workunit.client.0.smithi026.stdout:8/905: chown d5/d56/d15/l49 240744954 1 2024-04-23T10:18:02.702 INFO:tasks.workunit.client.0.smithi026.stdout:1/677: link dd/d15/f4f dd/d1a/ff4 0 2024-04-23T10:18:02.705 INFO:tasks.workunit.client.0.smithi026.stdout:5/724: readlink d0/l1 0 2024-04-23T10:18:02.705 INFO:tasks.workunit.client.0.smithi026.stdout:6/908: read d6/d21/d58/d8d/f84 [944148,99499] 0 2024-04-23T10:18:02.706 INFO:tasks.workunit.client.0.smithi026.stdout:4/801: truncate d4/d1b/fcf 2156342 0 2024-04-23T10:18:02.708 INFO:tasks.workunit.client.0.smithi026.stdout:4/802: write d4/d22/d4e/d57/fb2 [2510871,73031] 0 2024-04-23T10:18:02.708 INFO:tasks.workunit.client.0.smithi026.stdout:3/787: link d0/d1e/d30/d43/d82/fab d0/d1e/d23/d87/df8/f10b 0 2024-04-23T10:18:02.709 INFO:tasks.workunit.client.0.smithi026.stdout:0/935: creat d7/d8/d2d/d60/d62/db2/d126/f147 x:0 0 0 2024-04-23T10:18:02.710 INFO:tasks.workunit.client.0.smithi026.stdout:0/936: chown d7/f84 5 1 2024-04-23T10:18:02.710 INFO:tasks.workunit.client.0.smithi026.stdout:5/725: mkdir d0/d3c/d5d/db2/dc6/df5/df6 0 2024-04-23T10:18:02.711 INFO:tasks.workunit.client.0.smithi026.stdout:4/803: fdatasync d4/d14/f1c 0 2024-04-23T10:18:02.714 INFO:tasks.workunit.client.0.smithi026.stdout:1/678: creat dd/d1a/d20/d25/ff5 x:0 0 0 2024-04-23T10:18:02.716 INFO:tasks.workunit.client.0.smithi026.stdout:8/906: getdents d5 0 2024-04-23T10:18:02.716 INFO:tasks.workunit.client.0.smithi026.stdout:5/726: truncate d0/d3c/d5d/f19 3891976 0 2024-04-23T10:18:02.717 INFO:tasks.workunit.client.0.smithi026.stdout:1/679: readlink dd/d48/dab/ld3 0 2024-04-23T10:18:02.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/804: mkdir d4/d5b/d7b/d4d/dc7/d109 0 2024-04-23T10:18:02.720 INFO:tasks.workunit.client.0.smithi026.stdout:1/680: write dd/d15/f81 [141591,4710] 0 2024-04-23T10:18:02.721 INFO:tasks.workunit.client.0.smithi026.stdout:8/907: write d5/d56/d33/d113/f126 [614439,59665] 0 2024-04-23T10:18:02.722 INFO:tasks.workunit.client.0.smithi026.stdout:5/727: fdatasync d0/d3c/d5d/f19 0 2024-04-23T10:18:02.724 INFO:tasks.workunit.client.0.smithi026.stdout:7/669: truncate dd/d6c/f9c 285728 0 2024-04-23T10:18:02.725 INFO:tasks.workunit.client.0.smithi026.stdout:3/788: dwrite d0/d1e/d23/d87/db6/ff0 [0,4194304] 0 2024-04-23T10:18:02.727 INFO:tasks.workunit.client.0.smithi026.stdout:8/908: mknod d5/c130 0 2024-04-23T10:18:02.733 INFO:tasks.workunit.client.0.smithi026.stdout:0/937: dwrite d7/d8/d1e/d1d/d2f/dd1/dd6/fdf [0,4194304] 0 2024-04-23T10:18:02.734 INFO:tasks.workunit.client.0.smithi026.stdout:8/909: fdatasync d5/d50/fbf 0 2024-04-23T10:18:02.736 INFO:tasks.workunit.client.0.smithi026.stdout:7/670: chown dd/d44/f26 714697 1 2024-04-23T10:18:02.738 INFO:tasks.workunit.client.0.smithi026.stdout:3/789: rename d0/d1e/d30/d43/d6c/d79/d64 to d0/d1e/d30/d43/db4/d10c 0 2024-04-23T10:18:02.743 INFO:tasks.workunit.client.0.smithi026.stdout:5/728: dwrite d0/f54 [0,4194304] 0 2024-04-23T10:18:02.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/805: dread d4/d1b/dbf/dda/fa1 [4194304,4194304] 0 2024-04-23T10:18:02.747 INFO:tasks.workunit.client.0.smithi026.stdout:1/681: write dd/d15/d7d/d98/fa0 [43407,3284] 0 2024-04-23T10:18:02.747 INFO:tasks.workunit.client.0.smithi026.stdout:0/938: chown d7/d8/d1e/d1d/d2f/d6c/le5 16 1 2024-04-23T10:18:02.749 INFO:tasks.workunit.client.0.smithi026.stdout:7/671: creat dd/d3f/d47/d4c/fcc x:0 0 0 2024-04-23T10:18:02.751 INFO:tasks.workunit.client.0.smithi026.stdout:6/909: dwrite d6/d21/d58/d8d/d64/f95 [0,4194304] 0 2024-04-23T10:18:02.752 INFO:tasks.workunit.client.0.smithi026.stdout:8/910: rename d5/f84 to d5/d115/d22/d65/f131 0 2024-04-23T10:18:02.754 INFO:tasks.workunit.client.0.smithi026.stdout:5/729: creat d0/d68/d91/d9a/ff7 x:0 0 0 2024-04-23T10:18:02.755 INFO:tasks.workunit.client.0.smithi026.stdout:8/911: write d5/d50/d9a/fda [4852884,100197] 0 2024-04-23T10:18:02.756 INFO:tasks.workunit.client.0.smithi026.stdout:1/682: mkdir dd/d15/d7d/df6 0 2024-04-23T10:18:02.760 INFO:tasks.workunit.client.0.smithi026.stdout:3/790: creat d0/d1e/d30/d77/d100/f10d x:0 0 0 2024-04-23T10:18:02.765 INFO:tasks.workunit.client.0.smithi026.stdout:4/806: unlink d4/d5b/d7b/d4d/dc7/ff1 0 2024-04-23T10:18:02.765 INFO:tasks.workunit.client.0.smithi026.stdout:4/807: stat d4/d22/d4e/d57/faf 0 2024-04-23T10:18:02.766 INFO:tasks.workunit.client.0.smithi026.stdout:4/808: chown d4/d5b/da7 821 1 2024-04-23T10:18:02.766 INFO:tasks.workunit.client.0.smithi026.stdout:6/910: creat d6/d21/d58/f114 x:0 0 0 2024-04-23T10:18:02.770 INFO:tasks.workunit.client.0.smithi026.stdout:4/809: chown d4/d22/faa 18331 1 2024-04-23T10:18:02.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/912: write d5/d115/d22/d65/d78/f7d [556581,59107] 0 2024-04-23T10:18:02.773 INFO:tasks.workunit.client.0.smithi026.stdout:8/913: stat d5/d115/d22/d65/d78/d3e/l4c 0 2024-04-23T10:18:02.774 INFO:tasks.workunit.client.0.smithi026.stdout:0/939: dread d7/d8/d2d/f4e [0,4194304] 0 2024-04-23T10:18:02.775 INFO:tasks.workunit.client.0.smithi026.stdout:6/911: creat d6/d21/d2f/d32/d53/f115 x:0 0 0 2024-04-23T10:18:02.777 INFO:tasks.workunit.client.0.smithi026.stdout:6/912: write d6/d21/d2f/d37/ff2 [371498,10428] 0 2024-04-23T10:18:02.779 INFO:tasks.workunit.client.0.smithi026.stdout:4/810: creat d4/d1b/dbf/dda/d6c/d6f/d80/f10a x:0 0 0 2024-04-23T10:18:02.780 INFO:tasks.workunit.client.0.smithi026.stdout:7/672: write dd/d1d/d50/f87 [351837,88023] 0 2024-04-23T10:18:02.781 INFO:tasks.workunit.client.0.smithi026.stdout:5/730: link d0/d3c/d57/f7d d0/d3c/d5d/db2/dbd/ff8 0 2024-04-23T10:18:02.786 INFO:tasks.workunit.client.0.smithi026.stdout:4/811: mkdir d4/d5b/d10b 0 2024-04-23T10:18:02.786 INFO:tasks.workunit.client.0.smithi026.stdout:1/683: write dd/d1a/d20/d25/f91 [177326,44759] 0 2024-04-23T10:18:02.791 INFO:tasks.workunit.client.0.smithi026.stdout:5/731: dwrite d0/d3c/f3d [0,4194304] 0 2024-04-23T10:18:02.791 INFO:tasks.workunit.client.0.smithi026.stdout:8/914: getdents d5/d115/d22/d65 0 2024-04-23T10:18:02.794 INFO:tasks.workunit.client.0.smithi026.stdout:3/791: truncate d0/d1e/d30/d43/d6c/d79/fe1 9276511 0 2024-04-23T10:18:02.794 INFO:tasks.workunit.client.0.smithi026.stdout:6/913: getdents d6/d21/d58/d8d/d64 0 2024-04-23T10:18:02.797 INFO:tasks.workunit.client.0.smithi026.stdout:5/732: symlink d0/d3c/d5d/dbc/lf9 0 2024-04-23T10:18:02.799 INFO:tasks.workunit.client.0.smithi026.stdout:6/914: creat d6/d13/dcf/f116 x:0 0 0 2024-04-23T10:18:02.803 INFO:tasks.workunit.client.0.smithi026.stdout:8/915: rename d5/d56/d15/d76/l81 to d5/d56/d33/d113/l132 0 2024-04-23T10:18:02.805 INFO:tasks.workunit.client.0.smithi026.stdout:6/915: creat d6/d13/dcf/f117 x:0 0 0 2024-04-23T10:18:02.805 INFO:tasks.workunit.client.0.smithi026.stdout:1/684: link dd/d15/d7d/d98/ld1 dd/d48/dab/lf7 0 2024-04-23T10:18:02.807 INFO:tasks.workunit.client.0.smithi026.stdout:0/940: write d7/d8/d2d/d60/d62/db2/db4/de2/f105 [113206,78908] 0 2024-04-23T10:18:02.807 INFO:tasks.workunit.client.0.smithi026.stdout:5/733: fsync d0/f3 0 2024-04-23T10:18:02.808 INFO:tasks.workunit.client.0.smithi026.stdout:0/941: read - d7/d8/d1e/d2a/d6a/d70/f142 zero size 2024-04-23T10:18:02.810 INFO:tasks.workunit.client.0.smithi026.stdout:6/916: creat d6/d13/dcf/f118 x:0 0 0 2024-04-23T10:18:02.811 INFO:tasks.workunit.client.0.smithi026.stdout:2/741: sync 2024-04-23T10:18:02.812 INFO:tasks.workunit.client.0.smithi026.stdout:1/685: mkdir dd/d1a/d6a/df8 0 2024-04-23T10:18:02.813 INFO:tasks.workunit.client.0.smithi026.stdout:0/942: unlink d7/f144 0 2024-04-23T10:18:02.814 INFO:tasks.workunit.client.0.smithi026.stdout:2/742: fdatasync d3/d19/d21/d23/f33 0 2024-04-23T10:18:02.817 INFO:tasks.workunit.client.0.smithi026.stdout:1/686: dread dd/d1a/d6a/d7c/f8a [0,4194304] 0 2024-04-23T10:18:02.820 INFO:tasks.workunit.client.0.smithi026.stdout:0/943: mkdir d7/dc2/dcc/d148 0 2024-04-23T10:18:02.821 INFO:tasks.workunit.client.0.smithi026.stdout:6/917: dread d6/d21/d58/d8d/f84 [0,4194304] 0 2024-04-23T10:18:02.822 INFO:tasks.workunit.client.0.smithi026.stdout:1/687: chown dd/d1a/d20/d25/d35/d43/d7b/ld0 10335460 1 2024-04-23T10:18:02.827 INFO:tasks.workunit.client.0.smithi026.stdout:0/944: symlink d7/d8/d1e/l149 0 2024-04-23T10:18:02.831 INFO:tasks.workunit.client.0.smithi026.stdout:7/673: dwrite dd/d44/f74 [0,4194304] 0 2024-04-23T10:18:02.841 INFO:tasks.workunit.client.0.smithi026.stdout:3/792: write d0/d1e/d30/d43/df/dcb/d97/fd9 [792518,2336] 0 2024-04-23T10:18:02.842 INFO:tasks.workunit.client.0.smithi026.stdout:3/793: chown d0/d1e/d30/d43/df/de3 159668990 1 2024-04-23T10:18:02.847 INFO:tasks.workunit.client.0.smithi026.stdout:6/918: dread d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:18:02.850 INFO:tasks.workunit.client.0.smithi026.stdout:7/674: truncate dd/d1d/d50/d58/fad 827841 0 2024-04-23T10:18:02.850 INFO:tasks.workunit.client.0.smithi026.stdout:7/675: stat dd/d44/f3b 0 2024-04-23T10:18:02.881 INFO:tasks.workunit.client.0.smithi026.stdout:2/743: dwrite d3/d19/d21/d23/d3a/f69 [0,4194304] 0 2024-04-23T10:18:02.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/676: dread - dd/d2c/d48/f85 zero size 2024-04-23T10:18:02.883 INFO:tasks.workunit.client.0.smithi026.stdout:7/677: dread - dd/d1d/d78/db9/fc9 zero size 2024-04-23T10:18:02.886 INFO:tasks.workunit.client.0.smithi026.stdout:4/812: dread d4/d7/f13 [4194304,4194304] 0 2024-04-23T10:18:02.886 INFO:tasks.workunit.client.0.smithi026.stdout:2/744: truncate d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fcd 947463 0 2024-04-23T10:18:02.891 INFO:tasks.workunit.client.0.smithi026.stdout:6/919: mknod d6/c119 0 2024-04-23T10:18:02.893 INFO:tasks.workunit.client.0.smithi026.stdout:7/678: read dd/d1d/d50/f55 [3388154,70856] 0 2024-04-23T10:18:02.894 INFO:tasks.workunit.client.0.smithi026.stdout:3/794: dread d0/fc [0,4194304] 0 2024-04-23T10:18:02.896 INFO:tasks.workunit.client.0.smithi026.stdout:7/679: truncate dd/d1d/d7d/fb5 479174 0 2024-04-23T10:18:02.901 INFO:tasks.workunit.client.0.smithi026.stdout:3/795: symlink d0/d1e/d30/d77/d100/l10e 0 2024-04-23T10:18:02.902 INFO:tasks.workunit.client.0.smithi026.stdout:4/813: write d4/d5b/f60 [2051943,80302] 0 2024-04-23T10:18:02.909 INFO:tasks.workunit.client.0.smithi026.stdout:0/945: dwrite d7/d8/d2d/d60/f12b [0,4194304] 0 2024-04-23T10:18:02.911 INFO:tasks.workunit.client.0.smithi026.stdout:6/920: dwrite d6/d21/fd4 [0,4194304] 0 2024-04-23T10:18:02.911 INFO:tasks.workunit.client.0.smithi026.stdout:7/680: symlink dd/d2c/lcd 0 2024-04-23T10:18:02.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/796: creat d0/d1e/d23/d87/db3/dee/d39/d93/f10f x:0 0 0 2024-04-23T10:18:02.916 INFO:tasks.workunit.client.0.smithi026.stdout:2/745: dread d3/f22 [0,4194304] 0 2024-04-23T10:18:02.916 INFO:tasks.workunit.client.0.smithi026.stdout:4/814: rename d4/d5b/d7b/d4d/df3/d74 to d4/d14/d30/da2/d10c 0 2024-04-23T10:18:02.917 INFO:tasks.workunit.client.0.smithi026.stdout:4/815: stat d4/d5b/d7b/d4d 0 2024-04-23T10:18:02.920 INFO:tasks.workunit.client.0.smithi026.stdout:7/681: mknod dd/d1d/d78/cce 0 2024-04-23T10:18:02.921 INFO:tasks.workunit.client.0.smithi026.stdout:4/816: fdatasync d4/d22/faa 0 2024-04-23T10:18:02.921 INFO:tasks.workunit.client.0.smithi026.stdout:6/921: readlink d6/d21/d2f/d37/d9a/l9f 0 2024-04-23T10:18:02.927 INFO:tasks.workunit.client.0.smithi026.stdout:2/746: dwrite d3/d19/d21/d23/fc4 [0,4194304] 0 2024-04-23T10:18:02.927 INFO:tasks.workunit.client.0.smithi026.stdout:7/682: read dd/d6c/dc6/fba [2995352,95508] 0 2024-04-23T10:18:02.929 INFO:tasks.workunit.client.0.smithi026.stdout:6/922: unlink d6/d21/d2f/d32/f55 0 2024-04-23T10:18:02.930 INFO:tasks.workunit.client.0.smithi026.stdout:6/923: write d6/f1d [3951405,130655] 0 2024-04-23T10:18:02.931 INFO:tasks.workunit.client.0.smithi026.stdout:4/817: rename d4/d42/lbb to d4/d5b/da7/dba/l10d 0 2024-04-23T10:18:02.932 INFO:tasks.workunit.client.0.smithi026.stdout:3/797: creat d0/d1e/d23/d87/db3/dee/d39/f110 x:0 0 0 2024-04-23T10:18:02.933 INFO:tasks.workunit.client.0.smithi026.stdout:3/798: dread - d0/d1e/d23/d87/fc4 zero size 2024-04-23T10:18:02.934 INFO:tasks.workunit.client.0.smithi026.stdout:7/683: creat dd/d46/fcf x:0 0 0 2024-04-23T10:18:02.935 INFO:tasks.workunit.client.0.smithi026.stdout:4/818: chown d4/d1b/dbf/dda/f56 248780152 1 2024-04-23T10:18:02.936 INFO:tasks.workunit.client.0.smithi026.stdout:6/924: unlink d6/d21/d2f/d31/d52/d82/l93 0 2024-04-23T10:18:02.937 INFO:tasks.workunit.client.0.smithi026.stdout:4/819: chown d4/d14/d30/fb8 973 1 2024-04-23T10:18:02.937 INFO:tasks.workunit.client.0.smithi026.stdout:6/925: chown d6/lfc 190447 1 2024-04-23T10:18:02.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/926: truncate d6/d21/d2f/d32/d87/fe9 225361 0 2024-04-23T10:18:02.946 INFO:tasks.workunit.client.0.smithi026.stdout:7/684: mkdir dd/d6c/d72/dd0 0 2024-04-23T10:18:02.948 INFO:tasks.workunit.client.0.smithi026.stdout:4/820: dwrite d4/d5b/d7b/d86/fb7 [0,4194304] 0 2024-04-23T10:18:02.950 INFO:tasks.workunit.client.0.smithi026.stdout:2/747: truncate d3/d19/f55 6903119 0 2024-04-23T10:18:02.953 INFO:tasks.workunit.client.0.smithi026.stdout:6/927: dwrite d6/d21/d2f/d37/d9a/db1/ff8 [0,4194304] 0 2024-04-23T10:18:02.956 INFO:tasks.workunit.client.0.smithi026.stdout:2/748: read d3/d19/d31/f9d [826769,26768] 0 2024-04-23T10:18:02.958 INFO:tasks.workunit.client.0.smithi026.stdout:6/928: truncate d6/d21/d2f/d37/d68/fc5 696251 0 2024-04-23T10:18:02.960 INFO:tasks.workunit.client.0.smithi026.stdout:2/749: readlink d3/d19/d21/d23/da2/ldc 0 2024-04-23T10:18:02.962 INFO:tasks.workunit.client.0.smithi026.stdout:3/799: dwrite d0/d1e/d30/d43/d6c/d79/d73/faa [0,4194304] 0 2024-04-23T10:18:02.963 INFO:tasks.workunit.client.0.smithi026.stdout:6/929: mknod d6/dd3/c11a 0 2024-04-23T10:18:02.964 INFO:tasks.workunit.client.0.smithi026.stdout:2/750: fdatasync d3/d19/d21/d23/d3a/d3c/f47 0 2024-04-23T10:18:02.969 INFO:tasks.workunit.client.0.smithi026.stdout:7/685: rmdir dd/d3f/d47/d4c/d60/d75/dc3 0 2024-04-23T10:18:02.970 INFO:tasks.workunit.client.0.smithi026.stdout:4/821: dread d4/d7/f8 [4194304,4194304] 0 2024-04-23T10:18:02.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/751: rmdir d3 39 2024-04-23T10:18:02.977 INFO:tasks.workunit.client.0.smithi026.stdout:6/930: readlink d6/d21/d58/lec 0 2024-04-23T10:18:02.985 INFO:tasks.workunit.client.0.smithi026.stdout:4/822: mkdir d4/d22/d4e/d57/d10e 0 2024-04-23T10:18:02.986 INFO:tasks.workunit.client.0.smithi026.stdout:3/800: dread d0/d1e/d30/d43/df/dcb/d97/fd9 [0,4194304] 0 2024-04-23T10:18:02.987 INFO:tasks.workunit.client.0.smithi026.stdout:3/801: readlink d0/d1e/d30/d43/df/ld1 0 2024-04-23T10:18:02.988 INFO:tasks.workunit.client.0.smithi026.stdout:6/931: creat d6/d33/d10e/f11b x:0 0 0 2024-04-23T10:18:02.989 INFO:tasks.workunit.client.0.smithi026.stdout:7/686: write dd/d2c/d48/f85 [1008470,131022] 0 2024-04-23T10:18:02.991 INFO:tasks.workunit.client.0.smithi026.stdout:4/823: rename d4/d5b/d7b/d86/f8f to d4/d5b/d7b/d86/f10f 0 2024-04-23T10:18:02.994 INFO:tasks.workunit.client.0.smithi026.stdout:2/752: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 x:0 0 0 2024-04-23T10:18:02.995 INFO:tasks.workunit.client.0.smithi026.stdout:6/932: creat d6/d21/d58/f11c x:0 0 0 2024-04-23T10:18:02.997 INFO:tasks.workunit.client.0.smithi026.stdout:9/908: sync 2024-04-23T10:18:02.998 INFO:tasks.workunit.client.0.smithi026.stdout:7/687: dwrite dd/d46/f77 [0,4194304] 0 2024-04-23T10:18:03.000 INFO:tasks.workunit.client.0.smithi026.stdout:7/688: chown dd/d1d/d50/f87 52032 1 2024-04-23T10:18:03.000 INFO:tasks.workunit.client.0.smithi026.stdout:2/753: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/f105 x:0 0 0 2024-04-23T10:18:03.001 INFO:tasks.workunit.client.0.smithi026.stdout:3/802: link d0/d1e/d30/d43/d6c/lbc d0/d51/l111 0 2024-04-23T10:18:03.002 INFO:tasks.workunit.client.0.smithi026.stdout:4/824: creat d4/d5b/df4/f110 x:0 0 0 2024-04-23T10:18:03.005 INFO:tasks.workunit.client.0.smithi026.stdout:9/909: unlink d13/d3b/fee 0 2024-04-23T10:18:03.009 INFO:tasks.workunit.client.0.smithi026.stdout:6/933: rename d6/d21/d2f/d31/ca2 to d6/d21/d2f/d31/d52/d82/c11d 0 2024-04-23T10:18:03.010 INFO:tasks.workunit.client.0.smithi026.stdout:3/803: creat d0/d1e/d30/d43/d6c/d79/d73/d99/f112 x:0 0 0 2024-04-23T10:18:03.014 INFO:tasks.workunit.client.0.smithi026.stdout:7/689: creat dd/dbc/fd1 x:0 0 0 2024-04-23T10:18:03.014 INFO:tasks.workunit.client.0.smithi026.stdout:2/754: mkdir d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d106 0 2024-04-23T10:18:03.014 INFO:tasks.workunit.client.0.smithi026.stdout:4/825: dwrite d4/f5 [0,4194304] 0 2024-04-23T10:18:03.015 INFO:tasks.workunit.client.0.smithi026.stdout:3/804: readlink d0/d51/l111 0 2024-04-23T10:18:03.018 INFO:tasks.workunit.client.0.smithi026.stdout:4/826: write d4/d14/fd6 [345475,100275] 0 2024-04-23T10:18:03.019 INFO:tasks.workunit.client.0.smithi026.stdout:6/934: mkdir d6/d13/d15/d11e 0 2024-04-23T10:18:03.019 INFO:tasks.workunit.client.0.smithi026.stdout:2/755: stat d3/d19/d21/d23/d3a/d3c/d5d/da0/cba 0 2024-04-23T10:18:03.020 INFO:tasks.workunit.client.0.smithi026.stdout:9/910: dwrite d13/d1b/d26/f30 [0,4194304] 0 2024-04-23T10:18:03.024 INFO:tasks.workunit.client.0.smithi026.stdout:3/805: fsync d0/d1e/d23/d87/db3/dee/f35 0 2024-04-23T10:18:03.027 INFO:tasks.workunit.client.0.smithi026.stdout:3/806: truncate d0/d1e/d30/d43/d82/f10a 252994 0 2024-04-23T10:18:03.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/690: dwrite dd/d1d/d50/f62 [0,4194304] 0 2024-04-23T10:18:03.031 INFO:tasks.workunit.client.0.smithi026.stdout:9/911: rmdir d13/d31 39 2024-04-23T10:18:03.036 INFO:tasks.workunit.client.0.smithi026.stdout:0/946: dread d7/d8/d1e/f51 [0,4194304] 0 2024-04-23T10:18:03.037 INFO:tasks.workunit.client.0.smithi026.stdout:9/912: stat d13/d36/d66/d72/df0 0 2024-04-23T10:18:03.040 INFO:tasks.workunit.client.0.smithi026.stdout:4/827: link d4/d22/faa d4/d5b/d7b/d36/d38/d83/f111 0 2024-04-23T10:18:03.040 INFO:tasks.workunit.client.0.smithi026.stdout:0/947: dread d7/d8/d2d/f4e [0,4194304] 0 2024-04-23T10:18:03.041 INFO:tasks.workunit.client.0.smithi026.stdout:9/913: creat d13/d3e/dd7/f118 x:0 0 0 2024-04-23T10:18:03.043 INFO:tasks.workunit.client.0.smithi026.stdout:2/756: getdents d3/d19/d21/d23/d3a/d3c/d80/da7 0 2024-04-23T10:18:03.043 INFO:tasks.workunit.client.0.smithi026.stdout:3/807: write d0/d1e/d30/d43/df/dcb/f94 [1016480,1947] 0 2024-04-23T10:18:03.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/691: truncate dd/d2c/d48/d7e/f93 768084 0 2024-04-23T10:18:03.044 INFO:tasks.workunit.client.0.smithi026.stdout:4/828: fsync d4/d14/d3d/f8c 0 2024-04-23T10:18:03.046 INFO:tasks.workunit.client.0.smithi026.stdout:0/948: mknod d7/d8/d2d/d60/d62/db2/dca/c14a 0 2024-04-23T10:18:03.046 INFO:tasks.workunit.client.0.smithi026.stdout:1/688: dread dd/d1a/f55 [0,4194304] 0 2024-04-23T10:18:03.047 INFO:tasks.workunit.client.0.smithi026.stdout:4/829: readlink d4/d5b/d7b/d4d/df3/la9 0 2024-04-23T10:18:03.047 INFO:tasks.workunit.client.0.smithi026.stdout:3/808: creat d0/d4c/f113 x:0 0 0 2024-04-23T10:18:03.049 INFO:tasks.workunit.client.0.smithi026.stdout:2/757: fdatasync d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fcd 0 2024-04-23T10:18:03.050 INFO:tasks.workunit.client.0.smithi026.stdout:9/914: creat d13/d36/d66/f119 x:0 0 0 2024-04-23T10:18:03.050 INFO:tasks.workunit.client.0.smithi026.stdout:7/692: mkdir dd/d1d/d7d/d9f/dd2 0 2024-04-23T10:18:03.050 INFO:tasks.workunit.client.0.smithi026.stdout:1/689: fdatasync dd/d1a/d20/d25/f71 0 2024-04-23T10:18:03.050 INFO:tasks.workunit.client.0.smithi026.stdout:0/949: chown d7/d8/d2d/d60/d62/db2/db4/de2/f105 6362 1 2024-04-23T10:18:03.051 INFO:tasks.workunit.client.0.smithi026.stdout:4/830: write d4/d22/d4e/fd4 [2725618,121818] 0 2024-04-23T10:18:03.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/915: write d13/d3b/d4e/d76/ff4 [623400,14402] 0 2024-04-23T10:18:03.054 INFO:tasks.workunit.client.0.smithi026.stdout:7/693: rmdir dd/d1d/d50/d58 39 2024-04-23T10:18:03.057 INFO:tasks.workunit.client.0.smithi026.stdout:2/758: write d3/d19/d21/d23/d3a/d3c/f6e [112614,115787] 0 2024-04-23T10:18:03.057 INFO:tasks.workunit.client.0.smithi026.stdout:1/690: unlink dd/d1a/d6a/d7c/f80 0 2024-04-23T10:18:03.062 INFO:tasks.workunit.client.0.smithi026.stdout:0/950: mkdir d7/d8/d1e/d57/da9/d14b 0 2024-04-23T10:18:03.064 INFO:tasks.workunit.client.0.smithi026.stdout:6/935: dread d6/d21/d2f/d37/d68/fc5 [0,4194304] 0 2024-04-23T10:18:03.065 INFO:tasks.workunit.client.0.smithi026.stdout:6/936: stat d6/d13/dcf/dd6 0 2024-04-23T10:18:03.073 INFO:tasks.workunit.client.0.smithi026.stdout:3/809: getdents d0/d1e/d30/d43/df 0 2024-04-23T10:18:03.075 INFO:tasks.workunit.client.0.smithi026.stdout:1/691: rmdir dd/d1a/d23/d3f/ded 0 2024-04-23T10:18:03.076 INFO:tasks.workunit.client.0.smithi026.stdout:7/694: getdents dd/d1d/d7d/d9f 0 2024-04-23T10:18:03.077 INFO:tasks.workunit.client.0.smithi026.stdout:6/937: creat d6/d21/d2f/d31/d52/d82/f11f x:0 0 0 2024-04-23T10:18:03.079 INFO:tasks.workunit.client.0.smithi026.stdout:3/810: chown d0/c2f 43978 1 2024-04-23T10:18:03.079 INFO:tasks.workunit.client.0.smithi026.stdout:7/695: read - dd/d3f/fa0 zero size 2024-04-23T10:18:03.080 INFO:tasks.workunit.client.0.smithi026.stdout:2/759: getdents d3/d19/d21/dc6 0 2024-04-23T10:18:03.082 INFO:tasks.workunit.client.0.smithi026.stdout:4/831: dwrite d4/d14/d30/d52/f64 [4194304,4194304] 0 2024-04-23T10:18:03.085 INFO:tasks.workunit.client.0.smithi026.stdout:6/938: rename d6/db8/de6 to d6/d108/d120 0 2024-04-23T10:18:03.085 INFO:tasks.workunit.client.0.smithi026.stdout:9/916: dwrite d13/d19/f4d [0,4194304] 0 2024-04-23T10:18:03.086 INFO:tasks.workunit.client.0.smithi026.stdout:7/696: mknod dd/d46/cd3 0 2024-04-23T10:18:03.086 INFO:tasks.workunit.client.0.smithi026.stdout:4/832: write d4/d14/d30/d52/f64 [2735553,56243] 0 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:9/917: dread - d13/d3e/dd7/f118 zero size 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:7/697: chown dd/d3f/d47/d4c/c6b 3611 1 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:3/811: fsync d0/d1e/d30/d43/df/dcb/fd8 0 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:7/698: chown dd/d46/cd3 238 1 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:9/918: mknod d13/d3b/d68/dd6/d45/d3a/d6b/c11a 0 2024-04-23T10:18:03.096 INFO:tasks.workunit.client.0.smithi026.stdout:1/692: getdents dd/d1a/d23 0 2024-04-23T10:18:03.097 INFO:tasks.workunit.client.0.smithi026.stdout:6/939: fsync d6/d21/d58/f78 0 2024-04-23T10:18:03.098 INFO:tasks.workunit.client.0.smithi026.stdout:9/919: write d13/f25 [1533824,70454] 0 2024-04-23T10:18:03.099 INFO:tasks.workunit.client.0.smithi026.stdout:7/699: rename dd/d2c/d48/f85 to dd/d2c/d48/d8d/fd4 0 2024-04-23T10:18:03.101 INFO:tasks.workunit.client.0.smithi026.stdout:7/700: stat dd/d46/fcf 0 2024-04-23T10:18:03.102 INFO:tasks.workunit.client.0.smithi026.stdout:7/701: write dd/d1d/d7d/f98 [429195,85305] 0 2024-04-23T10:18:03.108 INFO:tasks.workunit.client.0.smithi026.stdout:6/940: mkdir d6/d108/d120/d121 0 2024-04-23T10:18:03.111 INFO:tasks.workunit.client.0.smithi026.stdout:4/833: link d4/d14/l3b d4/d5b/d7b/d4d/df8/l112 0 2024-04-23T10:18:03.112 INFO:tasks.workunit.client.0.smithi026.stdout:5/734: sync 2024-04-23T10:18:03.112 INFO:tasks.workunit.client.0.smithi026.stdout:8/916: sync 2024-04-23T10:18:03.118 INFO:tasks.workunit.client.0.smithi026.stdout:5/735: creat d0/d68/dcc/ffa x:0 0 0 2024-04-23T10:18:03.119 INFO:tasks.workunit.client.0.smithi026.stdout:7/702: creat dd/d44/fd5 x:0 0 0 2024-04-23T10:18:03.121 INFO:tasks.workunit.client.0.smithi026.stdout:3/812: write d0/d1e/d30/d43/d6c/d79/fe1 [7899752,87853] 0 2024-04-23T10:18:03.122 INFO:tasks.workunit.client.0.smithi026.stdout:8/917: creat d5/d115/d22/d108/f133 x:0 0 0 2024-04-23T10:18:03.128 INFO:tasks.workunit.client.0.smithi026.stdout:3/813: creat d0/d1e/d30/d43/d6c/d79/d73/d99/f114 x:0 0 0 2024-04-23T10:18:03.130 INFO:tasks.workunit.client.0.smithi026.stdout:0/951: dread d7/d8/d2d/d60/d77/feb [0,4194304] 0 2024-04-23T10:18:03.130 INFO:tasks.workunit.client.0.smithi026.stdout:4/834: dread d4/d1b/f9d [0,4194304] 0 2024-04-23T10:18:03.130 INFO:tasks.workunit.client.0.smithi026.stdout:7/703: creat dd/d1d/d50/d58/fd6 x:0 0 0 2024-04-23T10:18:03.136 INFO:tasks.workunit.client.0.smithi026.stdout:2/760: dread d3/d19/d4d/fb6 [0,4194304] 0 2024-04-23T10:18:03.137 INFO:tasks.workunit.client.0.smithi026.stdout:5/736: dwrite d0/d3c/d5d/db2/dc6/df5/fe3 [0,4194304] 0 2024-04-23T10:18:03.141 INFO:tasks.workunit.client.0.smithi026.stdout:7/704: truncate dd/d6c/fa8 107631 0 2024-04-23T10:18:03.144 INFO:tasks.workunit.client.0.smithi026.stdout:9/920: dwrite d13/d1b/d26/d88/dcf/dd1/f10e [0,4194304] 0 2024-04-23T10:18:03.144 INFO:tasks.workunit.client.0.smithi026.stdout:3/814: dread - d0/d1e/d30/d43/d6c/d79/d73/d99/f114 zero size 2024-04-23T10:18:03.144 INFO:tasks.workunit.client.0.smithi026.stdout:6/941: dwrite d6/d21/d58/f96 [0,4194304] 0 2024-04-23T10:18:03.150 INFO:tasks.workunit.client.0.smithi026.stdout:8/918: dwrite d5/d56/d33/f4e [0,4194304] 0 2024-04-23T10:18:03.152 INFO:tasks.workunit.client.0.smithi026.stdout:9/921: chown d13/d1b/d26/d88/db5/fe0 7 1 2024-04-23T10:18:03.155 INFO:tasks.workunit.client.0.smithi026.stdout:3/815: creat d0/d4c/f115 x:0 0 0 2024-04-23T10:18:03.161 INFO:tasks.workunit.client.0.smithi026.stdout:3/816: chown d0/d1e/d30/d43/df/dcb/ff6 13 1 2024-04-23T10:18:03.165 INFO:tasks.workunit.client.0.smithi026.stdout:6/942: rename d6/d13/l28 to d6/d108/l122 0 2024-04-23T10:18:03.165 INFO:tasks.workunit.client.0.smithi026.stdout:7/705: symlink dd/d1d/d7d/d9f/dd2/ld7 0 2024-04-23T10:18:03.167 INFO:tasks.workunit.client.0.smithi026.stdout:0/952: rename d7/d8/d1e/c117 to d7/d8/d1e/c14c 0 2024-04-23T10:18:03.169 INFO:tasks.workunit.client.0.smithi026.stdout:3/817: fsync d0/d1e/d30/d77/d100/f10d 0 2024-04-23T10:18:03.169 INFO:tasks.workunit.client.0.smithi026.stdout:0/953: stat d7/d5b 0 2024-04-23T10:18:03.171 INFO:tasks.workunit.client.0.smithi026.stdout:4/835: dwrite d4/d1b/dbf/dda/fa1 [0,4194304] 0 2024-04-23T10:18:03.173 INFO:tasks.workunit.client.0.smithi026.stdout:2/761: dwrite d3/d19/d21/d23/d3a/d3c/d80/fbd [0,4194304] 0 2024-04-23T10:18:03.177 INFO:tasks.workunit.client.0.smithi026.stdout:3/818: mkdir d0/d116 0 2024-04-23T10:18:03.177 INFO:tasks.workunit.client.0.smithi026.stdout:1/693: dread dd/d1a/d20/d25/f9c [0,4194304] 0 2024-04-23T10:18:03.179 INFO:tasks.workunit.client.0.smithi026.stdout:0/954: rmdir d7/d8/d1e/d1d/d2f/d6c/d7f 39 2024-04-23T10:18:03.185 INFO:tasks.workunit.client.0.smithi026.stdout:1/694: truncate dd/d1a/d20/d25/d35/d43/f50 1609207 0 2024-04-23T10:18:03.186 INFO:tasks.workunit.client.0.smithi026.stdout:0/955: write d7/da1/f11d [472770,54114] 0 2024-04-23T10:18:03.189 INFO:tasks.workunit.client.0.smithi026.stdout:9/922: dwrite d13/d19/f4d [0,4194304] 0 2024-04-23T10:18:03.189 INFO:tasks.workunit.client.0.smithi026.stdout:8/919: dwrite d5/d56/d33/f58 [8388608,4194304] 0 2024-04-23T10:18:03.196 INFO:tasks.workunit.client.0.smithi026.stdout:9/923: read d13/f25 [566983,30546] 0 2024-04-23T10:18:03.204 INFO:tasks.workunit.client.0.smithi026.stdout:4/836: dwrite d4/d14/fef [0,4194304] 0 2024-04-23T10:18:03.208 INFO:tasks.workunit.client.0.smithi026.stdout:0/956: stat d7/d8/d2d/d60/d62/db2/dca 0 2024-04-23T10:18:03.210 INFO:tasks.workunit.client.0.smithi026.stdout:2/762: truncate d3/dd/f43 1191268 0 2024-04-23T10:18:03.210 INFO:tasks.workunit.client.0.smithi026.stdout:9/924: write d13/d3e/f64 [1478521,122942] 0 2024-04-23T10:18:03.212 INFO:tasks.workunit.client.0.smithi026.stdout:4/837: write d4/d5b/d7b/d4d/fe4 [797655,91894] 0 2024-04-23T10:18:03.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/695: write dd/d1a/d23/f29 [949866,38229] 0 2024-04-23T10:18:03.214 INFO:tasks.workunit.client.0.smithi026.stdout:7/706: dwrite dd/d1d/d50/d58/fd6 [0,4194304] 0 2024-04-23T10:18:03.215 INFO:tasks.workunit.client.0.smithi026.stdout:9/925: write d13/f2d [1632500,129658] 0 2024-04-23T10:18:03.219 INFO:tasks.workunit.client.0.smithi026.stdout:3/819: dread d0/d1e/d30/fd7 [0,4194304] 0 2024-04-23T10:18:03.227 INFO:tasks.workunit.client.0.smithi026.stdout:8/920: dwrite d5/d115/d22/d65/d78/fa2 [0,4194304] 0 2024-04-23T10:18:03.229 INFO:tasks.workunit.client.0.smithi026.stdout:0/957: dwrite d7/d8/d2d/d60/d62/db2/db4/f12c [0,4194304] 0 2024-04-23T10:18:03.236 INFO:tasks.workunit.client.0.smithi026.stdout:9/926: dread - d13/d1b/d26/d88/dcf/fd8 zero size 2024-04-23T10:18:03.237 INFO:tasks.workunit.client.0.smithi026.stdout:4/838: creat d4/d1b/dbf/dda/d6c/dd7/f113 x:0 0 0 2024-04-23T10:18:03.238 INFO:tasks.workunit.client.0.smithi026.stdout:1/696: mkdir dd/deb/df9 0 2024-04-23T10:18:03.238 INFO:tasks.workunit.client.0.smithi026.stdout:8/921: creat d5/d56/d15/d8b/f134 x:0 0 0 2024-04-23T10:18:03.239 INFO:tasks.workunit.client.0.smithi026.stdout:0/958: creat d7/d5b/f14d x:0 0 0 2024-04-23T10:18:03.241 INFO:tasks.workunit.client.0.smithi026.stdout:7/707: mkdir dd/dd8 0 2024-04-23T10:18:03.241 INFO:tasks.workunit.client.0.smithi026.stdout:1/697: write dd/d15/d7d/d98/fa0 [738110,22585] 0 2024-04-23T10:18:03.242 INFO:tasks.workunit.client.0.smithi026.stdout:2/763: truncate d3/d19/d31/f91 1384365 0 2024-04-23T10:18:03.243 INFO:tasks.workunit.client.0.smithi026.stdout:1/698: chown dd/d15/c54 11852 1 2024-04-23T10:18:03.245 INFO:tasks.workunit.client.0.smithi026.stdout:9/927: fsync d13/d3b/d68/dd6/f2f 0 2024-04-23T10:18:03.246 INFO:tasks.workunit.client.0.smithi026.stdout:2/764: write d3/d19/d21/d23/fc4 [4015955,71414] 0 2024-04-23T10:18:03.247 INFO:tasks.workunit.client.0.smithi026.stdout:0/959: read d7/d8/d1e/d1d/d2f/dd1/dd6/fdf [2863920,94952] 0 2024-04-23T10:18:03.250 INFO:tasks.workunit.client.0.smithi026.stdout:7/708: mkdir dd/d1d/d78/db9/dd9 0 2024-04-23T10:18:03.253 INFO:tasks.workunit.client.0.smithi026.stdout:8/922: dwrite d5/d50/f119 [0,4194304] 0 2024-04-23T10:18:03.255 INFO:tasks.workunit.client.0.smithi026.stdout:8/923: chown d5/d115/d22/d65/f87 38243531 1 2024-04-23T10:18:03.255 INFO:tasks.workunit.client.0.smithi026.stdout:9/928: mknod d13/d3b/d68/dd6/d45/d67/c11b 0 2024-04-23T10:18:03.255 INFO:tasks.workunit.client.0.smithi026.stdout:2/765: read d3/dd/f32 [488327,24912] 0 2024-04-23T10:18:03.256 INFO:tasks.workunit.client.0.smithi026.stdout:9/929: chown d13/d3b/d5b/dc9 0 1 2024-04-23T10:18:03.262 INFO:tasks.workunit.client.0.smithi026.stdout:8/924: symlink d5/d12d/l135 0 2024-04-23T10:18:03.264 INFO:tasks.workunit.client.0.smithi026.stdout:9/930: mkdir d13/d3b/d68/dd6/d45/d11c 0 2024-04-23T10:18:03.266 INFO:tasks.workunit.client.0.smithi026.stdout:2/766: dwrite d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/ffc [0,4194304] 0 2024-04-23T10:18:03.267 INFO:tasks.workunit.client.0.smithi026.stdout:0/960: rename d7/d8/d1e/d57/l8b to d7/d8/d2d/d60/d62/db2/l14e 0 2024-04-23T10:18:03.267 INFO:tasks.workunit.client.0.smithi026.stdout:2/767: dread - d3/dd/fb4 zero size 2024-04-23T10:18:03.273 INFO:tasks.workunit.client.0.smithi026.stdout:2/768: fdatasync d3/d19/d21/d23/d3a/d3c/d5d/fce 0 2024-04-23T10:18:03.273 INFO:tasks.workunit.client.0.smithi026.stdout:9/931: mknod d13/d19/c11d 0 2024-04-23T10:18:03.275 INFO:tasks.workunit.client.0.smithi026.stdout:4/839: write d4/d5b/d7b/f4f [767645,70954] 0 2024-04-23T10:18:03.275 INFO:tasks.workunit.client.0.smithi026.stdout:3/820: dwrite d0/d1e/d23/d87/df8/f10b [4194304,4194304] 0 2024-04-23T10:18:03.278 INFO:tasks.workunit.client.0.smithi026.stdout:3/821: dread - d0/d1e/d30/d43/df/dcb/ff6 zero size 2024-04-23T10:18:03.281 INFO:tasks.workunit.client.0.smithi026.stdout:0/961: creat d7/d8/d1e/d1d/d2f/d6c/f14f x:0 0 0 2024-04-23T10:18:03.281 INFO:tasks.workunit.client.0.smithi026.stdout:8/925: write d5/d115/d22/f36 [1525690,107720] 0 2024-04-23T10:18:03.283 INFO:tasks.workunit.client.0.smithi026.stdout:0/962: chown f4 61 1 2024-04-23T10:18:03.285 INFO:tasks.workunit.client.0.smithi026.stdout:8/926: chown d5/d115/d22/d65/d78/d3e/df9 570437 1 2024-04-23T10:18:03.289 INFO:tasks.workunit.client.0.smithi026.stdout:9/932: mkdir d13/d3b/d68/dd6/d11e 0 2024-04-23T10:18:03.290 INFO:tasks.workunit.client.0.smithi026.stdout:1/699: dwrite dd/d1a/d23/d3f/d9a/fcc [0,4194304] 0 2024-04-23T10:18:03.290 INFO:tasks.workunit.client.0.smithi026.stdout:3/822: creat d0/d1e/d30/d43/d82/f117 x:0 0 0 2024-04-23T10:18:03.292 INFO:tasks.workunit.client.0.smithi026.stdout:9/933: chown d13/d3b/c83 49336277 1 2024-04-23T10:18:03.293 INFO:tasks.workunit.client.0.smithi026.stdout:4/840: write d4/d14/f6e [448642,116130] 0 2024-04-23T10:18:03.295 INFO:tasks.workunit.client.0.smithi026.stdout:8/927: mknod d5/d56/d47/c136 0 2024-04-23T10:18:03.295 INFO:tasks.workunit.client.0.smithi026.stdout:0/963: mknod d7/d8/c150 0 2024-04-23T10:18:03.296 INFO:tasks.workunit.client.0.smithi026.stdout:1/700: symlink dd/d1a/d23/d69/d9d/lfa 0 2024-04-23T10:18:03.297 INFO:tasks.workunit.client.0.smithi026.stdout:2/769: rmdir d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d106 0 2024-04-23T10:18:03.298 INFO:tasks.workunit.client.0.smithi026.stdout:0/964: mknod d7/d8/d1e/d1d/d2f/dd1/c151 0 2024-04-23T10:18:03.301 INFO:tasks.workunit.client.0.smithi026.stdout:1/701: write dd/d48/fe9 [977267,84854] 0 2024-04-23T10:18:03.302 INFO:tasks.workunit.client.0.smithi026.stdout:3/823: creat d0/d1e/d23/f118 x:0 0 0 2024-04-23T10:18:03.302 INFO:tasks.workunit.client.0.smithi026.stdout:2/770: dread d3/d19/d31/f91 [0,4194304] 0 2024-04-23T10:18:03.303 INFO:tasks.workunit.client.0.smithi026.stdout:8/928: mkdir d5/d56/d33/d137 0 2024-04-23T10:18:03.306 INFO:tasks.workunit.client.0.smithi026.stdout:2/771: creat d3/d19/d21/d23/d3a/d65/f107 x:0 0 0 2024-04-23T10:18:03.308 INFO:tasks.workunit.client.0.smithi026.stdout:0/965: creat d7/d8/d1e/d57/d114/f152 x:0 0 0 2024-04-23T10:18:03.309 INFO:tasks.workunit.client.0.smithi026.stdout:8/929: rmdir d5/d115/d22/d108 39 2024-04-23T10:18:03.311 INFO:tasks.workunit.client.0.smithi026.stdout:2/772: rename d3/d19/d21/d88 to d3/d19/d21/d23/d108 0 2024-04-23T10:18:03.314 INFO:tasks.workunit.client.0.smithi026.stdout:8/930: symlink d5/d56/d33/ddc/de1/da8/d11f/l138 0 2024-04-23T10:18:03.316 INFO:tasks.workunit.client.0.smithi026.stdout:9/934: dread d13/d1b/d26/d88/dcf/dd1/fd5 [0,4194304] 0 2024-04-23T10:18:03.316 INFO:tasks.workunit.client.0.smithi026.stdout:8/931: write d5/d115/d22/d65/d78/dc9/f27 [1294879,78497] 0 2024-04-23T10:18:03.324 INFO:tasks.workunit.client.0.smithi026.stdout:1/702: truncate dd/f2b 2124910 0 2024-04-23T10:18:03.328 INFO:tasks.workunit.client.0.smithi026.stdout:0/966: dwrite d7/d8/d1e/d2a/fd5 [0,4194304] 0 2024-04-23T10:18:03.332 INFO:tasks.workunit.client.0.smithi026.stdout:9/935: dwrite d13/d19/f8b [0,4194304] 0 2024-04-23T10:18:03.335 INFO:tasks.workunit.client.0.smithi026.stdout:0/967: fsync d7/d8/d2d/d60/d62/f112 0 2024-04-23T10:18:03.339 INFO:tasks.workunit.client.0.smithi026.stdout:9/936: mkdir d13/d105/d11f 0 2024-04-23T10:18:03.340 INFO:tasks.workunit.client.0.smithi026.stdout:2/773: dwrite d3/dd/f15 [0,4194304] 0 2024-04-23T10:18:03.349 INFO:tasks.workunit.client.0.smithi026.stdout:1/703: dwrite dd/d1a/ff4 [0,4194304] 0 2024-04-23T10:18:03.367 INFO:tasks.workunit.client.0.smithi026.stdout:8/932: dread d5/d115/dac/fe3 [0,4194304] 0 2024-04-23T10:18:03.376 INFO:tasks.workunit.client.0.smithi026.stdout:9/937: dread d13/d3b/d68/dd6/d45/fac [0,4194304] 0 2024-04-23T10:18:03.377 INFO:tasks.workunit.client.0.smithi026.stdout:9/938: truncate d13/d1b/d26/fcd 4808353 0 2024-04-23T10:18:03.379 INFO:tasks.workunit.client.0.smithi026.stdout:1/704: mknod dd/d1a/d20/d25/d35/d73/cfb 0 2024-04-23T10:18:03.380 INFO:tasks.workunit.client.0.smithi026.stdout:8/933: truncate d5/d56/d15/d76/f85 615400 0 2024-04-23T10:18:03.382 INFO:tasks.workunit.client.0.smithi026.stdout:9/939: creat d13/d3b/d4e/d76/f120 x:0 0 0 2024-04-23T10:18:03.385 INFO:tasks.workunit.client.0.smithi026.stdout:1/705: dwrite dd/d48/f72 [4194304,4194304] 0 2024-04-23T10:18:03.395 INFO:tasks.workunit.client.0.smithi026.stdout:8/934: creat d5/d11d/f139 x:0 0 0 2024-04-23T10:18:03.402 INFO:tasks.workunit.client.0.smithi026.stdout:8/935: mknod d5/d56/d3f/c13a 0 2024-04-23T10:18:03.404 INFO:tasks.workunit.client.0.smithi026.stdout:9/940: dwrite d13/d1b/d98/fd0 [0,4194304] 0 2024-04-23T10:18:03.404 INFO:tasks.workunit.client.0.smithi026.stdout:1/706: dwrite dd/d1a/d20/d25/d35/d43/d7b/fd4 [0,4194304] 0 2024-04-23T10:18:03.404 INFO:tasks.workunit.client.0.smithi026.stdout:8/936: truncate d5/d56/d15/f117 919991 0 2024-04-23T10:18:03.418 INFO:tasks.workunit.client.0.smithi026.stdout:8/937: chown d5/d115/f96 44 1 2024-04-23T10:18:03.419 INFO:tasks.workunit.client.0.smithi026.stdout:8/938: write d5/d115/d22/d65/d78/fa2 [2738967,82170] 0 2024-04-23T10:18:03.431 INFO:tasks.workunit.client.0.smithi026.stdout:9/941: dwrite d13/d3b/d68/dd6/d45/fac [0,4194304] 0 2024-04-23T10:18:03.432 INFO:tasks.workunit.client.0.smithi026.stdout:9/942: chown d13/d3b/d68/dd6/d45/d67/f104 1 1 2024-04-23T10:18:03.438 INFO:tasks.workunit.client.0.smithi026.stdout:8/939: dwrite d5/f10d [0,4194304] 0 2024-04-23T10:18:03.439 INFO:tasks.workunit.client.0.smithi026.stdout:8/940: fdatasync d5/d115/d22/f60 0 2024-04-23T10:18:03.457 INFO:tasks.workunit.client.0.smithi026.stdout:8/941: dread d5/d56/de8/ff0 [0,4194304] 0 2024-04-23T10:18:03.458 INFO:tasks.workunit.client.0.smithi026.stdout:8/942: truncate d5/d115/d22/d65/d78/dc9/f72 1163396 0 2024-04-23T10:18:03.460 INFO:tasks.workunit.client.0.smithi026.stdout:9/943: unlink d13/d3b/d68/dd6/d45/d67/f7c 0 2024-04-23T10:18:03.506 INFO:tasks.workunit.client.0.smithi026.stdout:5/737: sync 2024-04-23T10:18:03.511 INFO:tasks.workunit.client.0.smithi026.stdout:9/944: creat d13/d3b/d4e/d76/f121 x:0 0 0 2024-04-23T10:18:03.516 INFO:tasks.workunit.client.0.smithi026.stdout:5/738: rmdir d0/d3c/d5d/db2/dc6 39 2024-04-23T10:18:03.519 INFO:tasks.workunit.client.0.smithi026.stdout:8/943: symlink d5/d115/d22/d65/d78/dc9/l13b 0 2024-04-23T10:18:03.524 INFO:tasks.workunit.client.0.smithi026.stdout:5/739: mkdir d0/d12/dfb 0 2024-04-23T10:18:03.531 INFO:tasks.workunit.client.0.smithi026.stdout:9/945: link d13/d3b/d68/dd6/d45/fac d13/d3b/d4e/d76/f122 0 2024-04-23T10:18:03.535 INFO:tasks.workunit.client.0.smithi026.stdout:5/740: fsync d0/d3c/d57/f7d 0 2024-04-23T10:18:03.540 INFO:tasks.workunit.client.0.smithi026.stdout:9/946: creat d13/d3b/d4e/d76/f123 x:0 0 0 2024-04-23T10:18:03.541 INFO:tasks.workunit.client.0.smithi026.stdout:8/944: dread d5/d56/fa4 [0,4194304] 0 2024-04-23T10:18:03.547 INFO:tasks.workunit.client.0.smithi026.stdout:5/741: mknod d0/d3c/d84/d89/d8d/cfc 0 2024-04-23T10:18:03.559 INFO:tasks.workunit.client.0.smithi026.stdout:5/742: rename d0/d3c/f51 to d0/d3c/d84/ffd 0 2024-04-23T10:18:03.560 INFO:tasks.workunit.client.0.smithi026.stdout:5/743: chown d0/d3c/d57/f5a 248921658 1 2024-04-23T10:18:03.569 INFO:tasks.workunit.client.0.smithi026.stdout:5/744: creat d0/d3c/d5d/db2/dc6/df5/df6/ffe x:0 0 0 2024-04-23T10:18:03.569 INFO:tasks.workunit.client.0.smithi026.stdout:8/945: dwrite d5/d56/d15/d8b/fa9 [0,4194304] 0 2024-04-23T10:18:03.572 INFO:tasks.workunit.client.0.smithi026.stdout:8/946: read d5/d56/d33/f4e [1061458,58319] 0 2024-04-23T10:18:03.574 INFO:tasks.workunit.client.0.smithi026.stdout:5/745: symlink d0/d3c/d84/lff 0 2024-04-23T10:18:03.581 INFO:tasks.workunit.client.0.smithi026.stdout:8/947: symlink d5/d50/d9a/d129/l13c 0 2024-04-23T10:18:03.583 INFO:tasks.workunit.client.0.smithi026.stdout:5/746: mknod d0/d68/d91/d9a/c100 0 2024-04-23T10:18:03.607 INFO:tasks.workunit.client.0.smithi026.stdout:8/948: dread d5/d115/dac/faf [0,4194304] 0 2024-04-23T10:18:03.608 INFO:tasks.workunit.client.0.smithi026.stdout:8/949: stat d5/d115/dac 0 2024-04-23T10:18:03.612 INFO:tasks.workunit.client.0.smithi026.stdout:8/950: symlink d5/d56/d33/l13d 0 2024-04-23T10:18:03.624 INFO:tasks.workunit.client.0.smithi026.stdout:8/951: dread d5/d115/d22/d65/d78/f7d [0,4194304] 0 2024-04-23T10:18:03.626 INFO:tasks.workunit.client.0.smithi026.stdout:8/952: read - d5/d56/d15/d8b/f134 zero size 2024-04-23T10:18:03.647 INFO:tasks.workunit.client.0.smithi026.stdout:1/707: dread dd/d15/d7d/d98/fa0 [0,4194304] 0 2024-04-23T10:18:03.652 INFO:tasks.workunit.client.0.smithi026.stdout:1/708: symlink dd/d1a/d20/d25/d35/d73/lfc 0 2024-04-23T10:18:03.676 INFO:tasks.workunit.client.0.smithi026.stdout:6/943: sync 2024-04-23T10:18:03.681 INFO:tasks.workunit.client.0.smithi026.stdout:1/709: dwrite dd/d48/dcf/fe1 [0,4194304] 0 2024-04-23T10:18:03.682 INFO:tasks.workunit.client.0.smithi026.stdout:6/944: creat d6/d21/d2f/d32/d87/f123 x:0 0 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/710: dread - dd/d1a/d23/fad zero size 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/711: stat dd/d1a/d20/d25/d35/cc0 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:6/945: symlink d6/d108/d120/d121/l124 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/712: symlink dd/d1a/d23/lfd 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:6/946: chown d6/d33/d10e 2 1 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/713: write dd/d1a/d20/d25/d35/d74/fb4 [1783936,74699] 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/714: link dd/d1a/d20/d25/d35/d73/lfc dd/d1a/d20/d25/d35/d7f/dd5/lfe 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/715: mknod dd/d48/dac/cff 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/716: write dd/d15/f68 [493136,1978] 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:1/717: mkdir dd/d1a/d20/d25/d35/d7f/d100 0 2024-04-23T10:18:03.719 INFO:tasks.workunit.client.0.smithi026.stdout:6/947: dwrite d6/d21/d2f/d32/d53/f8b [0,4194304] 0 2024-04-23T10:18:03.726 INFO:tasks.workunit.client.0.smithi026.stdout:6/948: creat d6/d21/d2f/d37/d4f/f125 x:0 0 0 2024-04-23T10:18:03.727 INFO:tasks.workunit.client.0.smithi026.stdout:6/949: chown d6/d21/d2f/d32 987 1 2024-04-23T10:18:03.741 INFO:tasks.workunit.client.0.smithi026.stdout:1/718: write dd/d1a/d20/f39 [1225992,129571] 0 2024-04-23T10:18:03.743 INFO:tasks.workunit.client.0.smithi026.stdout:1/719: fdatasync dd/d1a/d20/d25/f4a 0 2024-04-23T10:18:03.745 INFO:tasks.workunit.client.0.smithi026.stdout:6/950: getdents d6/d108 0 2024-04-23T10:18:03.752 INFO:tasks.workunit.client.0.smithi026.stdout:1/720: unlink dd/d15/c54 0 2024-04-23T10:18:03.752 INFO:tasks.workunit.client.0.smithi026.stdout:1/721: readlink dd/d48/dab/ld3 0 2024-04-23T10:18:03.830 INFO:tasks.workunit.client.0.smithi026.stdout:8/953: dread d5/d50/f7a [0,4194304] 0 2024-04-23T10:18:03.837 INFO:tasks.workunit.client.0.smithi026.stdout:7/709: sync 2024-04-23T10:18:03.839 INFO:tasks.workunit.client.0.smithi026.stdout:8/954: rename d5/d56/d33/ddc/de1/da8/fc4 to d5/d56/de8/f13e 0 2024-04-23T10:18:03.840 INFO:tasks.workunit.client.0.smithi026.stdout:7/710: truncate dd/d3f/d47/d4c/fc5 632482 0 2024-04-23T10:18:03.842 INFO:tasks.workunit.client.0.smithi026.stdout:7/711: read - dd/d1d/d78/f9b zero size 2024-04-23T10:18:03.847 INFO:tasks.workunit.client.0.smithi026.stdout:8/955: mknod d5/d56/d15/c13f 0 2024-04-23T10:18:03.853 INFO:tasks.workunit.client.0.smithi026.stdout:6/951: getdents d6 0 2024-04-23T10:18:03.859 INFO:tasks.workunit.client.0.smithi026.stdout:6/952: mknod d6/d21/d2f/def/c126 0 2024-04-23T10:18:03.862 INFO:tasks.workunit.client.0.smithi026.stdout:6/953: write d6/d13/d15/f71 [2154496,107640] 0 2024-04-23T10:18:03.866 INFO:tasks.workunit.client.0.smithi026.stdout:6/954: dread - d6/d21/d2f/d31/d52/d82/f113 zero size 2024-04-23T10:18:03.872 INFO:tasks.workunit.client.0.smithi026.stdout:7/712: link lc dd/d1d/d78/lda 0 2024-04-23T10:18:03.873 INFO:tasks.workunit.client.0.smithi026.stdout:3/824: sync 2024-04-23T10:18:03.873 INFO:tasks.workunit.client.0.smithi026.stdout:4/841: sync 2024-04-23T10:18:03.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/713: readlink dd/d6c/dc6/l4d 0 2024-04-23T10:18:03.879 INFO:tasks.workunit.client.0.smithi026.stdout:7/714: truncate dd/d6c/fa8 729802 0 2024-04-23T10:18:03.881 INFO:tasks.workunit.client.0.smithi026.stdout:7/715: chown dd/f41 22213 1 2024-04-23T10:18:03.883 INFO:tasks.workunit.client.0.smithi026.stdout:8/956: link d5/d115/d64/f7b d5/d56/d33/d137/f140 0 2024-04-23T10:18:03.885 INFO:tasks.workunit.client.0.smithi026.stdout:6/955: dwrite d6/f1d [4194304,4194304] 0 2024-04-23T10:18:03.890 INFO:tasks.workunit.client.0.smithi026.stdout:7/716: rmdir dd/d1d/d7d 39 2024-04-23T10:18:03.898 INFO:tasks.workunit.client.0.smithi026.stdout:7/717: write dd/d2c/d48/f59 [3072943,48740] 0 2024-04-23T10:18:03.914 INFO:tasks.workunit.client.0.smithi026.stdout:6/956: link d6/d21/d2f/d32/d87/f9d d6/d33/d10e/f127 0 2024-04-23T10:18:03.918 INFO:tasks.workunit.client.0.smithi026.stdout:7/718: dwrite dd/d3f/d47/d4c/fcc [0,4194304] 0 2024-04-23T10:18:03.918 INFO:tasks.workunit.client.0.smithi026.stdout:4/842: truncate d4/d22/d4e/d57/fb2 2064491 0 2024-04-23T10:18:03.928 INFO:tasks.workunit.client.0.smithi026.stdout:7/719: mknod dd/d6c/cdb 0 2024-04-23T10:18:03.932 INFO:tasks.workunit.client.0.smithi026.stdout:8/957: getdents d5/d56/d33/ddc/de1/da8 0 2024-04-23T10:18:03.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/957: mkdir d6/d21/d2f/d32/df3/d128 0 2024-04-23T10:18:03.954 INFO:tasks.workunit.client.0.smithi026.stdout:9/947: sync 2024-04-23T10:18:03.954 INFO:tasks.workunit.client.0.smithi026.stdout:0/968: sync 2024-04-23T10:18:03.955 INFO:tasks.workunit.client.0.smithi026.stdout:1/722: sync 2024-04-23T10:18:03.955 INFO:tasks.workunit.client.0.smithi026.stdout:5/747: sync 2024-04-23T10:18:03.955 INFO:tasks.workunit.client.0.smithi026.stdout:2/774: sync 2024-04-23T10:18:03.956 INFO:tasks.workunit.client.0.smithi026.stdout:2/775: chown d3/d19 17018212 1 2024-04-23T10:18:03.957 INFO:tasks.workunit.client.0.smithi026.stdout:9/948: fsync d13/d3e/f64 0 2024-04-23T10:18:03.959 INFO:tasks.workunit.client.0.smithi026.stdout:4/843: mkdir d4/d5b/df0/d114 0 2024-04-23T10:18:03.960 INFO:tasks.workunit.client.0.smithi026.stdout:4/844: fsync d4/d5b/df4/f110 0 2024-04-23T10:18:03.970 INFO:tasks.workunit.client.0.smithi026.stdout:2/776: unlink d3/d19/d21/d23/d3a/d3c/cfa 0 2024-04-23T10:18:03.977 INFO:tasks.workunit.client.0.smithi026.stdout:4/845: creat d4/d5b/d7b/d4d/dad/f115 x:0 0 0 2024-04-23T10:18:03.984 INFO:tasks.workunit.client.0.smithi026.stdout:2/777: dwrite d3/d19/d21/d23/fc1 [0,4194304] 0 2024-04-23T10:18:03.987 INFO:tasks.workunit.client.0.smithi026.stdout:4/846: read d4/d5b/d7b/d4d/fe4 [341636,10710] 0 2024-04-23T10:18:03.988 INFO:tasks.workunit.client.0.smithi026.stdout:9/949: write d13/d3b/d68/fb9 [458458,101987] 0 2024-04-23T10:18:03.989 INFO:tasks.workunit.client.0.smithi026.stdout:2/778: dread d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/fa9 [0,4194304] 0 2024-04-23T10:18:03.992 INFO:tasks.workunit.client.0.smithi026.stdout:1/723: write dd/d15/f32 [2389850,56767] 0 2024-04-23T10:18:03.999 INFO:tasks.workunit.client.0.smithi026.stdout:0/969: dread d7/f39 [0,4194304] 0 2024-04-23T10:18:04.005 INFO:tasks.workunit.client.0.smithi026.stdout:5/748: dwrite d0/d3c/fd2 [0,4194304] 0 2024-04-23T10:18:04.009 INFO:tasks.workunit.client.0.smithi026.stdout:1/724: unlink dd/d1a/d20/d25/d35/d43/fd7 0 2024-04-23T10:18:04.010 INFO:tasks.workunit.client.0.smithi026.stdout:1/725: readlink dd/d1a/d23/d3f/la4 0 2024-04-23T10:18:04.017 INFO:tasks.workunit.client.0.smithi026.stdout:1/726: creat dd/d15/d7d/da1/dc6/ddc/f101 x:0 0 0 2024-04-23T10:18:04.020 INFO:tasks.workunit.client.0.smithi026.stdout:5/749: mknod d0/d68/c101 0 2024-04-23T10:18:04.023 INFO:tasks.workunit.client.0.smithi026.stdout:4/847: getdents d4/d1b/dbf/dda/d6c 0 2024-04-23T10:18:04.028 INFO:tasks.workunit.client.0.smithi026.stdout:4/848: mknod d4/d5b/d7b/d4d/dad/c116 0 2024-04-23T10:18:04.030 INFO:tasks.workunit.client.0.smithi026.stdout:1/727: getdents dd/d15/d7d/df6 0 2024-04-23T10:18:04.030 INFO:tasks.workunit.client.0.smithi026.stdout:2/779: dread d3/f6 [0,4194304] 0 2024-04-23T10:18:04.035 INFO:tasks.workunit.client.0.smithi026.stdout:4/849: mkdir d4/d1b/da0/d117 0 2024-04-23T10:18:04.036 INFO:tasks.workunit.client.0.smithi026.stdout:1/728: symlink dd/d1a/d23/d3f/d9a/l102 0 2024-04-23T10:18:04.037 INFO:tasks.workunit.client.0.smithi026.stdout:1/729: chown dd/d15/c4b 1 1 2024-04-23T10:18:04.038 INFO:tasks.workunit.client.0.smithi026.stdout:5/750: link d0/d12/c82 d0/d3c/d5d/dbc/c102 0 2024-04-23T10:18:04.040 INFO:tasks.workunit.client.0.smithi026.stdout:4/850: mknod d4/d5b/d7b/d36/d90/c118 0 2024-04-23T10:18:04.042 INFO:tasks.workunit.client.0.smithi026.stdout:5/751: mknod d0/d68/dea/c103 0 2024-04-23T10:18:04.043 INFO:tasks.workunit.client.0.smithi026.stdout:9/950: dread d13/d3e/fcb [0,4194304] 0 2024-04-23T10:18:04.044 INFO:tasks.workunit.client.0.smithi026.stdout:5/752: chown d0/d3c/d5d/dbc/fce 109 1 2024-04-23T10:18:04.047 INFO:tasks.workunit.client.0.smithi026.stdout:2/780: rename d3/d19/d21/dc6/cf6 to d3/dd/c109 0 2024-04-23T10:18:04.048 INFO:tasks.workunit.client.0.smithi026.stdout:1/730: getdents dd/deb/df9 0 2024-04-23T10:18:04.050 INFO:tasks.workunit.client.0.smithi026.stdout:5/753: readlink d0/l79 0 2024-04-23T10:18:04.051 INFO:tasks.workunit.client.0.smithi026.stdout:3/825: sync 2024-04-23T10:18:04.051 INFO:tasks.workunit.client.0.smithi026.stdout:2/781: chown d3/d19/d21/d23/d3a/d3c/fdf 0 1 2024-04-23T10:18:04.053 INFO:tasks.workunit.client.0.smithi026.stdout:4/851: dwrite d4/d1b/dbf/dda/d6c/fc4 [0,4194304] 0 2024-04-23T10:18:04.054 INFO:tasks.workunit.client.0.smithi026.stdout:9/951: symlink d13/d3b/d68/dd6/d45/d3a/d4f/l124 0 2024-04-23T10:18:04.056 INFO:tasks.workunit.client.0.smithi026.stdout:4/852: write d4/d22/fbd [3567340,24096] 0 2024-04-23T10:18:04.060 INFO:tasks.workunit.client.0.smithi026.stdout:1/731: dread dd/d1a/d20/d25/d35/d43/d7b/fd4 [0,4194304] 0 2024-04-23T10:18:04.078 INFO:tasks.workunit.client.0.smithi026.stdout:1/732: creat dd/d1a/d23/d3f/d9a/d9e/f103 x:0 0 0 2024-04-23T10:18:04.079 INFO:tasks.workunit.client.0.smithi026.stdout:1/733: write dd/d1a/f83 [1694054,92920] 0 2024-04-23T10:18:04.080 INFO:tasks.workunit.client.0.smithi026.stdout:1/734: dread - dd/d1a/d23/fad zero size 2024-04-23T10:18:04.081 INFO:tasks.workunit.client.0.smithi026.stdout:9/952: truncate d13/d1b/f6e 3054103 0 2024-04-23T10:18:04.081 INFO:tasks.workunit.client.0.smithi026.stdout:4/853: dread d4/d22/d4e/d57/faf [0,4194304] 0 2024-04-23T10:18:04.082 INFO:tasks.workunit.client.0.smithi026.stdout:9/953: chown d13/d1b/d26/d88/fd2 3157 1 2024-04-23T10:18:04.085 INFO:tasks.workunit.client.0.smithi026.stdout:5/754: link d0/d3c/d84/d89/d8d/d8f/cb1 d0/d68/d91/c104 0 2024-04-23T10:18:04.086 INFO:tasks.workunit.client.0.smithi026.stdout:5/755: fdatasync d0/d3c/d5d/d3a/f7f 0 2024-04-23T10:18:04.087 INFO:tasks.workunit.client.0.smithi026.stdout:2/782: write d3/d19/d21/d23/d3a/d3c/fc5 [534666,87303] 0 2024-04-23T10:18:04.093 INFO:tasks.workunit.client.0.smithi026.stdout:9/954: mknod d13/d105/c125 0 2024-04-23T10:18:04.094 INFO:tasks.workunit.client.0.smithi026.stdout:5/756: dwrite d0/d68/d91/d9a/fee [0,4194304] 0 2024-04-23T10:18:04.095 INFO:tasks.workunit.client.0.smithi026.stdout:9/955: write d13/d19/f8b [2268646,34811] 0 2024-04-23T10:18:04.096 INFO:tasks.workunit.client.0.smithi026.stdout:9/956: dread - d13/d3b/d4e/d76/f120 zero size 2024-04-23T10:18:04.100 INFO:tasks.workunit.client.0.smithi026.stdout:4/854: symlink d4/d5b/d7b/d36/l119 0 2024-04-23T10:18:04.100 INFO:tasks.workunit.client.0.smithi026.stdout:3/826: getdents d0/d1e/d23/d87/db3/dee 0 2024-04-23T10:18:04.100 INFO:tasks.workunit.client.0.smithi026.stdout:9/957: dread - d13/d36/d66/f119 zero size 2024-04-23T10:18:04.103 INFO:tasks.workunit.client.0.smithi026.stdout:1/735: getdents dd/d1a/d20/d25 0 2024-04-23T10:18:04.105 INFO:tasks.workunit.client.0.smithi026.stdout:4/855: creat d4/d5b/da7/f11a x:0 0 0 2024-04-23T10:18:04.109 INFO:tasks.workunit.client.0.smithi026.stdout:9/958: mkdir d13/d36/d66/d72/d126 0 2024-04-23T10:18:04.110 INFO:tasks.workunit.client.0.smithi026.stdout:4/856: rmdir d4/d14/d92 39 2024-04-23T10:18:04.114 INFO:tasks.workunit.client.0.smithi026.stdout:2/783: dwrite d3/d19/f55 [0,4194304] 0 2024-04-23T10:18:04.115 INFO:tasks.workunit.client.0.smithi026.stdout:4/857: write d4/d14/d30/fb8 [93707,36924] 0 2024-04-23T10:18:04.118 INFO:tasks.workunit.client.0.smithi026.stdout:3/827: dwrite d0/d1e/d30/d43/df/dcb/f88 [0,4194304] 0 2024-04-23T10:18:04.120 INFO:tasks.workunit.client.0.smithi026.stdout:1/736: truncate dd/d1a/ff4 6094221 0 2024-04-23T10:18:04.122 INFO:tasks.workunit.client.0.smithi026.stdout:5/757: dwrite d0/d12/f1f [0,4194304] 0 2024-04-23T10:18:04.123 INFO:tasks.workunit.client.0.smithi026.stdout:4/858: chown d4/d5b/f75 81955 1 2024-04-23T10:18:04.124 INFO:tasks.quiescer.fs.[cephfs]:Total duration (43.2) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:18:04.124 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.6 2024-04-23T10:18:04.124 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:18:04.125 INFO:tasks.workunit.client.0.smithi026.stdout:2/784: mknod d3/dd/d4b/d9c/c10a 0 2024-04-23T10:18:04.125 INFO:tasks.workunit.client.0.smithi026.stdout:5/758: truncate d0/d12/fe9 514497 0 2024-04-23T10:18:04.128 INFO:tasks.workunit.client.0.smithi026.stdout:3/828: mkdir d0/d51/d5e/da4/def/d119 0 2024-04-23T10:18:04.130 INFO:tasks.workunit.client.0.smithi026.stdout:5/759: creat d0/d3c/d84/d89/f105 x:0 0 0 2024-04-23T10:18:04.131 INFO:tasks.workunit.client.0.smithi026.stdout:1/737: creat dd/d1a/d20/d25/d35/d7f/dd5/dde/f104 x:0 0 0 2024-04-23T10:18:04.133 INFO:tasks.workunit.client.0.smithi026.stdout:2/785: rmdir d3/d19/d21/d23/d3a/d3c/d5d/de2 39 2024-04-23T10:18:04.136 INFO:tasks.workunit.client.0.smithi026.stdout:2/786: fdatasync d3/dd/fb4 0 2024-04-23T10:18:04.138 INFO:tasks.workunit.client.0.smithi026.stdout:9/959: write d13/d3b/ff9 [1129772,30026] 0 2024-04-23T10:18:04.142 INFO:tasks.workunit.client.0.smithi026.stdout:1/738: dread - dd/d15/fb5 zero size 2024-04-23T10:18:04.144 INFO:tasks.workunit.client.0.smithi026.stdout:2/787: mknod d3/d19/d21/d23/daf/c10b 0 2024-04-23T10:18:04.149 INFO:tasks.workunit.client.0.smithi026.stdout:4/859: write d4/d5b/d7b/d4d/fe4 [34059,56697] 0 2024-04-23T10:18:04.153 INFO:tasks.workunit.client.0.smithi026.stdout:5/760: creat d0/d3c/d5d/db2/dc6/dd4/f106 x:0 0 0 2024-04-23T10:18:04.155 INFO:tasks.workunit.client.0.smithi026.stdout:7/720: sync 2024-04-23T10:18:04.155 INFO:tasks.workunit.client.0.smithi026.stdout:8/958: sync 2024-04-23T10:18:04.159 INFO:tasks.workunit.client.0.smithi026.stdout:5/761: mkdir d0/d3c/d5d/dbc/d107 0 2024-04-23T10:18:04.162 INFO:tasks.workunit.client.0.smithi026.stdout:5/762: readlink d0/ld 0 2024-04-23T10:18:04.163 INFO:tasks.workunit.client.0.smithi026.stdout:4/860: dwrite d4/d14/d30/d52/fe8 [0,4194304] 0 2024-04-23T10:18:04.163 INFO:tasks.workunit.client.0.smithi026.stdout:7/721: creat dd/d6c/d72/dd0/fdc x:0 0 0 2024-04-23T10:18:04.163 INFO:tasks.workunit.client.0.smithi026.stdout:3/829: dwrite d0/d1e/d23/fb9 [0,4194304] 0 2024-04-23T10:18:04.164 INFO:tasks.workunit.client.0.smithi026.stdout:5/763: readlink d0/d12/l1d 0 2024-04-23T10:18:04.165 INFO:tasks.workunit.client.0.smithi026.stdout:7/722: chown dd/d2c/d48/d7e 77 1 2024-04-23T10:18:04.167 INFO:tasks.workunit.client.0.smithi026.stdout:1/739: getdents dd/d1a/d20/d25/d35/d7f/dd5/dde 0 2024-04-23T10:18:04.171 INFO:tasks.workunit.client.0.smithi026.stdout:5/764: dread d0/d3c/d84/f9d [0,4194304] 0 2024-04-23T10:18:04.179 INFO:tasks.workunit.client.0.smithi026.stdout:8/959: creat d5/d56/d15/f141 x:0 0 0 2024-04-23T10:18:04.179 INFO:tasks.workunit.client.0.smithi026.stdout:7/723: truncate dd/d44/f3b 1477595 0 2024-04-23T10:18:04.184 INFO:tasks.workunit.client.0.smithi026.stdout:8/960: rmdir d5/d56/d3f 39 2024-04-23T10:18:04.184 INFO:tasks.workunit.client.0.smithi026.stdout:5/765: write d0/d3c/d57/ff1 [24926,5314] 0 2024-04-23T10:18:04.190 INFO:tasks.workunit.client.0.smithi026.stdout:3/830: dwrite d0/d1e/d23/d87/db3/dee/f34 [0,4194304] 0 2024-04-23T10:18:04.190 INFO:tasks.workunit.client.0.smithi026.stdout:4/861: creat d4/d7/f11b x:0 0 0 2024-04-23T10:18:04.194 INFO:tasks.workunit.client.0.smithi026.stdout:7/724: dwrite dd/f76 [0,4194304] 0 2024-04-23T10:18:04.195 INFO:tasks.workunit.client.0.smithi026.stdout:3/831: unlink d0/f11 0 2024-04-23T10:18:04.197 INFO:tasks.workunit.client.0.smithi026.stdout:3/832: write d0/d1e/fc7 [2013465,39834] 0 2024-04-23T10:18:04.212 INFO:tasks.workunit.client.0.smithi026.stdout:7/725: dread dd/d2c/d48/d7e/f93 [0,4194304] 0 2024-04-23T10:18:04.213 INFO:tasks.workunit.client.0.smithi026.stdout:8/961: truncate d5/d56/d33/d113/f126 21376 0 2024-04-23T10:18:04.213 INFO:tasks.workunit.client.0.smithi026.stdout:4/862: write d4/d1b/fcf [2610367,10018] 0 2024-04-23T10:18:04.213 INFO:tasks.workunit.client.0.smithi026.stdout:1/740: dread dd/f3b [0,4194304] 0 2024-04-23T10:18:04.222 INFO:tasks.workunit.client.0.smithi026.stdout:1/741: dwrite dd/d15/d7d/da1/fb7 [0,4194304] 0 2024-04-23T10:18:04.240 INFO:tasks.workunit.client.0.smithi026.stdout:3/833: read d0/d1e/d30/d43/df/f18 [55256,12033] 0 2024-04-23T10:18:04.241 INFO:tasks.workunit.client.0.smithi026.stdout:5/766: getdents d0 0 2024-04-23T10:18:04.241 INFO:tasks.workunit.client.0.smithi026.stdout:4/863: mkdir d4/d5b/d7b/d86/d11c 0 2024-04-23T10:18:04.242 INFO:tasks.workunit.client.0.smithi026.stdout:4/864: chown d4/d22/d4e/l5a 1806697613 1 2024-04-23T10:18:04.243 INFO:tasks.workunit.client.0.smithi026.stdout:3/834: dread - d0/d1e/d23/d87/db3/dee/d39/d93/f10f zero size 2024-04-23T10:18:04.244 INFO:tasks.workunit.client.0.smithi026.stdout:4/865: chown d4/d5b/f60 43 1 2024-04-23T10:18:04.245 INFO:tasks.workunit.client.0.smithi026.stdout:7/726: truncate dd/d3f/d47/d4c/f4a 3160475 0 2024-04-23T10:18:04.246 INFO:tasks.workunit.client.0.smithi026.stdout:5/767: mkdir d0/d3c/d5d/db2/dc6/df5/ddf/d108 0 2024-04-23T10:18:04.247 INFO:tasks.workunit.client.0.smithi026.stdout:5/768: chown d0/d12/c18 236990 1 2024-04-23T10:18:04.248 INFO:tasks.workunit.client.0.smithi026.stdout:1/742: truncate dd/d1a/d23/f67 4319617 0 2024-04-23T10:18:04.253 INFO:tasks.workunit.client.0.smithi026.stdout:4/866: creat d4/d14/d3d/d73/df6/f11d x:0 0 0 2024-04-23T10:18:04.263 INFO:tasks.workunit.client.0.smithi026.stdout:3/835: dread d0/f3c [0,4194304] 0 2024-04-23T10:18:04.263 INFO:tasks.workunit.client.0.smithi026.stdout:4/867: mknod d4/d5b/d7b/d4d/dc7/c11e 0 2024-04-23T10:18:04.263 INFO:tasks.workunit.client.0.smithi026.stdout:1/743: dread dd/d1a/f5e [0,4194304] 0 2024-04-23T10:18:04.268 INFO:tasks.workunit.client.0.smithi026.stdout:3/836: creat d0/d4c/f11a x:0 0 0 2024-04-23T10:18:04.272 INFO:tasks.workunit.client.0.smithi026.stdout:3/837: read d0/d1e/d30/d77/d100/f101 [3547799,13398] 0 2024-04-23T10:18:04.272 INFO:tasks.workunit.client.0.smithi026.stdout:5/769: dread d0/d3c/d84/ffd [0,4194304] 0 2024-04-23T10:18:04.273 INFO:tasks.workunit.client.0.smithi026.stdout:4/868: mkdir d4/d14/d3d/d11f 0 2024-04-23T10:18:04.276 INFO:tasks.workunit.client.0.smithi026.stdout:1/744: write dd/d15/fa7 [1042387,78792] 0 2024-04-23T10:18:04.279 INFO:tasks.workunit.client.0.smithi026.stdout:1/745: stat dd/d15/d7d/d98/fdf 0 2024-04-23T10:18:04.282 INFO:tasks.workunit.client.0.smithi026.stdout:7/727: dwrite dd/f36 [0,4194304] 0 2024-04-23T10:18:04.283 INFO:tasks.workunit.client.0.smithi026.stdout:1/746: write dd/d1a/d20/d25/d35/d7f/dd5/dde/f104 [876127,82157] 0 2024-04-23T10:18:04.284 INFO:tasks.workunit.client.0.smithi026.stdout:3/838: dwrite d0/d4c/feb [0,4194304] 0 2024-04-23T10:18:04.284 INFO:tasks.workunit.client.0.smithi026.stdout:7/728: stat dd/d2c/d48/c5f 0 2024-04-23T10:18:04.286 INFO:tasks.workunit.client.0.smithi026.stdout:4/869: readlink d4/d1b/dbf/dda/d6c/d6f/d80/le6 0 2024-04-23T10:18:04.289 INFO:tasks.workunit.client.0.smithi026.stdout:5/770: truncate d0/d12/fe1 826942 0 2024-04-23T10:18:04.289 INFO:tasks.workunit.client.0.smithi026.stdout:1/747: chown dd/d1a/d20/d25/d35/d7f/da5/lc9 3903 1 2024-04-23T10:18:04.292 INFO:tasks.workunit.client.0.smithi026.stdout:7/729: write dd/d1d/d7d/f98 [750438,64042] 0 2024-04-23T10:18:04.292 INFO:tasks.workunit.client.0.smithi026.stdout:3/839: mknod d0/d1e/d30/d43/df/c11b 0 2024-04-23T10:18:04.292 INFO:tasks.workunit.client.0.smithi026.stdout:4/870: symlink d4/d22/d4e/l120 0 2024-04-23T10:18:04.293 INFO:tasks.workunit.client.0.smithi026.stdout:1/748: chown dd/d1a/d20/d25/d35/d43/fae 17885 1 2024-04-23T10:18:04.295 INFO:tasks.workunit.client.0.smithi026.stdout:5/771: mkdir d0/d68/dea/d109 0 2024-04-23T10:18:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 Processor -- start 2024-04-23T10:18:04.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 -- start start 2024-04-23T10:18:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9e5c0d1380 0x7f9e5c160210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9e5c15f7a0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5c15fd80 con 0x7f9e5c0d0fa0 2024-04-23T10:18:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.301+0000 7f9e60a9a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9e5c0b57f0 con 0x7f9e5c0d1380 2024-04-23T10:18:04.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57010/0 (socket says 172.21.15.26:57010) 2024-04-23T10:18:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 -- 172.21.15.26:0/4041038741 learned_addr learned my addr 172.21.15.26:0/4041038741 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 -- 172.21.15.26:0/4041038741 >> v2:172.21.15.190:3300/0 conn(0x7f9e5c0d1380 msgr2=0x7f9e5c160210 unknown :-1 s=STATE_CONNECTING l=0).mark_down 2024-04-23T10:18:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 --2- 172.21.15.26:0/4041038741 >> v2:172.21.15.190:3300/0 conn(0x7f9e5c0d1380 0x7f9e5c160210 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 -- 172.21.15.26:0/4041038741 >> v1:172.21.15.26:6789/0 conn(0x7f9e5c0b5220 legacy=0x7f9e5c1594b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.305+0000 7f9e5a59c640 1 -- 172.21.15.26:0/4041038741 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c0b5ad0 con 0x7f9e5c0d0fa0 2024-04-23T10:18:04.306 INFO:tasks.workunit.client.0.smithi026.stdout:5/772: mknod d0/d3c/d5d/db2/dc6/c10a 0 2024-04-23T10:18:04.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.309+0000 7f9e5a59c640 1 --2- 172.21.15.26:0/4041038741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0d19a0 tx=0x7f9e5401f470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e5f6e801d231a0c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.309+0000 7f9e5959a640 1 -- 172.21.15.26:0/4041038741 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e540b4070 con 0x7f9e5c0d0fa0 2024-04-23T10:18:04.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.309+0000 7f9e5959a640 1 -- 172.21.15.26:0/4041038741 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e540af400 con 0x7f9e5c0d0fa0 2024-04-23T10:18:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- 172.21.15.26:0/4041038741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 msgr2=0x7f9e5c0c5940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.312 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/4041038741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c0d19a0 tx=0x7f9e5401f470 comp rx=0 tx=0).stop 2024-04-23T10:18:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- 172.21.15.26:0/4041038741 shutdown_connections 2024-04-23T10:18:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/4041038741 >> v2:172.21.15.190:3300/0 conn(0x7f9e5c0d1380 0x7f9e5c160210 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/4041038741 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c0c5940 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- 172.21.15.26:0/4041038741 >> 172.21.15.26:0/4041038741 conn(0x7f9e5c06bad0 msgr2=0x7f9e5c06bee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.313 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- 172.21.15.26:0/4041038741 shutdown_connections 2024-04-23T10:18:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- 172.21.15.26:0/4041038741 wait complete. 2024-04-23T10:18:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 Processor -- start 2024-04-23T10:18:04.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.313+0000 7f9e60a9a640 1 -- start start 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c1e8aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 0x7f9e5c1ea1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c159bc0 con 0x7f9e5c0d0fa0 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9e5c0b5db0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9e5c159d40 con 0x7f9e5c0d1380 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:41720/0 (socket says 172.21.15.26:41720) 2024-04-23T10:18:04.317 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 -- 172.21.15.26:0/1779517837 learned_addr learned my addr 172.21.15.26:0/1779517837 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5ad9d640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 0x7f9e5c1ea1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.318 INFO:tasks.workunit.client.0.smithi026.stdout:1/749: dwrite dd/d15/d7d/da1/dc6/ddc/fea [0,4194304] 0 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 -- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 msgr2=0x7f9e5c1ea1f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 0x7f9e5c1ea1f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 -- 172.21.15.26:0/1779517837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 msgr2=0x7f9e5c1e8aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c1e8aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 -- 172.21.15.26:0/1779517837 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9e5c155810 con 0x7f9e5c0b5220 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5ad9d640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 0x7f9e5c1ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e5a59c640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e5409bd90 tx=0x7f9e5401c210 comp rx=0 tx=0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e540bd020 con 0x7f9e5c0b5220 2024-04-23T10:18:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9e540b9610 con 0x7f9e5c0b5220 2024-04-23T10:18:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9e540b4040 con 0x7f9e5c0b5220 2024-04-23T10:18:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9e5c155ab0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.317+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9e5c155ff0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.320 INFO:tasks.workunit.client.0.smithi026.stdout:5/773: mkdir d0/d12/dfb/d10b 0 2024-04-23T10:18:04.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9e540c0020 con 0x7f9e5c0b5220 2024-04-23T10:18:04.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9e5c075df0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e4affd640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9e54124be0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e59d9b640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.321+0000 7f9e59d9b640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 0x7f9e3c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c15f250 tx=0x7f9e50007a60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.325 INFO:tasks.workunit.client.0.smithi026.stdout:4/871: dwrite d4/d14/f25 [4194304,4194304] 0 2024-04-23T10:18:04.325 INFO:tasks.workunit.client.0.smithi026.stdout:7/730: dwrite dd/d1d/d50/d58/fad [0,4194304] 0 2024-04-23T10:18:04.327 INFO:tasks.workunit.client.0.smithi026.stdout:3/840: dwrite d0/d1e/d30/d43/d6c/d79/d73/f8f [0,4194304] 0 2024-04-23T10:18:04.331 INFO:tasks.workunit.client.0.smithi026.stdout:7/731: write dd/d3f/f73 [2493572,57494] 0 2024-04-23T10:18:04.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.337+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9e540c7030 con 0x7f9e5c0b5220 2024-04-23T10:18:04.339 INFO:tasks.workunit.client.0.smithi026.stdout:7/732: truncate dd/d2c/d48/fbe 518707 0 2024-04-23T10:18:04.345 INFO:tasks.workunit.client.0.smithi026.stdout:1/750: mkdir dd/d1a/d23/d69/d105 0 2024-04-23T10:18:04.348 INFO:tasks.workunit.client.0.smithi026.stdout:4/872: rename d4/d22/d4e/l5a to d4/d5b/df4/l121 0 2024-04-23T10:18:04.349 INFO:tasks.workunit.client.0.smithi026.stdout:5/774: creat d0/d3c/f10c x:0 0 0 2024-04-23T10:18:04.356 INFO:tasks.workunit.client.0.smithi026.stdout:4/873: creat d4/d1b/dbf/dda/d6c/dd7/f122 x:0 0 0 2024-04-23T10:18:04.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/733: dwrite dd/dbc/fd1 [0,4194304] 0 2024-04-23T10:18:04.361 INFO:tasks.workunit.client.0.smithi026.stdout:5/775: symlink d0/d3c/d5d/db2/dc6/df5/ddf/d108/l10d 0 2024-04-23T10:18:04.363 INFO:tasks.workunit.client.0.smithi026.stdout:3/841: dwrite d0/d1e/d30/d43/df/dcb/f94 [0,4194304] 0 2024-04-23T10:18:04.364 INFO:tasks.workunit.client.0.smithi026.stdout:5/776: dread - d0/d12/f4f zero size 2024-04-23T10:18:04.375 INFO:tasks.workunit.client.0.smithi026.stdout:3/842: write d0/d1e/d30/d43/df/f4b [3229900,66175] 0 2024-04-23T10:18:04.375 INFO:tasks.workunit.client.0.smithi026.stdout:1/751: dwrite dd/d1a/d23/d3f/f5b [0,4194304] 0 2024-04-23T10:18:04.376 INFO:tasks.workunit.client.0.smithi026.stdout:5/777: read d0/d3c/d5d/d3a/f72 [1049582,18471] 0 2024-04-23T10:18:04.382 INFO:tasks.workunit.client.0.smithi026.stdout:7/734: truncate dd/d1d/d7d/f98 27789 0 2024-04-23T10:18:04.383 INFO:tasks.workunit.client.0.smithi026.stdout:4/874: dwrite d4/d14/f6e [0,4194304] 0 2024-04-23T10:18:04.385 INFO:tasks.workunit.client.0.smithi026.stdout:7/735: chown dd/d2c 1628 1 2024-04-23T10:18:04.385 INFO:tasks.workunit.client.0.smithi026.stdout:7/736: chown dd/d1d/d78 0 1 2024-04-23T10:18:04.387 INFO:tasks.workunit.client.0.smithi026.stdout:3/843: creat d0/d1e/d30/d43/df/d17/f11c x:0 0 0 2024-04-23T10:18:04.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/737: mknod dd/dbc/cdd 0 2024-04-23T10:18:04.395 INFO:tasks.workunit.client.0.smithi026.stdout:4/875: mknod d4/d1b/da0/d117/c123 0 2024-04-23T10:18:04.398 INFO:tasks.workunit.client.0.smithi026.stdout:3/844: write d0/d1e/d23/d87/db3/dee/d39/db7/fa6 [1418139,96050] 0 2024-04-23T10:18:04.398 INFO:tasks.workunit.client.0.smithi026.stdout:7/738: rmdir dd/d1d/d7d 39 2024-04-23T10:18:04.402 INFO:tasks.workunit.client.0.smithi026.stdout:5/778: link d0/f9 d0/d3c/d5d/dbc/f10e 0 2024-04-23T10:18:04.403 INFO:tasks.workunit.client.0.smithi026.stdout:4/876: mknod d4/d22/dd8/c124 0 2024-04-23T10:18:04.405 INFO:tasks.workunit.client.0.smithi026.stdout:7/739: creat dd/d3f/fde x:0 0 0 2024-04-23T10:18:04.417 INFO:tasks.workunit.client.0.smithi026.stdout:5/779: dwrite d0/fe [4194304,4194304] 0 2024-04-23T10:18:04.418 INFO:tasks.workunit.client.0.smithi026.stdout:1/752: dread dd/d1a/d23/d3f/fe6 [0,4194304] 0 2024-04-23T10:18:04.419 INFO:tasks.workunit.client.0.smithi026.stdout:3/845: dwrite d0/d1e/d30/d43/f3b [0,4194304] 0 2024-04-23T10:18:04.422 INFO:tasks.workunit.client.0.smithi026.stdout:4/877: rename d4/d22/f47 to d4/d5b/d7b/d36/f125 0 2024-04-23T10:18:04.424 INFO:tasks.workunit.client.0.smithi026.stdout:4/878: write d4/d22/d4e/fd4 [1768920,29637] 0 2024-04-23T10:18:04.426 INFO:tasks.workunit.client.0.smithi026.stdout:4/879: write d4/fde [710768,83925] 0 2024-04-23T10:18:04.426 INFO:tasks.workunit.client.0.smithi026.stdout:6/958: sync 2024-04-23T10:18:04.426 INFO:tasks.workunit.client.0.smithi026.stdout:0/970: sync 2024-04-23T10:18:04.428 INFO:tasks.workunit.client.0.smithi026.stdout:3/846: mknod d0/d1e/d23/d87/db3/dee/d39/db7/c11d 0 2024-04-23T10:18:04.428 INFO:tasks.workunit.client.0.smithi026.stdout:5/780: mknod d0/d68/d91/dd6/c10f 0 2024-04-23T10:18:04.435 INFO:tasks.workunit.client.0.smithi026.stdout:7/740: dwrite dd/d1d/d7d/fb2 [0,4194304] 0 2024-04-23T10:18:04.438 INFO:tasks.workunit.client.0.smithi026.stdout:3/847: mkdir d0/d51/d5e/d11e 0 2024-04-23T10:18:04.438 INFO:tasks.workunit.client.0.smithi026.stdout:1/753: dwrite dd/fc2 [4194304,4194304] 0 2024-04-23T10:18:04.439 INFO:tasks.workunit.client.0.smithi026.stdout:4/880: mkdir d4/d5b/df0/d114/d126 0 2024-04-23T10:18:04.444 INFO:tasks.workunit.client.0.smithi026.stdout:0/971: symlink d7/d8/d1e/d2a/l153 0 2024-04-23T10:18:04.446 INFO:tasks.workunit.client.0.smithi026.stdout:3/848: read d0/d1e/d23/d87/db3/dee/fb1 [106220,92419] 0 2024-04-23T10:18:04.449 INFO:tasks.workunit.client.0.smithi026.stdout:5/781: dwrite d0/d3c/d84/fab [0,4194304] 0 2024-04-23T10:18:04.452 INFO:tasks.workunit.client.0.smithi026.stdout:5/782: write d0/d68/dcc/ffa [107895,23271] 0 2024-04-23T10:18:04.453 INFO:tasks.workunit.client.0.smithi026.stdout:4/881: rename d4/d1b/d95/cd2 to d4/d1b/da0/d117/c127 0 2024-04-23T10:18:04.455 INFO:tasks.workunit.client.0.smithi026.stdout:7/741: dwrite dd/d6c/fa2 [0,4194304] 0 2024-04-23T10:18:04.463 INFO:tasks.workunit.client.0.smithi026.stdout:4/882: stat d4/d14/d30/da2/d10c/cfa 0 2024-04-23T10:18:04.465 INFO:tasks.workunit.client.0.smithi026.stdout:0/972: readlink d7/d8/d1e/dd3/de7/l123 0 2024-04-23T10:18:04.465 INFO:tasks.workunit.client.0.smithi026.stdout:3/849: mknod d0/d1e/d30/d77/d100/c11f 0 2024-04-23T10:18:04.467 INFO:tasks.workunit.client.0.smithi026.stdout:7/742: fdatasync dd/d44/f5e 0 2024-04-23T10:18:04.470 INFO:tasks.workunit.client.0.smithi026.stdout:3/850: creat d0/d1e/d23/d87/db3/dee/d39/dda/f120 x:0 0 0 2024-04-23T10:18:04.471 INFO:tasks.workunit.client.0.smithi026.stdout:3/851: fsync d0/d1e/d23/d87/db3/dee/f5c 0 2024-04-23T10:18:04.472 INFO:tasks.workunit.client.0.smithi026.stdout:5/783: write d0/d3c/d57/f99 [4554156,128668] 0 2024-04-23T10:18:04.472 INFO:tasks.workunit.client.0.smithi026.stdout:3/852: stat d0/d1e/d23/d87/df8/f10b 0 2024-04-23T10:18:04.484 INFO:tasks.workunit.client.0.smithi026.stdout:4/883: truncate d4/d22/d2e/f9e 33981 0 2024-04-23T10:18:04.488 INFO:tasks.workunit.client.0.smithi026.stdout:4/884: creat d4/d1b/da0/f128 x:0 0 0 2024-04-23T10:18:04.490 INFO:tasks.workunit.client.0.smithi026.stdout:5/784: symlink d0/d12/dfb/d10b/l110 0 2024-04-23T10:18:04.493 INFO:tasks.workunit.client.0.smithi026.stdout:1/754: dread dd/d1a/d23/f67 [0,4194304] 0 2024-04-23T10:18:04.494 INFO:tasks.workunit.client.0.smithi026.stdout:4/885: rename d4/d1b/da0/d117/c123 to d4/d5b/da7/c129 0 2024-04-23T10:18:04.494 INFO:tasks.workunit.client.0.smithi026.stdout:0/973: dread d7/d8/d1e/d57/f13a [0,4194304] 0 2024-04-23T10:18:04.495 INFO:tasks.workunit.client.0.smithi026.stdout:4/886: write d4/d5b/da7/fec [1031296,105156] 0 2024-04-23T10:18:04.496 INFO:tasks.workunit.client.0.smithi026.stdout:1/755: fsync dd/d1a/d23/d3f/d9a/d9e/fba 0 2024-04-23T10:18:04.498 INFO:tasks.workunit.client.0.smithi026.stdout:5/785: mkdir d0/d3c/d5d/dbc/d107/d111 0 2024-04-23T10:18:04.503 INFO:tasks.workunit.client.0.smithi026.stdout:5/786: read d0/d3c/d84/f8c [743872,65681] 0 2024-04-23T10:18:04.506 INFO:tasks.workunit.client.0.smithi026.stdout:0/974: link d7/d8/d1e/d57/f13a d7/d8/d2d/d60/d77/f154 0 2024-04-23T10:18:04.506 INFO:tasks.workunit.client.0.smithi026.stdout:1/756: dread f2 [0,4194304] 0 2024-04-23T10:18:04.507 INFO:tasks.workunit.client.0.smithi026.stdout:7/743: dread dd/d1d/d50/f55 [0,4194304] 0 2024-04-23T10:18:04.508 INFO:tasks.workunit.client.0.smithi026.stdout:4/887: dwrite d4/d5b/d7b/d4d/fe4 [0,4194304] 0 2024-04-23T10:18:04.509 INFO:tasks.workunit.client.0.smithi026.stdout:5/787: mkdir d0/d12/d112 0 2024-04-23T10:18:04.512 INFO:tasks.workunit.client.0.smithi026.stdout:4/888: creat d4/d5b/df0/f12a x:0 0 0 2024-04-23T10:18:04.512 INFO:tasks.workunit.client.0.smithi026.stdout:0/975: read d7/d8/d1e/d2a/f55 [2232790,86461] 0 2024-04-23T10:18:04.514 INFO:tasks.workunit.client.0.smithi026.stdout:0/976: fsync d7/d8/d1e/d1d/d2f/dd1/dd6/f130 0 2024-04-23T10:18:04.521 INFO:tasks.workunit.client.0.smithi026.stdout:7/744: mkdir dd/d1d/d50/d58/ddf 0 2024-04-23T10:18:04.522 INFO:tasks.workunit.client.0.smithi026.stdout:1/757: dread dd/d1a/d6a/d7c/f8a [0,4194304] 0 2024-04-23T10:18:04.525 INFO:tasks.workunit.client.0.smithi026.stdout:5/788: write d0/d12/f98 [902292,103768] 0 2024-04-23T10:18:04.526 INFO:tasks.workunit.client.0.smithi026.stdout:0/977: creat d7/d8/d2d/d60/f155 x:0 0 0 2024-04-23T10:18:04.527 INFO:tasks.workunit.client.0.smithi026.stdout:5/789: fdatasync d0/d3c/d5d/d3a/f7f 0 2024-04-23T10:18:04.529 INFO:tasks.workunit.client.0.smithi026.stdout:1/758: symlink dd/d1a/d20/l106 0 2024-04-23T10:18:04.531 INFO:tasks.workunit.client.0.smithi026.stdout:0/978: mkdir d7/d8/d1e/d1d/d2f/dd1/dd6/d156 0 2024-04-23T10:18:04.533 INFO:tasks.workunit.client.0.smithi026.stdout:5/790: creat d0/d3c/d5d/f113 x:0 0 0 2024-04-23T10:18:04.534 INFO:tasks.workunit.client.0.smithi026.stdout:1/759: creat dd/d48/dcf/f107 x:0 0 0 2024-04-23T10:18:04.536 INFO:tasks.workunit.client.0.smithi026.stdout:5/791: creat d0/d3c/d5d/d3a/f114 x:0 0 0 2024-04-23T10:18:04.537 INFO:tasks.workunit.client.0.smithi026.stdout:5/792: write d0/fe [9031478,22686] 0 2024-04-23T10:18:04.541 INFO:tasks.workunit.client.0.smithi026.stdout:5/793: creat d0/d3c/d57/f115 x:0 0 0 2024-04-23T10:18:04.543 INFO:tasks.workunit.client.0.smithi026.stdout:4/889: dread d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:04.546 INFO:tasks.workunit.client.0.smithi026.stdout:1/760: getdents dd/d15 0 2024-04-23T10:18:04.546 INFO:tasks.workunit.client.0.smithi026.stdout:4/890: symlink d4/d5b/df0/l12b 0 2024-04-23T10:18:04.548 INFO:tasks.workunit.client.0.smithi026.stdout:5/794: mkdir d0/d3c/d5d/dbc/d107/d111/d116 0 2024-04-23T10:18:04.550 INFO:tasks.workunit.client.0.smithi026.stdout:0/979: dwrite d7/d8/d2d/d60/d77/f154 [0,4194304] 0 2024-04-23T10:18:04.553 INFO:tasks.workunit.client.0.smithi026.stdout:5/795: mknod d0/d68/d91/dd6/c117 0 2024-04-23T10:18:04.558 INFO:tasks.workunit.client.0.smithi026.stdout:0/980: symlink d7/d8/d1e/d1d/d115/d13b/l157 0 2024-04-23T10:18:04.560 INFO:tasks.workunit.client.0.smithi026.stdout:0/981: dread - d7/d8/d2d/d60/d62/db2/d126/f147 zero size 2024-04-23T10:18:04.560 INFO:tasks.workunit.client.0.smithi026.stdout:5/796: fsync d0/d68/d91/d9a/fdd 0 2024-04-23T10:18:04.561 INFO:tasks.workunit.client.0.smithi026.stdout:0/982: stat d7/d8/d1e/d57/f13a 0 2024-04-23T10:18:04.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/891: link d4/d14/d30/d52/fb9 d4/d1b/dbf/dda/d6c/d6f/d80/f12c 0 2024-04-23T10:18:04.562 INFO:tasks.workunit.client.0.smithi026.stdout:0/983: chown d7/d8/d2d/d60/d62/d119 16213891 1 2024-04-23T10:18:04.572 INFO:tasks.workunit.client.0.smithi026.stdout:4/892: link d4/d14/f6e d4/d14/f12d 0 2024-04-23T10:18:04.578 INFO:tasks.workunit.client.0.smithi026.stdout:5/797: dwrite d0/d3c/d5d/f113 [0,4194304] 0 2024-04-23T10:18:04.585 INFO:tasks.workunit.client.0.smithi026.stdout:1/761: dread dd/d1a/d23/d69/fce [0,4194304] 0 2024-04-23T10:18:04.589 INFO:tasks.workunit.client.0.smithi026.stdout:5/798: mkdir d0/d3c/d118 0 2024-04-23T10:18:04.591 INFO:tasks.workunit.client.0.smithi026.stdout:4/893: dwrite d4/d22/d4e/d57/fbc [8388608,4194304] 0 2024-04-23T10:18:04.592 INFO:tasks.workunit.client.0.smithi026.stdout:1/762: rmdir dd/d1a/d20/d25/d35/d7f/dd5/dde 39 2024-04-23T10:18:04.594 INFO:tasks.workunit.client.0.smithi026.stdout:0/984: dread d7/d8/d1e/d2a/fd5 [0,4194304] 0 2024-04-23T10:18:04.594 INFO:tasks.workunit.client.0.smithi026.stdout:5/799: truncate d0/d3c/d5d/db2/dc6/df5/fcd 907019 0 2024-04-23T10:18:04.596 INFO:tasks.workunit.client.0.smithi026.stdout:4/894: readlink d4/d5b/d7b/d36/d38/lc6 0 2024-04-23T10:18:04.596 INFO:tasks.workunit.client.0.smithi026.stdout:0/985: chown d7/d8/d2d/d60/d77/l12e 59 1 2024-04-23T10:18:04.597 INFO:tasks.workunit.client.0.smithi026.stdout:1/763: mknod dd/d48/dcf/c108 0 2024-04-23T10:18:04.599 INFO:tasks.workunit.client.0.smithi026.stdout:4/895: creat d4/d22/dd8/de1/f12e x:0 0 0 2024-04-23T10:18:04.599 INFO:tasks.workunit.client.0.smithi026.stdout:4/896: fsync d4/d1b/dbf/dda/fa1 0 2024-04-23T10:18:04.601 INFO:tasks.workunit.client.0.smithi026.stdout:4/897: fdatasync d4/d1b/dbf/dda/d6c/dd7/f122 0 2024-04-23T10:18:04.604 INFO:tasks.workunit.client.0.smithi026.stdout:5/800: link d0/d3c/d5d/db2/dc6/df5/fe3 d0/d3c/d5d/f119 0 2024-04-23T10:18:04.604 INFO:tasks.workunit.client.0.smithi026.stdout:1/764: mknod dd/d1a/d20/d25/d35/d7f/dd5/c109 0 2024-04-23T10:18:04.605 INFO:tasks.workunit.client.0.smithi026.stdout:0/986: write d7/d8/d1e/d2a/f47 [2546832,24678] 0 2024-04-23T10:18:04.605 INFO:tasks.workunit.client.0.smithi026.stdout:5/801: readlink d0/l1c 0 2024-04-23T10:18:04.606 INFO:tasks.workunit.client.0.smithi026.stdout:1/765: read - dd/d48/dab/fca zero size 2024-04-23T10:18:04.610 INFO:tasks.workunit.client.0.smithi026.stdout:4/898: truncate d4/f7e 914258 0 2024-04-23T10:18:04.610 INFO:tasks.workunit.client.0.smithi026.stdout:5/802: rename d0/d3c/cd1 to d0/d68/dcc/c11a 0 2024-04-23T10:18:04.611 INFO:tasks.workunit.client.0.smithi026.stdout:4/899: chown d4/d1b/dbf/dda/d6c/dd7/ff7 3100 1 2024-04-23T10:18:04.612 INFO:tasks.workunit.client.0.smithi026.stdout:1/766: creat dd/d48/dac/f10a x:0 0 0 2024-04-23T10:18:04.612 INFO:tasks.workunit.client.0.smithi026.stdout:4/900: fdatasync d4/d14/d3d/fc8 0 2024-04-23T10:18:04.613 INFO:tasks.workunit.client.0.smithi026.stdout:5/803: symlink d0/d3c/d84/d89/l11b 0 2024-04-23T10:18:04.617 INFO:tasks.workunit.client.0.smithi026.stdout:1/767: unlink dd/d1a/d20/d25/d35/d7f/f8d 0 2024-04-23T10:18:04.619 INFO:tasks.workunit.client.0.smithi026.stdout:0/987: write d7/d8/d1e/d1d/d2f/dd1/fe0 [326494,129450] 0 2024-04-23T10:18:04.621 INFO:tasks.workunit.client.0.smithi026.stdout:1/768: write dd/d1a/d20/d25/d35/d43/d7b/fd4 [2743177,22127] 0 2024-04-23T10:18:04.625 INFO:tasks.workunit.client.0.smithi026.stdout:4/901: unlink d4/d1b/dbf/dda/d6c/d6f/d80/ced 0 2024-04-23T10:18:04.633 INFO:tasks.workunit.client.0.smithi026.stdout:0/988: link d7/d8/d1e/d2a/d6a/d70/f8e d7/d8/d1e/dd3/de7/f158 0 2024-04-23T10:18:04.635 INFO:tasks.workunit.client.0.smithi026.stdout:5/804: dwrite d0/d12/f59 [0,4194304] 0 2024-04-23T10:18:04.636 INFO:tasks.workunit.client.0.smithi026.stdout:4/902: dwrite d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:04.640 INFO:tasks.workunit.client.0.smithi026.stdout:0/989: mknod d7/d8/d1e/d2a/d6a/d70/c159 0 2024-04-23T10:18:04.641 INFO:tasks.workunit.client.0.smithi026.stdout:9/960: sync 2024-04-23T10:18:04.641 INFO:tasks.workunit.client.0.smithi026.stdout:0/990: chown d7/d8/d1e/d1d/d115/c120 2001938 1 2024-04-23T10:18:04.642 INFO:tasks.workunit.client.0.smithi026.stdout:1/769: dread dd/d1a/d20/d25/d35/d74/fb4 [0,4194304] 0 2024-04-23T10:18:04.643 INFO:tasks.workunit.client.0.smithi026.stdout:0/991: chown d7/d8/d1e/l149 77 1 2024-04-23T10:18:04.644 INFO:tasks.workunit.client.0.smithi026.stdout:1/770: fdatasync dd/d1a/d23/d69/d9d/ff2 0 2024-04-23T10:18:04.649 INFO:tasks.workunit.client.0.smithi026.stdout:1/771: dread dd/d1a/d23/d69/fce [0,4194304] 0 2024-04-23T10:18:04.654 INFO:tasks.workunit.client.0.smithi026.stdout:1/772: creat dd/d1a/d23/d3f/d9a/f10b x:0 0 0 2024-04-23T10:18:04.655 INFO:tasks.workunit.client.0.smithi026.stdout:9/961: creat d13/d3b/d68/dd6/d45/d11c/f127 x:0 0 0 2024-04-23T10:18:04.656 INFO:tasks.workunit.client.0.smithi026.stdout:5/805: rmdir d0/d3c/d118 0 2024-04-23T10:18:04.660 INFO:tasks.workunit.client.0.smithi026.stdout:1/773: fdatasync dd/f90 0 2024-04-23T10:18:04.661 INFO:tasks.workunit.client.0.smithi026.stdout:5/806: mknod d0/d3c/d5d/db2/dc6/df5/ddf/c11c 0 2024-04-23T10:18:04.662 INFO:tasks.workunit.client.0.smithi026.stdout:9/962: symlink d13/d3b/d68/dd6/d11e/l128 0 2024-04-23T10:18:04.664 INFO:tasks.workunit.client.0.smithi026.stdout:0/992: dwrite d7/d8/d2d/d60/d62/da2/dd9/fed [0,4194304] 0 2024-04-23T10:18:04.669 INFO:tasks.workunit.client.0.smithi026.stdout:5/807: rename d0/d3c/d5d/dbc/ff4 to d0/d3c/d84/d89/d8d/d8f/f11d 0 2024-04-23T10:18:04.669 INFO:tasks.workunit.client.0.smithi026.stdout:5/808: chown d0/d3c/d84/fab 28 1 2024-04-23T10:18:04.671 INFO:tasks.workunit.client.0.smithi026.stdout:0/993: mknod d7/d8/d1e/d1d/d115/d13b/c15a 0 2024-04-23T10:18:04.674 INFO:tasks.workunit.client.0.smithi026.stdout:5/809: creat d0/d3c/d84/d89/f11e x:0 0 0 2024-04-23T10:18:04.674 INFO:tasks.workunit.client.0.smithi026.stdout:1/774: truncate dd/f2b 2237176 0 2024-04-23T10:18:04.676 INFO:tasks.workunit.client.0.smithi026.stdout:0/994: symlink d7/d8/d1e/d57/l15b 0 2024-04-23T10:18:04.676 INFO:tasks.workunit.client.0.smithi026.stdout:9/963: dwrite d13/d31/f53 [4194304,4194304] 0 2024-04-23T10:18:04.678 INFO:tasks.workunit.client.0.smithi026.stdout:5/810: creat d0/d3c/d84/f11f x:0 0 0 2024-04-23T10:18:04.685 INFO:tasks.workunit.client.0.smithi026.stdout:0/995: creat d7/d8/f15c x:0 0 0 2024-04-23T10:18:04.686 INFO:tasks.workunit.client.0.smithi026.stdout:0/996: chown d7/d8/d2d/d60/d62/f40 0 1 2024-04-23T10:18:04.689 INFO:tasks.workunit.client.0.smithi026.stdout:9/964: rename d13/d36/d66/dc2/cf7 to d13/d3b/d68/dd6/d45/c129 0 2024-04-23T10:18:04.691 INFO:tasks.workunit.client.0.smithi026.stdout:0/997: mknod d7/d8/d1e/d1d/d2f/dd1/c15d 0 2024-04-23T10:18:04.692 INFO:tasks.workunit.client.0.smithi026.stdout:1/775: write dd/d1a/d20/d25/d35/d43/fae [612206,68686] 0 2024-04-23T10:18:04.692 INFO:tasks.workunit.client.0.smithi026.stdout:5/811: write d0/d12/f3f [3830808,94533] 0 2024-04-23T10:18:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.697+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f9e5c158e00 con 0x7f9e5c0b5220 2024-04-23T10:18:04.699 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.697+0000 7f9e4affd640 1 -- 172.21.15.26:0/1779517837 <== mon.1 v2:172.21.15.190:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f9e54018fd0 con 0x7f9e5c0b5220 2024-04-23T10:18:04.700 INFO:tasks.workunit.client.0.smithi026.stdout:1/776: truncate dd/d15/d7d/da1/fa6 522408 0 2024-04-23T10:18:04.700 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:18:04.700 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:18:04.700 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:18:04.702 INFO:tasks.workunit.client.0.smithi026.stdout:5/812: write d0/d3c/d5d/db2/dc6/df5/df6/ffe [204324,65818] 0 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 msgr2=0x7f9e3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 0x7f9e3c06a840 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f9e5c15f250 tx=0x7f9e50007a60 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 msgr2=0x7f9e5c0cc400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f9e5409bd90 tx=0x7f9e5401c210 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 shutdown_connections 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9e3c068380 0x7f9e3c06a840 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9e5c0d1380 0x7f9e5c1ea1f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9e5c0d0fa0 0x7f9e5c1e8aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 --2- 172.21.15.26:0/1779517837 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9e5c0b5220 0x7f9e5c0cc400 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 >> 172.21.15.26:0/1779517837 conn(0x7f9e5c06bad0 msgr2=0x7f9e5c157890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 shutdown_connections 2024-04-23T10:18:04.703 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.701+0000 7f9e60a9a640 1 -- 172.21.15.26:0/1779517837 wait complete. 2024-04-23T10:18:04.705 INFO:tasks.workunit.client.0.smithi026.stdout:0/998: dwrite d7/d8/d1e/d57/f13a [0,4194304] 0 2024-04-23T10:18:04.708 INFO:tasks.workunit.client.0.smithi026.stdout:5/813: mknod d0/d3c/d84/c120 0 2024-04-23T10:18:04.708 INFO:tasks.workunit.client.0.smithi026.stdout:0/999: stat d7/d8/d2d/d60/d62/db9/c13c 0 2024-04-23T10:18:04.710 INFO:tasks.workunit.client.0.smithi026.stdout:9/965: dwrite d13/d1b/d26/d88/dcf/fd8 [0,4194304] 0 2024-04-23T10:18:04.712 INFO:tasks.workunit.client.0.smithi026.stdout:1/777: rename dd/d1a/d20/d25/f38 to dd/d1a/d23/d69/d105/f10c 0 2024-04-23T10:18:04.717 INFO:tasks.workunit.client.0.smithi026.stdout:9/966: symlink d13/d31/d87/l12a 0 2024-04-23T10:18:04.721 INFO:tasks.workunit.client.0.smithi026.stdout:5/814: creat d0/d3c/d5d/f121 x:0 0 0 2024-04-23T10:18:04.733 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 81.6 --await-for 42.0' 2024-04-23T10:18:04.733 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 81.6 --await-for 42.0 2024-04-23T10:18:04.733 INFO:tasks.workunit.client.0.smithi026.stdout:5/815: dwrite d0/d3c/d5d/dbc/fe6 [0,4194304] 0 2024-04-23T10:18:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.889+0000 7ffb26342640 1 Processor -- start 2024-04-23T10:18:04.891 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.889+0000 7ffb26342640 1 -- start start 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb200c87d0 0x7ffb20158860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb200c73e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffb200c7920 con 0x7ffb2014ec60 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7ffb200c8c20 con 0x7ffb200c87d0 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffb200c37a0 con 0x7ffb200c6f50 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb200c87d0 0x7ffb20158860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.893 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7ffb200c87d0 0x7ffb20158860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57032/0 (socket says 172.21.15.26:57032) 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/4027728118 learned_addr learned my addr 172.21.15.26:0/4027728118 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb248df640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb200c73e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/4027728118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 msgr2=0x7ffb200c73e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb200c73e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/4027728118 >> v1:172.21.15.190:6789/0 conn(0x7ffb2014ec60 legacy=0x7ffb200cc4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/4027728118 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb200c8e60 con 0x7ffb200c87d0 2024-04-23T10:18:04.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb248df640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb200c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:04.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200c87d0 0x7ffb20158860 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009870 tx=0x7ffb1401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5c7198ab59f7497f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1effd640 1 -- 172.21.15.26:0/4027728118 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b0070 con 0x7ffb200c87d0 2024-04-23T10:18:04.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1effd640 1 -- 172.21.15.26:0/4027728118 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140ab600 con 0x7ffb200c87d0 2024-04-23T10:18:04.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb1effd640 1 -- 172.21.15.26:0/4027728118 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140ab9d0 con 0x7ffb200c87d0 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 -- 172.21.15.26:0/4027728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200c87d0 msgr2=0x7ffb20158860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.893+0000 7ffb26342640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200c87d0 0x7ffb20158860 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7ffb14009870 tx=0x7ffb1401c520 comp rx=0 tx=0).stop 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/4027728118 shutdown_connections 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb200c73e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 --2- 172.21.15.26:0/4027728118 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb200c87d0 0x7ffb20158860 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/4027728118 >> 172.21.15.26:0/4027728118 conn(0x7ffb2006ec90 msgr2=0x7ffb2006f0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.896 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/4027728118 shutdown_connections 2024-04-23T10:18:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/4027728118 wait complete. 2024-04-23T10:18:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 Processor -- start 2024-04-23T10:18:04.897 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- start start 2024-04-23T10:18:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb2014f780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 0x7ffb2014df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200c5280 con 0x7ffb2014ec60 2024-04-23T10:18:04.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb200c55f0 con 0x7ffb200c87d0 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffb200c3a50 con 0x7ffb200c6f50 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57044/0 (socket says 172.21.15.26:57044) 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 -- 172.21.15.26:0/56151450 learned_addr learned my addr 172.21.15.26:0/56151450 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb2014f780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 0x7ffb2014df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 -- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 msgr2=0x7ffb2014f780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb2014f780 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 -- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 msgr2=0x7ffb2014df20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 0x7ffb2014df20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 -- 172.21.15.26:0/56151450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffb20159c90 con 0x7ffb2014ec60 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 0x7ffb2014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb248df640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800cd50 tx=0x7ffb1800a650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1cff9640 1 -- 172.21.15.26:0/56151450 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800f680 con 0x7ffb2014ec60 2024-04-23T10:18:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1cff9640 1 -- 172.21.15.26:0/56151450 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb1800f840 con 0x7ffb2014ec60 2024-04-23T10:18:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffb2014d470 con 0x7ffb2014ec60 2024-04-23T10:18:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb1cff9640 1 -- 172.21.15.26:0/56151450 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb1800fc30 con 0x7ffb2014ec60 2024-04-23T10:18:04.901 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.897+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffb2014a140 con 0x7ffb2014ec60 2024-04-23T10:18:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1cff9640 1 -- 172.21.15.26:0/56151450 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffb180213f0 con 0x7ffb2014ec60 2024-04-23T10:18:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1cff9640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 0x7ffb0c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1cff9640 1 -- 172.21.15.26:0/56151450 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ffb18087b30 con 0x7ffb2014ec60 2024-04-23T10:18:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 0x7ffb0c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.904 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 Processor -- start 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- start start 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 0x7ffb0c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb10004e30 tx=0x7ffb10009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b31204aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b312053c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558b310ab2a0 con 0x558b311ff600 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558b310115f0 con 0x558b31204fe0 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558b30fac820 con 0x558b312046c0 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57054/0 (socket says 172.21.15.26:57054) 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 -- 172.21.15.26:0/226356505 learned_addr learned my addr 172.21.15.26:0/226356505 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb248df640 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b312053c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 -- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 msgr2=0x558b31204aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b31204aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.905 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 -- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 msgr2=0x558b312053c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b312053c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 -- 172.21.15.26:0/226356505 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b31057c00 con 0x558b311ff600 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb248df640 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b312053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffb100055d0 tx=0x7ffb10011000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=33d23cef8ff4e42f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb05ffb640 1 -- 172.21.15.26:0/226356505 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10025070 con 0x558b311ff600 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb05ffb640 1 -- 172.21.15.26:0/226356505 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10015880 con 0x558b311ff600 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb05ffb640 1 -- 172.21.15.26:0/226356505 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10015c30 con 0x558b311ff600 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- 172.21.15.26:0/226356505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 msgr2=0x558b311ff9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7ffb100055d0 tx=0x7ffb10011000 comp rx=0 tx=0).stop 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- 172.21.15.26:0/226356505 shutdown_connections 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b312053c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b31204aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 --2- 172.21.15.26:0/226356505 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311ff9e0 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.901+0000 7ffb294c4000 1 -- 172.21.15.26:0/226356505 >> 172.21.15.26:0/226356505 conn(0x558b31200470 msgr2=0x558b31202890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- 172.21.15.26:0/226356505 shutdown_connections 2024-04-23T10:18:04.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- 172.21.15.26:0/226356505 wait complete. 2024-04-23T10:18:04.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- start start 2024-04-23T10:18:04.907 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 Processor -- start 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b311fef20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b3120a620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558b30fbcc60 con 0x558b311ff600 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558b31093bf0 con 0x558b31204fe0 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558b310ce560 con 0x558b312046c0 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 10 client.0 _ll_register_callbacks cb 0x558b30fe8570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:04.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57070/0 (socket says 172.21.15.26:57070) 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 -- 172.21.15.26:0/2342944931 learned_addr learned my addr 172.21.15.26:0/2342944931 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b311fef20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 -- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 msgr2=0x558b311fef20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b311fef20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 -- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 msgr2=0x558b3120a620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b3120a620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 -- 172.21.15.26:0/2342944931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b3104c630 con 0x558b311ff600 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x558b31017ac0 tx=0x7ffb10003700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b202ca62e26270c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb10025040 con 0x558b311ff600 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb10015880 con 0x558b311ff600 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ffb10015af0 con 0x558b311ff600 2024-04-23T10:18:04.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffb10032050 con 0x558b311ff600 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 10 client.5424 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558b30fb1490 con 0x558b311ff600 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb10015880 con 0x558b311ff600 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ffb10035020 con 0x558b311ff600 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 10 client.5424 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 10 client.5424 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 20 client.5424 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b3120b3c0 0x558b3120b7d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 4 client.5424 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x558b30fab7f0 con 0x558b3120b3c0 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b3120b3c0 0x558b3120b7d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffafeffd640 10 client.5424 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.905+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b3120b3c0 0x558b3120b7d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=28bf56d0b0bc76dd server_cookie=8db63e7938a856e1 in_seq=0 out_seq=0 2024-04-23T10:18:04.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffafeffd640 1 -- 172.21.15.26:0/2342944931 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x558b30fab7f0 con 0x558b3120b3c0 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffafeffd640 10 client.5424 handle_command_reply: tid=0 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 client.5424 shutdown 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 msgr2=0x558b311fe9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x558b31017ac0 tx=0x7ffb10003700 comp rx=0 tx=0).stop 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 shutdown_connections 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b3120b3c0 0x558b3120b7d0 crc :-1 s=READY pgs=78 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b31204fe0 0x558b3120a620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b312046c0 0x558b311fef20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffafeffd640 0 client.5424 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 --2- 172.21.15.26:0/2342944931 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b311ff600 0x558b311fe9e0 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 >> 172.21.15.26:0/2342944931 conn(0x558b31200470 msgr2=0x558b312036b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 shutdown_connections 2024-04-23T10:18:04.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 1 -- 172.21.15.26:0/2342944931 wait complete. 2024-04-23T10:18:04.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.909+0000 7ffb294c4000 20 client.5424 trim_cache size 0 max 16384 2024-04-23T10:18:04.914 INFO:tasks.workunit.client.0.smithi026.stdout:2/788: sync 2024-04-23T10:18:04.914 INFO:tasks.workunit.client.0.smithi026.stdout:1/778: rename dd/d15/d7d/cc7 to dd/d1a/d23/d3f/c10d 0 2024-04-23T10:18:04.918 INFO:tasks.workunit.client.0.smithi026.stdout:2/789: unlink d3/dd/d4b/c6f 0 2024-04-23T10:18:04.922 INFO:tasks.workunit.client.0.smithi026.stdout:1/779: stat dd/d1a/d20/d25/d35/d43/fae 0 2024-04-23T10:18:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 Processor -- start 2024-04-23T10:18:04.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 -- start start 2024-04-23T10:18:04.927 INFO:tasks.workunit.client.0.smithi026.stdout:9/967: rename d13/d1b/d26/lbc to d13/d3b/d68/dd6/d45/d3a/l12b 0 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b3120a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31209920 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201ff650 con 0x558b312046c0 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffb201ffd20 con 0x558b311ff600 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffb201425b0 con 0x558b31204fe0 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57076/0 (socket says 172.21.15.26:57076) 2024-04-23T10:18:04.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/395647315 learned_addr learned my addr 172.21.15.26:0/395647315 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.925+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b3120a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb248df640 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31209920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 msgr2=0x558b31209920 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31209920 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 msgr2=0x558b3120a6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b3120a6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/395647315 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558b30faca70 con 0x558b312046c0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401abd0 tx=0x7ffb14008040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=413f44453c3a5478 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb057fa640 1 -- 172.21.15.26:0/395647315 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b0040 con 0x558b312046c0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb057fa640 1 -- 172.21.15.26:0/395647315 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140bbe50 con 0x558b312046c0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb057fa640 1 -- 172.21.15.26:0/395647315 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140abb80 con 0x558b312046c0 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/395647315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 msgr2=0x558b312093e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401abd0 tx=0x7ffb14008040 comp rx=0 tx=0).stop 2024-04-23T10:18:04.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/395647315 shutdown_connections 2024-04-23T10:18:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31209920 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b312093e0 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- 172.21.15.26:0/395647315 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b3120a6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/395647315 >> 172.21.15.26:0/395647315 conn(0x558b31200470 msgr2=0x558b31203730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:04.931 INFO:tasks.workunit.client.0.smithi026.stdout:1/780: unlink dd/fc2 0 2024-04-23T10:18:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/395647315 shutdown_connections 2024-04-23T10:18:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/395647315 wait complete. 2024-04-23T10:18:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- start start 2024-04-23T10:18:04.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 Processor -- start 2024-04-23T10:18:04.932 INFO:tasks.workunit.client.0.smithi026.stdout:2/790: creat d3/dd/f10c x:0 0 0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b31277120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31277df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x558b31010900 con 0x558b312046c0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x558b30fdbe60 con 0x558b311ff600 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x558b31015c20 con 0x558b31204fe0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 10 client.0 _ll_register_callbacks cb 0x7ffb10023070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:57082/0 (socket says 172.21.15.26:57082) 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/366295175 learned_addr learned my addr 172.21.15.26:0/366295175 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b31277120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb248df640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31277df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 msgr2=0x558b31277df0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31277df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 msgr2=0x558b31277120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b31277120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 -- 172.21.15.26:0/366295175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558b31094080 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b31277120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb1f7fe640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401ca00 tx=0x7ffb1401ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c58522de39570944 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffafeffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffb140b0050 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ffb140ab800 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ffb140bbe50 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ffb140aba20 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 10 client.5430 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.929+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x558b30fb73e0 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb140bbe50 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ffb140abbc0 con 0x558b312046c0 2024-04-23T10:18:04.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 10 client.5430 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 10 client.5430 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 20 client.5430 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b31278750 0x558b31278b30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 4 client.5430 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.6, "await_for": 42.0}] 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.6, "await_for": 42.0}) -- 0x558b30fba940 con 0x558b31278750 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b31278750 0x558b31278b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:04.937 INFO:tasks.workunit.client.0.smithi026.stdout:9/968: rename d13/d3b/d5b/f90 to d13/d36/d66/dc2/dc3/f12c 0 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffafeffd640 10 client.5430 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:04.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:04.933+0000 7ffb1ffff640 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b31278750 0x558b31278b30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=db7f4d579763d514 server_cookie=178a26507f8a9e91 in_seq=0 out_seq=0 2024-04-23T10:18:04.940 INFO:tasks.workunit.client.0.smithi026.stdout:9/969: dwrite d13/d1b/d26/d88/dcf/dd1/f10e [0,4194304] 0 2024-04-23T10:18:04.945 INFO:tasks.workunit.client.0.smithi026.stdout:9/970: symlink d13/d36/d66/dbf/l12d 0 2024-04-23T10:18:04.946 INFO:tasks.workunit.client.0.smithi026.stdout:2/791: link d3/d19/d21/d23/d3a/d65/lf8 d3/d19/d31/d83/l10d 0 2024-04-23T10:18:04.956 INFO:tasks.workunit.client.0.smithi026.stdout:1/781: write dd/d1a/d23/d3f/f87 [547961,128825] 0 2024-04-23T10:18:05.010 INFO:tasks.workunit.client.0.smithi026.stdout:8/962: sync 2024-04-23T10:18:05.057 INFO:tasks.workunit.client.0.smithi026.stdout:9/971: mknod d13/d3b/d68/dd6/d45/c12e 0 2024-04-23T10:18:05.219 INFO:tasks.workunit.client.0.smithi026.stdout:6/959: sync 2024-04-23T10:18:05.310 INFO:tasks.workunit.client.0.smithi026.stdout:3/853: sync 2024-04-23T10:18:05.392 INFO:tasks.workunit.client.0.smithi026.stdout:4/903: sync 2024-04-23T10:18:05.393 INFO:tasks.workunit.client.0.smithi026.stdout:5/816: sync 2024-04-23T10:18:05.393 INFO:tasks.workunit.client.0.smithi026.stdout:7/745: sync 2024-04-23T10:18:06.355 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:06.358 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:06.677 INFO:tasks.workunit.client.0.smithi026.stdout:2/792: link d3/d19/d21/d23/d3a/d3c/d80/d96/cd7 d3/d19/d21/dc6/c10e 0 2024-04-23T10:18:07.926 INFO:tasks.workunit.client.0.smithi026.stdout:5/817: readlink d0/la 0 2024-04-23T10:18:07.927 INFO:tasks.workunit.client.0.smithi026.stdout:4/904: stat d4/d1b 0 2024-04-23T10:18:08.063 INFO:tasks.workunit.client.0.smithi026.stdout:9/972: dread d13/d19/f4d [0,4194304] 0 2024-04-23T10:18:08.319 INFO:tasks.workunit.client.0.smithi026.stdout:1/782: dread dd/d1a/d20/f4d [0,4194304] 0 2024-04-23T10:18:08.698 INFO:tasks.workunit.client.0.smithi026.stdout:2/793: dread d3/d19/d21/d23/fc1 [0,4194304] 0 2024-04-23T10:18:08.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/963: chown d5/d115/d22/d65/d78/dc9/lc0 549746 1 2024-04-23T10:18:08.837 INFO:tasks.workunit.client.0.smithi026.stdout:2/794: getdents d3/dd/def 0 2024-04-23T10:18:08.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffafeffd640 1 -- 172.21.15.26:0/366295175 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x558b30fba940 con 0x558b31278750 2024-04-23T10:18:08.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffafeffd640 10 client.5430 handle_command_reply: tid=0 2024-04-23T10:18:08.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 client.5430 shutdown 2024-04-23T10:18:08.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 msgr2=0x558b31277660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:08.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7ffb1401ca00 tx=0x7ffb1401ad60 comp rx=0 tx=0).stop 2024-04-23T10:18:08.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 shutdown_connections 2024-04-23T10:18:08.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x558b31278750 0x558b31278b30 crc :-1 s=READY pgs=79 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x558b31204fe0 0x558b31277df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x558b312046c0 0x558b31277660 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 --2- 172.21.15.26:0/366295175 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x558b311ff600 0x558b31277120 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffafeffd640 0 client.5430 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.845+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 >> 172.21.15.26:0/366295175 conn(0x558b31200470 msgr2=0x558b3121f8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 shutdown_connections 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb294c4000 1 -- 172.21.15.26:0/366295175 wait complete. 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb294c4000 20 client.5430 trim_cache size 0 max 16384 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:18:08.849 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 18, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "721a18f4": { 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 18, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 81.6, 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:18:08.850 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:08.851 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 msgr2=0x7ffb0c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 0x7ffb0c06a840 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7ffb10004e30 tx=0x7ffb10009040 comp rx=0 tx=0).stop 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 msgr2=0x7ffb201f4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 crypto rx=0x7ffb1800cd50 tx=0x7ffb1800a650 comp rx=0 tx=0).stop 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 shutdown_connections 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffb0c068380 0x7ffb0c06a840 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffb2014ec60 0x7ffb201f4f20 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffb200c87d0 0x7ffb2014df20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 --2- 172.21.15.26:0/56151450 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffb200c6f50 0x7ffb2014f780 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 >> 172.21.15.26:0/56151450 conn(0x7ffb2006ec90 msgr2=0x7ffb200cc650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 shutdown_connections 2024-04-23T10:18:08.853 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:08.849+0000 7ffb26342640 1 -- 172.21.15.26:0/56151450 wait complete. 2024-04-23T10:18:08.876 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '721a18f4', quiesce took 4.8 seconds. Will release after: 21.6 2024-04-23T10:18:30.477 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:18:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.609+0000 7fd45177e640 1 Processor -- start 2024-04-23T10:18:30.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd45177e640 1 -- start start 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd45177e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c06e970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd45177e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c0c2480 con 0x7fd44c073fd0 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd45177e640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd44c15e590 con 0x7fd44c0c2000 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd45177e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c0c2700 con 0x7fd44c0c7a50 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd44c073fd0 0x7fd44c15c3f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:43690/0 (socket says 172.21.15.26:43690) 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44affd640 1 -- 172.21.15.26:0/470466039 learned_addr learned my addr 172.21.15.26:0/470466039 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd443fff640 1 --2- 172.21.15.26:0/470466039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c06e970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1558406289 0 0) 0x7fd43c001120 con 0x7fd44c073fd0 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd438003530 con 0x7fd44c073fd0 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3618439473 0 0) 0x7fd44c15e590 con 0x7fd44c0c2000 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd43c001120 con 0x7fd44c0c2000 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 373539933 0 0) 0x7fd438003530 con 0x7fd44c073fd0 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd443fff640 1 -- 172.21.15.26:0/470466039 >> v1:172.21.15.190:6789/0 conn(0x7fd44c0c2000 legacy=0x7fd44c0cd3e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd443fff640 1 -- 172.21.15.26:0/470466039 >> v1:172.21.15.26:6789/0 conn(0x7fd44c073fd0 legacy=0x7fd44c15c3f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.613+0000 7fd443fff640 1 -- 172.21.15.26:0/470466039 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c15e830 con 0x7fd44c0c7a50 2024-04-23T10:18:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd443fff640 1 --2- 172.21.15.26:0/470466039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c06e970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4340097f0 tx=0x7fd43401ebf0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=29b07fe15e7609bf server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4340b5070 con 0x7fd44c0c7a50 2024-04-23T10:18:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4340a8670 con 0x7fd44c0c7a50 2024-04-23T10:18:30.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44a7fc640 1 -- 172.21.15.26:0/470466039 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c001850 con 0x7fd44c0c7a50 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- 172.21.15.26:0/470466039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 msgr2=0x7fd44c06e970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 --2- 172.21.15.26:0/470466039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c06e970 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7fd4340097f0 tx=0x7fd43401ebf0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- 172.21.15.26:0/470466039 shutdown_connections 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 --2- 172.21.15.26:0/470466039 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c06e970 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- 172.21.15.26:0/470466039 >> 172.21.15.26:0/470466039 conn(0x7fd44c06bdd0 msgr2=0x7fd44c06c1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- 172.21.15.26:0/470466039 shutdown_connections 2024-04-23T10:18:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- 172.21.15.26:0/470466039 wait complete. 2024-04-23T10:18:30.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 Processor -- start 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- start start 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd44c0c2000 0x7fd44c15d6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c14abb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c0c29e0 con 0x7fd44c073fd0 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd44c15edf0 con 0x7fd44c0c2000 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd45177e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd44c0c2b60 con 0x7fd44c0c7a50 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48098/0 (socket says 172.21.15.26:48098) 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd44affd640 1 -- 172.21.15.26:0/3010646575 learned_addr learned my addr 172.21.15.26:0/3010646575 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:30.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.617+0000 7fd443fff640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd44c0c2000 0x7fd44c15d6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44b7fe640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c14abb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 -- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 msgr2=0x7fd44c14abb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c14abb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 -- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd44c0c2000 msgr2=0x7fd44c15d6b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd44c0c2000 0x7fd44c15d6b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 -- 172.21.15.26:0/3010646575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd44c1f0890 con 0x7fd44c073fd0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd44affd640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00cb00 tx=0x7fd43c0018c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c005cf0 con 0x7fd44c073fd0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd43c007070 con 0x7fd44c073fd0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd43c007460 con 0x7fd44c073fd0 2024-04-23T10:18:30.622 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd44c1f0b70 con 0x7fd44c073fd0 2024-04-23T10:18:30.623 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd44c1f1130 con 0x7fd44c073fd0 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd44c075df0 con 0x7fd44c073fd0 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd43c007600 con 0x7fd44c073fd0 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 0x7fd42c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd43c086dd0 con 0x7fd44c073fd0 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.621+0000 7fd443fff640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 0x7fd42c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.625+0000 7fd443fff640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 0x7fd42c06a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4340b2000 tx=0x7fd434008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.625+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd44c0c2480 con 0x7fd44c073fd0 2024-04-23T10:18:30.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.825+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fd44c14e7a0 con 0x7fd44c073fd0 2024-04-23T10:18:30.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.825+0000 7fd4437fe640 1 -- 172.21.15.26:0/3010646575 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7fd43c056f60 con 0x7fd44c073fd0 2024-04-23T10:18:30.828 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:18:30.828 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:18:30.828 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 msgr2=0x7fd42c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 0x7fd42c06a870 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fd4340b2000 tx=0x7fd434008040 comp rx=0 tx=0).stop 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 msgr2=0x7fd44c0ca370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7fd43c00cb00 tx=0x7fd43c0018c0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 shutdown_connections 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd42c0683b0 0x7fd42c06a870 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.830 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd44c0c7a50 0x7fd44c14abb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd44c0c2000 0x7fd44c15d6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 --2- 172.21.15.26:0/3010646575 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd44c073fd0 0x7fd44c0ca370 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 >> 172.21.15.26:0/3010646575 conn(0x7fd44c06bdd0 msgr2=0x7fd44c0cade0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 shutdown_connections 2024-04-23T10:18:30.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.829+0000 7fd45177e640 1 -- 172.21.15.26:0/3010646575 wait complete. 2024-04-23T10:18:30.847 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id 721a18f4 --release --await' 2024-04-23T10:18:30.847 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id 721a18f4 --release --await 2024-04-23T10:18:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 Processor -- start 2024-04-23T10:18:30.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 -- start start 2024-04-23T10:18:30.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 0x7fc64c158950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc64c0c6030 0x7fc64c0c6480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc64c0c69c0 con 0x7fc64c152240 2024-04-23T10:18:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc64c158e90 con 0x7fc64c0c6030 2024-04-23T10:18:30.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.981+0000 7fc651d12640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c152620 con 0x7fc64c0c8640 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 0x7fc64c158950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc64c0c6030 0x7fc64c0c6480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64affd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 0x7fc64c158950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:52842/0 (socket says 172.21.15.26:52842) 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64affd640 1 -- 172.21.15.26:0/2035936557 learned_addr learned my addr 172.21.15.26:0/2035936557 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 -- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 msgr2=0x7fc64c158950 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 --2- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 0x7fc64c158950 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 -- 172.21.15.26:0/2035936557 >> v1:172.21.15.190:6789/0 conn(0x7fc64c152240 legacy=0x7fc64c0cd640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 -- 172.21.15.26:0/2035936557 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c0c8ae0 con 0x7fc64c0c6030 2024-04-23T10:18:30.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64bfff640 1 --2- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c0c6480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6440097c0 tx=0x7fc64401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=9a544392baf22b57 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64a7fc640 1 -- 172.21.15.26:0/2035936557 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6440b5070 con 0x7fc64c0c6030 2024-04-23T10:18:30.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64a7fc640 1 -- 172.21.15.26:0/2035936557 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6440a8990 con 0x7fc64c0c6030 2024-04-23T10:18:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.985+0000 7fc64a7fc640 1 -- 172.21.15.26:0/2035936557 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc6440a8d60 con 0x7fc64c0c6030 2024-04-23T10:18:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 msgr2=0x7fc64c0c6480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c0c6480 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fc6440097c0 tx=0x7fc64401ec90 comp rx=0 tx=0).stop 2024-04-23T10:18:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/2035936557 shutdown_connections 2024-04-23T10:18:30.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c0c6480 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- 172.21.15.26:0/2035936557 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c0c8640 0x7fc64c158950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/2035936557 >> 172.21.15.26:0/2035936557 conn(0x7fc64c06fca0 msgr2=0x7fc64c0700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/2035936557 shutdown_connections 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/2035936557 wait complete. 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 Processor -- start 2024-04-23T10:18:30.989 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- start start 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c151510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c152240 0x7fc64c14b420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c15ba40 con 0x7fc64c0c8640 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c15b760 con 0x7fc64c0c6030 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c15bd20 con 0x7fc64c152240 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.991 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48102/0 (socket says 172.21.15.26:48102) 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 -- 172.21.15.26:0/3836590783 learned_addr learned my addr 172.21.15.26:0/3836590783 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c151510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64bfff640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c152240 0x7fc64c14b420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 -- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c152240 msgr2=0x7fc64c14b420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c152240 0x7fc64c14b420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 -- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 msgr2=0x7fc64c151510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c151510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 -- 172.21.15.26:0/3836590783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc64c1f1350 con 0x7fc64c0c8640 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc64affd640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc64000e8c0 tx=0x7fc64000ed80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc633fff640 1 -- 172.21.15.26:0/3836590783 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc640017070 con 0x7fc64c0c8640 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc633fff640 1 -- 172.21.15.26:0/3836590783 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc64000c940 con 0x7fc64c0c8640 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc64c1f1630 con 0x7fc64c0c8640 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc633fff640 1 -- 172.21.15.26:0/3836590783 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64000cd30 con 0x7fc64c0c8640 2024-04-23T10:18:30.992 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.989+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc64c1f1bf0 con 0x7fc64c0c8640 2024-04-23T10:18:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc633fff640 1 -- 172.21.15.26:0/3836590783 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc64001a070 con 0x7fc64c0c8640 2024-04-23T10:18:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc633fff640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 0x7fc63806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.993 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc633fff640 1 -- 172.21.15.26:0/3836590783 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc640087000 con 0x7fc64c0c8640 2024-04-23T10:18:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 0x7fc63806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 Processor -- start 2024-04-23T10:18:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 -- start start 2024-04-23T10:18:30.994 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 0x7fc63806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc63c001e00 tx=0x7fc63c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2800bf00 0x556d2800c2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d28047120 0x556d28047500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x556d27e53660 con 0x556d280428a0 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556d27df85d0 con 0x556d2800bf00 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556d27e4f620 con 0x556d28047120 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48118/0 (socket says 172.21.15.26:48118) 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64b7fe640 1 -- 172.21.15.26:0/452298002 learned_addr learned my addr 172.21.15.26:0/452298002 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64bfff640 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d28047120 0x556d28047500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.997 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.993+0000 7fc64affd640 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2800bf00 0x556d2800c2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 -- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d28047120 msgr2=0x556d28047500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d28047120 0x556d28047500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 -- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2800bf00 msgr2=0x556d2800c2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2800bf00 0x556d2800c2e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 -- 172.21.15.26:0/452298002 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d27e2cbd0 con 0x556d280428a0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc63c007f50 tx=0x7fc63c012000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41391da814b0d410 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc6317fa640 1 -- 172.21.15.26:0/452298002 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c0077c0 con 0x556d280428a0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc6317fa640 1 -- 172.21.15.26:0/452298002 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c007960 con 0x556d280428a0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc6317fa640 1 -- 172.21.15.26:0/452298002 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c021650 con 0x556d280428a0 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/452298002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 msgr2=0x556d2800b9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7fc63c007f50 tx=0x7fc63c012000 comp rx=0 tx=0).stop 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/452298002 shutdown_connections 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d28047120 0x556d28047500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d2800bf00 0x556d2800c2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- 172.21.15.26:0/452298002 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d2800b9c0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/452298002 >> 172.21.15.26:0/452298002 conn(0x556d27eedb00 msgr2=0x556d28044ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/452298002 shutdown_connections 2024-04-23T10:18:30.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/452298002 wait complete. 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- start start 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 Processor -- start 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 0x556d28041650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d28006900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x556d27f10d40 con 0x556d280428a0 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556d27e0deb0 con 0x556d28047120 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556d27e4e2a0 con 0x556d2800bf00 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 10 client.0 _ll_register_callbacks cb 0x556d27ff1a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48130/0 (socket says 172.21.15.26:48130) 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 -- 172.21.15.26:0/39017934 learned_addr learned my addr 172.21.15.26:0/39017934 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 0x556d28041650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64bfff640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d28006900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.005 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 -- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 msgr2=0x556d28041650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 0x556d28041650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 -- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 msgr2=0x556d28006900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d28006900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 -- 172.21.15.26:0/39017934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d27e99b30 con 0x556d280428a0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 0x556d28041650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc64affd640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc640056ae0 tx=0x7fc640056780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8eea370ea9e2b3d4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc64006f020 con 0x556d280428a0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc64005d2b0 con 0x556d280428a0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x556d27ded060 con 0x556d280428a0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc640021040 con 0x556d280428a0 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 10 client.5445 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:31.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556d27df2b70 con 0x556d280428a0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x556d27ded060 con 0x556d280428a0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fc6400753a0 con 0x556d280428a0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 10 client.5445 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 10 client.5445 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 20 client.5445 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d280076a0 0x556d28007a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 4 client.5445 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:30.997+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x556d27e2be30 con 0x556d280076a0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d280076a0 0x556d28007a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc62a7fc640 10 client.5445 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d280076a0 0x556d28007a80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=f26cb153b22c443 server_cookie=5b894aaf36e8c9b9 in_seq=0 out_seq=0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc62a7fc640 1 -- 172.21.15.26:0/39017934 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x556d27e2be30 con 0x556d280076a0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc62a7fc640 10 client.5445 handle_command_reply: tid=0 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 client.5445 shutdown 2024-04-23T10:18:31.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 msgr2=0x556d28041b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7fc640056ae0 tx=0x7fc640056780 comp rx=0 tx=0).stop 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 shutdown_connections 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d280076a0 0x556d28007a80 crc :-1 s=READY pgs=88 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d28006900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d280428a0 0x556d28041b90 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 --2- 172.21.15.26:0/39017934 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d2800bf00 0x556d28041650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc62a7fc640 0 client.5445 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 >> 172.21.15.26:0/39017934 conn(0x556d27eedb00 msgr2=0x556d280469a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 shutdown_connections 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 1 -- 172.21.15.26:0/39017934 wait complete. 2024-04-23T10:18:31.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.001+0000 7fc654e94000 20 client.5445 trim_cache size 0 max 16384 2024-04-23T10:18:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 Processor -- start 2024-04-23T10:18:31.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- start start 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d2800a860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805db10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c1fead0 con 0x556d2800bf00 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc64c1ff1a0 con 0x556d28047120 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc64c1fd3d0 con 0x556d280428a0 2024-04-23T10:18:31.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48140/0 (socket says 172.21.15.26:48140) 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 -- 172.21.15.26:0/2271656755 learned_addr learned my addr 172.21.15.26:0/2271656755 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64affd640 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d2800a860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 -- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 msgr2=0x556d2800a860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64bfff640 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805db10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d2800a860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 -- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 msgr2=0x556d2805db10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805db10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 -- 172.21.15.26:0/2271656755 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556d27ed55e0 con 0x556d2800bf00 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00f660 tx=0x7fc63c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f1143ee10c1726f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc630ff9640 1 -- 172.21.15.26:0/2271656755 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c02f420 con 0x556d2800bf00 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc630ff9640 1 -- 172.21.15.26:0/2271656755 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c02f5c0 con 0x556d2800bf00 2024-04-23T10:18:31.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc630ff9640 1 -- 172.21.15.26:0/2271656755 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c021450 con 0x556d2800bf00 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- 172.21.15.26:0/2271656755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 msgr2=0x556d2800a320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7fc63c00f660 tx=0x7fc63c013000 comp rx=0 tx=0).stop 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- 172.21.15.26:0/2271656755 shutdown_connections 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805db10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d2800a860 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- 172.21.15.26:0/2271656755 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d2800a320 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- 172.21.15.26:0/2271656755 >> 172.21.15.26:0/2271656755 conn(0x556d27eedb00 msgr2=0x556d28042080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- 172.21.15.26:0/2271656755 shutdown_connections 2024-04-23T10:18:31.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- 172.21.15.26:0/2271656755 wait complete. 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- start start 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 Processor -- start 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d280b5460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805fe30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x556d27e52970 con 0x556d2800bf00 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x556d27e088f0 con 0x556d28047120 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x556d27e57c90 con 0x556d280428a0 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc654e94000 10 client.0 _ll_register_callbacks cb 0x7fc6440b3070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:31.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48146/0 (socket says 172.21.15.26:48146) 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.021+0000 7fc64b7fe640 1 -- 172.21.15.26:0/1647308971 learned_addr learned my addr 172.21.15.26:0/1647308971 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64affd640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d280b5460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64bfff640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805fe30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 -- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 msgr2=0x556d280b5460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d280b5460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 -- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 msgr2=0x556d2805fe30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805fe30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 -- 172.21.15.26:0/1647308971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556d27de5ae0 con 0x556d2800bf00 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64affd640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d280b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64b7fe640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006fd0 tx=0x7fc63c001260 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90c32d8f38bdb85e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc63c007a20 con 0x556d2800bf00 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc63c034070 con 0x556d2800bf00 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fc63c02f5c0 con 0x556d2800bf00 2024-04-23T10:18:31.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fc63c044050 con 0x556d2800bf00 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 10 client.5451 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x556d27de8d80 con 0x556d2800bf00 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc63c02f5c0 con 0x556d2800bf00 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fc63c047020 con 0x556d2800bf00 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 10 client.5451 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 10 client.5451 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 20 client.5451 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d28060850 0x556d28060c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 4 client.5451 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "721a18f4", "release": true, "await": true}] 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "721a18f4", "release": true, "await": true}) -- 0x556d27df10d0 con 0x556d28060850 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64affd640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d28060850 0x556d28060c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc62a7fc640 10 client.5451 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:31.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.025+0000 7fc64affd640 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d28060850 0x556d28060c60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=4b638365b7023fc4 server_cookie=8f9c645b0a91f228 in_seq=0 out_seq=0 2024-04-23T10:18:31.554 INFO:tasks.workunit.client.0.smithi026.stdout:9/973: mkdir d13/d1b/d12f 0 2024-04-23T10:18:31.555 INFO:tasks.workunit.client.0.smithi026.stdout:1/783: rmdir dd/d15/d7d 39 2024-04-23T10:18:31.580 INFO:tasks.workunit.client.0.smithi026.stdout:3/854: rename d0/d1e/d30/d43/d6c/d79/d73/d99/ce4 to d0/d1e/d23/d52/c121 0 2024-04-23T10:18:31.618 INFO:tasks.workunit.client.0.smithi026.stdout:2/795: mknod d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/de9/c10f 0 2024-04-23T10:18:31.620 INFO:tasks.workunit.client.0.smithi026.stdout:4/905: symlink d4/d22/dd8/de1/l12f 0 2024-04-23T10:18:31.623 INFO:tasks.workunit.client.0.smithi026.stdout:7/746: unlink dd/d6c/dc6/fba 0 2024-04-23T10:18:31.626 INFO:tasks.workunit.client.0.smithi026.stdout:8/964: symlink d5/d50/d9a/d129/l142 0 2024-04-23T10:18:31.636 INFO:tasks.workunit.client.0.smithi026.stdout:5/818: creat d0/d12/dfb/d10b/f122 x:0 0 0 2024-04-23T10:18:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.637+0000 7fc62a7fc640 1 -- 172.21.15.26:0/1647308971 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x556d27df10d0 con 0x556d28060850 2024-04-23T10:18:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.637+0000 7fc62a7fc640 10 client.5451 handle_command_reply: tid=0 2024-04-23T10:18:31.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 client.5451 shutdown 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 msgr2=0x556d280b4f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7fc63c006fd0 tx=0x7fc63c001260 comp rx=0 tx=0).stop 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 shutdown_connections 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x556d28060850 0x556d28060c60 crc :-1 s=READY pgs=89 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x556d28047120 0x556d2805fe30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x556d280428a0 0x556d280b5460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 --2- 172.21.15.26:0/1647308971 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x556d2800bf00 0x556d280b4f20 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 >> 172.21.15.26:0/1647308971 conn(0x556d27eedb00 msgr2=0x556d28062d70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc62a7fc640 0 client.5451 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 shutdown_connections 2024-04-23T10:18:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 1 -- 172.21.15.26:0/1647308971 wait complete. 2024-04-23T10:18:31.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc654e94000 20 client.5451 trim_cache size 0 max 16384 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 20, 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "721a18f4": { 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 20, 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:18:31.643 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 81.6, 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:31.644 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 msgr2=0x7fc63806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 0x7fc63806a870 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7fc63c001e00 tx=0x7fc63c009040 comp rx=0 tx=0).stop 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 msgr2=0x7fc64c1481a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 crypto rx=0x7fc64000e8c0 tx=0x7fc64000ed80 comp rx=0 tx=0).stop 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 shutdown_connections 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc6380683b0 0x7fc63806a870 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc64c152240 0x7fc64c14b420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc64c0c8640 0x7fc64c1481a0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 --2- 172.21.15.26:0/3836590783 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc64c0c6030 0x7fc64c151510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.641+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 >> 172.21.15.26:0/3836590783 conn(0x7fc64c06fca0 msgr2=0x7fc64c06b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.646 INFO:tasks.workunit.client.0.smithi026.stdout:6/960: dwrite d6/d21/d58/f11c [0,4194304] 0 2024-04-23T10:18:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.645+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 shutdown_connections 2024-04-23T10:18:31.646 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.645+0000 7fc651d12640 1 -- 172.21.15.26:0/3836590783 wait complete. 2024-04-23T10:18:31.667 INFO:tasks.workunit.client.0.smithi026.stdout:7/747: rmdir dd/dc1 0 2024-04-23T10:18:31.673 INFO:tasks.workunit.client.0.smithi026.stdout:3/855: write d0/d1e/d30/d43/f3b [1981376,96172] 0 2024-04-23T10:18:31.680 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '721a18f4', seconds elapsed: 27.6 2024-04-23T10:18:31.680 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 21.6 2024-04-23T10:18:31.680 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:18:31.680 INFO:tasks.workunit.client.0.smithi026.stdout:1/784: rmdir dd/d1a/d20/d25/d35/d7f 39 2024-04-23T10:18:31.686 INFO:tasks.workunit.client.0.smithi026.stdout:3/856: mkdir d0/d1e/d30/d43/d122 0 2024-04-23T10:18:31.688 INFO:tasks.workunit.client.0.smithi026.stdout:2/796: dread - d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/f102 zero size 2024-04-23T10:18:31.690 INFO:tasks.workunit.client.0.smithi026.stdout:6/961: fdatasync d6/d13/dcf/f118 0 2024-04-23T10:18:31.696 INFO:tasks.workunit.client.0.smithi026.stdout:4/906: getdents d4/d1b/da0/d117 0 2024-04-23T10:18:31.705 INFO:tasks.workunit.client.0.smithi026.stdout:2/797: write d3/d19/d21/d23/d3a/d3c/f6e [471261,1761] 0 2024-04-23T10:18:31.708 INFO:tasks.workunit.client.0.smithi026.stdout:5/819: symlink d0/d3c/d5d/dbc/d107/d111/l123 0 2024-04-23T10:18:31.712 INFO:tasks.workunit.client.0.smithi026.stdout:6/962: fsync d6/d33/d10e/f11b 0 2024-04-23T10:18:31.714 INFO:tasks.workunit.client.0.smithi026.stdout:1/785: creat dd/d15/d7d/da1/f10e x:0 0 0 2024-04-23T10:18:31.717 INFO:tasks.workunit.client.0.smithi026.stdout:7/748: rename dd/d2c/d48/d7e/fa9 to dd/d3f/fe0 0 2024-04-23T10:18:31.719 INFO:tasks.workunit.client.0.smithi026.stdout:3/857: getdents d0/d1e/d30/d43/df/d17 0 2024-04-23T10:18:31.720 INFO:tasks.workunit.client.0.smithi026.stdout:5/820: creat d0/d3c/d5d/dbc/f124 x:0 0 0 2024-04-23T10:18:31.724 INFO:tasks.workunit.client.0.smithi026.stdout:1/786: creat dd/deb/f10f x:0 0 0 2024-04-23T10:18:31.724 INFO:tasks.workunit.client.0.smithi026.stdout:7/749: read dd/d2c/f70 [303402,119861] 0 2024-04-23T10:18:31.725 INFO:tasks.workunit.client.0.smithi026.stdout:5/821: mknod d0/d3c/d84/c125 0 2024-04-23T10:18:31.725 INFO:tasks.workunit.client.0.smithi026.stdout:4/907: truncate d4/d14/d30/da2/d10c/f2d 516966 0 2024-04-23T10:18:31.733 INFO:tasks.workunit.client.0.smithi026.stdout:6/963: rename d6/d33/f67 to d6/d21/d2f/d32/d87/d8e/f129 0 2024-04-23T10:18:31.735 INFO:tasks.workunit.client.0.smithi026.stdout:1/787: truncate dd/d15/d7d/d98/f9b 889560 0 2024-04-23T10:18:31.738 INFO:tasks.workunit.client.0.smithi026.stdout:5/822: creat d0/d68/dea/d109/f126 x:0 0 0 2024-04-23T10:18:31.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/908: getdents d4/d1b/dbf/dda 0 2024-04-23T10:18:31.750 INFO:tasks.workunit.client.0.smithi026.stdout:6/964: truncate d6/d13/d15/f7c 2137474 0 2024-04-23T10:18:31.752 INFO:tasks.workunit.client.0.smithi026.stdout:7/750: dwrite dd/f36 [0,4194304] 0 2024-04-23T10:18:31.753 INFO:tasks.workunit.client.0.smithi026.stdout:5/823: stat d0/d3c/d5d/db2/dc6/df5/f85 0 2024-04-23T10:18:31.758 INFO:tasks.workunit.client.0.smithi026.stdout:6/965: unlink d6/d13/d15/l24 0 2024-04-23T10:18:31.759 INFO:tasks.workunit.client.0.smithi026.stdout:5/824: mknod d0/d3c/d5d/dbc/d107/c127 0 2024-04-23T10:18:31.762 INFO:tasks.workunit.client.0.smithi026.stdout:7/751: fdatasync dd/d1d/d50/f63 0 2024-04-23T10:18:31.763 INFO:tasks.workunit.client.0.smithi026.stdout:6/966: stat d6/d13/dcf/dd6/lf0 0 2024-04-23T10:18:31.765 INFO:tasks.workunit.client.0.smithi026.stdout:4/909: mkdir d4/d5b/d7b/d36/d90/d130 0 2024-04-23T10:18:31.773 INFO:tasks.workunit.client.0.smithi026.stdout:7/752: fdatasync dd/d1d/d50/f5c 0 2024-04-23T10:18:31.778 INFO:tasks.workunit.client.0.smithi026.stdout:6/967: symlink d6/d21/d2f/def/l12a 0 2024-04-23T10:18:31.782 INFO:tasks.workunit.client.0.smithi026.stdout:4/910: unlink d4/d1b/dbf/dda/d6c/d6f/d80/l101 0 2024-04-23T10:18:31.785 INFO:tasks.workunit.client.0.smithi026.stdout:5/825: dwrite d0/d68/dcc/ffa [0,4194304] 0 2024-04-23T10:18:31.786 INFO:tasks.workunit.client.0.smithi026.stdout:7/753: creat dd/d6c/dc6/fe1 x:0 0 0 2024-04-23T10:18:31.787 INFO:tasks.workunit.client.0.smithi026.stdout:4/911: fdatasync d4/d14/d30/fb8 0 2024-04-23T10:18:31.793 INFO:tasks.workunit.client.0.smithi026.stdout:4/912: readlink d4/d1b/dbf/dda/d6c/d6f/d80/le6 0 2024-04-23T10:18:31.800 INFO:tasks.workunit.client.0.smithi026.stdout:6/968: dwrite d6/fd8 [0,4194304] 0 2024-04-23T10:18:31.803 INFO:tasks.workunit.client.0.smithi026.stdout:5/826: creat d0/d3c/d84/d89/d8d/f128 x:0 0 0 2024-04-23T10:18:31.803 INFO:tasks.workunit.client.0.smithi026.stdout:4/913: symlink d4/d14/d3d/l131 0 2024-04-23T10:18:31.812 INFO:tasks.workunit.client.0.smithi026.stdout:6/969: symlink d6/d21/d58/l12b 0 2024-04-23T10:18:31.815 INFO:tasks.workunit.client.0.smithi026.stdout:5/827: truncate d0/d3c/d5d/d3a/f72 4847529 0 2024-04-23T10:18:31.817 INFO:tasks.workunit.client.0.smithi026.stdout:4/914: symlink d4/d22/d4e/d57/d10e/l132 0 2024-04-23T10:18:31.818 INFO:tasks.workunit.client.0.smithi026.stdout:5/828: read - d0/d3c/d84/d89/f11e zero size 2024-04-23T10:18:31.818 INFO:tasks.workunit.client.0.smithi026.stdout:6/970: symlink d6/d21/d2f/d32/df3/d128/l12c 0 2024-04-23T10:18:31.819 INFO:tasks.workunit.client.0.smithi026.stdout:7/754: link dd/d3f/d47/d4c/d60/d75/lb6 dd/d1d/d7d/le2 0 2024-04-23T10:18:31.824 INFO:tasks.workunit.client.0.smithi026.stdout:4/915: dread d4/d5b/d7b/d4d/fe4 [0,4194304] 0 2024-04-23T10:18:31.827 INFO:tasks.workunit.client.0.smithi026.stdout:5/829: link d0/d3c/d5d/d3a/f114 d0/d12/d112/f129 0 2024-04-23T10:18:31.832 INFO:tasks.workunit.client.0.smithi026.stdout:5/830: mknod d0/d3c/d5d/db2/dc6/c12a 0 2024-04-23T10:18:31.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/755: write dd/d1d/d50/f55 [693231,14751] 0 2024-04-23T10:18:31.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.833+0000 7fbd318d1640 1 Processor -- start 2024-04-23T10:18:31.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.833+0000 7fbd318d1640 1 -- start start 2024-04-23T10:18:31.836 INFO:tasks.workunit.client.0.smithi026.stdout:5/831: chown d0/d3c/d5d/db2/dc6/df5/l7a 14 1 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd318d1640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbd2c0cada0 0x7fbd2c06cae0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd318d1640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fbd2c06d020 0x7fbd2c15b200 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd318d1640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbd2c1556f0 con 0x7fbd2c155310 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd318d1640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2c15f2e0 con 0x7fbd2c0cada0 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd318d1640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fbd2c15e6d0 con 0x7fbd2c06d020 2024-04-23T10:18:31.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fbd2c155310 0x7fbd2c0cb350 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:53930/0 (socket says 172.21.15.26:53930) 2024-04-23T10:18:31.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 -- 172.21.15.26:0/3785025342 learned_addr learned my addr 172.21.15.26:0/3785025342 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:18:31.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2b7fe640 1 --2- 172.21.15.26:0/3785025342 >> v2:172.21.15.190:3300/0 conn(0x7fbd2c06d020 0x7fbd2c15b200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3035982053 0 0) 0x7fbd2c1556f0 con 0x7fbd2c155310 2024-04-23T10:18:31.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fbd14003530 con 0x7fbd2c155310 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.1 v1:172.21.15.190:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3126541256 0 0) 0x7fbd14003530 con 0x7fbd2c155310 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 >> v2:172.21.15.190:3300/0 conn(0x7fbd2c06d020 msgr2=0x7fbd2c15b200 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 --2- 172.21.15.26:0/3785025342 >> v2:172.21.15.190:3300/0 conn(0x7fbd2c06d020 0x7fbd2c15b200 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 >> v2:172.21.15.26:3300/0 conn(0x7fbd2c0cada0 msgr2=0x7fbd2c06cae0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/3785025342 >> v2:172.21.15.26:3300/0 conn(0x7fbd2c0cada0 0x7fbd2c06cae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 --2- 172.21.15.26:0/3785025342 >> v2:172.21.15.26:3300/0 conn(0x7fbd2c0cada0 0x7fbd2c06cae0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 --> v1:172.21.15.190:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c06d4b0 con 0x7fbd2c155310 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.1 v1:172.21.15.190:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fbd20001680 con 0x7fbd2c155310 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 >> v1:172.21.15.190:6789/0 conn(0x7fbd2c155310 legacy=0x7fbd2c0cb350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd14003e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd14004810 0x7fbd14004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140051d0 0x7fbd1400b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c15f2e0 con 0x7fbd14003a10 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c15e6d0 con 0x7fbd14004810 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbd1400c150 con 0x7fbd140051d0 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/3785025342 >> v2:172.21.15.26:3300/0 conn(0x7fbd2c0cada0 0x7fbd2c06cae0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd14003e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd14004810 0x7fbd14004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2b7fe640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140051d0 0x7fbd1400b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.841 INFO:tasks.workunit.client.0.smithi026.stdout:4/916: rename d4/d5b/d7b/d4d/df3/c76 to d4/d14/d92/dff/c133 0 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 -- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140051d0 msgr2=0x7fbd1400b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140051d0 0x7fbd1400b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 -- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd14004810 msgr2=0x7fbd14004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd14004810 0x7fbd14004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2affd640 1 -- 172.21.15.26:0/3785025342 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd14003530 con 0x7fbd14003a10 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2b7fe640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd140051d0 0x7fbd1400b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd14004810 0x7fbd14004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:18:31.841 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.837+0000 7fbd2b7fe640 1 -- 172.21.15.26:0/3785025342 reap_dead start 2024-04-23T10:18:31.842 INFO:tasks.workunit.client.0.smithi026.stdout:6/971: dwrite d6/d21/d2f/d32/d53/f8b [0,4194304] 0 2024-04-23T10:18:31.842 INFO:tasks.workunit.client.0.smithi026.stdout:7/756: fsync dd/d3f/fa0 0 2024-04-23T10:18:31.842 INFO:tasks.workunit.client.0.smithi026.stdout:5/832: mkdir d0/d3c/d5d/db2/d12b 0 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd2affd640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd14003e30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c160 tx=0x7fbd2001cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=88eef25b5b18f74e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007cb0 con 0x7fbd14003a10 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200a9070 con 0x7fbd14003a10 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd29ffb640 1 -- 172.21.15.26:0/3785025342 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20005d40 con 0x7fbd14003a10 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd318d1640 1 -- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 msgr2=0x7fbd14003e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.841+0000 7fbd318d1640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd14003e30 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7fbd2000c160 tx=0x7fbd2001cb80 comp rx=0 tx=0).stop 2024-04-23T10:18:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/3785025342 shutdown_connections 2024-04-23T10:18:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 --2- 172.21.15.26:0/3785025342 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd14003e30 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/3785025342 >> 172.21.15.26:0/3785025342 conn(0x7fbd2c0676a0 msgr2=0x7fbd2c067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/3785025342 shutdown_connections 2024-04-23T10:18:31.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/3785025342 wait complete. 2024-04-23T10:18:31.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 Processor -- start 2024-04-23T10:18:31.845 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- start start 2024-04-23T10:18:31.847 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd2c15ccc0 0x7fbd2c1468b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 0x7fbd2c15d8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c15b360 con 0x7fbd14003a10 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbd2c15b1e0 con 0x7fbd2c15ccc0 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbd2c15b4e0 con 0x7fbd2c15d430 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36238/0 (socket says 172.21.15.26:36238) 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 -- 172.21.15.26:0/1603348429 learned_addr learned my addr 172.21.15.26:0/1603348429 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2b7fe640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 0x7fbd2c15d8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd2c15ccc0 0x7fbd2c1468b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 -- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 msgr2=0x7fbd2c15d8b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 0x7fbd2c15d8b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 -- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd2c15ccc0 msgr2=0x7fbd2c1468b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd2c15ccc0 0x7fbd2c1468b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 -- 172.21.15.26:0/1603348429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbd2c0cdff0 con 0x7fbd14003a10 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2b7fe640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 0x7fbd2c15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd2affd640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd20098380 tx=0x7fbd14005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd20007140 con 0x7fbd14003a10 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbd200072e0 con 0x7fbd14003a10 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbd2c146df0 con 0x7fbd14003a10 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbd200076b0 con 0x7fbd14003a10 2024-04-23T10:18:31.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.845+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbd2c1f8170 con 0x7fbd14003a10 2024-04-23T10:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.849+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbd2c075df0 con 0x7fbd14003a10 2024-04-23T10:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.849+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbd200b6030 con 0x7fbd14003a10 2024-04-23T10:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.849+0000 7fbd13fff640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 0x7fbd1806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.849+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbd2011fd80 con 0x7fbd14003a10 2024-04-23T10:18:31.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.849+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 0x7fbd1806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:31.852 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.853+0000 7fbd2a7fc640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 0x7fbd1806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c15cc50 tx=0x7fbd1c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:31.852 INFO:tasks.workunit.client.0.smithi026.stdout:5/833: fdatasync d0/d3c/d5d/db2/dc6/df5/fe3 0 2024-04-23T10:18:31.852 INFO:tasks.workunit.client.0.smithi026.stdout:5/834: chown d0/d3c/d84 135583351 1 2024-04-23T10:18:31.854 INFO:tasks.workunit.client.0.smithi026.stdout:4/917: getdents d4/d22/d4e/d57/d10e 0 2024-04-23T10:18:31.855 INFO:tasks.workunit.client.0.smithi026.stdout:7/757: getdents dd/d1d/d78/db9 0 2024-04-23T10:18:31.857 INFO:tasks.workunit.client.0.smithi026.stdout:6/972: write d6/d21/d2f/d32/d87/fe9 [582242,23027] 0 2024-04-23T10:18:31.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:31.857+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbd20016890 con 0x7fbd14003a10 2024-04-23T10:18:31.859 INFO:tasks.workunit.client.0.smithi026.stdout:5/835: fsync d0/d3c/d5d/db2/dc6/dd4/f106 0 2024-04-23T10:18:31.861 INFO:tasks.workunit.client.0.smithi026.stdout:4/918: mkdir d4/d5b/d7b/d4d/dc7/d134 0 2024-04-23T10:18:31.861 INFO:tasks.workunit.client.0.smithi026.stdout:6/973: chown d6/d13/d15/d11e 6004 1 2024-04-23T10:18:31.865 INFO:tasks.workunit.client.0.smithi026.stdout:4/919: mknod d4/d5b/d10b/c135 0 2024-04-23T10:18:31.865 INFO:tasks.workunit.client.0.smithi026.stdout:6/974: symlink d6/d21/d2f/d32/df3/l12d 0 2024-04-23T10:18:31.866 INFO:tasks.workunit.client.0.smithi026.stdout:7/758: rename dd/d3f/lb8 to dd/d3f/d47/d4c/d60/d75/le3 0 2024-04-23T10:18:31.869 INFO:tasks.workunit.client.0.smithi026.stdout:7/759: dread - dd/d1d/d50/fa6 zero size 2024-04-23T10:18:31.875 INFO:tasks.workunit.client.0.smithi026.stdout:5/836: dwrite d0/d3c/d84/d89/fc7 [0,4194304] 0 2024-04-23T10:18:31.877 INFO:tasks.workunit.client.0.smithi026.stdout:4/920: write d4/d7/f102 [954486,22482] 0 2024-04-23T10:18:31.884 INFO:tasks.workunit.client.0.smithi026.stdout:5/837: dread d0/d3c/d5d/f94 [0,4194304] 0 2024-04-23T10:18:31.885 INFO:tasks.workunit.client.0.smithi026.stdout:6/975: dread d6/d33/f2c [0,4194304] 0 2024-04-23T10:18:31.891 INFO:tasks.workunit.client.0.smithi026.stdout:7/760: getdents dd/d1d/d50/d58 0 2024-04-23T10:18:31.894 INFO:tasks.workunit.client.0.smithi026.stdout:5/838: truncate d0/d3c/d5d/d3a/f72 1552637 0 2024-04-23T10:18:31.896 INFO:tasks.workunit.client.0.smithi026.stdout:6/976: mknod d6/d21/d2f/d32/df3/d128/c12e 0 2024-04-23T10:18:31.898 INFO:tasks.workunit.client.0.smithi026.stdout:6/977: rmdir d6 39 2024-04-23T10:18:31.900 INFO:tasks.workunit.client.0.smithi026.stdout:4/921: dwrite d4/d1b/da0/f128 [0,4194304] 0 2024-04-23T10:18:31.907 INFO:tasks.workunit.client.0.smithi026.stdout:7/761: write dd/d46/f77 [3710237,28089] 0 2024-04-23T10:18:31.907 INFO:tasks.workunit.client.0.smithi026.stdout:6/978: read d6/d21/d58/f75 [107240,30425] 0 2024-04-23T10:18:31.909 INFO:tasks.workunit.client.0.smithi026.stdout:4/922: mkdir d4/d5b/d7b/d4d/d136 0 2024-04-23T10:18:31.913 INFO:tasks.workunit.client.0.smithi026.stdout:5/839: creat d0/d3c/d84/d89/d8d/d8f/f12c x:0 0 0 2024-04-23T10:18:31.920 INFO:tasks.workunit.client.0.smithi026.stdout:7/762: dwrite dd/d6c/dc6/fe1 [0,4194304] 0 2024-04-23T10:18:31.924 INFO:tasks.workunit.client.0.smithi026.stdout:4/923: write d4/f35 [6505653,113488] 0 2024-04-23T10:18:31.931 INFO:tasks.workunit.client.0.smithi026.stdout:7/763: mknod dd/d3f/d47/d4c/d60/d75/ce4 0 2024-04-23T10:18:31.935 INFO:tasks.workunit.client.0.smithi026.stdout:5/840: rename d0/d3c/d5d/c53 to d0/d68/c12d 0 2024-04-23T10:18:31.941 INFO:tasks.workunit.client.0.smithi026.stdout:6/979: symlink d6/d21/d2f/d31/d52/d82/l12f 0 2024-04-23T10:18:31.943 INFO:tasks.workunit.client.0.smithi026.stdout:7/764: mkdir dd/de5 0 2024-04-23T10:18:31.949 INFO:tasks.workunit.client.0.smithi026.stdout:5/841: mknod d0/d3c/d5d/db2/dca/c12e 0 2024-04-23T10:18:31.954 INFO:tasks.workunit.client.0.smithi026.stdout:4/924: link d4/d5b/da7/c129 d4/d1b/dbf/dda/d6c/d6f/d80/c137 0 2024-04-23T10:18:31.955 INFO:tasks.workunit.client.0.smithi026.stdout:6/980: mkdir d6/d21/d2f/d32/d53/dca/ddc/d130 0 2024-04-23T10:18:31.957 INFO:tasks.workunit.client.0.smithi026.stdout:5/842: unlink d0/d3c/d5d/d3a/f72 0 2024-04-23T10:18:31.962 INFO:tasks.workunit.client.0.smithi026.stdout:4/925: dread d4/d14/f1c [0,4194304] 0 2024-04-23T10:18:31.974 INFO:tasks.workunit.client.0.smithi026.stdout:6/981: dread d6/d21/d2f/d31/d52/d82/fba [0,4194304] 0 2024-04-23T10:18:31.975 INFO:tasks.workunit.client.0.smithi026.stdout:7/765: link dd/d1d/d50/f62 dd/d6c/d72/fe6 0 2024-04-23T10:18:31.979 INFO:tasks.workunit.client.0.smithi026.stdout:7/766: chown dd/d3f/d47/d4c/lc0 243 1 2024-04-23T10:18:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fbd2c0c9680 con 0x7fbd14003a10 2024-04-23T10:18:32.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd13fff640 1 -- 172.21.15.26:0/1603348429 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7fbd200ef8d0 con 0x7fbd14003a10 2024-04-23T10:18:32.093 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:18:32.093 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:18:32.093 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 msgr2=0x7fbd1806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 0x7fbd1806a840 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7fbd2c15cc50 tx=0x7fbd1c008040 comp rx=0 tx=0).stop 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 msgr2=0x7fbd2c15dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7fbd20098380 tx=0x7fbd14005840 comp rx=0 tx=0).stop 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 shutdown_connections 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbd18068380 0x7fbd1806a840 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbd2c15d430 0x7fbd2c15d8b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbd2c15ccc0 0x7fbd2c1468b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 --2- 172.21.15.26:0/1603348429 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbd14003a10 0x7fbd2c15dfc0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 >> 172.21.15.26:0/1603348429 conn(0x7fbd2c0676a0 msgr2=0x7fbd2c0712b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 shutdown_connections 2024-04-23T10:18:32.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.093+0000 7fbd318d1640 1 -- 172.21.15.26:0/1603348429 wait complete. 2024-04-23T10:18:32.112 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 81.6 --await-for 42.0' 2024-04-23T10:18:32.112 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 81.6 --await-for 42.0 2024-04-23T10:18:32.151 INFO:tasks.workunit.client.0.smithi026.stdout:9/974: sync 2024-04-23T10:18:32.243 INFO:tasks.workunit.client.0.smithi026.stdout:4/926: fdatasync d4/d5b/d7b/d86/f10f 0 2024-04-23T10:18:32.248 INFO:tasks.workunit.client.0.smithi026.stdout:5/843: creat d0/d3c/d84/d89/d8d/d8f/f12f x:0 0 0 2024-04-23T10:18:32.259 INFO:tasks.workunit.client.0.smithi026.stdout:6/982: dwrite d6/d21/d2f/d32/f97 [0,4194304] 0 2024-04-23T10:18:32.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 Processor -- start 2024-04-23T10:18:32.288 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 -- start start 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb3b415e790 0x7fb3b4143410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b415b2b0 con 0x7fb3b406fed0 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb3b415c150 con 0x7fb3b406faf0 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b9055640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb3b415b5b0 con 0x7fb3b415e790 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb3b406fed0 0x7fb3b40c7f40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:53470/0 (socket says 172.21.15.26:53470) 2024-04-23T10:18:32.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 -- 172.21.15.26:0/1452706803 learned_addr learned my addr 172.21.15.26:0/1452706803 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b359e640 1 --2- 172.21.15.26:0/1452706803 >> v2:172.21.15.190:3300/0 conn(0x7fb3b415e790 0x7fb3b4143410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4259392698 0 0) 0x7fb3b415b2b0 con 0x7fb3b406fed0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb39c003530 con 0x7fb3b406fed0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4216430446 0 0) 0x7fb39c003530 con 0x7fb3b406fed0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 >> v2:172.21.15.190:3300/0 conn(0x7fb3b415e790 msgr2=0x7fb3b4143410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 --2- 172.21.15.26:0/1452706803 >> v2:172.21.15.190:3300/0 conn(0x7fb3b415e790 0x7fb3b4143410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 >> v1:172.21.15.190:6789/0 conn(0x7fb3b406faf0 legacy=0x7fb3b415ba40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b415ed90 con 0x7fb3b406fed0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fb3a8001680 con 0x7fb3b406fed0 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 >> v1:172.21.15.26:6789/0 conn(0x7fb3b406fed0 legacy=0x7fb3b40c7f40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb39c0039c0 0x7fb39c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb39c0051d0 0x7fb39c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b415b5b0 con 0x7fb39c004810 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb39c00c070 con 0x7fb39c0039c0 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb39c00c270 con 0x7fb39c0051d0 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb39c0039c0 0x7fb39c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b359e640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb39c0051d0 0x7fb39c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 -- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb39c0051d0 msgr2=0x7fb39c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb39c0051d0 0x7fb39c00b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 -- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb39c0039c0 msgr2=0x7fb39c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb39c0039c0 0x7fb39c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b259c640 1 -- 172.21.15.26:0/1452706803 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb39c003530 con 0x7fb39c004810 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b359e640 1 -- 172.21.15.26:0/1452706803 reap_dead start 2024-04-23T10:18:32.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.289+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb39c0039c0 0x7fb39c003de0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:32.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b259c640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c210 tx=0x7fb3a801f2b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a18523a9d1c62e3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8007d20 con 0x7fb39c004810 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80ac070 con 0x7fb39c004810 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b1d9b640 1 -- 172.21.15.26:0/1452706803 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8005b20 con 0x7fb39c004810 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 msgr2=0x7fb39c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c90 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7fb3a800c210 tx=0x7fb3a801f2b0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- 172.21.15.26:0/1452706803 shutdown_connections 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 --2- 172.21.15.26:0/1452706803 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb39c004c90 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- 172.21.15.26:0/1452706803 >> 172.21.15.26:0/1452706803 conn(0x7fb3b40ca140 msgr2=0x7fb3b40ca550 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- 172.21.15.26:0/1452706803 shutdown_connections 2024-04-23T10:18:32.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- 172.21.15.26:0/1452706803 wait complete. 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 Processor -- start 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.293+0000 7fb3b9055640 1 -- start start 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3b41f4530 0x7fb3b41f49b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3b413d4c0 0x7fb3b413d940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b40c8e90 con 0x7fb39c004810 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b415f350 con 0x7fb3b41f4530 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b415f630 con 0x7fb3b413d4c0 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36262/0 (socket says 172.21.15.26:36262) 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/3059135601 learned_addr learned my addr 172.21.15.26:0/3059135601 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b259c640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3b41f4530 0x7fb3b41f49b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b359e640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3b413d4c0 0x7fb3b413d940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3b413d4c0 msgr2=0x7fb3b413d940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3b413d4c0 0x7fb3b413d940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3b41f4530 msgr2=0x7fb3b41f49b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3b41f4530 0x7fb3b41f49b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/3059135601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb3b41f4ef0 con 0x7fb39c004810 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400d4d0 tx=0x7fb3a400d990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 -- 172.21.15.26:0/3059135601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4019070 con 0x7fb39c004810 2024-04-23T10:18:32.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 -- 172.21.15.26:0/3059135601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a40054a0 con 0x7fb39c004810 2024-04-23T10:18:32.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb3b413b690 con 0x7fb39c004810 2024-04-23T10:18:32.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 -- 172.21.15.26:0/3059135601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4007270 con 0x7fb39c004810 2024-04-23T10:18:32.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb3b4142dd0 con 0x7fb39c004810 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 -- 172.21.15.26:0/3059135601 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb3a401c070 con 0x7fb39c004810 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 0x7fb3a006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb39b7fe640 1 -- 172.21.15.26:0/3059135601 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb3a40864a0 con 0x7fb39c004810 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3b259c640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 0x7fb3a006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.297+0000 7fb3bc1d7000 1 Processor -- start 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- start start 2024-04-23T10:18:32.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 0x7fb3a006a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80ae000 tx=0x7fb3a80b3040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be21b600 0x5610be21b9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be2213c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5610be0c72a0 con 0x5610be2206c0 2024-04-23T10:18:32.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5610be02d5f0 con 0x5610be220fe0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5610bdfc8820 con 0x5610be21b600 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36268/0 (socket says 172.21.15.26:36268) 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 -- 172.21.15.26:0/183636159 learned_addr learned my addr 172.21.15.26:0/183636159 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be21b600 0x5610be21b9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b359e640 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be2213c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 -- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be21b600 msgr2=0x5610be21b9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be21b600 0x5610be21b9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 -- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 msgr2=0x5610be2213c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be2213c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 -- 172.21.15.26:0/183636159 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610be073c00 con 0x5610be2206c0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8001980 tx=0x7fb3b40c89d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=91a37c8b41ffc3c2 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb398ff9640 1 -- 172.21.15.26:0/183636159 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8004c80 con 0x5610be2206c0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb398ff9640 1 -- 172.21.15.26:0/183636159 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80ac040 con 0x5610be2206c0 2024-04-23T10:18:32.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb398ff9640 1 -- 172.21.15.26:0/183636159 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a8007700 con 0x5610be2206c0 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/183636159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 msgr2=0x5610be220aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x7fb3a8001980 tx=0x7fb3b40c89d0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/183636159 shutdown_connections 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be2213c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be2206c0 0x5610be220aa0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/183636159 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be21b600 0x5610be21b9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/183636159 >> 172.21.15.26:0/183636159 conn(0x5610be21c470 msgr2=0x5610be21e890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/183636159 shutdown_connections 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/183636159 wait complete. 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- start start 2024-04-23T10:18:32.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 Processor -- start 2024-04-23T10:18:32.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be21af20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be226620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5610bdfd8c60 con 0x5610be21b600 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5610be0afbf0 con 0x5610be220fe0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5610be0ea560 con 0x5610be2206c0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3bc1d7000 10 client.0 _ll_register_callbacks cb 0x5610be004570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36272/0 (socket says 172.21.15.26:36272) 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/617198517 learned_addr learned my addr 172.21.15.26:0/617198517 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.301+0000 7fb3b259c640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be21af20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b359e640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be226620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 msgr2=0x5610be21af20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be21af20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 msgr2=0x5610be226620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be226620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/617198517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610be068630 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b259c640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be21af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4084520 tx=0x7fb3a4056030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8110074f0261d9c4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a405e950 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb3a4007410 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a80ac040 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3a4007610 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 10 client.5466 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5610bdfcd490 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a80ac040 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb3a40553c0 con 0x5610be21b600 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 10 client.5466 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 10 client.5466 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 20 client.5466 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:32.308 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be227390 0x5610be2277a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 4 client.5466 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:18:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5610bdfc77f0 con 0x5610be227390 2024-04-23T10:18:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b259c640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be227390 0x5610be2277a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 10 client.5466 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:32.309 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3b259c640 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be227390 0x5610be2277a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2389430882fb61b5 server_cookie=2b1170e5dfd103f6 in_seq=0 out_seq=0 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 1 -- 172.21.15.26:0/617198517 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5610bdfc77f0 con 0x5610be227390 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 10 client.5466 handle_command_reply: tid=0 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 client.5466 shutdown 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 msgr2=0x5610be21a9e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4084520 tx=0x7fb3a4056030 comp rx=0 tx=0).stop 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 shutdown_connections 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be227390 0x5610be2277a0 crc :-1 s=READY pgs=91 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be226620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be21af20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.310 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb391ffb640 0 client.5466 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/617198517 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be21a9e0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 >> 172.21.15.26:0/617198517 conn(0x5610be21c470 msgr2=0x5610be21f6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 shutdown_connections 2024-04-23T10:18:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/617198517 wait complete. 2024-04-23T10:18:32.311 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.305+0000 7fb3bc1d7000 20 client.5466 trim_cache size 0 max 16384 2024-04-23T10:18:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 Processor -- start 2024-04-23T10:18:32.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- start start 2024-04-23T10:18:32.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be2289c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be228f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41fefc0 con 0x5610be21b600 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb3b41ff690 con 0x5610be220fe0 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb3b41fd710 con 0x5610be2206c0 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36284/0 (socket says 172.21.15.26:36284) 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/4244583361 learned_addr learned my addr 172.21.15.26:0/4244583361 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 msgr2=0x5610be2289c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b259c640 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be2289c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b359e640 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be228f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be2289c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 msgr2=0x5610be228f00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be228f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 -- 172.21.15.26:0/4244583361 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5610bdfc8a70 con 0x5610be21b600 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4055f00 tx=0x7fb3a407f000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b99360020ebd921f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb393fff640 1 -- 172.21.15.26:0/4244583361 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a4054010 con 0x5610be21b600 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb393fff640 1 -- 172.21.15.26:0/4244583361 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a4081030 con 0x5610be21b600 2024-04-23T10:18:32.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb393fff640 1 -- 172.21.15.26:0/4244583361 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3a405e750 con 0x5610be21b600 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/4244583361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 msgr2=0x5610be2322e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7fb3a4055f00 tx=0x7fb3a407f000 comp rx=0 tx=0).stop 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/4244583361 shutdown_connections 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be220fe0 0x5610be228f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be2289c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/4244583361 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be21b600 0x5610be2322e0 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/4244583361 >> 172.21.15.26:0/4244583361 conn(0x5610be21c470 msgr2=0x5610be23c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/4244583361 shutdown_connections 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.325+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/4244583361 wait complete. 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- start start 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 Processor -- start 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be21b600 0x5610be228b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be1e4330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5610be02c900 con 0x5610be220fe0 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5610bdff7e60 con 0x5610be21b600 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5610be031c20 con 0x5610be2206c0 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 10 client.0 _ll_register_callbacks cb 0x7fb3a4055dc0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:36286/0 (socket says 172.21.15.26:36286) 2024-04-23T10:18:32.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 -- 172.21.15.26:0/2205979943 learned_addr learned my addr 172.21.15.26:0/2205979943 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be21b600 0x5610be228b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b259c640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be1e4330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 -- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 msgr2=0x5610be1e4330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be1e4330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 -- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be21b600 msgr2=0x5610be228b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be21b600 0x5610be228b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 -- 172.21.15.26:0/2205979943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5610be0b0080 con 0x5610be220fe0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b359e640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac016d30 tx=0x7fb3ac007700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=881d93cdfb317ab6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb3ac009c30 con 0x5610be220fe0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb3ac009dd0 con 0x5610be220fe0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fb3a4081030 con 0x5610be220fe0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb3ac02a050 con 0x5610be220fe0 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 10 client.5472 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:32.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5610bdfd33e0 con 0x5610be220fe0 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb3a4081030 con 0x5610be220fe0 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fb3ac02d020 con 0x5610be220fe0 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 10 client.5472 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 10 client.5472 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 20 client.5472 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be1e28d0 0x5610be29da90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 4 client.5472 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.6, "await_for": 42.0}] 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 81.6, "await_for": 42.0}) -- 0x5610bdfd6940 con 0x5610be1e28d0 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be1e28d0 0x5610be29da90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb391ffb640 10 client.5472 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:32.329+0000 7fb3b2d9d640 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be1e28d0 0x5610be29da90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=42f3406554459777 server_cookie=6f4fc99101373156 in_seq=0 out_seq=0 2024-04-23T10:18:32.335 INFO:tasks.workunit.client.0.smithi026.stdout:8/965: sync 2024-04-23T10:18:32.446 INFO:tasks.workunit.client.0.smithi026.stdout:2/798: sync 2024-04-23T10:18:32.660 INFO:tasks.workunit.client.0.smithi026.stdout:3/858: sync 2024-04-23T10:18:32.703 INFO:tasks.workunit.client.0.smithi026.stdout:9/975: sync 2024-04-23T10:18:32.703 INFO:tasks.workunit.client.0.smithi026.stdout:7/767: sync 2024-04-23T10:18:32.703 INFO:tasks.workunit.client.0.smithi026.stdout:1/788: sync 2024-04-23T10:18:32.703 INFO:tasks.workunit.client.0.smithi026.stdout:5/844: sync 2024-04-23T10:18:34.771 INFO:tasks.workunit.client.0.smithi026.stdout:8/966: chown d5/d115/fc 7444 1 2024-04-23T10:18:34.826 INFO:tasks.workunit.client.0.smithi026.stdout:4/927: dwrite d4/d5b/d7b/d36/d38/f58 [0,4194304] 0 2024-04-23T10:18:34.927 INFO:tasks.workunit.client.0.smithi026.stdout:5/845: stat d0/f16 0 2024-04-23T10:18:35.076 INFO:tasks.workunit.client.0.smithi026.stdout:2/799: chown d3/d19/f62 764 1 2024-04-23T10:18:35.081 INFO:tasks.workunit.client.0.smithi026.stdout:6/983: write d6/d21/d2f/d37/d9a/db1/ffa [4722299,102540] 0 2024-04-23T10:18:35.186 INFO:tasks.workunit.client.0.smithi026.stdout:4/928: chown d4/d22/dd8 93320 1 2024-04-23T10:18:35.263 INFO:tasks.workunit.client.0.smithi026.stdout:9/976: dread d13/d3b/d4e/d76/f91 [0,4194304] 0 2024-04-23T10:18:35.314 INFO:tasks.workunit.client.0.smithi026.stdout:2/800: fdatasync d3/d19/d4d/fd2 0 2024-04-23T10:18:35.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.381+0000 7fb391ffb640 1 -- 172.21.15.26:0/2205979943 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5610bdfd6940 con 0x5610be1e28d0 2024-04-23T10:18:35.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.381+0000 7fb391ffb640 10 client.5472 handle_command_reply: tid=0 2024-04-23T10:18:35.383 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.381+0000 7fb3bc1d7000 1 client.5472 shutdown 2024-04-23T10:18:35.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 msgr2=0x5610be1e4870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7fb3ac016d30 tx=0x7fb3ac007700 comp rx=0 tx=0).stop 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 shutdown_connections 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5610be1e28d0 0x5610be29da90 crc :-1 s=READY pgs=92 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5610be220fe0 0x5610be1e4870 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5610be2206c0 0x5610be1e4330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 --2- 172.21.15.26:0/2205979943 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5610be21b600 0x5610be228b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb391ffb640 0 client.5472 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 >> 172.21.15.26:0/2205979943 conn(0x5610be21c470 msgr2=0x5610be23c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 shutdown_connections 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 1 -- 172.21.15.26:0/2205979943 wait complete. 2024-04-23T10:18:35.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3bc1d7000 20 client.5472 trim_cache size 0 max 16384 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 22, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "bc6e2a0c": { 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 22, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:18:35.386 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 81.6, 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:35.387 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 msgr2=0x7fb3a006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 0x7fb3a006a870 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb3a80ae000 tx=0x7fb3a80b3040 comp rx=0 tx=0).stop 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 msgr2=0x7fb3b415a5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7fb3a400d4d0 tx=0x7fb3a400d990 comp rx=0 tx=0).stop 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 shutdown_connections 2024-04-23T10:18:35.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb3a00683b0 0x7fb3a006a870 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb3b413d4c0 0x7fb3b413d940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb3b41f4530 0x7fb3b41f49b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 --2- 172.21.15.26:0/3059135601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb39c004810 0x7fb3b415a5a0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 >> 172.21.15.26:0/3059135601 conn(0x7fb3b40ca140 msgr2=0x7fb3b415ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 shutdown_connections 2024-04-23T10:18:35.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:35.385+0000 7fb3b9055640 1 -- 172.21.15.26:0/3059135601 wait complete. 2024-04-23T10:18:35.406 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'bc6e2a0c', quiesce took 3.7 seconds. Will release after: 21.6 2024-04-23T10:18:35.835 INFO:tasks.workunit.client.0.smithi026.stdout:2/801: fdatasync d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fbb 0 2024-04-23T10:18:36.042 INFO:tasks.workunit.client.0.smithi026.stdout:2/802: dread - d3/d19/d21/d23/f24 zero size 2024-04-23T10:18:36.048 INFO:tasks.workunit.client.0.smithi026.stdout:2/803: chown d3/d19/d31/l60 39424 1 2024-04-23T10:18:36.051 INFO:tasks.workunit.client.0.smithi026.stdout:2/804: chown d3/d19/d31/cd5 8371 1 2024-04-23T10:18:36.544 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:36.547 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:18:57.007 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:18:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 Processor -- start 2024-04-23T10:18:57.144 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 -- start start 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fddd80c8630 0x7fddd8151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddd80c8a70 0x7fddd8152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fddd80c6490 con 0x7fddd80c8a70 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fddd815b740 con 0x7fddd80c8630 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fdddd70a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fddd81525c0 con 0x7fddd80c8250 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddd80c8a70 0x7fddd8152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fddd80c8a70 0x7fddd8152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53314/0 (socket says 172.21.15.26:53314) 2024-04-23T10:18:57.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 -- 172.21.15.26:0/2866979465 learned_addr learned my addr 172.21.15.26:0/2866979465 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd67fc640 1 --2- 172.21.15.26:0/2866979465 >> v2:172.21.15.190:3300/0 conn(0x7fddd80c8630 0x7fddd8151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd6ffd640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 -- 172.21.15.26:0/2866979465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 msgr2=0x7fddd80c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd80c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 -- 172.21.15.26:0/2866979465 >> v2:172.21.15.190:3300/0 conn(0x7fddd80c8630 msgr2=0x7fddd8151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 --2- 172.21.15.26:0/2866979465 >> v2:172.21.15.190:3300/0 conn(0x7fddd80c8630 0x7fddd8151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd77fe640 1 -- 172.21.15.26:0/2866979465 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd80c58c0 con 0x7fddd80c8a70 2024-04-23T10:18:57.147 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.145+0000 7fddd6ffd640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd77fe640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8a70 0x7fddd8152080 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fddd000d150 tx=0x7fddd001eb60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=371eb11c238141ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd5ffb640 1 -- 172.21.15.26:0/2866979465 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd000b2d0 con 0x7fddd80c8a70 2024-04-23T10:18:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd5ffb640 1 -- 172.21.15.26:0/2866979465 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddd000b470 con 0x7fddd80c8a70 2024-04-23T10:18:57.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd5ffb640 1 -- 172.21.15.26:0/2866979465 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddd00a7b00 con 0x7fddd80c8a70 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- 172.21.15.26:0/2866979465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8a70 msgr2=0x7fddd8152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8a70 0x7fddd8152080 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 crypto rx=0x7fddd000d150 tx=0x7fddd001eb60 comp rx=0 tx=0).stop 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- 172.21.15.26:0/2866979465 shutdown_connections 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8a70 0x7fddd8152080 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2866979465 >> v2:172.21.15.190:3300/0 conn(0x7fddd80c8630 0x7fddd8151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2866979465 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd80c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- 172.21.15.26:0/2866979465 >> 172.21.15.26:0/2866979465 conn(0x7fddd806b9d0 msgr2=0x7fddd806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- 172.21.15.26:0/2866979465 shutdown_connections 2024-04-23T10:18:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- 172.21.15.26:0/2866979465 wait complete. 2024-04-23T10:18:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 Processor -- start 2024-04-23T10:18:57.150 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- start start 2024-04-23T10:18:57.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd81599a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c8a70 0x7fddd8142940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fddd815b400 con 0x7fddd80c8630 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fddd80721a0 con 0x7fddd80c8a70 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fdddd70a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fddd80c6900 con 0x7fddd80c8250 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd67fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53326/0 (socket says 172.21.15.26:53326) 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd67fc640 1 -- 172.21.15.26:0/2619789228 learned_addr learned my addr 172.21.15.26:0/2619789228 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd77fe640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c8a70 0x7fddd8142940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.149+0000 7fddd6ffd640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd81599a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 -- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 msgr2=0x7fddd81599a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd81599a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 -- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c8a70 msgr2=0x7fddd8142940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c8a70 0x7fddd8142940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 -- 172.21.15.26:0/2619789228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fddd8159300 con 0x7fddd80c8630 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd67fc640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00d800 tx=0x7fddcc00dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00b6c0 con 0x7fddd80c8630 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fddcc019070 con 0x7fddd80c8630 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fddd80c5380 con 0x7fddd80c8630 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fddcc00ba60 con 0x7fddd80c8630 2024-04-23T10:18:57.154 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fddd814b620 con 0x7fddd80c8630 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fddd8075df0 con 0x7fddd80c8630 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fddcc00bc00 con 0x7fddd80c8630 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 0x7fddc406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fddcc087190 con 0x7fddd80c8630 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd6ffd640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 0x7fddc406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.155 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.153+0000 7fddd6ffd640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 0x7fddc406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006b20 tx=0x7fddc8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.158 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.157+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fddcc057330 con 0x7fddd80c8630 2024-04-23T10:18:57.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.353+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fddd814bc70 con 0x7fddd80c8630 2024-04-23T10:18:57.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fddbf7fe640 1 -- 172.21.15.26:0/2619789228 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7fddcc056c30 con 0x7fddd80c8630 2024-04-23T10:18:57.356 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:18:57.356 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:18:57.356 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:18:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 msgr2=0x7fddc406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 0x7fddc406a870 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fddc8006b20 tx=0x7fddc8008040 comp rx=0 tx=0).stop 2024-04-23T10:18:57.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 msgr2=0x7fddd8142400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fddcc00d800 tx=0x7fddcc00dcc0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 shutdown_connections 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fddc40683b0 0x7fddc406a870 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fddd80c8a70 0x7fddd8142940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fddd80c8630 0x7fddd8142400 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 --2- 172.21.15.26:0/2619789228 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fddd80c8250 0x7fddd81599a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 >> 172.21.15.26:0/2619789228 conn(0x7fddd806b9d0 msgr2=0x7fddd81502a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 shutdown_connections 2024-04-23T10:18:57.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.357+0000 7fdddd70a640 1 -- 172.21.15.26:0/2619789228 wait complete. 2024-04-23T10:18:57.373 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id bc6e2a0c --release --await' 2024-04-23T10:18:57.373 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id bc6e2a0c --release --await 2024-04-23T10:18:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 Processor -- start 2024-04-23T10:18:57.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 -- start start 2024-04-23T10:18:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d540c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d540c4e80 con 0x7f4d5406f700 2024-04-23T10:18:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4d5415f320 con 0x7f4d5415ee20 2024-04-23T10:18:57.499 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5892d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d540c4230 con 0x7f4d54155300 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d51d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4d5406f700 0x7f4d5415e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:34874/0 (socket says 172.21.15.26:34874) 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d51d9b640 1 -- 172.21.15.26:0/2139965275 learned_addr learned my addr 172.21.15.26:0/2139965275 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d540c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3880335456 0 0) 0x7f4d540c4e80 con 0x7f4d5406f700 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4d40003530 con 0x7f4d5406f700 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3791255501 0 0) 0x7f4d40003530 con 0x7f4d5406f700 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 msgr2=0x7f4d540c3cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d540c3cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 >> v1:172.21.15.190:6789/0 conn(0x7f4d5415ee20 legacy=0x7f4d540c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d540c5120 con 0x7f4d5406f700 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4d44001680 con 0x7f4d5406f700 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 >> v1:172.21.15.26:6789/0 conn(0x7f4d5406f700 legacy=0x7f4d5415e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d400039f0 0x7f4d40003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d40004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d40004d50 0x7f4d400051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540c4230 con 0x7f4d400039f0 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d4000ba80 con 0x7f4d40004d50 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d4000bc80 con 0x7f4d54155300 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d400039f0 0x7f4d40003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d40004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 -- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 msgr2=0x7f4d40004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d40004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 -- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d40004d50 msgr2=0x7f4d400051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d40004d50 0x7f4d400051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d40004d50 0x7f4d400051d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d5259c640 1 -- 172.21.15.26:0/2139965275 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d40003530 con 0x7f4d400039f0 2024-04-23T10:18:57.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.497+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d54155300 0x7f4d40004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5259c640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d400039f0 0x7f4d40003e10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009a90 tx=0x7f4d3c01ca30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e47951861fccdf3a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c009690 con 0x7f4d400039f0 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0a6410 con 0x7f4d400039f0 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5159a640 1 -- 172.21.15.26:0/2139965275 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0a67e0 con 0x7f4d400039f0 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- 172.21.15.26:0/2139965275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d400039f0 msgr2=0x7f4d40003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 --2- 172.21.15.26:0/2139965275 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d400039f0 0x7f4d40003e10 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c009a90 tx=0x7f4d3c01ca30 comp rx=0 tx=0).stop 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d52d9d640 1 -- 172.21.15.26:0/2139965275 reap_dead start 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- 172.21.15.26:0/2139965275 shutdown_connections 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- 172.21.15.26:0/2139965275 >> 172.21.15.26:0/2139965275 conn(0x7f4d5406b9d0 msgr2=0x7f4d5406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- 172.21.15.26:0/2139965275 shutdown_connections 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- 172.21.15.26:0/2139965275 wait complete. 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 Processor -- start 2024-04-23T10:18:57.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- start start 2024-04-23T10:18:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d400039f0 0x7f4d541507d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 0x7f4d541464c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d541556e0 con 0x7f4d54146a00 2024-04-23T10:18:57.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d540c5770 con 0x7f4d400039f0 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.501+0000 7f4d5892d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d54155860 con 0x7f4d5414f090 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53336/0 (socket says 172.21.15.26:53336) 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 -- 172.21.15.26:0/3272944135 learned_addr learned my addr 172.21.15.26:0/3272944135 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 0x7f4d541464c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d400039f0 0x7f4d541507d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 -- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 msgr2=0x7f4d541464c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 0x7f4d541464c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 -- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d400039f0 msgr2=0x7f4d541507d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d400039f0 0x7f4d541507d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 -- 172.21.15.26:0/3272944135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4d5415d7e0 con 0x7f4d54146a00 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 0x7f4d541464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:18:57.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c000f90 tx=0x7f4d4c00dc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 -- 172.21.15.26:0/3272944135 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c018070 con 0x7f4d54146a00 2024-04-23T10:18:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 -- 172.21.15.26:0/3272944135 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c003b80 con 0x7f4d54146a00 2024-04-23T10:18:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4d5415c410 con 0x7f4d54146a00 2024-04-23T10:18:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 -- 172.21.15.26:0/3272944135 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c005070 con 0x7f4d54146a00 2024-04-23T10:18:57.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4d5415c9d0 con 0x7f4d54146a00 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 -- 172.21.15.26:0/3272944135 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4d4c01b070 con 0x7f4d54146a00 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 0x7f4d3406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d4affd640 1 -- 172.21.15.26:0/3272944135 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4d4c086580 con 0x7f4d54146a00 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 0x7f4d3406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5baaf000 1 Processor -- start 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5baaf000 1 -- start start 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.505+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 0x7f4d3406a870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0ad000 tx=0x7f4d3c0b2040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606c58a0 0x55e86068e9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e86068f2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e8604d6660 con 0x55e8606ca120 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e86047b5d0 con 0x55e86068ef00 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e8604d2620 con 0x55e8606c58a0 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53350/0 (socket says 172.21.15.26:53350) 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 -- 172.21.15.26:0/1979415581 learned_addr learned my addr 172.21.15.26:0/1979415581 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606c58a0 0x55e86068e9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e86068f2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 -- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606c58a0 msgr2=0x55e86068e9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606c58a0 0x55e86068e9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 -- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 msgr2=0x55e86068f2e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e86068f2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 -- 172.21.15.26:0/1979415581 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8604afbd0 con 0x55e8606ca120 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0523e0 tx=0x7f4d4c055f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b756ebaf79bdb87b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d33fff640 1 -- 172.21.15.26:0/1979415581 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c054280 con 0x55e8606ca120 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d33fff640 1 -- 172.21.15.26:0/1979415581 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d4c0525f0 con 0x55e8606ca120 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d33fff640 1 -- 172.21.15.26:0/1979415581 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4c086270 con 0x55e8606ca120 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1979415581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 msgr2=0x55e8606ca500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c0523e0 tx=0x7f4d4c055f80 comp rx=0 tx=0).stop 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1979415581 shutdown_connections 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606ca120 0x55e8606ca500 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e86068f2e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1979415581 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606c58a0 0x55e86068e9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1979415581 >> 172.21.15.26:0/1979415581 conn(0x55e860570b00 msgr2=0x55e8606c7ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1979415581 shutdown_connections 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1979415581 wait complete. 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- start start 2024-04-23T10:18:57.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 Processor -- start 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e8606c4650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606898d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e860593d40 con 0x55e8606c58a0 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e860490eb0 con 0x55e86068ef00 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e8604d12a0 con 0x55e8606ca120 2024-04-23T10:18:57.516 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5baaf000 10 client.0 _ll_register_callbacks cb 0x55e860674a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53366/0 (socket says 172.21.15.26:53366) 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 -- 172.21.15.26:0/3328893083 learned_addr learned my addr 172.21.15.26:0/3328893083 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e8606c4650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606898d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 -- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 msgr2=0x55e8606898d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606898d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 -- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 msgr2=0x55e8606c4650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e8606c4650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.509+0000 7f4d51d9b640 1 -- 172.21.15.26:0/3328893083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e86051cb30 con 0x55e8606c58a0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d44010490 tx=0x7f4d44010950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d065c283cff72c69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4401b060 con 0x55e8606c58a0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4d44004ab0 con 0x55e8606c58a0 2024-04-23T10:18:57.517 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e860470060 con 0x55e8606c58a0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d44004cb0 con 0x55e8606c58a0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 10 client.5490 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e860475b70 con 0x55e8606c58a0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e860470060 con 0x55e8606c58a0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4d44016780 con 0x55e8606c58a0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 10 client.5490 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 10 client.5490 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 20 client.5490 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e86068a640 0x55e86068aa50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 4 client.5490 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e8604aee30 con 0x55e86068a640 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e86068a640 0x55e86068aa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5259c640 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e86068a640 0x55e86068aa50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=74fb305eda5e58b3 server_cookie=b29d09937d4e038a in_seq=0 out_seq=0 2024-04-23T10:18:57.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 10 client.5490 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 1 -- 172.21.15.26:0/3328893083 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e8604aee30 con 0x55e86068a640 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 10 client.5490 handle_command_reply: tid=0 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 client.5490 shutdown 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 msgr2=0x55e8606c4b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7f4d44010490 tx=0x7f4d44010950 comp rx=0 tx=0).stop 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 shutdown_connections 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e86068a640 0x55e86068aa50 crc :-1 s=READY pgs=94 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606898d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e8606c4b90 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/3328893083 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e8606c4650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d317fa640 0 client.5490 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 >> 172.21.15.26:0/3328893083 conn(0x55e860570b00 msgr2=0x55e8606c99a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 shutdown_connections 2024-04-23T10:18:57.519 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 1 -- 172.21.15.26:0/3328893083 wait complete. 2024-04-23T10:18:57.520 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.513+0000 7f4d5baaf000 20 client.5490 trim_cache size 0 max 16384 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 Processor -- start 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- start start 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8606c58a0 0x55e86068d800 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e0b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4d542024e0 con 0x55e86068ef00 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4d54202bb0 con 0x55e8606c58a0 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4d54200c10 con 0x55e8606ca120 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53378/0 (socket says 172.21.15.26:53378) 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 -- 172.21.15.26:0/1048379848 learned_addr learned my addr 172.21.15.26:0/1048379848 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 -- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 msgr2=0x55e8606e0b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.536 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e0b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8606c58a0 0x55e86068d800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e0b10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 -- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8606c58a0 msgr2=0x55e86068d800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8606c58a0 0x55e86068d800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 -- 172.21.15.26:0/1048379848 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e8605585e0 con 0x55e86068ef00 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c01cf10 tx=0x7f4d3c004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1570974cd025deb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d337fe640 1 -- 172.21.15.26:0/1048379848 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0cb360 con 0x55e86068ef00 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d337fe640 1 -- 172.21.15.26:0/1048379848 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0cb500 con 0x55e86068ef00 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d337fe640 1 -- 172.21.15.26:0/1048379848 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d3c0cb8b0 con 0x55e86068ef00 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1048379848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 msgr2=0x55e86068d2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c01cf10 tx=0x7f4d3c004740 comp rx=0 tx=0).stop 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1048379848 shutdown_connections 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e0b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e8606c58a0 0x55e86068d800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.537 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1048379848 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e86068ef00 0x55e86068d2c0 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1048379848 >> 172.21.15.26:0/1048379848 conn(0x55e860570b00 msgr2=0x55e8606c5080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1048379848 shutdown_connections 2024-04-23T10:18:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.533+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1048379848 wait complete. 2024-04-23T10:18:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- start start 2024-04-23T10:18:57.538 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 Processor -- start 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e860737d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e2e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e8604d5970 con 0x55e8606c58a0 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e86048b8f0 con 0x55e86068ef00 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e8604dac90 con 0x55e8606ca120 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 10 client.0 _ll_register_callbacks cb 0x7f4d440014c0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53382/0 (socket says 172.21.15.26:53382) 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 -- 172.21.15.26:0/1814156919 learned_addr learned my addr 172.21.15.26:0/1814156919 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e860737d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d52d9d640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e2e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 -- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 msgr2=0x55e8606e2e30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e2e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.541 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 -- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 msgr2=0x55e860737d10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e860737d10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 -- 172.21.15.26:0/1814156919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e860468ae0 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e860737d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d51d9b640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000eb0 tx=0x7f4d44001160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0001088e87da453 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4d4402e030 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4d44025040 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4d3c0cb500 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4d44037050 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 10 client.5496 fetch_fsmap learned FSMap version 19 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e86046bd80 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d3c0cb500 con 0x55e8606c58a0 2024-04-23T10:18:57.542 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4d4403a020 con 0x55e8606c58a0 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 10 client.5496 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 10 client.5496 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 20 client.5496 populate_metadata read hostname 'smithi026' 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e8606e3de0 0x55e8606e41f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 4 client.5496 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "bc6e2a0c", "release": true, "await": true}] 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "bc6e2a0c", "release": true, "await": true}) -- 0x55e8604740d0 con 0x55e8606e3de0 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e8606e3de0 0x55e8606e41f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d5259c640 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e8606e3de0 0x55e8606e41f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=989c6d0629043f77 server_cookie=5bd18050bf39ef32 in_seq=0 out_seq=0 2024-04-23T10:18:57.543 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:57.537+0000 7f4d317fa640 10 client.5496 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:58.073 INFO:tasks.workunit.client.0.smithi026.stdout:6/984: write d6/d21/d2f/d37/f3f [3239682,45678] 0 2024-04-23T10:18:58.119 INFO:tasks.workunit.client.0.smithi026.stdout:2/805: write d3/d19/d21/d23/d3a/d65/f99 [70794,4812] 0 2024-04-23T10:18:58.125 INFO:tasks.workunit.client.0.smithi026.stdout:8/967: write d5/d56/de8/fd1 [1033877,67289] 0 2024-04-23T10:18:58.128 INFO:tasks.workunit.client.0.smithi026.stdout:9/977: rename d13/d1b/d26/d88/dcf/dd1/fd5 to d13/d1b/d98/f130 0 2024-04-23T10:18:58.145 INFO:tasks.workunit.client.0.smithi026.stdout:1/789: creat dd/d15/d7d/da1/dc6/ddc/f110 x:0 0 0 2024-04-23T10:18:58.150 INFO:tasks.workunit.client.0.smithi026.stdout:3/859: dwrite d0/d1e/d23/d87/fc4 [0,4194304] 0 2024-04-23T10:18:58.151 INFO:tasks.workunit.client.0.smithi026.stdout:7/768: write dd/d3f/fe0 [507661,19052] 0 2024-04-23T10:18:58.157 INFO:tasks.workunit.client.0.smithi026.stdout:4/929: truncate d4/d5b/d7b/d36/d38/d83/fea 1046351 0 2024-04-23T10:18:58.166 INFO:tasks.workunit.client.0.smithi026.stdout:5/846: dwrite d0/d3c/d5d/dbc/fe6 [0,4194304] 0 2024-04-23T10:18:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d317fa640 1 -- 172.21.15.26:0/1814156919 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e8604740d0 con 0x55e8606e3de0 2024-04-23T10:18:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d317fa640 10 client.5496 handle_command_reply: tid=0 2024-04-23T10:18:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 client.5496 shutdown 2024-04-23T10:18:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 msgr2=0x55e860738250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7f4d44000eb0 tx=0x7f4d44001160 comp rx=0 tx=0).stop 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 shutdown_connections 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e8606e3de0 0x55e8606e41f0 crc :-1 s=READY pgs=95 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e8606ca120 0x55e8606e2e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e8606c58a0 0x55e860738250 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 --2- 172.21.15.26:0/1814156919 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e86068ef00 0x55e860737d10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 >> 172.21.15.26:0/1814156919 conn(0x55e860570b00 msgr2=0x55e860688cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.189+0000 7f4d317fa640 0 client.5496 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 shutdown_connections 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5baaf000 1 -- 172.21.15.26:0/1814156919 wait complete. 2024-04-23T10:18:58.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5baaf000 20 client.5496 trim_cache size 0 max 16384 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 24, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "bc6e2a0c": { 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 24, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:18:58.193 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 81.6, 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:18:58.194 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 msgr2=0x7f4d3406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 0x7f4d3406a870 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f4d3c0ad000 tx=0x7f4d3c0b2040 comp rx=0 tx=0).stop 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 msgr2=0x7f4d5415dd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7f4d4c000f90 tx=0x7f4d4c00dc00 comp rx=0 tx=0).stop 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 shutdown_connections 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4d340683b0 0x7f4d3406a870 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4d54146a00 0x7f4d5415dd80 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4d5414f090 0x7f4d541464c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 --2- 172.21.15.26:0/3272944135 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4d400039f0 0x7f4d541507d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:18:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 >> 172.21.15.26:0/3272944135 conn(0x7f4d5406b9d0 msgr2=0x7f4d540c7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:18:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 shutdown_connections 2024-04-23T10:18:58.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:18:58.193+0000 7f4d5892d640 1 -- 172.21.15.26:0/3272944135 wait complete. 2024-04-23T10:18:58.206 INFO:tasks.workunit.client.0.smithi026.stdout:2/806: write d3/d19/d31/f66 [3198784,107681] 0 2024-04-23T10:18:58.208 INFO:tasks.workunit.client.0.smithi026.stdout:8/968: truncate d5/d56/de8/f13e 56405 0 2024-04-23T10:18:58.209 INFO:tasks.workunit.client.0.smithi026.stdout:9/978: truncate d13/d3e/fcb 4455509 0 2024-04-23T10:18:58.211 INFO:tasks.workunit.client.0.smithi026.stdout:7/769: mkdir dd/d1d/de7 0 2024-04-23T10:18:58.212 INFO:tasks.workunit.client.0.smithi026.stdout:5/847: chown d0/d3c/d5d/db2/dca/fde 67085863 1 2024-04-23T10:18:58.214 INFO:tasks.workunit.client.0.smithi026.stdout:2/807: read - d3/d19/d21/d23/d3a/d65/f107 zero size 2024-04-23T10:18:58.216 INFO:tasks.workunit.client.0.smithi026.stdout:6/985: creat d6/d21/d2f/d31/d52/f131 x:0 0 0 2024-04-23T10:18:58.220 INFO:tasks.workunit.client.0.smithi026.stdout:1/790: mkdir dd/d1a/d20/d25/df3/d111 0 2024-04-23T10:18:58.221 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'bc6e2a0c', seconds elapsed: 26.5 2024-04-23T10:18:58.227 INFO:tasks.workunit.client.0.smithi026.stdout:3/860: symlink d0/d1e/d23/d87/db3/dee/d39/d93/l123 0 2024-04-23T10:18:58.229 INFO:tasks.workunit.client.0.smithi026.stdout:6/986: truncate d6/d21/d2f/d37/f6d 4845719 0 2024-04-23T10:18:58.231 INFO:tasks.workunit.client.0.smithi026.stdout:4/930: dread d4/d7/f13 [0,4194304] 0 2024-04-23T10:18:58.233 INFO:tasks.workunit.client.0.smithi026.stdout:5/848: creat d0/d68/dcc/f130 x:0 0 0 2024-04-23T10:18:58.237 INFO:tasks.workunit.client.0.smithi026.stdout:1/791: dread - dd/d1a/d23/d69/d9d/ff2 zero size 2024-04-23T10:18:58.238 INFO:tasks.workunit.client.0.smithi026.stdout:9/979: creat d13/d3b/d68/dd6/d45/d67/f131 x:0 0 0 2024-04-23T10:18:58.239 INFO:tasks.workunit.client.0.smithi026.stdout:8/969: mkdir d5/d115/d22/d65/d78/d3e/d143 0 2024-04-23T10:18:58.240 INFO:tasks.workunit.client.0.smithi026.stdout:2/808: dread d3/d19/d21/d23/d3a/d65/f87 [0,4194304] 0 2024-04-23T10:18:58.241 INFO:tasks.workunit.client.0.smithi026.stdout:6/987: fdatasync d6/d21/d2f/d37/d4f/f125 0 2024-04-23T10:18:58.243 INFO:tasks.workunit.client.0.smithi026.stdout:7/770: rename dd/d1d/d50/c89 to dd/d6c/ce8 0 2024-04-23T10:18:58.245 INFO:tasks.workunit.client.0.smithi026.stdout:3/861: chown d0/d1e/d30/d43/df/d17/c49 36 1 2024-04-23T10:18:58.247 INFO:tasks.workunit.client.0.smithi026.stdout:1/792: dread dd/f90 [0,4194304] 0 2024-04-23T10:18:58.254 INFO:tasks.workunit.client.0.smithi026.stdout:4/931: fsync d4/d14/d92/f106 0 2024-04-23T10:18:58.258 INFO:tasks.workunit.client.0.smithi026.stdout:6/988: chown d6/d108/d120 0 1 2024-04-23T10:18:58.260 INFO:tasks.workunit.client.0.smithi026.stdout:9/980: creat d13/d3b/d68/f132 x:0 0 0 2024-04-23T10:18:58.265 INFO:tasks.workunit.client.0.smithi026.stdout:5/849: dread d0/d3c/d84/d89/d8d/fa2 [0,4194304] 0 2024-04-23T10:18:58.267 INFO:tasks.workunit.client.0.smithi026.stdout:8/970: write d5/d11d/f139 [630729,13634] 0 2024-04-23T10:18:58.270 INFO:tasks.workunit.client.0.smithi026.stdout:3/862: chown d0/d1e/d30/d43/d6c/d79/fe1 0 1 2024-04-23T10:18:58.274 INFO:tasks.workunit.client.0.smithi026.stdout:7/771: mkdir dd/d2c/d48/de9 0 2024-04-23T10:18:58.278 INFO:tasks.workunit.client.0.smithi026.stdout:2/809: symlink d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/l110 0 2024-04-23T10:18:58.278 INFO:tasks.workunit.client.0.smithi026.stdout:8/971: dread - d5/d56/d33/faa zero size 2024-04-23T10:18:58.281 INFO:tasks.workunit.client.0.smithi026.stdout:1/793: mknod dd/d1a/d20/d25/d35/d7f/da5/c112 0 2024-04-23T10:18:58.291 INFO:tasks.workunit.client.0.smithi026.stdout:1/794: read dd/d15/f32 [2126380,45405] 0 2024-04-23T10:18:58.294 INFO:tasks.workunit.client.0.smithi026.stdout:5/850: getdents d0/d12 0 2024-04-23T10:18:58.294 INFO:tasks.workunit.client.0.smithi026.stdout:7/772: truncate dd/d1d/d7d/f98 741913 0 2024-04-23T10:18:58.296 INFO:tasks.workunit.client.0.smithi026.stdout:8/972: rename d5/c130 to d5/d115/d22/d12e/c144 0 2024-04-23T10:18:58.304 INFO:tasks.workunit.client.0.smithi026.stdout:9/981: dwrite d13/d3b/d68/dd6/d45/d11c/f127 [0,4194304] 0 2024-04-23T10:18:58.305 INFO:tasks.workunit.client.0.smithi026.stdout:3/863: dwrite d0/d1e/d23/d87/db3/dee/f84 [0,4194304] 0 2024-04-23T10:18:58.308 INFO:tasks.workunit.client.0.smithi026.stdout:8/973: readlink d5/le0 0 2024-04-23T10:18:58.308 INFO:tasks.workunit.client.0.smithi026.stdout:4/932: dwrite d4/d1b/dbf/dda/f56 [0,4194304] 0 2024-04-23T10:18:58.310 INFO:tasks.workunit.client.0.smithi026.stdout:6/989: link d6/d21/d2f/d32/d87/d8e/f104 d6/d13/f132 0 2024-04-23T10:18:58.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/810: dwrite d3/d19/d31/f91 [0,4194304] 0 2024-04-23T10:18:58.320 INFO:tasks.workunit.client.0.smithi026.stdout:1/795: rmdir dd/d48/dac/df1 0 2024-04-23T10:18:58.332 INFO:tasks.workunit.client.0.smithi026.stdout:5/851: dwrite d0/d3c/d84/d89/d8d/fa2 [0,4194304] 0 2024-04-23T10:18:58.336 INFO:tasks.workunit.client.0.smithi026.stdout:3/864: mkdir d0/d1e/d23/d87/df8/d124 0 2024-04-23T10:18:58.338 INFO:tasks.workunit.client.0.smithi026.stdout:1/796: truncate dd/d1a/d20/d25/d35/f53 4755968 0 2024-04-23T10:18:58.340 INFO:tasks.workunit.client.0.smithi026.stdout:9/982: write d13/d3b/d68/dd6/d45/fac [1418538,100697] 0 2024-04-23T10:18:58.344 INFO:tasks.workunit.client.0.smithi026.stdout:5/852: mkdir d0/d3c/d5d/d131 0 2024-04-23T10:18:58.345 INFO:tasks.workunit.client.0.smithi026.stdout:6/990: write d6/fe [5776886,87467] 0 2024-04-23T10:18:58.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/811: write d3/d19/f55 [1572968,56073] 0 2024-04-23T10:18:58.349 INFO:tasks.workunit.client.0.smithi026.stdout:1/797: creat dd/d15/d7d/df6/f113 x:0 0 0 2024-04-23T10:18:58.352 INFO:tasks.workunit.client.0.smithi026.stdout:8/974: mkdir d5/d56/d33/ddc/de1/da8/d11f/d145 0 2024-04-23T10:18:58.355 INFO:tasks.workunit.client.0.smithi026.stdout:2/812: chown d3/d19/lb2 22 1 2024-04-23T10:18:58.356 INFO:tasks.workunit.client.0.smithi026.stdout:7/773: dwrite dd/d1d/d78/db9/fc9 [0,4194304] 0 2024-04-23T10:18:58.356 INFO:tasks.workunit.client.0.smithi026.stdout:3/865: creat d0/d1e/d23/d87/db6/f125 x:0 0 0 2024-04-23T10:18:58.356 INFO:tasks.workunit.client.0.smithi026.stdout:1/798: stat dd/d1a/d20/d25/fb3 0 2024-04-23T10:18:58.357 INFO:tasks.workunit.client.0.smithi026.stdout:6/991: truncate d6/d21/d2f/f110 322928 0 2024-04-23T10:18:58.358 INFO:tasks.workunit.client.0.smithi026.stdout:8/975: chown d5/d115/f96 15 1 2024-04-23T10:18:58.359 INFO:tasks.workunit.client.0.smithi026.stdout:4/933: rename d4/d14/d30/da2/d10c/c3a to d4/d5b/df0/c138 0 2024-04-23T10:18:58.361 INFO:tasks.workunit.client.0.smithi026.stdout:9/983: truncate d13/d31/d87/fe5 961976 0 2024-04-23T10:18:58.363 INFO:tasks.workunit.client.0.smithi026.stdout:8/976: chown d5/f127 34668721 1 2024-04-23T10:18:58.364 INFO:tasks.workunit.client.0.smithi026.stdout:2/813: readlink d3/d19/d1d/l8f 0 2024-04-23T10:18:58.365 INFO:tasks.workunit.client.0.smithi026.stdout:7/774: chown dd/d46/l84 15510931 1 2024-04-23T10:18:58.365 INFO:tasks.workunit.client.0.smithi026.stdout:4/934: mkdir d4/d14/d139 0 2024-04-23T10:18:58.368 INFO:tasks.workunit.client.0.smithi026.stdout:5/853: dwrite d0/fdc [0,4194304] 0 2024-04-23T10:18:58.371 INFO:tasks.workunit.client.0.smithi026.stdout:9/984: chown d13/d3b/d5b/dc9 189672 1 2024-04-23T10:18:58.372 INFO:tasks.workunit.client.0.smithi026.stdout:3/866: fdatasync d0/d1e/d23/d87/db3/dee/d39/dda/f120 0 2024-04-23T10:18:58.377 INFO:tasks.workunit.client.0.smithi026.stdout:7/775: read dd/f35 [6326269,95779] 0 2024-04-23T10:18:58.383 INFO:tasks.workunit.client.0.smithi026.stdout:1/799: rename dd/d15/d7d/d98 to dd/d15/d7d/df6/d114 0 2024-04-23T10:18:58.384 INFO:tasks.workunit.client.0.smithi026.stdout:6/992: dwrite d6/d21/d58/f96 [0,4194304] 0 2024-04-23T10:18:58.387 INFO:tasks.workunit.client.0.smithi026.stdout:8/977: creat d5/d56/d3f/f146 x:0 0 0 2024-04-23T10:18:58.390 INFO:tasks.workunit.client.0.smithi026.stdout:3/867: unlink d0/d1e/d30/d43/d82/f117 0 2024-04-23T10:18:58.392 INFO:tasks.workunit.client.0.smithi026.stdout:9/985: dwrite d13/f22 [0,4194304] 0 2024-04-23T10:18:58.397 INFO:tasks.workunit.client.0.smithi026.stdout:8/978: chown d5/d115/d22/d65/d78/d3e/fc6 77331 1 2024-04-23T10:18:58.397 INFO:tasks.workunit.client.0.smithi026.stdout:5/854: symlink d0/d3c/d5d/db2/dc6/dd4/l132 0 2024-04-23T10:18:58.400 INFO:tasks.workunit.client.0.smithi026.stdout:6/993: read d6/d13/fa0 [1875829,60740] 0 2024-04-23T10:18:58.401 INFO:tasks.workunit.client.0.smithi026.stdout:1/800: mkdir dd/d1a/d20/d25/d35/d43/d115 0 2024-04-23T10:18:58.409 INFO:tasks.workunit.client.0.smithi026.stdout:2/814: dwrite d3/d19/d21/d23/da2/db8/ffd [0,4194304] 0 2024-04-23T10:18:58.411 INFO:tasks.workunit.client.0.smithi026.stdout:3/868: getdents d0/d1e/d30/d43/df/d63 0 2024-04-23T10:18:58.412 INFO:tasks.workunit.client.0.smithi026.stdout:1/801: mknod dd/d1a/d20/d25/d35/d7f/dd5/c116 0 2024-04-23T10:18:58.423 INFO:tasks.workunit.client.0.smithi026.stdout:5/855: write d0/f2a [509891,6124] 0 2024-04-23T10:18:58.426 INFO:tasks.workunit.client.0.smithi026.stdout:1/802: dread - dd/d48/dab/fca zero size 2024-04-23T10:18:58.428 INFO:tasks.workunit.client.0.smithi026.stdout:6/994: write d6/d21/d2f/d37/d9a/db1/ff8 [5016443,13615] 0 2024-04-23T10:18:58.430 INFO:tasks.workunit.client.0.smithi026.stdout:2/815: creat d3/d19/d21/d23/dec/f111 x:0 0 0 2024-04-23T10:18:58.430 INFO:tasks.workunit.client.0.smithi026.stdout:3/869: write d0/d1e/d30/f4f [2626430,30124] 0 2024-04-23T10:18:58.433 INFO:tasks.workunit.client.0.smithi026.stdout:4/935: dwrite d4/d1b/dbf/dda/d6c/dd7/f122 [0,4194304] 0 2024-04-23T10:18:58.436 INFO:tasks.workunit.client.0.smithi026.stdout:9/986: dwrite d13/d3b/d4e/d76/f91 [0,4194304] 0 2024-04-23T10:18:58.441 INFO:tasks.workunit.client.0.smithi026.stdout:1/803: chown dd/d1a/d23/c78 7889438 1 2024-04-23T10:18:58.444 INFO:tasks.workunit.client.0.smithi026.stdout:7/776: dwrite dd/d6c/d72/dd0/fdc [0,4194304] 0 2024-04-23T10:18:58.447 INFO:tasks.workunit.client.0.smithi026.stdout:6/995: mknod d6/db8/c133 0 2024-04-23T10:18:58.448 INFO:tasks.workunit.client.0.smithi026.stdout:1/804: rmdir dd 39 2024-04-23T10:18:58.448 INFO:tasks.workunit.client.0.smithi026.stdout:8/979: dwrite d5/d56/d15/d76/f85 [0,4194304] 0 2024-04-23T10:18:58.450 INFO:tasks.workunit.client.0.smithi026.stdout:3/870: dread d0/d1e/d30/d43/d82/f10a [0,4194304] 0 2024-04-23T10:18:58.453 INFO:tasks.workunit.client.0.smithi026.stdout:4/936: rmdir d4/d5b/df0/d114 39 2024-04-23T10:18:58.455 INFO:tasks.workunit.client.0.smithi026.stdout:3/871: readlink d0/d1e/d30/d43/d6c/lbc 0 2024-04-23T10:18:58.458 INFO:tasks.workunit.client.0.smithi026.stdout:4/937: dread - d4/d5b/d7b/f6b zero size 2024-04-23T10:18:58.461 INFO:tasks.workunit.client.0.smithi026.stdout:8/980: read d5/d56/f12c [201354,36244] 0 2024-04-23T10:18:58.463 INFO:tasks.workunit.client.0.smithi026.stdout:6/996: unlink d6/d21/d2f/d31/d52/c6e 0 2024-04-23T10:18:58.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/816: rename d3/d19/d21/dc6/cfe to d3/d19/d4d/c112 0 2024-04-23T10:18:58.465 INFO:tasks.workunit.client.0.smithi026.stdout:7/777: dread dd/d6c/fa2 [0,4194304] 0 2024-04-23T10:18:58.467 INFO:tasks.workunit.client.0.smithi026.stdout:2/817: rmdir d3/d19/d1d 39 2024-04-23T10:18:58.468 INFO:tasks.workunit.client.0.smithi026.stdout:9/987: mkdir d13/d36/d66/dc2/de7/d133 0 2024-04-23T10:18:58.470 INFO:tasks.workunit.client.0.smithi026.stdout:3/872: creat d0/d1e/d30/d43/d82/f126 x:0 0 0 2024-04-23T10:18:58.471 INFO:tasks.workunit.client.0.smithi026.stdout:2/818: chown d3/d19/d21/d23/d3a/d3c/d5d 2611822 1 2024-04-23T10:18:58.471 INFO:tasks.workunit.client.0.smithi026.stdout:6/997: symlink d6/d21/d2f/l134 0 2024-04-23T10:18:58.472 INFO:tasks.workunit.client.0.smithi026.stdout:5/856: rename d0/d3c/d5d/db2/dca/c12e to d0/d3c/d5d/dbc/d107/d111/d116/c133 0 2024-04-23T10:18:58.472 INFO:tasks.workunit.client.0.smithi026.stdout:4/938: getdents d4/d1b/dbf/dda/d6c/dd7/dfe 0 2024-04-23T10:18:58.473 INFO:tasks.workunit.client.0.smithi026.stdout:8/981: creat d5/d56/de8/f147 x:0 0 0 2024-04-23T10:18:58.479 INFO:tasks.workunit.client.0.smithi026.stdout:8/982: symlink d5/d115/d22/d65/l148 0 2024-04-23T10:18:58.481 INFO:tasks.workunit.client.0.smithi026.stdout:5/857: creat d0/d12/d112/f134 x:0 0 0 2024-04-23T10:18:58.482 INFO:tasks.workunit.client.0.smithi026.stdout:7/778: readlink dd/d3f/d47/d4c/d60/d75/lb6 0 2024-04-23T10:18:58.483 INFO:tasks.workunit.client.0.smithi026.stdout:8/983: chown d5/d115/d22/d108 3 1 2024-04-23T10:18:58.484 INFO:tasks.workunit.client.0.smithi026.stdout:1/805: dread dd/d1a/d6a/f86 [0,4194304] 0 2024-04-23T10:18:58.486 INFO:tasks.workunit.client.0.smithi026.stdout:5/858: chown d0/d12/dfb/d10b/f122 2617456 1 2024-04-23T10:18:58.487 INFO:tasks.workunit.client.0.smithi026.stdout:2/819: write d3/d19/d21/d23/fc1 [157414,53676] 0 2024-04-23T10:18:58.487 INFO:tasks.workunit.client.0.smithi026.stdout:1/806: rmdir dd/d1a/d23/d69 39 2024-04-23T10:18:58.488 INFO:tasks.workunit.client.0.smithi026.stdout:5/859: readlink d0/d12/l7e 0 2024-04-23T10:18:58.490 INFO:tasks.workunit.client.0.smithi026.stdout:8/984: mknod d5/d115/d22/d106/c149 0 2024-04-23T10:18:58.494 INFO:tasks.workunit.client.0.smithi026.stdout:1/807: fdatasync dd/d1a/d23/f89 0 2024-04-23T10:18:58.496 INFO:tasks.workunit.client.0.smithi026.stdout:9/988: dread d13/d3e/f44 [0,4194304] 0 2024-04-23T10:18:58.496 INFO:tasks.workunit.client.0.smithi026.stdout:5/860: unlink d0/f25 0 2024-04-23T10:18:58.497 INFO:tasks.workunit.client.0.smithi026.stdout:4/939: dwrite d4/d7/f13 [4194304,4194304] 0 2024-04-23T10:18:58.499 INFO:tasks.workunit.client.0.smithi026.stdout:6/998: link d6/d13/d15/cb7 d6/d21/d2f/d32/d53/dca/ddc/d130/c135 0 2024-04-23T10:18:58.504 INFO:tasks.workunit.client.0.smithi026.stdout:8/985: write d5/d115/d22/d65/d78/d3e/fc6 [3283843,4109] 0 2024-04-23T10:18:58.506 INFO:tasks.workunit.client.0.smithi026.stdout:4/940: fsync d4/d5b/d7b/f9f 0 2024-04-23T10:18:58.511 INFO:tasks.workunit.client.0.smithi026.stdout:2/820: rename d3/d19/d21/d23/d3a/d3c/d80/da7/fd6 to d3/d19/d21/f113 0 2024-04-23T10:18:58.512 INFO:tasks.workunit.client.0.smithi026.stdout:5/861: creat d0/f135 x:0 0 0 2024-04-23T10:18:58.513 INFO:tasks.workunit.client.0.smithi026.stdout:1/808: write dd/d1a/f83 [4475424,83832] 0 2024-04-23T10:18:58.515 INFO:tasks.workunit.client.0.smithi026.stdout:2/821: chown d3/d19/d21/d23/d3a/d3c/d5d/da0 12261 1 2024-04-23T10:18:58.520 INFO:tasks.workunit.client.0.smithi026.stdout:2/822: chown d3/d19/d21/d23/d3a/d65/f86 42864 1 2024-04-23T10:18:58.521 INFO:tasks.workunit.client.0.smithi026.stdout:9/989: rename d13/d1b/d26/d88/db5/dd9 to d13/d3b/d68/dd6/d11e/d134 0 2024-04-23T10:18:58.521 INFO:tasks.workunit.client.0.smithi026.stdout:5/862: creat d0/d3c/d84/d89/d8d/f136 x:0 0 0 2024-04-23T10:18:58.526 INFO:tasks.workunit.client.0.smithi026.stdout:5/863: readlink d0/d3c/d84/lff 0 2024-04-23T10:18:58.529 INFO:tasks.workunit.client.0.smithi026.stdout:6/999: rename d6/c1e to d6/d21/d2f/d37/d68/da8/c136 0 2024-04-23T10:18:58.532 INFO:tasks.workunit.client.0.smithi026.stdout:2/823: write d3/d19/d21/d23/d3a/d3c/fdf [4940,48002] 0 2024-04-23T10:18:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:4/941: dwrite d4/d22/d2e/fdd [0,4194304] 0 2024-04-23T10:18:58.534 INFO:tasks.workunit.client.0.smithi026.stdout:1/809: dwrite dd/d1a/d20/d25/d35/f53 [4194304,4194304] 0 2024-04-23T10:18:58.535 INFO:tasks.workunit.client.0.smithi026.stdout:5/864: truncate d0/d3c/faf 682700 0 2024-04-23T10:18:58.538 INFO:tasks.workunit.client.0.smithi026.stdout:5/865: chown d0/d68/dcc/f130 0 1 2024-04-23T10:18:58.538 INFO:tasks.workunit.client.0.smithi026.stdout:2/824: dread - d3/dd/f10c zero size 2024-04-23T10:18:58.542 INFO:tasks.workunit.client.0.smithi026.stdout:1/810: rename dd/d1a/d23/d3f/l7a to dd/d1a/d23/l117 0 2024-04-23T10:18:58.543 INFO:tasks.workunit.client.0.smithi026.stdout:2/825: symlink d3/d19/d21/l114 0 2024-04-23T10:18:58.553 INFO:tasks.workunit.client.0.smithi026.stdout:5/866: getdents d0/d3c/d5d/dbc/d107/d111/d116 0 2024-04-23T10:18:58.557 INFO:tasks.workunit.client.0.smithi026.stdout:9/990: dread d13/d36/d66/dc2/dc3/f12c [0,4194304] 0 2024-04-23T10:18:58.561 INFO:tasks.workunit.client.0.smithi026.stdout:1/811: link dd/d48/dcf/fe1 dd/deb/df9/f118 0 2024-04-23T10:18:58.562 INFO:tasks.workunit.client.0.smithi026.stdout:9/991: readlink d13/d36/d66/dbf/ld4 0 2024-04-23T10:18:58.562 INFO:tasks.workunit.client.0.smithi026.stdout:5/867: fsync d0/d3c/d5d/db2/dc6/dd4/f106 0 2024-04-23T10:18:58.563 INFO:tasks.workunit.client.0.smithi026.stdout:2/826: dwrite d3/dd/f18 [4194304,4194304] 0 2024-04-23T10:18:58.565 INFO:tasks.workunit.client.0.smithi026.stdout:4/942: dread d4/d22/d4e/d57/faf [0,4194304] 0 2024-04-23T10:18:58.567 INFO:tasks.workunit.client.0.smithi026.stdout:2/827: dread - d3/dd/fb4 zero size 2024-04-23T10:18:58.568 INFO:tasks.workunit.client.0.smithi026.stdout:5/868: fdatasync d0/d3c/d84/f11f 0 2024-04-23T10:18:58.569 INFO:tasks.workunit.client.0.smithi026.stdout:1/812: mkdir dd/d1a/d20/d25/d35/d7f/d119 0 2024-04-23T10:18:58.572 INFO:tasks.workunit.client.0.smithi026.stdout:9/992: creat d13/d105/f135 x:0 0 0 2024-04-23T10:18:58.581 INFO:tasks.workunit.client.0.smithi026.stdout:9/993: mkdir d13/d1b/d12f/d136 0 2024-04-23T10:18:58.582 INFO:tasks.workunit.client.0.smithi026.stdout:4/943: mknod d4/d5b/da7/dba/c13a 0 2024-04-23T10:18:58.584 INFO:tasks.workunit.client.0.smithi026.stdout:1/813: mkdir dd/d1a/d23/d3f/d9a/d9e/d11a 0 2024-04-23T10:18:58.587 INFO:tasks.workunit.client.0.smithi026.stdout:2/828: dwrite d3/d19/f5a [0,4194304] 0 2024-04-23T10:18:58.588 INFO:tasks.workunit.client.0.smithi026.stdout:9/994: stat d13/d3b/d68/dd6/d45/d67/f95 0 2024-04-23T10:18:58.588 INFO:tasks.workunit.client.0.smithi026.stdout:5/869: write d0/d3c/d5d/db2/dc6/df5/df6/ffe [238175,15539] 0 2024-04-23T10:18:58.591 INFO:tasks.workunit.client.0.smithi026.stdout:2/829: chown d3/d19/d21/c41 42 1 2024-04-23T10:18:58.593 INFO:tasks.workunit.client.0.smithi026.stdout:1/814: truncate dd/d1a/d20/f5f 1137412 0 2024-04-23T10:18:58.597 INFO:tasks.workunit.client.0.smithi026.stdout:5/870: rmdir d0/d3c/d5d/d3a 39 2024-04-23T10:18:58.599 INFO:tasks.workunit.client.0.smithi026.stdout:5/871: chown d0/d3c/d5d/f121 1509 1 2024-04-23T10:18:58.603 INFO:tasks.workunit.client.0.smithi026.stdout:4/944: link d4/d7/f3e d4/d42/f13b 0 2024-04-23T10:18:58.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/815: stat dd/d15/d7d/df6/d114/lb0 0 2024-04-23T10:18:58.606 INFO:tasks.workunit.client.0.smithi026.stdout:9/995: getdents d13/d105 0 2024-04-23T10:18:58.608 INFO:tasks.workunit.client.0.smithi026.stdout:1/816: dread - dd/d1a/d20/fcd zero size 2024-04-23T10:18:58.609 INFO:tasks.workunit.client.0.smithi026.stdout:5/872: symlink d0/d3c/d57/l137 0 2024-04-23T10:18:58.609 INFO:tasks.workunit.client.0.smithi026.stdout:4/945: creat d4/d14/d139/f13c x:0 0 0 2024-04-23T10:18:58.613 INFO:tasks.workunit.client.0.smithi026.stdout:1/817: getdents dd/deb 0 2024-04-23T10:18:58.614 INFO:tasks.workunit.client.0.smithi026.stdout:2/830: dwrite d3/d19/d21/d23/d108/dd8/fe5 [0,4194304] 0 2024-04-23T10:18:58.618 INFO:tasks.workunit.client.0.smithi026.stdout:5/873: creat d0/d3c/d5d/db2/dc6/df5/ddf/f138 x:0 0 0 2024-04-23T10:18:58.619 INFO:tasks.workunit.client.0.smithi026.stdout:4/946: dread d4/d14/d30/da2/d10c/f2d [0,4194304] 0 2024-04-23T10:18:58.621 INFO:tasks.workunit.client.0.smithi026.stdout:1/818: creat dd/d1a/d23/d92/f11b x:0 0 0 2024-04-23T10:18:58.628 INFO:tasks.workunit.client.0.smithi026.stdout:4/947: readlink d4/d5b/da7/dba/l10d 0 2024-04-23T10:18:58.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/819: truncate dd/d1a/d20/d25/f4a 469241 0 2024-04-23T10:18:58.633 INFO:tasks.workunit.client.0.smithi026.stdout:5/874: dwrite d0/d3c/f65 [0,4194304] 0 2024-04-23T10:18:58.636 INFO:tasks.workunit.client.0.smithi026.stdout:2/831: rename d3/d19/d4d/f78 to d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f115 0 2024-04-23T10:18:58.639 INFO:tasks.workunit.client.0.smithi026.stdout:1/820: creat dd/d15/d7d/df6/d114/f11c x:0 0 0 2024-04-23T10:18:58.643 INFO:tasks.workunit.client.0.smithi026.stdout:2/832: creat d3/d19/d21/f116 x:0 0 0 2024-04-23T10:18:58.647 INFO:tasks.workunit.client.0.smithi026.stdout:5/875: write d0/d3c/d84/d89/d8d/d8f/f12c [230533,50614] 0 2024-04-23T10:18:58.652 INFO:tasks.workunit.client.0.smithi026.stdout:5/876: fsync d0/d3c/d5d/f121 0 2024-04-23T10:18:58.652 INFO:tasks.workunit.client.0.smithi026.stdout:1/821: write dd/d15/d7d/da1/dc6/ddc/f101 [629459,88725] 0 2024-04-23T10:18:58.660 INFO:tasks.workunit.client.0.smithi026.stdout:2/833: dread d3/dd/f30 [0,4194304] 0 2024-04-23T10:18:58.668 INFO:tasks.workunit.client.0.smithi026.stdout:1/822: dwrite dd/d1a/d23/f89 [0,4194304] 0 2024-04-23T10:18:58.671 INFO:tasks.workunit.client.0.smithi026.stdout:5/877: dread d0/d3c/d5d/f6b [0,4194304] 0 2024-04-23T10:18:58.674 INFO:tasks.workunit.client.0.smithi026.stdout:5/878: stat d0/d3c/d84/d89/c92 0 2024-04-23T10:18:58.675 INFO:tasks.workunit.client.0.smithi026.stdout:2/834: write d3/d19/d21/d23/d3a/d3c/d80/fbd [2495553,21827] 0 2024-04-23T10:18:58.676 INFO:tasks.workunit.client.0.smithi026.stdout:1/823: write dd/d1a/d20/fa8 [221560,107688] 0 2024-04-23T10:18:58.683 INFO:tasks.workunit.client.0.smithi026.stdout:2/835: chown d3/d19/d21/d23/d3a/d3c/d80/d96/lb9 30266267 1 2024-04-23T10:18:58.684 INFO:tasks.workunit.client.0.smithi026.stdout:5/879: write d0/d3c/d5d/dbc/fce [5004481,6040] 0 2024-04-23T10:18:58.686 INFO:tasks.workunit.client.0.smithi026.stdout:5/880: write d0/d3c/d84/d89/d8d/d8f/f12c [669633,111973] 0 2024-04-23T10:18:58.689 INFO:tasks.workunit.client.0.smithi026.stdout:2/836: chown d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f6a 137 1 2024-04-23T10:18:58.694 INFO:tasks.workunit.client.0.smithi026.stdout:2/837: creat d3/dd/df2/f117 x:0 0 0 2024-04-23T10:18:58.696 INFO:tasks.workunit.client.0.smithi026.stdout:1/824: dread dd/d1a/ff4 [0,4194304] 0 2024-04-23T10:18:58.698 INFO:tasks.workunit.client.0.smithi026.stdout:5/881: rename d0/d12/c7b to d0/d3c/d5d/db2/dc6/df5/ddf/d108/c139 0 2024-04-23T10:18:58.698 INFO:tasks.workunit.client.0.smithi026.stdout:1/825: rmdir dd/d48/dab 39 2024-04-23T10:18:58.700 INFO:tasks.workunit.client.0.smithi026.stdout:5/882: read d0/d3c/d84/f9d [242785,22673] 0 2024-04-23T10:18:58.709 INFO:tasks.workunit.client.0.smithi026.stdout:2/838: dwrite d3/dd/d4b/f64 [0,4194304] 0 2024-04-23T10:18:58.710 INFO:tasks.workunit.client.0.smithi026.stdout:1/826: dwrite dd/d1a/d20/fcd [0,4194304] 0 2024-04-23T10:18:58.713 INFO:tasks.workunit.client.0.smithi026.stdout:5/883: creat d0/d68/d91/dd6/f13a x:0 0 0 2024-04-23T10:18:58.718 INFO:tasks.workunit.client.0.smithi026.stdout:5/884: dread - d0/d3c/d5d/dbc/f124 zero size 2024-04-23T10:18:58.718 INFO:tasks.workunit.client.0.smithi026.stdout:2/839: write d3/d19/d21/f85 [2076849,85705] 0 2024-04-23T10:18:58.725 INFO:tasks.workunit.client.0.smithi026.stdout:2/840: chown d3/d19/d21/d23/f33 337274307 1 2024-04-23T10:18:58.727 INFO:tasks.workunit.client.0.smithi026.stdout:1/827: dwrite dd/d15/f68 [0,4194304] 0 2024-04-23T10:18:58.731 INFO:tasks.workunit.client.0.smithi026.stdout:5/885: unlink d0/d68/d91/d9a/ff7 0 2024-04-23T10:18:58.733 INFO:tasks.workunit.client.0.smithi026.stdout:1/828: rmdir dd/d48 39 2024-04-23T10:18:58.740 INFO:tasks.workunit.client.0.smithi026.stdout:5/886: fsync d0/d3c/fd2 0 2024-04-23T10:18:58.745 INFO:tasks.workunit.client.0.smithi026.stdout:1/829: dwrite dd/deb/f10f [0,4194304] 0 2024-04-23T10:18:58.748 INFO:tasks.workunit.client.0.smithi026.stdout:2/841: dread d3/dd/f2d [0,4194304] 0 2024-04-23T10:18:58.753 INFO:tasks.workunit.client.0.smithi026.stdout:5/887: mkdir d0/d3c/d5d/db2/dc6/df5/ddf/d108/d13b 0 2024-04-23T10:18:58.754 INFO:tasks.workunit.client.0.smithi026.stdout:2/842: creat d3/dd/def/f118 x:0 0 0 2024-04-23T10:18:58.757 INFO:tasks.workunit.client.0.smithi026.stdout:1/830: mkdir dd/d48/dab/d11d 0 2024-04-23T10:18:58.759 INFO:tasks.workunit.client.0.smithi026.stdout:5/888: readlink d0/d3c/d5d/d3a/lba 0 2024-04-23T10:18:58.762 INFO:tasks.workunit.client.0.smithi026.stdout:2/843: truncate d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f81 226778 0 2024-04-23T10:18:58.770 INFO:tasks.workunit.client.0.smithi026.stdout:1/831: write dd/d1a/d23/f7e [670862,121720] 0 2024-04-23T10:18:58.773 INFO:tasks.workunit.client.0.smithi026.stdout:2/844: link d3/d19/d21/f116 d3/d19/d31/d83/f119 0 2024-04-23T10:18:58.775 INFO:tasks.workunit.client.0.smithi026.stdout:5/889: dwrite d0/d3c/d84/d89/f11e [0,4194304] 0 2024-04-23T10:18:58.780 INFO:tasks.workunit.client.0.smithi026.stdout:2/845: dread d3/d19/d31/f91 [0,4194304] 0 2024-04-23T10:18:58.784 INFO:tasks.workunit.client.0.smithi026.stdout:5/890: creat d0/d3c/d5d/db2/dc6/f13c x:0 0 0 2024-04-23T10:18:58.786 INFO:tasks.workunit.client.0.smithi026.stdout:5/891: chown d0/d3c/d5d/c35 255 1 2024-04-23T10:18:58.787 INFO:tasks.workunit.client.0.smithi026.stdout:1/832: dwrite dd/d1a/d23/d69/d105/f10c [4194304,4194304] 0 2024-04-23T10:18:58.789 INFO:tasks.workunit.client.0.smithi026.stdout:2/846: creat d3/d19/d21/d23/d3a/f11a x:0 0 0 2024-04-23T10:18:58.791 INFO:tasks.workunit.client.0.smithi026.stdout:1/833: truncate dd/d15/f32 2371296 0 2024-04-23T10:18:58.798 INFO:tasks.workunit.client.0.smithi026.stdout:1/834: dread - dd/d1a/d23/d92/fa2 zero size 2024-04-23T10:18:58.804 INFO:tasks.workunit.client.0.smithi026.stdout:5/892: dwrite d0/d12/f98 [0,4194304] 0 2024-04-23T10:18:58.806 INFO:tasks.workunit.client.0.smithi026.stdout:2/847: dwrite d3/d19/d1d/f25 [0,4194304] 0 2024-04-23T10:18:58.808 INFO:tasks.workunit.client.0.smithi026.stdout:1/835: write dd/d1a/d23/d3f/f52 [864845,43780] 0 2024-04-23T10:18:58.810 INFO:tasks.workunit.client.0.smithi026.stdout:5/893: mknod d0/d3c/d5d/db2/d12b/c13d 0 2024-04-23T10:18:58.817 INFO:tasks.workunit.client.0.smithi026.stdout:1/836: chown dd/d1a/d20/d25/d35/d74/fb4 24245747 1 2024-04-23T10:18:58.826 INFO:tasks.workunit.client.0.smithi026.stdout:1/837: dwrite dd/d1a/d23/d69/d105/f10c [0,4194304] 0 2024-04-23T10:18:58.829 INFO:tasks.workunit.client.0.smithi026.stdout:5/894: dwrite d0/d3c/d84/d89/fc7 [4194304,4194304] 0 2024-04-23T10:18:58.830 INFO:tasks.workunit.client.0.smithi026.stdout:1/838: stat dd/d1a/d20/d25/df3 0 2024-04-23T10:18:58.839 INFO:tasks.workunit.client.0.smithi026.stdout:2/848: rename d3/d19/d21/d23/d3a/d3c/df1 to d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/d11b 0 2024-04-23T10:18:58.840 INFO:tasks.workunit.client.0.smithi026.stdout:5/895: symlink d0/d3c/d84/l13e 0 2024-04-23T10:18:58.849 INFO:tasks.workunit.client.0.smithi026.stdout:1/839: truncate dd/d1a/f83 1804065 0 2024-04-23T10:18:58.854 INFO:tasks.workunit.client.0.smithi026.stdout:5/896: write d0/d3c/f3d [2891778,85588] 0 2024-04-23T10:18:58.862 INFO:tasks.workunit.client.0.smithi026.stdout:5/897: dwrite d0/fdc [4194304,4194304] 0 2024-04-23T10:18:58.864 INFO:tasks.workunit.client.0.smithi026.stdout:1/840: getdents dd/d48/dac 0 2024-04-23T10:18:58.879 INFO:tasks.workunit.client.0.smithi026.stdout:1/841: dread dd/d48/f72 [0,4194304] 0 2024-04-23T10:18:58.880 INFO:tasks.workunit.client.0.smithi026.stdout:5/898: fsync d0/d12/f3f 0 2024-04-23T10:18:58.882 INFO:tasks.workunit.client.0.smithi026.stdout:5/899: chown d0/d12/c82 109621 1 2024-04-23T10:18:58.886 INFO:tasks.workunit.client.0.smithi026.stdout:1/842: write dd/d15/fa7 [591191,34759] 0 2024-04-23T10:18:58.889 INFO:tasks.workunit.client.0.smithi026.stdout:5/900: creat d0/d12/dfb/d10b/f13f x:0 0 0 2024-04-23T10:18:58.891 INFO:tasks.workunit.client.0.smithi026.stdout:1/843: creat dd/d48/dab/f11e x:0 0 0 2024-04-23T10:18:58.893 INFO:tasks.workunit.client.0.smithi026.stdout:1/844: chown dd/d1a/d20/d25/fa9 169605931 1 2024-04-23T10:18:58.896 INFO:tasks.workunit.client.0.smithi026.stdout:1/845: rename dd/f3b to dd/d1a/d20/d25/df3/d111/f11f 0 2024-04-23T10:18:58.902 INFO:tasks.workunit.client.0.smithi026.stdout:5/901: write d0/d68/dea/d109/f126 [725766,10733] 0 2024-04-23T10:18:58.906 INFO:tasks.workunit.client.0.smithi026.stdout:5/902: read d0/f80 [1951383,79643] 0 2024-04-23T10:18:59.075 INFO:tasks.workunit.client.0.smithi026.stdout:3/873: sync 2024-04-23T10:18:59.078 INFO:tasks.workunit.client.0.smithi026.stdout:1/846: truncate dd/d1a/d20/d25/d35/d43/fae 685758 0 2024-04-23T10:18:59.091 INFO:tasks.workunit.client.0.smithi026.stdout:1/847: mkdir dd/d1a/d20/d25/d35/d74/d120 0 2024-04-23T10:18:59.096 INFO:tasks.workunit.client.0.smithi026.stdout:1/848: truncate dd/d15/d7d/df6/f113 353434 0 2024-04-23T10:18:59.101 INFO:tasks.workunit.client.0.smithi026.stdout:3/874: dwrite d0/d1e/d23/fbd [4194304,4194304] 0 2024-04-23T10:18:59.112 INFO:tasks.workunit.client.0.smithi026.stdout:1/849: mkdir dd/d1a/d20/d25/d35/d7f/dd5/d121 0 2024-04-23T10:18:59.115 INFO:tasks.workunit.client.0.smithi026.stdout:3/875: write d0/d1e/d30/d43/df/d63/f7b [1895352,74966] 0 2024-04-23T10:18:59.130 INFO:tasks.workunit.client.0.smithi026.stdout:3/876: read d0/d1e/d30/d43/df/dcb/f94 [2126379,97189] 0 2024-04-23T10:18:59.132 INFO:tasks.workunit.client.0.smithi026.stdout:1/850: write dd/d15/f81 [546482,79007] 0 2024-04-23T10:18:59.134 INFO:tasks.workunit.client.0.smithi026.stdout:1/851: dread - dd/d1a/d20/d25/fa9 zero size 2024-04-23T10:18:59.137 INFO:tasks.workunit.client.0.smithi026.stdout:1/852: write dd/d1a/d23/d3f/f52 [1577063,75976] 0 2024-04-23T10:18:59.164 INFO:tasks.workunit.client.0.smithi026.stdout:7/779: sync 2024-04-23T10:18:59.165 INFO:tasks.workunit.client.0.smithi026.stdout:1/853: symlink dd/d1a/d23/d69/d105/l122 0 2024-04-23T10:18:59.167 INFO:tasks.workunit.client.0.smithi026.stdout:3/877: dwrite d0/d1e/d30/d43/dc1/fec [0,4194304] 0 2024-04-23T10:18:59.168 INFO:tasks.workunit.client.0.smithi026.stdout:7/780: chown dd/dbc 0 1 2024-04-23T10:18:59.176 INFO:tasks.workunit.client.0.smithi026.stdout:3/878: chown d0/d1e/d30/d43/df/de3/dfb 15631 1 2024-04-23T10:18:59.183 INFO:tasks.workunit.client.0.smithi026.stdout:2/849: sync 2024-04-23T10:18:59.184 INFO:tasks.workunit.client.0.smithi026.stdout:4/948: sync 2024-04-23T10:18:59.184 INFO:tasks.workunit.client.0.smithi026.stdout:9/996: sync 2024-04-23T10:18:59.184 INFO:tasks.workunit.client.0.smithi026.stdout:8/986: sync 2024-04-23T10:18:59.184 INFO:tasks.workunit.client.0.smithi026.stdout:5/903: sync 2024-04-23T10:18:59.196 INFO:tasks.workunit.client.0.smithi026.stdout:7/781: rename dd/d3f/d47/d4c/d60/d75/f7c to dd/d1d/d50/fea 0 2024-04-23T10:18:59.206 INFO:tasks.workunit.client.0.smithi026.stdout:1/854: link dd/f12 dd/d1a/d20/d25/f123 0 2024-04-23T10:18:59.213 INFO:tasks.workunit.client.0.smithi026.stdout:9/997: rmdir d13/d3b/d68/dd6/d11e 39 2024-04-23T10:18:59.214 INFO:tasks.workunit.client.0.smithi026.stdout:2/850: mkdir d3/d19/d31/d11c 0 2024-04-23T10:18:59.221 INFO:tasks.workunit.client.0.smithi026.stdout:3/879: write d0/d1e/d30/d43/d6c/d79/d73/faa [1312187,80585] 0 2024-04-23T10:18:59.226 INFO:tasks.workunit.client.0.smithi026.stdout:7/782: unlink cb 0 2024-04-23T10:18:59.228 INFO:tasks.workunit.client.0.smithi026.stdout:4/949: symlink d4/d1b/da0/l13d 0 2024-04-23T10:18:59.233 INFO:tasks.workunit.client.0.smithi026.stdout:5/904: creat d0/d3c/d5d/db2/f140 x:0 0 0 2024-04-23T10:18:59.248 INFO:tasks.workunit.client.0.smithi026.stdout:8/987: mkdir d5/d56/d33/ddc/de1/da8/d11f/d121/d14a 0 2024-04-23T10:18:59.254 INFO:tasks.workunit.client.0.smithi026.stdout:1/855: write dd/d15/d7d/da1/fb7 [474973,78003] 0 2024-04-23T10:18:59.258 INFO:tasks.workunit.client.0.smithi026.stdout:9/998: mknod d13/d3b/d68/dd6/d45/d6d/c137 0 2024-04-23T10:18:59.263 INFO:tasks.workunit.client.0.smithi026.stdout:5/905: fsync d0/d3c/d84/d89/d8d/d8f/f11d 0 2024-04-23T10:18:59.265 INFO:tasks.workunit.client.0.smithi026.stdout:7/783: truncate dd/d44/f2e 3718593 0 2024-04-23T10:18:59.266 INFO:tasks.workunit.client.0.smithi026.stdout:1/856: chown dd/d1a/d20/d25/f123 42891 1 2024-04-23T10:18:59.272 INFO:tasks.workunit.client.0.smithi026.stdout:4/950: creat d4/d5b/d7b/d36/d90/f13e x:0 0 0 2024-04-23T10:18:59.274 INFO:tasks.workunit.client.0.smithi026.stdout:7/784: readlink dd/d1d/d50/l81 0 2024-04-23T10:18:59.275 INFO:tasks.workunit.client.0.smithi026.stdout:9/999: rmdir d13/d31/d87/dce 39 2024-04-23T10:18:59.276 INFO:tasks.workunit.client.0.smithi026.stdout:2/851: link d3/dd/f30 d3/d19/d21/d23/d3a/d3c/d5d/de2/f11d 0 2024-04-23T10:18:59.277 INFO:tasks.workunit.client.0.smithi026.stdout:1/857: read dd/f2b [440335,20940] 0 2024-04-23T10:18:59.279 INFO:tasks.workunit.client.0.smithi026.stdout:3/880: rename d0/d1e/d30/d43/f7f to d0/d1e/d23/d87/df8/f127 0 2024-04-23T10:18:59.281 INFO:tasks.workunit.client.0.smithi026.stdout:2/852: readlink d3/d19/d21/d23/lbc 0 2024-04-23T10:18:59.285 INFO:tasks.workunit.client.0.smithi026.stdout:7/785: unlink dd/d46/cd3 0 2024-04-23T10:18:59.287 INFO:tasks.workunit.client.0.smithi026.stdout:4/951: creat d4/d14/d30/da2/d10c/f13f x:0 0 0 2024-04-23T10:18:59.288 INFO:tasks.workunit.client.0.smithi026.stdout:1/858: truncate dd/d1a/d20/d25/f71 1971515 0 2024-04-23T10:18:59.291 INFO:tasks.workunit.client.0.smithi026.stdout:3/881: mkdir d0/d1e/d30/d43/db4/d128 0 2024-04-23T10:18:59.292 INFO:tasks.workunit.client.0.smithi026.stdout:3/882: chown d0/d1e/d30/d43 50 1 2024-04-23T10:18:59.293 INFO:tasks.workunit.client.0.smithi026.stdout:2/853: symlink d3/d19/d21/d23/dec/l11e 0 2024-04-23T10:18:59.296 INFO:tasks.workunit.client.0.smithi026.stdout:5/906: rename d0/d3c/f97 to d0/d12/d112/f141 0 2024-04-23T10:18:59.306 INFO:tasks.workunit.client.0.smithi026.stdout:3/883: mkdir d0/d1e/d129 0 2024-04-23T10:18:59.312 INFO:tasks.workunit.client.0.smithi026.stdout:1/859: rename dd/d48/dcf/c108 to dd/d48/dac/c124 0 2024-04-23T10:18:59.314 INFO:tasks.workunit.client.0.smithi026.stdout:4/952: creat d4/d5b/d10b/f140 x:0 0 0 2024-04-23T10:18:59.318 INFO:tasks.workunit.client.0.smithi026.stdout:7/786: dwrite dd/d6c/d72/fe6 [4194304,4194304] 0 2024-04-23T10:18:59.321 INFO:tasks.workunit.client.0.smithi026.stdout:5/907: write d0/d3c/d84/d89/fc7 [5896075,126001] 0 2024-04-23T10:18:59.323 INFO:tasks.workunit.client.0.smithi026.stdout:4/953: creat d4/d1b/d95/f141 x:0 0 0 2024-04-23T10:18:59.323 INFO:tasks.workunit.client.0.smithi026.stdout:7/787: chown dd/de5 33616655 1 2024-04-23T10:18:59.324 INFO:tasks.workunit.client.0.smithi026.stdout:1/860: creat dd/d48/dab/f125 x:0 0 0 2024-04-23T10:18:59.326 INFO:tasks.workunit.client.0.smithi026.stdout:4/954: chown d4/d14/f25 1185987 1 2024-04-23T10:18:59.329 INFO:tasks.workunit.client.0.smithi026.stdout:3/884: creat d0/d1e/d30/d43/df/d72/d8c/f12a x:0 0 0 2024-04-23T10:18:59.330 INFO:tasks.workunit.client.0.smithi026.stdout:5/908: symlink d0/d68/d91/d9a/l142 0 2024-04-23T10:18:59.333 INFO:tasks.workunit.client.0.smithi026.stdout:7/788: creat dd/d1d/d78/db9/dd9/feb x:0 0 0 2024-04-23T10:18:59.334 INFO:tasks.workunit.client.0.smithi026.stdout:3/885: rmdir d0/d1e/d30/d43/d6c/d79/d73 39 2024-04-23T10:18:59.337 INFO:tasks.workunit.client.0.smithi026.stdout:1/861: creat dd/d15/d7d/df6/d114/f126 x:0 0 0 2024-04-23T10:18:59.338 INFO:tasks.workunit.client.0.smithi026.stdout:5/909: symlink d0/d3c/l143 0 2024-04-23T10:18:59.340 INFO:tasks.workunit.client.0.smithi026.stdout:7/789: symlink dd/d3f/d47/d4c/d60/d75/lec 0 2024-04-23T10:18:59.342 INFO:tasks.workunit.client.0.smithi026.stdout:4/955: rmdir d4/d14/d3d/d73/df6 39 2024-04-23T10:18:59.345 INFO:tasks.workunit.client.0.smithi026.stdout:3/886: mknod d0/d51/d5e/c12b 0 2024-04-23T10:18:59.345 INFO:tasks.workunit.client.0.smithi026.stdout:1/862: getdents dd/d15/d7d/da1/dc6 0 2024-04-23T10:18:59.346 INFO:tasks.workunit.client.0.smithi026.stdout:7/790: mkdir dd/d6c/d72/dd0/ded 0 2024-04-23T10:18:59.349 INFO:tasks.workunit.client.0.smithi026.stdout:5/910: read d0/d3c/d5d/db2/dbd/ff8 [3083951,98025] 0 2024-04-23T10:18:59.349 INFO:tasks.workunit.client.0.smithi026.stdout:1/863: symlink dd/d1a/d20/d25/d35/d43/l127 0 2024-04-23T10:18:59.350 INFO:tasks.workunit.client.0.smithi026.stdout:3/887: truncate d0/d1e/d30/d43/d82/fcf 5194051 0 2024-04-23T10:18:59.351 INFO:tasks.workunit.client.0.smithi026.stdout:7/791: symlink dd/d6c/d72/dd0/ded/lee 0 2024-04-23T10:18:59.353 INFO:tasks.workunit.client.0.smithi026.stdout:4/956: rename d4/d1b/dbf/dda/d6c/dd7/ff7 to d4/f142 0 2024-04-23T10:18:59.354 INFO:tasks.workunit.client.0.smithi026.stdout:1/864: chown dd/d48/dcf/fe1 62795416 1 2024-04-23T10:18:59.354 INFO:tasks.workunit.client.0.smithi026.stdout:2/854: write d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 [568255,76763] 0 2024-04-23T10:18:59.358 INFO:tasks.workunit.client.0.smithi026.stdout:3/888: chown d0/d1e/d23/d87/db6/ff0 1 1 2024-04-23T10:18:59.360 INFO:tasks.workunit.client.0.smithi026.stdout:7/792: creat dd/d6c/fef x:0 0 0 2024-04-23T10:18:59.361 INFO:tasks.workunit.client.0.smithi026.stdout:1/865: mknod dd/d1a/d20/d25/d35/d7f/d119/c128 0 2024-04-23T10:18:59.362 INFO:tasks.workunit.client.0.smithi026.stdout:4/957: mknod d4/d14/d92/c143 0 2024-04-23T10:18:59.365 INFO:tasks.workunit.client.0.smithi026.stdout:1/866: mknod dd/d15/c129 0 2024-04-23T10:18:59.368 INFO:tasks.workunit.client.0.smithi026.stdout:2/855: rename d3/d19/d21/d23/fc1 to d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/f11f 0 2024-04-23T10:18:59.372 INFO:tasks.workunit.client.0.smithi026.stdout:2/856: chown d3/d19/d21/d23/daf 466 1 2024-04-23T10:18:59.374 INFO:tasks.workunit.client.0.smithi026.stdout:1/867: fdatasync dd/f21 0 2024-04-23T10:18:59.375 INFO:tasks.workunit.client.0.smithi026.stdout:2/857: dread - d3/d19/d31/d83/f119 zero size 2024-04-23T10:18:59.383 INFO:tasks.workunit.client.0.smithi026.stdout:4/958: getdents d4/d22/dd8/de1 0 2024-04-23T10:18:59.389 INFO:tasks.workunit.client.0.smithi026.stdout:1/868: mkdir dd/d1a/d20/d25/d35/d7f/dd5/dde/d12a 0 2024-04-23T10:18:59.392 INFO:tasks.workunit.client.0.smithi026.stdout:2/858: getdents d3/d19/d21 0 2024-04-23T10:18:59.396 INFO:tasks.workunit.client.0.smithi026.stdout:5/911: dwrite d0/d12/f3f [0,4194304] 0 2024-04-23T10:18:59.400 INFO:tasks.workunit.client.0.smithi026.stdout:1/869: unlink dd/d15/f68 0 2024-04-23T10:18:59.402 INFO:tasks.workunit.client.0.smithi026.stdout:7/793: dwrite dd/d3f/d47/d4c/fcc [0,4194304] 0 2024-04-23T10:18:59.403 INFO:tasks.workunit.client.0.smithi026.stdout:1/870: dread - dd/d15/d7d/df6/d114/f126 zero size 2024-04-23T10:18:59.406 INFO:tasks.workunit.client.0.smithi026.stdout:2/859: dwrite d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 [0,4194304] 0 2024-04-23T10:18:59.423 INFO:tasks.workunit.client.0.smithi026.stdout:4/959: creat d4/d1b/dbf/dda/d6c/d6f/f144 x:0 0 0 2024-04-23T10:18:59.454 INFO:tasks.workunit.client.0.smithi026.stdout:7/794: creat dd/d46/ff0 x:0 0 0 2024-04-23T10:18:59.460 INFO:tasks.workunit.client.0.smithi026.stdout:8/988: sync 2024-04-23T10:18:59.484 INFO:tasks.workunit.client.0.smithi026.stdout:4/960: dread d4/d7/fa6 [0,4194304] 0 2024-04-23T10:18:59.488 INFO:tasks.workunit.client.0.smithi026.stdout:2/860: truncate d3/d19/d21/d23/d3a/d65/f74 793077 0 2024-04-23T10:18:59.502 INFO:tasks.workunit.client.0.smithi026.stdout:2/861: unlink d3/d19/d31/d83/f119 0 2024-04-23T10:18:59.502 INFO:tasks.workunit.client.0.smithi026.stdout:2/862: chown d3/d19/d1d 1 1 2024-04-23T10:18:59.506 INFO:tasks.workunit.client.0.smithi026.stdout:7/795: rmdir dd/d1d/d78/db9/dd9 39 2024-04-23T10:18:59.511 INFO:tasks.workunit.client.0.smithi026.stdout:4/961: truncate d4/d1b/dbf/f107 745832 0 2024-04-23T10:18:59.514 INFO:tasks.workunit.client.0.smithi026.stdout:2/863: chown d3/d19/d21/d23/d3a/d3c/d80/ca5 25709 1 2024-04-23T10:18:59.519 INFO:tasks.workunit.client.0.smithi026.stdout:4/962: stat d4/d5b/da7/dba/c13a 0 2024-04-23T10:18:59.526 INFO:tasks.workunit.client.0.smithi026.stdout:3/889: sync 2024-04-23T10:18:59.528 INFO:tasks.workunit.client.0.smithi026.stdout:2/864: symlink d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/l120 0 2024-04-23T10:18:59.531 INFO:tasks.workunit.client.0.smithi026.stdout:7/796: creat dd/d3f/d47/d4c/ff1 x:0 0 0 2024-04-23T10:18:59.536 INFO:tasks.workunit.client.0.smithi026.stdout:8/989: creat d5/d56/d47/d99/f14b x:0 0 0 2024-04-23T10:18:59.537 INFO:tasks.workunit.client.0.smithi026.stdout:4/963: fdatasync d4/d5b/da7/fec 0 2024-04-23T10:18:59.548 INFO:tasks.workunit.client.0.smithi026.stdout:2/865: dread d3/d19/d21/d23/d3a/d3c/f7c [0,4194304] 0 2024-04-23T10:18:59.556 INFO:tasks.workunit.client.0.smithi026.stdout:4/964: chown d4/d5b/d7b/d4d/dad 127697 1 2024-04-23T10:18:59.559 INFO:tasks.workunit.client.0.smithi026.stdout:5/912: dwrite d0/d3c/f88 [0,4194304] 0 2024-04-23T10:18:59.560 INFO:tasks.workunit.client.0.smithi026.stdout:8/990: chown d5/d115/d64/dc5/d116 229125 1 2024-04-23T10:18:59.561 INFO:tasks.workunit.client.0.smithi026.stdout:4/965: rmdir d4/d22 39 2024-04-23T10:18:59.563 INFO:tasks.workunit.client.0.smithi026.stdout:3/890: symlink d0/d51/d5e/da4/l12c 0 2024-04-23T10:18:59.565 INFO:tasks.workunit.client.0.smithi026.stdout:7/797: rmdir dd/d2c/d48/de9 0 2024-04-23T10:18:59.567 INFO:tasks.workunit.client.0.smithi026.stdout:8/991: dread - d5/d56/d33/ddc/de1/da8/f103 zero size 2024-04-23T10:18:59.573 INFO:tasks.workunit.client.0.smithi026.stdout:5/913: symlink d0/d68/dea/l144 0 2024-04-23T10:18:59.578 INFO:tasks.workunit.client.0.smithi026.stdout:2/866: creat d3/d19/d21/d23/d3a/d3c/d5d/de2/f121 x:0 0 0 2024-04-23T10:18:59.586 INFO:tasks.workunit.client.0.smithi026.stdout:1/871: dwrite dd/f95 [4194304,4194304] 0 2024-04-23T10:18:59.587 INFO:tasks.workunit.client.0.smithi026.stdout:3/891: creat d0/d1e/d23/f12d x:0 0 0 2024-04-23T10:18:59.589 INFO:tasks.workunit.client.0.smithi026.stdout:7/798: creat dd/dbc/ff2 x:0 0 0 2024-04-23T10:18:59.591 INFO:tasks.workunit.client.0.smithi026.stdout:2/867: write d3/d19/d31/f66 [3773297,74948] 0 2024-04-23T10:18:59.595 INFO:tasks.workunit.client.0.smithi026.stdout:8/992: creat d5/d115/d22/d65/d78/d3e/d143/f14c x:0 0 0 2024-04-23T10:18:59.605 INFO:tasks.workunit.client.0.smithi026.stdout:5/914: creat d0/d68/dcc/f145 x:0 0 0 2024-04-23T10:18:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:1/872: mknod dd/d1a/d20/d25/d35/d7f/dd5/c12b 0 2024-04-23T10:18:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:7/799: symlink dd/d44/lf3 0 2024-04-23T10:18:59.614 INFO:tasks.workunit.client.0.smithi026.stdout:2/868: mkdir d3/d19/d21/d23/d3a/d122 0 2024-04-23T10:18:59.625 INFO:tasks.workunit.client.0.smithi026.stdout:3/892: dread d0/d1e/d23/d87/fc4 [0,4194304] 0 2024-04-23T10:18:59.625 INFO:tasks.workunit.client.0.smithi026.stdout:5/915: creat d0/d3c/d5d/db2/dc6/df5/df6/f146 x:0 0 0 2024-04-23T10:18:59.630 INFO:tasks.workunit.client.0.smithi026.stdout:8/993: rename d5/d56/d33/ddc/de1/fc7 to d5/d56/d33/ddc/f14d 0 2024-04-23T10:18:59.631 INFO:tasks.workunit.client.0.smithi026.stdout:1/873: creat dd/d1a/d20/d25/d35/d74/d120/f12c x:0 0 0 2024-04-23T10:18:59.632 INFO:tasks.workunit.client.0.smithi026.stdout:7/800: creat dd/d1d/d78/db9/ff4 x:0 0 0 2024-04-23T10:18:59.636 INFO:tasks.workunit.client.0.smithi026.stdout:8/994: fdatasync d5/d56/f12c 0 2024-04-23T10:18:59.639 INFO:tasks.workunit.client.0.smithi026.stdout:3/893: symlink d0/d1e/d23/d87/db6/l12e 0 2024-04-23T10:18:59.639 INFO:tasks.workunit.client.0.smithi026.stdout:3/894: chown d0/d1e/d30/d43/df 384 1 2024-04-23T10:18:59.640 INFO:tasks.workunit.client.0.smithi026.stdout:5/916: mkdir d0/d3c/d5d/db2/dca/d147 0 2024-04-23T10:18:59.642 INFO:tasks.workunit.client.0.smithi026.stdout:4/966: rename d4/d1b/dbf/dda/d6c/d6f/lc0 to d4/d5b/d7b/d86/d11c/l145 0 2024-04-23T10:18:59.645 INFO:tasks.workunit.client.0.smithi026.stdout:1/874: fdatasync dd/d1a/d23/d69/fc8 0 2024-04-23T10:18:59.646 INFO:tasks.workunit.client.0.smithi026.stdout:7/801: mknod dd/d44/cf5 0 2024-04-23T10:18:59.656 INFO:tasks.workunit.client.0.smithi026.stdout:3/895: fsync d0/d51/d5e/f68 0 2024-04-23T10:18:59.658 INFO:tasks.workunit.client.0.smithi026.stdout:5/917: getdents d0/d3c/d5d/dbc/d107/d111/d116 0 2024-04-23T10:18:59.658 INFO:tasks.workunit.client.0.smithi026.stdout:2/869: write d3/d19/d31/d83/fae [899225,8707] 0 2024-04-23T10:18:59.660 INFO:tasks.workunit.client.0.smithi026.stdout:4/967: chown d4/d22/faa 264380 1 2024-04-23T10:18:59.668 INFO:tasks.workunit.client.0.smithi026.stdout:8/995: write d5/d56/d47/f4f [598553,62844] 0 2024-04-23T10:18:59.670 INFO:tasks.workunit.client.0.smithi026.stdout:3/896: creat d0/d1e/d30/d43/df/d72/dff/f12f x:0 0 0 2024-04-23T10:18:59.671 INFO:tasks.workunit.client.0.smithi026.stdout:2/870: symlink d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/l123 0 2024-04-23T10:18:59.672 INFO:tasks.workunit.client.0.smithi026.stdout:5/918: mknod d0/d3c/d5d/db2/dc6/df5/ddf/d108/c148 0 2024-04-23T10:18:59.674 INFO:tasks.workunit.client.0.smithi026.stdout:3/897: symlink d0/d1e/d30/d43/l130 0 2024-04-23T10:18:59.680 INFO:tasks.workunit.client.0.smithi026.stdout:8/996: creat d5/d56/d33/d137/f14e x:0 0 0 2024-04-23T10:18:59.682 INFO:tasks.workunit.client.0.smithi026.stdout:5/919: symlink d0/d3c/d5d/db2/d12b/l149 0 2024-04-23T10:18:59.684 INFO:tasks.workunit.client.0.smithi026.stdout:4/968: link d4/d1b/dbf/dda/d6c/d6f/d80/f10a d4/d14/d92/dff/f146 0 2024-04-23T10:18:59.686 INFO:tasks.workunit.client.0.smithi026.stdout:5/920: creat d0/d68/dea/f14a x:0 0 0 2024-04-23T10:18:59.689 INFO:tasks.workunit.client.0.smithi026.stdout:1/875: dwrite dd/d1a/d20/d25/f5c [0,4194304] 0 2024-04-23T10:18:59.691 INFO:tasks.workunit.client.0.smithi026.stdout:7/802: dread dd/d2c/d48/d7e/f93 [0,4194304] 0 2024-04-23T10:18:59.692 INFO:tasks.workunit.client.0.smithi026.stdout:7/803: stat dd/d3f/d47 0 2024-04-23T10:18:59.692 INFO:tasks.workunit.client.0.smithi026.stdout:5/921: mkdir d0/d68/d14b 0 2024-04-23T10:18:59.695 INFO:tasks.workunit.client.0.smithi026.stdout:1/876: dread - dd/d15/fb5 zero size 2024-04-23T10:18:59.696 INFO:tasks.workunit.client.0.smithi026.stdout:7/804: fsync dd/d1d/d78/f9b 0 2024-04-23T10:18:59.704 INFO:tasks.workunit.client.0.smithi026.stdout:3/898: dwrite d0/d1e/fc7 [4194304,4194304] 0 2024-04-23T10:18:59.705 INFO:tasks.workunit.client.0.smithi026.stdout:2/871: dwrite d3/dd/f15 [0,4194304] 0 2024-04-23T10:18:59.706 INFO:tasks.workunit.client.0.smithi026.stdout:1/877: fsync dd/d1a/d20/d25/d35/fbf 0 2024-04-23T10:18:59.709 INFO:tasks.workunit.client.0.smithi026.stdout:5/922: mknod d0/d3c/d5d/db2/d12b/c14c 0 2024-04-23T10:18:59.710 INFO:tasks.workunit.client.0.smithi026.stdout:3/899: mkdir d0/d1e/d131 0 2024-04-23T10:18:59.712 INFO:tasks.workunit.client.0.smithi026.stdout:1/878: symlink dd/d15/d7d/da1/l12d 0 2024-04-23T10:18:59.717 INFO:tasks.workunit.client.0.smithi026.stdout:5/923: readlink d0/d3c/d5d/dbc/d107/d111/l123 0 2024-04-23T10:18:59.719 INFO:tasks.workunit.client.0.smithi026.stdout:4/969: dwrite d4/d5b/d7b/d86/fa3 [0,4194304] 0 2024-04-23T10:18:59.727 INFO:tasks.workunit.client.0.smithi026.stdout:4/970: getdents d4/d5b/da7 0 2024-04-23T10:18:59.728 INFO:tasks.workunit.client.0.smithi026.stdout:1/879: truncate dd/d1a/d20/d25/d35/d74/d120/f12c 690982 0 2024-04-23T10:18:59.730 INFO:tasks.workunit.client.0.smithi026.stdout:7/805: dwrite dd/d1d/d50/f5c [0,4194304] 0 2024-04-23T10:18:59.733 INFO:tasks.workunit.client.0.smithi026.stdout:4/971: chown d4/d1b/dbf/dda/d6c/dd7/dfe 203182538 1 2024-04-23T10:18:59.734 INFO:tasks.workunit.client.0.smithi026.stdout:1/880: mknod dd/d1a/d20/d25/d35/d43/c12e 0 2024-04-23T10:18:59.735 INFO:tasks.workunit.client.0.smithi026.stdout:3/900: creat d0/d1e/d23/d87/df8/f132 x:0 0 0 2024-04-23T10:18:59.736 INFO:tasks.workunit.client.0.smithi026.stdout:5/924: truncate d0/d3c/d5d/dbc/f10e 2015927 0 2024-04-23T10:18:59.737 INFO:tasks.workunit.client.0.smithi026.stdout:4/972: stat d4/d14/l3b 0 2024-04-23T10:18:59.743 INFO:tasks.workunit.client.0.smithi026.stdout:7/806: creat dd/d3f/ff6 x:0 0 0 2024-04-23T10:18:59.745 INFO:tasks.workunit.client.0.smithi026.stdout:3/901: truncate d0/d1e/d30/f8a 3909103 0 2024-04-23T10:18:59.746 INFO:tasks.workunit.client.0.smithi026.stdout:5/925: symlink d0/d3c/d5d/db2/dc6/df5/ddf/d108/l14d 0 2024-04-23T10:18:59.747 INFO:tasks.workunit.client.0.smithi026.stdout:4/973: truncate d4/f142 862462 0 2024-04-23T10:18:59.749 INFO:tasks.workunit.client.0.smithi026.stdout:4/974: dread - d4/d5b/da7/fdc zero size 2024-04-23T10:18:59.751 INFO:tasks.workunit.client.0.smithi026.stdout:2/872: dwrite d3/d19/d21/d23/d3a/d65/f87 [0,4194304] 0 2024-04-23T10:18:59.753 INFO:tasks.workunit.client.0.smithi026.stdout:7/807: link dd/d1d/d50/l81 dd/d6c/lf7 0 2024-04-23T10:18:59.756 INFO:tasks.workunit.client.0.smithi026.stdout:5/926: mknod d0/d3c/d84/c14e 0 2024-04-23T10:18:59.759 INFO:tasks.workunit.client.0.smithi026.stdout:7/808: dread - dd/d44/f86 zero size 2024-04-23T10:18:59.761 INFO:tasks.workunit.client.0.smithi026.stdout:2/873: unlink d3/c9 0 2024-04-23T10:18:59.765 INFO:tasks.workunit.client.0.smithi026.stdout:1/881: dwrite dd/d15/fb5 [0,4194304] 0 2024-04-23T10:18:59.765 INFO:tasks.workunit.client.0.smithi026.stdout:4/975: creat d4/d1b/dbf/dda/f147 x:0 0 0 2024-04-23T10:18:59.773 INFO:tasks.workunit.client.0.smithi026.stdout:4/976: chown d4/d5b/d7b/d36/d38/d83/f111 26 1 2024-04-23T10:18:59.773 INFO:tasks.workunit.client.0.smithi026.stdout:7/809: mknod dd/d1d/d7d/cf8 0 2024-04-23T10:18:59.775 INFO:tasks.workunit.client.0.smithi026.stdout:4/977: write d4/d7/f13 [6240525,73538] 0 2024-04-23T10:18:59.775 INFO:tasks.workunit.client.0.smithi026.stdout:4/978: stat d4/d1b/dbf/dda/d6c/d6f 0 2024-04-23T10:18:59.776 INFO:tasks.workunit.client.0.smithi026.stdout:3/902: rename d0/d1e/d30/d43/df/d17/f32 to d0/d1e/d30/d43/df/dcb/d97/f133 0 2024-04-23T10:18:59.777 INFO:tasks.workunit.client.0.smithi026.stdout:1/882: unlink dd/d1a/d20/d25/f71 0 2024-04-23T10:18:59.779 INFO:tasks.workunit.client.0.smithi026.stdout:5/927: getdents d0/d3c/d5d 0 2024-04-23T10:18:59.780 INFO:tasks.workunit.client.0.smithi026.stdout:2/874: creat d3/d19/d21/d23/d3a/d65/f124 x:0 0 0 2024-04-23T10:18:59.781 INFO:tasks.workunit.client.0.smithi026.stdout:7/810: chown dd/d1d/lb3 34376751 1 2024-04-23T10:18:59.782 INFO:tasks.workunit.client.0.smithi026.stdout:3/903: stat d0/d1e/d30/d77 0 2024-04-23T10:18:59.786 INFO:tasks.workunit.client.0.smithi026.stdout:3/904: fdatasync d0/f20 0 2024-04-23T10:18:59.789 INFO:tasks.workunit.client.0.smithi026.stdout:4/979: rmdir d4/d1b/dbf/dda/d6c/dd7/dfe 0 2024-04-23T10:18:59.789 INFO:tasks.workunit.client.0.smithi026.stdout:1/883: dread dd/d15/d7d/da1/fa6 [0,4194304] 0 2024-04-23T10:18:59.789 INFO:tasks.workunit.client.0.smithi026.stdout:5/928: rename d0/f135 to d0/d68/d91/f14f 0 2024-04-23T10:18:59.790 INFO:tasks.workunit.client.0.smithi026.stdout:7/811: creat dd/d3f/d47/d4c/d60/ff9 x:0 0 0 2024-04-23T10:18:59.791 INFO:tasks.workunit.client.0.smithi026.stdout:7/812: chown dd/d6c/d72/fe6 123 1 2024-04-23T10:18:59.792 INFO:tasks.workunit.client.0.smithi026.stdout:2/875: rename d3/d19 to d3/d19/d4d/d125 22 2024-04-23T10:18:59.792 INFO:tasks.workunit.client.0.smithi026.stdout:1/884: readlink dd/d1a/d23/d69/d9d/lc3 0 2024-04-23T10:18:59.796 INFO:tasks.workunit.client.0.smithi026.stdout:3/905: unlink d0/d51/d5e/da4/fba 0 2024-04-23T10:18:59.797 INFO:tasks.workunit.client.0.smithi026.stdout:7/813: mknod dd/d3f/d47/d4c/d60/d75/cfa 0 2024-04-23T10:18:59.799 INFO:tasks.workunit.client.0.smithi026.stdout:3/906: rmdir d0/d1e/d30/d43/df/d63 39 2024-04-23T10:18:59.801 INFO:tasks.workunit.client.0.smithi026.stdout:2/876: creat d3/d19/d21/d23/d3a/d3c/f126 x:0 0 0 2024-04-23T10:18:59.802 INFO:tasks.workunit.client.0.smithi026.stdout:8/997: sync 2024-04-23T10:18:59.802 INFO:tasks.workunit.client.0.smithi026.stdout:4/980: rename d4/d1b/f67 to d4/d14/d30/da2/d10c/f148 0 2024-04-23T10:18:59.805 INFO:tasks.workunit.client.0.smithi026.stdout:7/814: symlink dd/d2c/d48/d8d/lfb 0 2024-04-23T10:18:59.807 INFO:tasks.workunit.client.0.smithi026.stdout:4/981: unlink d4/d7/f102 0 2024-04-23T10:18:59.809 INFO:tasks.workunit.client.0.smithi026.stdout:2/877: mkdir d3/dd/def/d127 0 2024-04-23T10:18:59.810 INFO:tasks.workunit.client.0.smithi026.stdout:1/885: rename dd/d1a/d23/d3f/d9a/d9e/d11a to dd/d1a/d6a/d7c/d12f 0 2024-04-23T10:18:59.810 INFO:tasks.workunit.client.0.smithi026.stdout:5/929: dread d0/d3c/d5d/dbc/fce [0,4194304] 0 2024-04-23T10:18:59.811 INFO:tasks.workunit.client.0.smithi026.stdout:8/998: truncate d5/d56/d33/ddc/de1/fe5 130772 0 2024-04-23T10:18:59.813 INFO:tasks.workunit.client.0.smithi026.stdout:5/930: dread - d0/d68/d91/fc2 zero size 2024-04-23T10:18:59.814 INFO:tasks.workunit.client.0.smithi026.stdout:2/878: symlink d3/d19/d1d/l128 0 2024-04-23T10:18:59.815 INFO:tasks.workunit.client.0.smithi026.stdout:8/999: rmdir d5/d115/d64/dc5/d116 0 2024-04-23T10:18:59.817 INFO:tasks.workunit.client.0.smithi026.stdout:4/982: mknod d4/d14/d92/dff/c149 0 2024-04-23T10:18:59.820 INFO:tasks.workunit.client.0.smithi026.stdout:3/907: dread d0/d1e/d30/d43/df/f1a [0,4194304] 0 2024-04-23T10:18:59.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/879: dread d3/dd/f2d [0,4194304] 0 2024-04-23T10:18:59.820 INFO:tasks.workunit.client.0.smithi026.stdout:4/983: creat d4/d7/f14a x:0 0 0 2024-04-23T10:18:59.823 INFO:tasks.workunit.client.0.smithi026.stdout:4/984: mkdir d4/d1b/d14b 0 2024-04-23T10:18:59.825 INFO:tasks.workunit.client.0.smithi026.stdout:2/880: creat d3/d19/d21/d23/da2/db8/f129 x:0 0 0 2024-04-23T10:18:59.829 INFO:tasks.workunit.client.0.smithi026.stdout:3/908: link d0/d51/d5e/da4/fe8 d0/d4c/f134 0 2024-04-23T10:18:59.830 INFO:tasks.workunit.client.0.smithi026.stdout:2/881: truncate d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/fbf 838188 0 2024-04-23T10:18:59.838 INFO:tasks.workunit.client.0.smithi026.stdout:3/909: dwrite d0/d1e/d30/d43/df/d63/f7b [0,4194304] 0 2024-04-23T10:18:59.839 INFO:tasks.workunit.client.0.smithi026.stdout:7/815: write dd/dbc/fd1 [3605174,59517] 0 2024-04-23T10:18:59.839 INFO:tasks.workunit.client.0.smithi026.stdout:1/886: mknod dd/d1a/d23/d3f/d9a/d9e/c130 0 2024-04-23T10:18:59.841 INFO:tasks.workunit.client.0.smithi026.stdout:5/931: write d0/d3c/d5d/db2/dc6/dd4/f106 [191235,21480] 0 2024-04-23T10:18:59.845 INFO:tasks.workunit.client.0.smithi026.stdout:7/816: rmdir dd/d6c/d72/dd0 39 2024-04-23T10:18:59.850 INFO:tasks.workunit.client.0.smithi026.stdout:7/817: mkdir dd/de5/dfc 0 2024-04-23T10:18:59.850 INFO:tasks.workunit.client.0.smithi026.stdout:5/932: mkdir d0/d3c/d5d/db2/dc6/df5/df6/d150 0 2024-04-23T10:18:59.853 INFO:tasks.workunit.client.0.smithi026.stdout:7/818: mknod dd/d1d/cfd 0 2024-04-23T10:18:59.864 INFO:tasks.workunit.client.0.smithi026.stdout:3/910: dread d0/d1e/d30/d43/df/f4b [0,4194304] 0 2024-04-23T10:18:59.866 INFO:tasks.workunit.client.0.smithi026.stdout:4/985: dwrite d4/d22/d2e/f9e [0,4194304] 0 2024-04-23T10:18:59.867 INFO:tasks.workunit.client.0.smithi026.stdout:3/911: readlink d0/d1e/d23/d87/db3/dee/l4e 0 2024-04-23T10:18:59.867 INFO:tasks.workunit.client.0.smithi026.stdout:1/887: dread dd/d1a/d23/d69/fce [0,4194304] 0 2024-04-23T10:18:59.870 INFO:tasks.workunit.client.0.smithi026.stdout:1/888: rmdir dd/d15/d7d/df6 39 2024-04-23T10:18:59.871 INFO:tasks.workunit.client.0.smithi026.stdout:4/986: creat d4/d22/f14c x:0 0 0 2024-04-23T10:18:59.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/819: dread dd/d2c/d48/f59 [0,4194304] 0 2024-04-23T10:18:59.877 INFO:tasks.workunit.client.0.smithi026.stdout:1/889: chown dd/d15/d7d/df6/d114/f11c 1969 1 2024-04-23T10:18:59.880 INFO:tasks.workunit.client.0.smithi026.stdout:2/882: dwrite d3/d19/d21/d23/d3a/d3c/d80/fb1 [0,4194304] 0 2024-04-23T10:18:59.883 INFO:tasks.workunit.client.0.smithi026.stdout:5/933: dwrite d0/d12/f1f [0,4194304] 0 2024-04-23T10:18:59.887 INFO:tasks.workunit.client.0.smithi026.stdout:1/890: rename dd/d15/d7d/df6/d114 to dd/d15/d7d/da1/dd6/d131 0 2024-04-23T10:18:59.892 INFO:tasks.workunit.client.0.smithi026.stdout:1/891: mknod dd/d48/dab/c132 0 2024-04-23T10:18:59.947 INFO:tasks.workunit.client.0.smithi026.stdout:3/912: dwrite d0/d1e/d23/d87/db3/dee/d39/dda/f120 [0,4194304] 0 2024-04-23T10:18:59.948 INFO:tasks.workunit.client.0.smithi026.stdout:1/892: rmdir dd/d1a/d6a/df8 0 2024-04-23T10:18:59.954 INFO:tasks.workunit.client.0.smithi026.stdout:7/820: dwrite dd/d3f/fde [0,4194304] 0 2024-04-23T10:18:59.955 INFO:tasks.workunit.client.0.smithi026.stdout:4/987: dread d4/d22/f29 [0,4194304] 0 2024-04-23T10:18:59.959 INFO:tasks.workunit.client.0.smithi026.stdout:7/821: rename dd/d44/fc7 to dd/d1d/de7/ffe 0 2024-04-23T10:18:59.960 INFO:tasks.workunit.client.0.smithi026.stdout:4/988: mkdir d4/d7/d14d 0 2024-04-23T10:18:59.964 INFO:tasks.workunit.client.0.smithi026.stdout:5/934: dwrite d0/d3c/d84/d89/fb9 [0,4194304] 0 2024-04-23T10:18:59.967 INFO:tasks.workunit.client.0.smithi026.stdout:4/989: symlink d4/d5b/df0/l14e 0 2024-04-23T10:18:59.969 INFO:tasks.workunit.client.0.smithi026.stdout:5/935: dread - d0/d68/d91/fbb zero size 2024-04-23T10:18:59.980 INFO:tasks.workunit.client.0.smithi026.stdout:1/893: truncate dd/d1a/d23/d3f/f52 1569284 0 2024-04-23T10:18:59.981 INFO:tasks.workunit.client.0.smithi026.stdout:7/822: link dd/f1b dd/d1d/d7d/fff 0 2024-04-23T10:18:59.986 INFO:tasks.workunit.client.0.smithi026.stdout:7/823: mkdir dd/d1d/d78/d100 0 2024-04-23T10:18:59.997 INFO:tasks.workunit.client.0.smithi026.stdout:1/894: dread dd/d1a/d23/d3f/d9a/fcc [0,4194304] 0 2024-04-23T10:19:00.002 INFO:tasks.workunit.client.0.smithi026.stdout:5/936: dread d0/d3c/f41 [0,4194304] 0 2024-04-23T10:19:00.003 INFO:tasks.workunit.client.0.smithi026.stdout:1/895: link dd/d15/f4f dd/d1a/d20/d25/df3/f133 0 2024-04-23T10:19:00.003 INFO:tasks.workunit.client.0.smithi026.stdout:5/937: dread - d0/d3c/d5d/f121 zero size 2024-04-23T10:19:00.006 INFO:tasks.workunit.client.0.smithi026.stdout:1/896: rename dd/d1a/d23/c78 to dd/d48/dab/d11d/c134 0 2024-04-23T10:19:00.014 INFO:tasks.workunit.client.0.smithi026.stdout:1/897: rename dd/d1a/d20/ce2 to dd/d1a/d6a/d7c/c135 0 2024-04-23T10:19:00.017 INFO:tasks.workunit.client.0.smithi026.stdout:4/990: dwrite d4/d22/dd8/de1/f12e [0,4194304] 0 2024-04-23T10:19:00.118 INFO:tasks.workunit.client.0.smithi026.stdout:2/883: sync 2024-04-23T10:19:00.176 INFO:tasks.workunit.client.0.smithi026.stdout:3/913: sync 2024-04-23T10:19:00.218 INFO:tasks.workunit.client.0.smithi026.stdout:7/824: write dd/f41 [684698,79375] 0 2024-04-23T10:19:00.232 INFO:tasks.workunit.client.0.smithi026.stdout:3/914: creat d0/d1e/d30/d43/d122/f135 x:0 0 0 2024-04-23T10:19:00.234 INFO:tasks.workunit.client.0.smithi026.stdout:5/938: dwrite d0/d3c/d57/ff1 [0,4194304] 0 2024-04-23T10:19:00.234 INFO:tasks.workunit.client.0.smithi026.stdout:1/898: creat dd/d1a/d23/d3f/d9a/f136 x:0 0 0 2024-04-23T10:19:00.238 INFO:tasks.workunit.client.0.smithi026.stdout:4/991: mkdir d4/d5b/d7b/d4d/dc7/d14f 0 2024-04-23T10:19:00.251 INFO:tasks.workunit.client.0.smithi026.stdout:2/884: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/de9/f12a x:0 0 0 2024-04-23T10:19:00.253 INFO:tasks.workunit.client.0.smithi026.stdout:3/915: symlink d0/d1e/d30/d43/d82/l136 0 2024-04-23T10:19:00.262 INFO:tasks.workunit.client.0.smithi026.stdout:7/825: mkdir dd/d1d/d50/d58/d101 0 2024-04-23T10:19:00.264 INFO:tasks.workunit.client.0.smithi026.stdout:1/899: creat dd/d48/f137 x:0 0 0 2024-04-23T10:19:00.265 INFO:tasks.workunit.client.0.smithi026.stdout:5/939: creat d0/d3c/d5d/db2/dc6/df5/df6/f151 x:0 0 0 2024-04-23T10:19:00.268 INFO:tasks.workunit.client.0.smithi026.stdout:4/992: mkdir d4/d1b/da0/d150 0 2024-04-23T10:19:00.273 INFO:tasks.workunit.client.0.smithi026.stdout:5/940: readlink d0/d68/dcc/lc8 0 2024-04-23T10:19:00.275 INFO:tasks.workunit.client.0.smithi026.stdout:7/826: creat dd/d2c/f102 x:0 0 0 2024-04-23T10:19:00.275 INFO:tasks.workunit.client.0.smithi026.stdout:2/885: truncate d3/d19/d21/d23/d3a/d3c/f6c 4913412 0 2024-04-23T10:19:00.277 INFO:tasks.workunit.client.0.smithi026.stdout:4/993: creat d4/f151 x:0 0 0 2024-04-23T10:19:00.282 INFO:tasks.workunit.client.0.smithi026.stdout:2/886: readlink d3/d19/d1d/l8f 0 2024-04-23T10:19:00.284 INFO:tasks.workunit.client.0.smithi026.stdout:7/827: chown dd/d1d/d50/fb1 61 1 2024-04-23T10:19:00.289 INFO:tasks.workunit.client.0.smithi026.stdout:4/994: creat d4/f152 x:0 0 0 2024-04-23T10:19:00.294 INFO:tasks.workunit.client.0.smithi026.stdout:4/995: dread - d4/d5b/da7/f11a zero size 2024-04-23T10:19:00.295 INFO:tasks.workunit.client.0.smithi026.stdout:5/941: link d0/d3c/d84/f8c d0/d12/d112/f152 0 2024-04-23T10:19:00.296 INFO:tasks.workunit.client.0.smithi026.stdout:1/900: dwrite dd/d48/dab/f11e [0,4194304] 0 2024-04-23T10:19:00.299 INFO:tasks.workunit.client.0.smithi026.stdout:3/916: dwrite d0/d1e/d30/d43/df/d72/d8c/f12a [0,4194304] 0 2024-04-23T10:19:00.321 INFO:tasks.workunit.client.0.smithi026.stdout:5/942: mknod d0/d3c/d5d/db2/dc6/df5/df6/d150/c153 0 2024-04-23T10:19:00.324 INFO:tasks.workunit.client.0.smithi026.stdout:5/943: chown d0/d3c/d84/lff 114431441 1 2024-04-23T10:19:00.330 INFO:tasks.workunit.client.0.smithi026.stdout:2/887: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/de9/f12b x:0 0 0 2024-04-23T10:19:00.332 INFO:tasks.workunit.client.0.smithi026.stdout:5/944: symlink d0/d3c/d5d/db2/dca/d147/l154 0 2024-04-23T10:19:00.332 INFO:tasks.workunit.client.0.smithi026.stdout:4/996: getdents d4/d22/d2e 0 2024-04-23T10:19:00.339 INFO:tasks.workunit.client.0.smithi026.stdout:2/888: creat d3/d19/d21/d23/da2/db8/f12c x:0 0 0 2024-04-23T10:19:00.340 INFO:tasks.workunit.client.0.smithi026.stdout:5/945: mknod d0/d3c/d5d/d131/c155 0 2024-04-23T10:19:00.341 INFO:tasks.workunit.client.0.smithi026.stdout:2/889: chown d3/d19/d1d 3802 1 2024-04-23T10:19:00.343 INFO:tasks.workunit.client.0.smithi026.stdout:1/901: dwrite dd/d1a/d20/d25/fb3 [0,4194304] 0 2024-04-23T10:19:00.344 INFO:tasks.workunit.client.0.smithi026.stdout:2/890: chown d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 23 1 2024-04-23T10:19:00.347 INFO:tasks.workunit.client.0.smithi026.stdout:1/902: dread - dd/d1a/d23/d3f/d9a/f10b zero size 2024-04-23T10:19:00.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/891: chown d3/dd/def 225680 1 2024-04-23T10:19:00.350 INFO:tasks.workunit.client.0.smithi026.stdout:4/997: link d4/d1b/dbf/dda/d6c/fc4 d4/d5b/d7b/d4d/dad/f153 0 2024-04-23T10:19:00.352 INFO:tasks.workunit.client.0.smithi026.stdout:5/946: creat d0/d3c/d5d/db2/d12b/f156 x:0 0 0 2024-04-23T10:19:00.353 INFO:tasks.workunit.client.0.smithi026.stdout:2/892: chown d3/d19/d21/d23/d3a/d65/fcc 4577179 1 2024-04-23T10:19:00.353 INFO:tasks.workunit.client.0.smithi026.stdout:5/947: dread - d0/d3c/d5d/f121 zero size 2024-04-23T10:19:00.356 INFO:tasks.workunit.client.0.smithi026.stdout:1/903: creat dd/d1a/d6a/d7c/d12f/f138 x:0 0 0 2024-04-23T10:19:00.361 INFO:tasks.workunit.client.0.smithi026.stdout:4/998: mknod d4/d5b/d7b/d4d/df8/c154 0 2024-04-23T10:19:00.363 INFO:tasks.workunit.client.0.smithi026.stdout:5/948: fsync d0/d68/dcc/ffa 0 2024-04-23T10:19:00.368 INFO:tasks.workunit.client.0.smithi026.stdout:5/949: chown d0/d3c/l46 404689 1 2024-04-23T10:19:00.373 INFO:tasks.workunit.client.0.smithi026.stdout:4/999: creat d4/d5b/d7b/d36/f155 x:0 0 0 2024-04-23T10:19:00.381 INFO:tasks.workunit.client.0.smithi026.stdout:5/950: truncate d0/d3c/d84/d89/d8d/fb7 4821876 0 2024-04-23T10:19:00.382 INFO:tasks.workunit.client.0.smithi026.stdout:1/904: link dd/d1a/d20/d25/f2f dd/d1a/f139 0 2024-04-23T10:19:00.385 INFO:tasks.workunit.client.0.smithi026.stdout:2/893: dwrite d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f76 [0,4194304] 0 2024-04-23T10:19:00.387 INFO:tasks.workunit.client.0.smithi026.stdout:1/905: dread - dd/d15/d7d/da1/dc6/ddc/f110 zero size 2024-04-23T10:19:00.388 INFO:tasks.workunit.client.0.smithi026.stdout:5/951: mknod d0/d68/d91/c157 0 2024-04-23T10:19:00.392 INFO:tasks.workunit.client.0.smithi026.stdout:5/952: stat d0/d3c/fc0 0 2024-04-23T10:19:00.393 INFO:tasks.workunit.client.0.smithi026.stdout:2/894: read d3/dd/f30 [185562,116444] 0 2024-04-23T10:19:00.403 INFO:tasks.workunit.client.0.smithi026.stdout:1/906: dread dd/d1a/d20/d25/d35/d43/fae [0,4194304] 0 2024-04-23T10:19:00.405 INFO:tasks.workunit.client.0.smithi026.stdout:5/953: creat d0/d68/d91/dd6/f158 x:0 0 0 2024-04-23T10:19:00.406 INFO:tasks.workunit.client.0.smithi026.stdout:2/895: write d3/d19/d21/d23/d3a/d65/f90 [1536459,66309] 0 2024-04-23T10:19:00.410 INFO:tasks.workunit.client.0.smithi026.stdout:1/907: unlink dd/d1a/d20/d25/d35/d43/l127 0 2024-04-23T10:19:00.412 INFO:tasks.workunit.client.0.smithi026.stdout:5/954: dread - d0/d3c/d5d/db2/dc6/df5/fe0 zero size 2024-04-23T10:19:00.414 INFO:tasks.workunit.client.0.smithi026.stdout:2/896: readlink d3/d19/d21/d23/d3a/d3c/d80/da7/l100 0 2024-04-23T10:19:00.422 INFO:tasks.workunit.client.0.smithi026.stdout:7/828: sync 2024-04-23T10:19:00.423 INFO:tasks.workunit.client.0.smithi026.stdout:7/829: dread - dd/d3f/d47/d4c/d60/ff9 zero size 2024-04-23T10:19:00.435 INFO:tasks.workunit.client.0.smithi026.stdout:5/955: dwrite d0/d68/d91/dd6/f158 [0,4194304] 0 2024-04-23T10:19:00.435 INFO:tasks.workunit.client.0.smithi026.stdout:1/908: dwrite dd/d1a/d20/d25/d35/d43/d7b/fd4 [0,4194304] 0 2024-04-23T10:19:00.439 INFO:tasks.workunit.client.0.smithi026.stdout:1/909: truncate dd/d1a/d20/d25/fb3 4810670 0 2024-04-23T10:19:00.444 INFO:tasks.workunit.client.0.smithi026.stdout:2/897: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/de9/f12d x:0 0 0 2024-04-23T10:19:00.448 INFO:tasks.workunit.client.0.smithi026.stdout:1/910: readlink dd/d1a/d20/d25/d35/d7f/ld8 0 2024-04-23T10:19:00.455 INFO:tasks.workunit.client.0.smithi026.stdout:5/956: getdents d0/d3c/d5d/db2/dc6/df5/df6 0 2024-04-23T10:19:00.459 INFO:tasks.workunit.client.0.smithi026.stdout:1/911: creat dd/d1a/d23/d3f/d9a/d9e/f13a x:0 0 0 2024-04-23T10:19:00.464 INFO:tasks.workunit.client.0.smithi026.stdout:2/898: truncate d3/dd/f18 1946692 0 2024-04-23T10:19:00.467 INFO:tasks.workunit.client.0.smithi026.stdout:1/912: mkdir dd/d1a/d23/d3f/d9a/d9e/d13b 0 2024-04-23T10:19:00.470 INFO:tasks.workunit.client.0.smithi026.stdout:2/899: chown d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9 861653 1 2024-04-23T10:19:00.472 INFO:tasks.workunit.client.0.smithi026.stdout:5/957: link d0/d12/c73 d0/d68/dea/d109/c159 0 2024-04-23T10:19:00.484 INFO:tasks.workunit.client.0.smithi026.stdout:5/958: dwrite d0/fdc [8388608,4194304] 0 2024-04-23T10:19:00.487 INFO:tasks.workunit.client.0.smithi026.stdout:5/959: read d0/d3c/d5d/f94 [989326,89814] 0 2024-04-23T10:19:00.494 INFO:tasks.workunit.client.0.smithi026.stdout:2/900: write d3/dd/d4b/d9c/fee [496149,107160] 0 2024-04-23T10:19:00.495 INFO:tasks.workunit.client.0.smithi026.stdout:1/913: dread dd/d1a/d20/d25/d35/f53 [0,4194304] 0 2024-04-23T10:19:00.508 INFO:tasks.workunit.client.0.smithi026.stdout:5/960: fsync d0/d12/fe1 0 2024-04-23T10:19:00.509 INFO:tasks.workunit.client.0.smithi026.stdout:2/901: creat d3/dd/f12e x:0 0 0 2024-04-23T10:19:00.518 INFO:tasks.workunit.client.0.smithi026.stdout:2/902: dwrite d3/d19/d21/d23/d3a/d3c/fdf [0,4194304] 0 2024-04-23T10:19:00.519 INFO:tasks.workunit.client.0.smithi026.stdout:2/903: fdatasync d3/d19/d21/d23/d3a/d65/f124 0 2024-04-23T10:19:00.524 INFO:tasks.workunit.client.0.smithi026.stdout:1/914: rename dd/d1a/d20/d25/d35/d43/d7b/ld0 to dd/d48/dcf/l13c 0 2024-04-23T10:19:00.525 INFO:tasks.workunit.client.0.smithi026.stdout:1/915: dread - dd/d1a/d20/d25/d35/fbf zero size 2024-04-23T10:19:00.528 INFO:tasks.workunit.client.0.smithi026.stdout:2/904: unlink d3/d19/d21/d23/d108/cc9 0 2024-04-23T10:19:00.536 INFO:tasks.workunit.client.0.smithi026.stdout:5/961: rename d0/d3c/d5d/d3a/f78 to d0/d68/dea/d109/f15a 0 2024-04-23T10:19:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:1/916: dwrite dd/d1a/d20/f4d [0,4194304] 0 2024-04-23T10:19:00.553 INFO:tasks.workunit.client.0.smithi026.stdout:2/905: dwrite d3/d19/d21/d23/d3a/d65/f86 [0,4194304] 0 2024-04-23T10:19:00.557 INFO:tasks.workunit.client.0.smithi026.stdout:2/906: read d3/d19/d21/d23/d3a/d65/f99 [50583,2568] 0 2024-04-23T10:19:00.559 INFO:tasks.workunit.client.0.smithi026.stdout:5/962: fdatasync d0/d3c/d84/d89/d8d/d8f/fac 0 2024-04-23T10:19:00.560 INFO:tasks.workunit.client.0.smithi026.stdout:3/917: sync 2024-04-23T10:19:00.563 INFO:tasks.workunit.client.0.smithi026.stdout:2/907: getdents d3/d19/d21/d23/d3a/d122 0 2024-04-23T10:19:00.566 INFO:tasks.workunit.client.0.smithi026.stdout:5/963: unlink d0/d68/dea/d109/f126 0 2024-04-23T10:19:00.574 INFO:tasks.workunit.client.0.smithi026.stdout:1/917: truncate dd/d1a/d20/d25/f5c 171233 0 2024-04-23T10:19:00.577 INFO:tasks.workunit.client.0.smithi026.stdout:3/918: unlink d0/d1e/d30/d43/d6c/d79/lde 0 2024-04-23T10:19:00.577 INFO:tasks.workunit.client.0.smithi026.stdout:2/908: fsync d3/f2a 0 2024-04-23T10:19:00.578 INFO:tasks.workunit.client.0.smithi026.stdout:7/830: sync 2024-04-23T10:19:00.580 INFO:tasks.workunit.client.0.smithi026.stdout:5/964: rename d0/d3c/d5d/db2/dc6/df5 to d0/d12/dfb/d15b 0 2024-04-23T10:19:00.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/918: creat dd/d1a/d20/d25/d35/d7f/d100/f13d x:0 0 0 2024-04-23T10:19:00.584 INFO:tasks.workunit.client.0.smithi026.stdout:2/909: mknod d3/d19/d21/d23/d3a/d3c/c12f 0 2024-04-23T10:19:00.590 INFO:tasks.workunit.client.0.smithi026.stdout:5/965: symlink d0/d3c/d84/d89/d8d/l15c 0 2024-04-23T10:19:00.595 INFO:tasks.workunit.client.0.smithi026.stdout:1/919: creat dd/d1a/d6a/f13e x:0 0 0 2024-04-23T10:19:00.599 INFO:tasks.workunit.client.0.smithi026.stdout:1/920: mkdir dd/d1a/d23/d3f/d9a/d13f 0 2024-04-23T10:19:00.602 INFO:tasks.workunit.client.0.smithi026.stdout:5/966: rename d0/d12/la0 to d0/d3c/d5d/db2/l15d 0 2024-04-23T10:19:00.605 INFO:tasks.workunit.client.0.smithi026.stdout:1/921: creat dd/d15/d7d/da1/dc6/f140 x:0 0 0 2024-04-23T10:19:00.605 INFO:tasks.workunit.client.0.smithi026.stdout:7/831: dread dd/d1d/d7d/fb2 [0,4194304] 0 2024-04-23T10:19:00.611 INFO:tasks.workunit.client.0.smithi026.stdout:5/967: creat d0/d3c/d57/f15e x:0 0 0 2024-04-23T10:19:00.612 INFO:tasks.workunit.client.0.smithi026.stdout:7/832: creat dd/d2c/d48/f103 x:0 0 0 2024-04-23T10:19:00.615 INFO:tasks.workunit.client.0.smithi026.stdout:5/968: truncate d0/d3c/d5d/f86 633725 0 2024-04-23T10:19:00.616 INFO:tasks.workunit.client.0.smithi026.stdout:1/922: write dd/d1a/d20/d25/d35/d43/d7b/fec [1014961,117209] 0 2024-04-23T10:19:00.618 INFO:tasks.workunit.client.0.smithi026.stdout:1/923: dread dd/d15/d7d/df6/f113 [0,4194304] 0 2024-04-23T10:19:00.619 INFO:tasks.workunit.client.0.smithi026.stdout:7/833: symlink dd/d2c/d48/d8d/l104 0 2024-04-23T10:19:00.620 INFO:tasks.workunit.client.0.smithi026.stdout:1/924: readlink dd/d48/lbd 0 2024-04-23T10:19:00.623 INFO:tasks.workunit.client.0.smithi026.stdout:5/969: rename d0/d3c/d5d/dbc/d107 to d0/d12/dfb/d15b/ddf/d108/d15f 0 2024-04-23T10:19:00.628 INFO:tasks.workunit.client.0.smithi026.stdout:1/925: dread dd/d1a/d23/d3f/fe6 [0,4194304] 0 2024-04-23T10:19:00.629 INFO:tasks.workunit.client.0.smithi026.stdout:5/970: symlink d0/d12/dfb/l160 0 2024-04-23T10:19:00.637 INFO:tasks.workunit.client.0.smithi026.stdout:7/834: dwrite dd/d46/f77 [0,4194304] 0 2024-04-23T10:19:00.637 INFO:tasks.workunit.client.0.smithi026.stdout:1/926: creat dd/d48/dab/f141 x:0 0 0 2024-04-23T10:19:00.638 INFO:tasks.workunit.client.0.smithi026.stdout:1/927: read - dd/d48/dab/fca zero size 2024-04-23T10:19:00.643 INFO:tasks.workunit.client.0.smithi026.stdout:5/971: link d0/f54 d0/d3c/d5d/db2/d12b/f161 0 2024-04-23T10:19:00.646 INFO:tasks.workunit.client.0.smithi026.stdout:7/835: creat dd/d1d/d7d/f105 x:0 0 0 2024-04-23T10:19:00.649 INFO:tasks.workunit.client.0.smithi026.stdout:1/928: truncate dd/d15/d7d/da1/dd6/d131/fdf 431944 0 2024-04-23T10:19:00.656 INFO:tasks.workunit.client.0.smithi026.stdout:5/972: truncate d0/d12/f3f 2584307 0 2024-04-23T10:19:00.659 INFO:tasks.workunit.client.0.smithi026.stdout:5/973: creat d0/d3c/d5d/f162 x:0 0 0 2024-04-23T10:19:00.662 INFO:tasks.workunit.client.0.smithi026.stdout:1/929: creat dd/d15/d7d/da1/dd6/d131/f142 x:0 0 0 2024-04-23T10:19:00.675 INFO:tasks.workunit.client.0.smithi026.stdout:5/974: read - d0/d3c/d5d/db2/dc6/fda zero size 2024-04-23T10:19:00.677 INFO:tasks.workunit.client.0.smithi026.stdout:1/930: fdatasync dd/d1a/d20/d25/df3/d111/f11f 0 2024-04-23T10:19:00.688 INFO:tasks.workunit.client.0.smithi026.stdout:1/931: dwrite dd/d1a/d23/d3f/d9a/f10b [0,4194304] 0 2024-04-23T10:19:00.782 INFO:tasks.workunit.client.0.smithi026.stdout:3/919: sync 2024-04-23T10:19:00.789 INFO:tasks.workunit.client.0.smithi026.stdout:1/932: truncate dd/d1a/d20/d25/d35/d43/fae 1225871 0 2024-04-23T10:19:00.845 INFO:tasks.workunit.client.0.smithi026.stdout:2/910: sync 2024-04-23T10:19:00.894 INFO:tasks.workunit.client.0.smithi026.stdout:7/836: sync 2024-04-23T10:19:00.897 INFO:tasks.workunit.client.0.smithi026.stdout:7/837: write dd/d6c/fef [413225,10431] 0 2024-04-23T10:19:00.898 INFO:tasks.workunit.client.0.smithi026.stdout:5/975: rename d0/f1a to d0/d3c/d84/d89/f163 0 2024-04-23T10:19:00.906 INFO:tasks.workunit.client.0.smithi026.stdout:7/838: readlink dd/l18 0 2024-04-23T10:19:00.917 INFO:tasks.workunit.client.0.smithi026.stdout:5/976: write d0/d12/f3f [2976208,111101] 0 2024-04-23T10:19:00.919 INFO:tasks.workunit.client.0.smithi026.stdout:7/839: mkdir dd/d3f/d47/d4c/d60/d106 0 2024-04-23T10:19:00.927 INFO:tasks.workunit.client.0.smithi026.stdout:3/920: rename d0/d1e/d30/d43/df/d63/f96 to d0/d1e/d30/d43/d122/f137 0 2024-04-23T10:19:00.928 INFO:tasks.workunit.client.0.smithi026.stdout:1/933: dwrite dd/d1a/d20/d25/df3/d111/f11f [4194304,4194304] 0 2024-04-23T10:19:00.931 INFO:tasks.workunit.client.0.smithi026.stdout:1/934: dread - dd/d1a/d23/d92/f11b zero size 2024-04-23T10:19:00.934 INFO:tasks.workunit.client.0.smithi026.stdout:7/840: chown dd/d1d/d50/f6a 0 1 2024-04-23T10:19:00.937 INFO:tasks.workunit.client.0.smithi026.stdout:3/921: fsync d0/d1e/d30/d43/d6c/d79/fe1 0 2024-04-23T10:19:00.944 INFO:tasks.workunit.client.0.smithi026.stdout:5/977: creat d0/d3c/d5d/db2/dbd/f164 x:0 0 0 2024-04-23T10:19:00.964 INFO:tasks.workunit.client.0.smithi026.stdout:2/911: rename d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/c53 to d3/d19/d21/d23/d3a/d3c/d5d/da0/c130 0 2024-04-23T10:19:00.969 INFO:tasks.workunit.client.0.smithi026.stdout:3/922: unlink d0/d1e/d30/d43/df/dcb/d97/fd9 0 2024-04-23T10:19:00.972 INFO:tasks.workunit.client.0.smithi026.stdout:2/912: write d3/d19/d21/d23/d3a/d3c/fdf [1122790,51827] 0 2024-04-23T10:19:00.972 INFO:tasks.workunit.client.0.smithi026.stdout:1/935: dwrite dd/d1a/d23/d69/d9d/ff2 [0,4194304] 0 2024-04-23T10:19:00.974 INFO:tasks.workunit.client.0.smithi026.stdout:5/978: write d0/d12/dfb/d15b/fe3 [203360,112676] 0 2024-04-23T10:19:00.978 INFO:tasks.workunit.client.0.smithi026.stdout:2/913: write d3/d19/d21/d23/d108/dd8/fe5 [4415859,17426] 0 2024-04-23T10:19:00.988 INFO:tasks.workunit.client.0.smithi026.stdout:1/936: truncate dd/f21 1209619 0 2024-04-23T10:19:00.999 INFO:tasks.workunit.client.0.smithi026.stdout:7/841: rename dd/d6c/d72/f80 to dd/f107 0 2024-04-23T10:19:01.000 INFO:tasks.workunit.client.0.smithi026.stdout:1/937: symlink dd/d48/dab/d11d/l143 0 2024-04-23T10:19:01.003 INFO:tasks.workunit.client.0.smithi026.stdout:7/842: rmdir dd/d3f/d47/d4c 39 2024-04-23T10:19:01.011 INFO:tasks.workunit.client.0.smithi026.stdout:5/979: write d0/d68/dcc/fc1 [498590,100662] 0 2024-04-23T10:19:01.016 INFO:tasks.workunit.client.0.smithi026.stdout:1/938: write dd/d1a/d20/d25/d35/d74/fb4 [5035245,73400] 0 2024-04-23T10:19:01.028 INFO:tasks.workunit.client.0.smithi026.stdout:3/923: dwrite d0/d1e/d30/d43/df/f18 [4194304,4194304] 0 2024-04-23T10:19:01.028 INFO:tasks.workunit.client.0.smithi026.stdout:5/980: readlink d0/d12/dfb/d10b/l110 0 2024-04-23T10:19:01.029 INFO:tasks.workunit.client.0.smithi026.stdout:2/914: dwrite d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 [4194304,4194304] 0 2024-04-23T10:19:01.037 INFO:tasks.workunit.client.0.smithi026.stdout:1/939: rmdir dd/d1a/d20/d25/d35/d74/d120 39 2024-04-23T10:19:01.043 INFO:tasks.workunit.client.0.smithi026.stdout:1/940: unlink dd/f2b 0 2024-04-23T10:19:01.044 INFO:tasks.workunit.client.0.smithi026.stdout:7/843: dwrite dd/f107 [4194304,4194304] 0 2024-04-23T10:19:01.046 INFO:tasks.workunit.client.0.smithi026.stdout:5/981: symlink d0/d3c/d5d/db2/dc6/l165 0 2024-04-23T10:19:01.056 INFO:tasks.workunit.client.0.smithi026.stdout:2/915: symlink d3/d19/d21/d23/d108/l131 0 2024-04-23T10:19:01.060 INFO:tasks.workunit.client.0.smithi026.stdout:3/924: rename d0/d1e/d30/d43/ld to d0/d1e/d131/l138 0 2024-04-23T10:19:01.063 INFO:tasks.workunit.client.0.smithi026.stdout:5/982: chown d0/d3c/d5d/c38 7613391 1 2024-04-23T10:19:01.064 INFO:tasks.workunit.client.0.smithi026.stdout:5/983: stat d0/d68/dcc 0 2024-04-23T10:19:01.067 INFO:tasks.workunit.client.0.smithi026.stdout:7/844: mkdir dd/d6c/d72/dd0/ded/d108 0 2024-04-23T10:19:01.075 INFO:tasks.workunit.client.0.smithi026.stdout:3/925: mkdir d0/d1e/d23/d87/db3/d139 0 2024-04-23T10:19:01.080 INFO:tasks.workunit.client.0.smithi026.stdout:5/984: mknod d0/d12/dfb/d15b/c166 0 2024-04-23T10:19:01.083 INFO:tasks.workunit.client.0.smithi026.stdout:1/941: creat dd/d1a/d20/d25/d35/d43/d7b/f144 x:0 0 0 2024-04-23T10:19:01.086 INFO:tasks.workunit.client.0.smithi026.stdout:2/916: dwrite d3/dd/f43 [0,4194304] 0 2024-04-23T10:19:01.087 INFO:tasks.workunit.client.0.smithi026.stdout:7/845: creat dd/d1d/d7d/f109 x:0 0 0 2024-04-23T10:19:01.088 INFO:tasks.workunit.client.0.smithi026.stdout:3/926: dread d0/d1e/d30/d43/df/f18 [4194304,4194304] 0 2024-04-23T10:19:01.092 INFO:tasks.workunit.client.0.smithi026.stdout:2/917: stat d3/d19/d21/d23/d3a/d3c/d80/da7/fe1 0 2024-04-23T10:19:01.096 INFO:tasks.workunit.client.0.smithi026.stdout:3/927: dread - d0/d1e/d30/d43/df/fe0 zero size 2024-04-23T10:19:01.104 INFO:tasks.workunit.client.0.smithi026.stdout:1/942: dread dd/d48/f63 [0,4194304] 0 2024-04-23T10:19:01.111 INFO:tasks.workunit.client.0.smithi026.stdout:2/918: unlink d3/d19/d4d/f82 0 2024-04-23T10:19:01.116 INFO:tasks.workunit.client.0.smithi026.stdout:5/985: dwrite d0/d3c/d84/d89/f105 [0,4194304] 0 2024-04-23T10:19:01.120 INFO:tasks.workunit.client.0.smithi026.stdout:1/943: unlink dd/d1a/ff4 0 2024-04-23T10:19:01.120 INFO:tasks.workunit.client.0.smithi026.stdout:5/986: dread - d0/d12/dfb/d15b/df6/f146 zero size 2024-04-23T10:19:01.122 INFO:tasks.workunit.client.0.smithi026.stdout:7/846: dwrite dd/d3f/d47/d4c/f4a [0,4194304] 0 2024-04-23T10:19:01.123 INFO:tasks.workunit.client.0.smithi026.stdout:5/987: chown d0/d3c/d84/d89/c92 57702 1 2024-04-23T10:19:01.127 INFO:tasks.workunit.client.0.smithi026.stdout:7/847: creat dd/d1d/de7/f10a x:0 0 0 2024-04-23T10:19:01.128 INFO:tasks.workunit.client.0.smithi026.stdout:2/919: creat d3/d19/d31/f132 x:0 0 0 2024-04-23T10:19:01.133 INFO:tasks.workunit.client.0.smithi026.stdout:7/848: chown dd/d1d/d50/f8b 6 1 2024-04-23T10:19:01.134 INFO:tasks.workunit.client.0.smithi026.stdout:5/988: dread d0/d3c/d5d/db2/fcb [0,4194304] 0 2024-04-23T10:19:01.136 INFO:tasks.workunit.client.0.smithi026.stdout:1/944: rename dd/d1a/d20/d25/d35/d43/d7b/fec to dd/d1a/d20/f145 0 2024-04-23T10:19:01.136 INFO:tasks.workunit.client.0.smithi026.stdout:7/849: dread - dd/d2c/f102 zero size 2024-04-23T10:19:01.136 INFO:tasks.workunit.client.0.smithi026.stdout:3/928: dwrite d0/d4c/fb8 [0,4194304] 0 2024-04-23T10:19:01.138 INFO:tasks.workunit.client.0.smithi026.stdout:3/929: chown d0/d1e/d23/d87/db3/dee/d39/dda 411846 1 2024-04-23T10:19:01.142 INFO:tasks.workunit.client.0.smithi026.stdout:5/989: stat d0/l1c 0 2024-04-23T10:19:01.148 INFO:tasks.workunit.client.0.smithi026.stdout:7/850: mkdir dd/d3f/d47/d4c/d60/d75/d10b 0 2024-04-23T10:19:01.151 INFO:tasks.workunit.client.0.smithi026.stdout:3/930: mkdir d0/d1e/d13a 0 2024-04-23T10:19:01.153 INFO:tasks.workunit.client.0.smithi026.stdout:5/990: mkdir d0/d3c/d5d/db2/dc6/dd4/d167 0 2024-04-23T10:19:01.154 INFO:tasks.workunit.client.0.smithi026.stdout:5/991: stat d0/d12/f98 0 2024-04-23T10:19:01.160 INFO:tasks.workunit.client.0.smithi026.stdout:2/920: rename d3/d19/d21/c41 to d3/d19/d21/d23/d108/dd8/c133 0 2024-04-23T10:19:01.168 INFO:tasks.workunit.client.0.smithi026.stdout:5/992: chown d0/c20 25617 1 2024-04-23T10:19:01.172 INFO:tasks.workunit.client.0.smithi026.stdout:7/851: mknod dd/d6c/d72/dd0/c10c 0 2024-04-23T10:19:01.173 INFO:tasks.workunit.client.0.smithi026.stdout:7/852: read - dd/d2c/d48/f103 zero size 2024-04-23T10:19:01.175 INFO:tasks.workunit.client.0.smithi026.stdout:1/945: dread dd/d1a/f139 [0,4194304] 0 2024-04-23T10:19:01.178 INFO:tasks.workunit.client.0.smithi026.stdout:2/921: write d3/dd/f56 [1831970,47708] 0 2024-04-23T10:19:01.182 INFO:tasks.workunit.client.0.smithi026.stdout:5/993: rmdir d0/d3c/d5d/db2/dc6/dd4/d167 0 2024-04-23T10:19:01.182 INFO:tasks.workunit.client.0.smithi026.stdout:7/853: dread dd/d2c/d48/fbe [0,4194304] 0 2024-04-23T10:19:01.187 INFO:tasks.workunit.client.0.smithi026.stdout:5/994: mkdir d0/d168 0 2024-04-23T10:19:01.187 INFO:tasks.workunit.client.0.smithi026.stdout:3/931: dwrite d0/d1e/d30/d43/df/f4b [4194304,4194304] 0 2024-04-23T10:19:01.189 INFO:tasks.workunit.client.0.smithi026.stdout:1/946: getdents dd/d1a/d6a/d7c 0 2024-04-23T10:19:01.192 INFO:tasks.workunit.client.0.smithi026.stdout:1/947: write dd/d1a/d23/d69/d105/f10c [7477830,31458] 0 2024-04-23T10:19:01.193 INFO:tasks.workunit.client.0.smithi026.stdout:7/854: truncate dd/d1d/d50/fa6 759715 0 2024-04-23T10:19:01.195 INFO:tasks.workunit.client.0.smithi026.stdout:3/932: chown d0/d1e/d30/d43/d6c/d79/d73/d99 317 1 2024-04-23T10:19:01.197 INFO:tasks.workunit.client.0.smithi026.stdout:2/922: rename d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/fbf to d3/d19/d21/d23/d3a/d122/f134 0 2024-04-23T10:19:01.198 INFO:tasks.workunit.client.0.smithi026.stdout:7/855: unlink dd/d1d/cfd 0 2024-04-23T10:19:01.199 INFO:tasks.workunit.client.0.smithi026.stdout:2/923: chown d3/d19/d21/d23/d3a/d3c/d80/d96 616813 1 2024-04-23T10:19:01.202 INFO:tasks.workunit.client.0.smithi026.stdout:3/933: fdatasync d0/d1e/d23/d87/df8/f132 0 2024-04-23T10:19:01.208 INFO:tasks.workunit.client.0.smithi026.stdout:3/934: readlink d0/d1e/d23/d87/db6/lc0 0 2024-04-23T10:19:01.211 INFO:tasks.workunit.client.0.smithi026.stdout:1/948: rmdir dd/d1a/d20/d25/d35/d7f/dd5/dde/d12a 0 2024-04-23T10:19:01.213 INFO:tasks.workunit.client.0.smithi026.stdout:7/856: mknod dd/d1d/d7d/d9f/dd2/c10d 0 2024-04-23T10:19:01.214 INFO:tasks.workunit.client.0.smithi026.stdout:7/857: chown dd/d3f/fde 0 1 2024-04-23T10:19:01.215 INFO:tasks.workunit.client.0.smithi026.stdout:3/935: read - d0/d1e/d30/d43/df/dcb/ff6 zero size 2024-04-23T10:19:01.216 INFO:tasks.workunit.client.0.smithi026.stdout:7/858: fsync dd/d1d/d7d/f105 0 2024-04-23T10:19:01.217 INFO:tasks.workunit.client.0.smithi026.stdout:3/936: chown d0/d1e/d30/d43/d6c 1684651 1 2024-04-23T10:19:01.223 INFO:tasks.workunit.client.0.smithi026.stdout:5/995: dread d0/d3c/d84/d89/d8d/fb7 [0,4194304] 0 2024-04-23T10:19:01.223 INFO:tasks.workunit.client.0.smithi026.stdout:7/859: rename dd/d3f/d47/d4c/fc5 to dd/d3f/d47/d4c/d60/d106/f10e 0 2024-04-23T10:19:01.224 INFO:tasks.workunit.client.0.smithi026.stdout:3/937: mknod d0/d1e/d30/d43/db4/c13b 0 2024-04-23T10:19:01.227 INFO:tasks.workunit.client.0.smithi026.stdout:2/924: dwrite d3/dd/d4b/f61 [0,4194304] 0 2024-04-23T10:19:01.228 INFO:tasks.workunit.client.0.smithi026.stdout:7/860: creat dd/f10f x:0 0 0 2024-04-23T10:19:01.229 INFO:tasks.workunit.client.0.smithi026.stdout:2/925: symlink d3/d19/d21/d23/d3a/d122/l135 0 2024-04-23T10:19:01.292 INFO:tasks.workunit.client.0.smithi026.stdout:7/861: dread dd/d3f/fe0 [0,4194304] 0 2024-04-23T10:19:01.292 INFO:tasks.workunit.client.0.smithi026.stdout:2/926: getdents d3/d19/d21/d23 0 2024-04-23T10:19:01.297 INFO:tasks.workunit.client.0.smithi026.stdout:1/949: dwrite dd/d1a/d23/d92/fa3 [0,4194304] 0 2024-04-23T10:19:01.313 INFO:tasks.workunit.client.0.smithi026.stdout:2/927: mkdir d3/d19/d31/d83/d136 0 2024-04-23T10:19:01.321 INFO:tasks.workunit.client.0.smithi026.stdout:1/950: stat dd/d15/d7d/da1/dd6/d131/fa0 0 2024-04-23T10:19:01.326 INFO:tasks.workunit.client.0.smithi026.stdout:1/951: readlink dd/d1a/d23/d3f/la4 0 2024-04-23T10:19:01.328 INFO:tasks.workunit.client.0.smithi026.stdout:2/928: truncate d3/d19/d31/f66 680804 0 2024-04-23T10:19:01.328 INFO:tasks.workunit.client.0.smithi026.stdout:7/862: dwrite dd/f13 [4194304,4194304] 0 2024-04-23T10:19:01.333 INFO:tasks.workunit.client.0.smithi026.stdout:7/863: fsync dd/d46/fcf 0 2024-04-23T10:19:01.342 INFO:tasks.workunit.client.0.smithi026.stdout:2/929: creat d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/f137 x:0 0 0 2024-04-23T10:19:01.345 INFO:tasks.workunit.client.0.smithi026.stdout:7/864: mknod dd/d44/c110 0 2024-04-23T10:19:01.346 INFO:tasks.workunit.client.0.smithi026.stdout:1/952: link dd/d1a/d23/d69/c6d dd/d15/d7d/df6/c146 0 2024-04-23T10:19:01.348 INFO:tasks.workunit.client.0.smithi026.stdout:2/930: mknod d3/d19/d4d/c138 0 2024-04-23T10:19:01.350 INFO:tasks.workunit.client.0.smithi026.stdout:7/865: truncate dd/f35 13312298 0 2024-04-23T10:19:01.363 INFO:tasks.workunit.client.0.smithi026.stdout:1/953: dwrite f7 [0,4194304] 0 2024-04-23T10:19:01.364 INFO:tasks.workunit.client.0.smithi026.stdout:2/931: mknod d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/c139 0 2024-04-23T10:19:01.365 INFO:tasks.workunit.client.0.smithi026.stdout:1/954: readlink dd/d1a/d6a/d7c/l96 0 2024-04-23T10:19:01.367 INFO:tasks.workunit.client.0.smithi026.stdout:7/866: write dd/d3f/d47/d4c/d60/d75/f92 [1047515,90312] 0 2024-04-23T10:19:01.378 INFO:tasks.workunit.client.0.smithi026.stdout:1/955: mknod dd/d15/d7d/df6/c147 0 2024-04-23T10:19:01.384 INFO:tasks.workunit.client.0.smithi026.stdout:1/956: chown dd/d1a/d20/d25/d35/lbb 14042 1 2024-04-23T10:19:01.391 INFO:tasks.workunit.client.0.smithi026.stdout:2/932: dwrite d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/ff4 [0,4194304] 0 2024-04-23T10:19:01.392 INFO:tasks.workunit.client.0.smithi026.stdout:7/867: dwrite dd/d1d/d50/f8b [0,4194304] 0 2024-04-23T10:19:01.393 INFO:tasks.workunit.client.0.smithi026.stdout:1/957: fsync dd/d15/d7d/fc4 0 2024-04-23T10:19:01.398 INFO:tasks.workunit.client.0.smithi026.stdout:1/958: readlink dd/d48/dcf/l13c 0 2024-04-23T10:19:01.403 INFO:tasks.workunit.client.0.smithi026.stdout:2/933: fsync d3/d19/d21/d23/d3a/d3c/d5d/fce 0 2024-04-23T10:19:01.406 INFO:tasks.workunit.client.0.smithi026.stdout:1/959: mknod dd/d1a/d6a/d7c/d12f/c148 0 2024-04-23T10:19:01.407 INFO:tasks.workunit.client.0.smithi026.stdout:2/934: fdatasync d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/f104 0 2024-04-23T10:19:01.409 INFO:tasks.workunit.client.0.smithi026.stdout:7/868: getdents dd/d46 0 2024-04-23T10:19:01.411 INFO:tasks.workunit.client.0.smithi026.stdout:7/869: write dd/dbc/ff2 [440817,31226] 0 2024-04-23T10:19:01.415 INFO:tasks.workunit.client.0.smithi026.stdout:7/870: chown dd/d2c/d48/lb0 88 1 2024-04-23T10:19:01.416 INFO:tasks.workunit.client.0.smithi026.stdout:1/960: mknod dd/d15/d7d/da1/dc6/c149 0 2024-04-23T10:19:01.420 INFO:tasks.workunit.client.0.smithi026.stdout:5/996: sync 2024-04-23T10:19:01.423 INFO:tasks.workunit.client.0.smithi026.stdout:1/961: truncate dd/d1a/d20/d25/d35/d74/fc1 957800 0 2024-04-23T10:19:01.425 INFO:tasks.workunit.client.0.smithi026.stdout:5/997: symlink d0/d68/dcc/l169 0 2024-04-23T10:19:01.425 INFO:tasks.workunit.client.0.smithi026.stdout:1/962: write dd/d1a/d6a/d7c/f8a [182846,98615] 0 2024-04-23T10:19:01.433 INFO:tasks.workunit.client.0.smithi026.stdout:5/998: mknod d0/d3c/d84/d89/d8d/d8f/c16a 0 2024-04-23T10:19:01.433 INFO:tasks.workunit.client.0.smithi026.stdout:7/871: dwrite dd/d3f/d47/f83 [0,4194304] 0 2024-04-23T10:19:01.438 INFO:tasks.workunit.client.0.smithi026.stdout:1/963: write dd/d48/dac/f10a [13165,51542] 0 2024-04-23T10:19:01.438 INFO:tasks.workunit.client.0.smithi026.stdout:5/999: chown d0/d3c/d5d/dbc/f10e 0 1 2024-04-23T10:19:01.444 INFO:tasks.workunit.client.0.smithi026.stdout:2/935: dread d3/d19/d31/f91 [0,4194304] 0 2024-04-23T10:19:01.445 INFO:tasks.workunit.client.0.smithi026.stdout:1/964: mkdir dd/d1a/d23/d69/d9d/d14a 0 2024-04-23T10:19:01.447 INFO:tasks.workunit.client.0.smithi026.stdout:1/965: chown dd/d15/d7d/da1/dd6/d131/f11c 441 1 2024-04-23T10:19:01.448 INFO:tasks.workunit.client.0.smithi026.stdout:7/872: dwrite dd/dbc/ff2 [0,4194304] 0 2024-04-23T10:19:01.452 INFO:tasks.workunit.client.0.smithi026.stdout:1/966: symlink dd/d1a/d20/d25/d35/d43/d7b/l14b 0 2024-04-23T10:19:01.454 INFO:tasks.workunit.client.0.smithi026.stdout:1/967: dread - dd/d1a/d23/fad zero size 2024-04-23T10:19:01.457 INFO:tasks.workunit.client.0.smithi026.stdout:7/873: dwrite dd/dbc/fd1 [0,4194304] 0 2024-04-23T10:19:01.461 INFO:tasks.workunit.client.0.smithi026.stdout:1/968: creat dd/d1a/d23/f14c x:0 0 0 2024-04-23T10:19:01.462 INFO:tasks.workunit.client.0.smithi026.stdout:7/874: creat dd/dd8/f111 x:0 0 0 2024-04-23T10:19:01.467 INFO:tasks.workunit.client.0.smithi026.stdout:7/875: fsync dd/d46/fcf 0 2024-04-23T10:19:01.468 INFO:tasks.workunit.client.0.smithi026.stdout:1/969: mkdir dd/d15/d7d/da1/dd6/d131/de8/d14d 0 2024-04-23T10:19:01.474 INFO:tasks.workunit.client.0.smithi026.stdout:7/876: mkdir dd/d6c/d112 0 2024-04-23T10:19:01.476 INFO:tasks.workunit.client.0.smithi026.stdout:1/970: rmdir dd/d1a/d20/d25/d35/d74/d93 39 2024-04-23T10:19:01.478 INFO:tasks.workunit.client.0.smithi026.stdout:1/971: readlink dd/d1a/d20/l6e 0 2024-04-23T10:19:01.479 INFO:tasks.workunit.client.0.smithi026.stdout:1/972: dread - dd/d1a/d23/d69/fc8 zero size 2024-04-23T10:19:01.479 INFO:tasks.workunit.client.0.smithi026.stdout:7/877: rename dd/d1d/d7d to dd/d1d/d113 0 2024-04-23T10:19:01.480 INFO:tasks.workunit.client.0.smithi026.stdout:1/973: mkdir dd/deb/d14e 0 2024-04-23T10:19:01.483 INFO:tasks.workunit.client.0.smithi026.stdout:7/878: truncate dd/d3f/d47/d4c/f6f 634453 0 2024-04-23T10:19:01.484 INFO:tasks.workunit.client.0.smithi026.stdout:1/974: symlink dd/d48/dab/l14f 0 2024-04-23T10:19:01.487 INFO:tasks.workunit.client.0.smithi026.stdout:7/879: dread dd/d46/f77 [0,4194304] 0 2024-04-23T10:19:01.489 INFO:tasks.workunit.client.0.smithi026.stdout:1/975: symlink dd/d1a/d23/d69/d105/l150 0 2024-04-23T10:19:01.502 INFO:tasks.workunit.client.0.smithi026.stdout:7/880: dread dd/d2c/d48/d8d/fd4 [0,4194304] 0 2024-04-23T10:19:01.505 INFO:tasks.workunit.client.0.smithi026.stdout:1/976: creat dd/d1a/d20/d25/d35/d7f/d100/f151 x:0 0 0 2024-04-23T10:19:01.505 INFO:tasks.workunit.client.0.smithi026.stdout:1/977: chown dd/d48/dcf/l13c 102 1 2024-04-23T10:19:01.507 INFO:tasks.workunit.client.0.smithi026.stdout:1/978: stat dd/d1a/d20/d25/d35/d7f/dd5/c109 0 2024-04-23T10:19:01.511 INFO:tasks.workunit.client.0.smithi026.stdout:7/881: link dd/f41 dd/d3f/d47/f114 0 2024-04-23T10:19:01.512 INFO:tasks.workunit.client.0.smithi026.stdout:1/979: mknod dd/d48/c152 0 2024-04-23T10:19:01.517 INFO:tasks.workunit.client.0.smithi026.stdout:1/980: mkdir dd/d1a/d20/d25/d35/d7f/d153 0 2024-04-23T10:19:01.529 INFO:tasks.workunit.client.0.smithi026.stdout:7/882: truncate dd/f76 928760 0 2024-04-23T10:19:01.536 INFO:tasks.workunit.client.0.smithi026.stdout:7/883: dread dd/d1d/d78/fab [0,4194304] 0 2024-04-23T10:19:01.536 INFO:tasks.workunit.client.0.smithi026.stdout:7/884: stat dd/d2c/d48/fbe 0 2024-04-23T10:19:01.543 INFO:tasks.workunit.client.0.smithi026.stdout:1/981: truncate dd/d1a/d23/d69/d9d/ff2 1523641 0 2024-04-23T10:19:01.543 INFO:tasks.workunit.client.0.smithi026.stdout:7/885: read dd/d3f/d47/d4c/d60/d75/fc4 [1960169,28134] 0 2024-04-23T10:19:01.544 INFO:tasks.workunit.client.0.smithi026.stdout:3/938: sync 2024-04-23T10:19:01.550 INFO:tasks.workunit.client.0.smithi026.stdout:1/982: creat dd/d1a/d20/d25/d35/d43/f154 x:0 0 0 2024-04-23T10:19:01.556 INFO:tasks.workunit.client.0.smithi026.stdout:3/939: write d0/d1e/d23/d87/db3/dee/f34 [4767629,30665] 0 2024-04-23T10:19:01.556 INFO:tasks.workunit.client.0.smithi026.stdout:7/886: link dd/d1d/d78/f9b dd/d1d/d113/d9f/f115 0 2024-04-23T10:19:01.557 INFO:tasks.workunit.client.0.smithi026.stdout:1/983: dread dd/d1a/d20/d25/f2f [0,4194304] 0 2024-04-23T10:19:01.561 INFO:tasks.workunit.client.0.smithi026.stdout:3/940: dread - d0/d1e/d30/d43/df/d72/dff/f12f zero size 2024-04-23T10:19:01.563 INFO:tasks.workunit.client.0.smithi026.stdout:2/936: sync 2024-04-23T10:19:01.563 INFO:tasks.workunit.client.0.smithi026.stdout:1/984: symlink dd/d15/d7d/da1/l155 0 2024-04-23T10:19:01.565 INFO:tasks.workunit.client.0.smithi026.stdout:7/887: dread dd/d1d/d50/f87 [0,4194304] 0 2024-04-23T10:19:01.566 INFO:tasks.workunit.client.0.smithi026.stdout:3/941: creat d0/d1e/d30/d43/db4/d128/f13c x:0 0 0 2024-04-23T10:19:01.566 INFO:tasks.workunit.client.0.smithi026.stdout:7/888: dread - dd/d2c/d48/f103 zero size 2024-04-23T10:19:01.567 INFO:tasks.workunit.client.0.smithi026.stdout:2/937: creat d3/dd/d4b/f13a x:0 0 0 2024-04-23T10:19:01.570 INFO:tasks.workunit.client.0.smithi026.stdout:2/938: rmdir d3/d19/d21/d23/d108/dd8 39 2024-04-23T10:19:01.571 INFO:tasks.workunit.client.0.smithi026.stdout:3/942: chown d0/d1e/d30/d77/d100/c11f 1897 1 2024-04-23T10:19:01.572 INFO:tasks.workunit.client.0.smithi026.stdout:7/889: rename dd/d6c to dd/d3f/d47/d4c/d60/d75/d10b/d116 0 2024-04-23T10:19:01.573 INFO:tasks.workunit.client.0.smithi026.stdout:1/985: dwrite dd/f95 [4194304,4194304] 0 2024-04-23T10:19:01.574 INFO:tasks.workunit.client.0.smithi026.stdout:3/943: fdatasync d0/d1e/d30/d43/df/f18 0 2024-04-23T10:19:01.579 INFO:tasks.workunit.client.0.smithi026.stdout:3/944: chown d0/c3 7169 1 2024-04-23T10:19:01.582 INFO:tasks.workunit.client.0.smithi026.stdout:1/986: symlink dd/d1a/d20/d25/d35/d7f/d100/l156 0 2024-04-23T10:19:01.588 INFO:tasks.workunit.client.0.smithi026.stdout:2/939: rename d3/d19/d21/d23/d3a/d3c/fc5 to d3/d19/d21/d23/dec/f13b 0 2024-04-23T10:19:01.589 INFO:tasks.workunit.client.0.smithi026.stdout:1/987: fsync dd/d15/fa7 0 2024-04-23T10:19:01.590 INFO:tasks.workunit.client.0.smithi026.stdout:3/945: fsync d0/d1e/d30/d43/df/d63/f65 0 2024-04-23T10:19:01.593 INFO:tasks.workunit.client.0.smithi026.stdout:3/946: stat d0/d1e/d131/l138 0 2024-04-23T10:19:01.594 INFO:tasks.workunit.client.0.smithi026.stdout:7/890: dwrite dd/f35 [0,4194304] 0 2024-04-23T10:19:01.597 INFO:tasks.workunit.client.0.smithi026.stdout:2/940: creat d3/d19/d21/d23/d108/dd8/f13c x:0 0 0 2024-04-23T10:19:01.599 INFO:tasks.workunit.client.0.smithi026.stdout:3/947: unlink d0/d1e/d23/f118 0 2024-04-23T10:19:01.600 INFO:tasks.workunit.client.0.smithi026.stdout:1/988: dwrite dd/d48/dab/f141 [0,4194304] 0 2024-04-23T10:19:01.600 INFO:tasks.workunit.client.0.smithi026.stdout:2/941: chown d3/d19/d21/d23/d3a/d3c/d5d/fce 1165869 1 2024-04-23T10:19:01.604 INFO:tasks.workunit.client.0.smithi026.stdout:3/948: rmdir d0/d1e/d30/d43/df/dcb/d97 39 2024-04-23T10:19:01.606 INFO:tasks.workunit.client.0.smithi026.stdout:7/891: fdatasync dd/d1d/f37 0 2024-04-23T10:19:01.611 INFO:tasks.workunit.client.0.smithi026.stdout:2/942: rename d3/d19/d1d/led to d3/dd/def/l13d 0 2024-04-23T10:19:01.614 INFO:tasks.workunit.client.0.smithi026.stdout:3/949: creat d0/d51/d5e/f13d x:0 0 0 2024-04-23T10:19:01.615 INFO:tasks.workunit.client.0.smithi026.stdout:3/950: rename d0 to d0/d1e/d23/d87/db6/d13e 22 2024-04-23T10:19:01.618 INFO:tasks.workunit.client.0.smithi026.stdout:3/951: symlink d0/d1e/d23/d87/df8/d124/l13f 0 2024-04-23T10:19:01.621 INFO:tasks.workunit.client.0.smithi026.stdout:3/952: mkdir d0/d1e/d30/d43/df/d17/d140 0 2024-04-23T10:19:01.621 INFO:tasks.workunit.client.0.smithi026.stdout:2/943: link d3/d19/d21/d23/d3a/f69 d3/d19/d21/dc6/f13e 0 2024-04-23T10:19:01.622 INFO:tasks.workunit.client.0.smithi026.stdout:7/892: write dd/d44/f3b [2469052,91673] 0 2024-04-23T10:19:01.623 INFO:tasks.workunit.client.0.smithi026.stdout:3/953: mknod d0/d51/d5e/c141 0 2024-04-23T10:19:01.625 INFO:tasks.workunit.client.0.smithi026.stdout:7/893: creat dd/d46/f117 x:0 0 0 2024-04-23T10:19:01.625 INFO:tasks.workunit.client.0.smithi026.stdout:2/944: creat d3/d19/d21/d23/dec/f13f x:0 0 0 2024-04-23T10:19:01.627 INFO:tasks.workunit.client.0.smithi026.stdout:3/954: mknod d0/d51/d5e/c142 0 2024-04-23T10:19:01.628 INFO:tasks.workunit.client.0.smithi026.stdout:3/955: stat d0/d1e/d30/fd7 0 2024-04-23T10:19:01.629 INFO:tasks.workunit.client.0.smithi026.stdout:2/945: read d3/d19/d21/d23/d3a/d122/f134 [799066,104493] 0 2024-04-23T10:19:01.630 INFO:tasks.workunit.client.0.smithi026.stdout:2/946: rmdir d3/d19/d1d 39 2024-04-23T10:19:01.631 INFO:tasks.workunit.client.0.smithi026.stdout:3/956: fsync d0/d4c/feb 0 2024-04-23T10:19:01.632 INFO:tasks.workunit.client.0.smithi026.stdout:7/894: dread dd/d1d/d78/fab [0,4194304] 0 2024-04-23T10:19:01.721 INFO:tasks.workunit.client.0.smithi026.stdout:1/989: sync 2024-04-23T10:19:01.738 INFO:tasks.workunit.client.0.smithi026.stdout:1/990: mknod dd/d1a/d20/d25/d35/d43/d115/c157 0 2024-04-23T10:19:01.742 INFO:tasks.workunit.client.0.smithi026.stdout:1/991: write dd/d1a/d20/d25/d35/d43/d7b/f144 [929514,35146] 0 2024-04-23T10:19:01.744 INFO:tasks.workunit.client.0.smithi026.stdout:3/957: rename d0/d1e/d30/d43/d6c/d79/l2b to d0/d4c/l143 0 2024-04-23T10:19:01.746 INFO:tasks.workunit.client.0.smithi026.stdout:7/895: creat dd/de5/f118 x:0 0 0 2024-04-23T10:19:01.747 INFO:tasks.workunit.client.0.smithi026.stdout:2/947: link d3/d19/d4d/fb6 d3/d19/d21/d23/d3a/d3c/d80/da7/f140 0 2024-04-23T10:19:01.749 INFO:tasks.workunit.client.0.smithi026.stdout:1/992: stat dd/d1a/d23/f28 0 2024-04-23T10:19:01.753 INFO:tasks.workunit.client.0.smithi026.stdout:3/958: mknod d0/d1e/d129/c144 0 2024-04-23T10:19:01.759 INFO:tasks.workunit.client.0.smithi026.stdout:3/959: chown d0/d1e/d30/d43/fa 1269 1 2024-04-23T10:19:01.763 INFO:tasks.workunit.client.0.smithi026.stdout:3/960: chown d0/d1e/d30/d43/db4/d10c 8078538 1 2024-04-23T10:19:01.769 INFO:tasks.workunit.client.0.smithi026.stdout:7/896: getdents dd/d3f/d47/d4c/d60/d75/d10b/d116/dc6 0 2024-04-23T10:19:01.770 INFO:tasks.workunit.client.0.smithi026.stdout:7/897: readlink dd/l18 0 2024-04-23T10:19:01.776 INFO:tasks.workunit.client.0.smithi026.stdout:7/898: mknod dd/d44/c119 0 2024-04-23T10:19:01.780 INFO:tasks.workunit.client.0.smithi026.stdout:7/899: fsync dd/d1d/d113/fff 0 2024-04-23T10:19:01.786 INFO:tasks.workunit.client.0.smithi026.stdout:7/900: dread - dd/d3f/d47/d4c/ff1 zero size 2024-04-23T10:19:01.789 INFO:tasks.workunit.client.0.smithi026.stdout:2/948: dwrite d3/d19/d21/d23/d3a/d65/f107 [0,4194304] 0 2024-04-23T10:19:01.792 INFO:tasks.workunit.client.0.smithi026.stdout:1/993: dwrite dd/d1a/d23/d3f/f5b [0,4194304] 0 2024-04-23T10:19:01.796 INFO:tasks.workunit.client.0.smithi026.stdout:3/961: link d0/d1e/d30/d43/df/d63/f104 d0/d1e/d23/d52/f145 0 2024-04-23T10:19:01.805 INFO:tasks.workunit.client.0.smithi026.stdout:2/949: mkdir d3/d19/d21/d23/d3a/d3c/d80/d96/d141 0 2024-04-23T10:19:01.809 INFO:tasks.workunit.client.0.smithi026.stdout:1/994: chown dd/d1a/d23/d3f/d9a/d9e/fba 1094504 1 2024-04-23T10:19:01.810 INFO:tasks.workunit.client.0.smithi026.stdout:3/962: chown d0/d1e/d30/d43/d122 159786 1 2024-04-23T10:19:01.817 INFO:tasks.workunit.client.0.smithi026.stdout:7/901: dwrite dd/d3f/d47/d4c/d60/d75/d10b/d116/dc6/f3d [0,4194304] 0 2024-04-23T10:19:01.822 INFO:tasks.workunit.client.0.smithi026.stdout:3/963: creat d0/d51/d5e/f146 x:0 0 0 2024-04-23T10:19:01.823 INFO:tasks.workunit.client.0.smithi026.stdout:2/950: write d3/d19/d31/ff5 [218416,75821] 0 2024-04-23T10:19:01.824 INFO:tasks.workunit.client.0.smithi026.stdout:7/902: stat dd/d44/f26 0 2024-04-23T10:19:01.832 INFO:tasks.workunit.client.0.smithi026.stdout:2/951: readlink d3/d19/d21/d23/dec/l11e 0 2024-04-23T10:19:01.835 INFO:tasks.workunit.client.0.smithi026.stdout:7/903: unlink dd/l25 0 2024-04-23T10:19:01.836 INFO:tasks.workunit.client.0.smithi026.stdout:2/952: chown d3/d19/d21/d23/d3a/d3c/d80/da7/dac/fbb 166 1 2024-04-23T10:19:01.837 INFO:tasks.workunit.client.0.smithi026.stdout:2/953: fsync d3/dd/d4b/f64 0 2024-04-23T10:19:01.839 INFO:tasks.workunit.client.0.smithi026.stdout:1/995: link dd/d1a/d20/d25/f123 dd/d1a/d20/d25/d35/d7f/dd5/f158 0 2024-04-23T10:19:01.839 INFO:tasks.workunit.client.0.smithi026.stdout:7/904: dread dd/d2c/d48/fbe [0,4194304] 0 2024-04-23T10:19:01.846 INFO:tasks.workunit.client.0.smithi026.stdout:7/905: readlink dd/d3f/d47/d4c/d60/l6d 0 2024-04-23T10:19:01.848 INFO:tasks.workunit.client.0.smithi026.stdout:3/964: dread d0/d1e/d30/d43/df/d63/f7b [0,4194304] 0 2024-04-23T10:19:01.848 INFO:tasks.workunit.client.0.smithi026.stdout:2/954: mknod d3/d19/d21/d23/d3a/d3c/d80/da7/c142 0 2024-04-23T10:19:01.851 INFO:tasks.workunit.client.0.smithi026.stdout:1/996: write dd/d1a/d23/f28 [1973904,3048] 0 2024-04-23T10:19:01.854 INFO:tasks.workunit.client.0.smithi026.stdout:3/965: chown d0/d1e/d23/d87/db3/dee/c90 526270989 1 2024-04-23T10:19:01.863 INFO:tasks.workunit.client.0.smithi026.stdout:7/906: mknod dd/dd8/c11a 0 2024-04-23T10:19:01.864 INFO:tasks.workunit.client.0.smithi026.stdout:2/955: write d3/d19/d21/d23/d3a/d65/f99 [588472,76132] 0 2024-04-23T10:19:01.865 INFO:tasks.workunit.client.0.smithi026.stdout:1/997: truncate dd/d1a/d20/d25/f9c 159561 0 2024-04-23T10:19:01.874 INFO:tasks.workunit.client.0.smithi026.stdout:7/907: fdatasync dd/d1d/d50/d58/fd6 0 2024-04-23T10:19:01.875 INFO:tasks.workunit.client.0.smithi026.stdout:2/956: readlink d3/d19/d1d/d49/l4a 0 2024-04-23T10:19:01.878 INFO:tasks.workunit.client.0.smithi026.stdout:1/998: mknod dd/d15/d7d/da1/dc6/ddc/c159 0 2024-04-23T10:19:01.885 INFO:tasks.workunit.client.0.smithi026.stdout:2/957: mkdir d3/d19/d21/d23/d3a/d3c/d80/d96/d141/d143 0 2024-04-23T10:19:01.891 INFO:tasks.workunit.client.0.smithi026.stdout:7/908: dread dd/d1d/f37 [0,4194304] 0 2024-04-23T10:19:01.893 INFO:tasks.workunit.client.0.smithi026.stdout:1/999: mkdir dd/d1a/d20/d25/d35/d7f/da5/d15a 0 2024-04-23T10:19:01.893 INFO:tasks.workunit.client.0.smithi026.stdout:2/958: truncate d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f6a 2028403 0 2024-04-23T10:19:01.897 INFO:tasks.workunit.client.0.smithi026.stdout:2/959: dread - d3/dd/df2/f117 zero size 2024-04-23T10:19:01.901 INFO:tasks.workunit.client.0.smithi026.stdout:7/909: mkdir dd/d1d/d113/d9f/dd2/d11b 0 2024-04-23T10:19:01.920 INFO:tasks.workunit.client.0.smithi026.stdout:2/960: dwrite d3/d19/d31/f77 [4194304,4194304] 0 2024-04-23T10:19:01.930 INFO:tasks.workunit.client.0.smithi026.stdout:7/910: dread dd/d44/f2e [0,4194304] 0 2024-04-23T10:19:01.939 INFO:tasks.workunit.client.0.smithi026.stdout:3/966: sync 2024-04-23T10:19:01.946 INFO:tasks.workunit.client.0.smithi026.stdout:3/967: truncate d0/d1e/d30/d43/d6c/d79/d73/d99/f114 71633 0 2024-04-23T10:19:01.947 INFO:tasks.workunit.client.0.smithi026.stdout:2/961: link d3/d19/d21/d23/d3a/d3c/f47 d3/d19/d21/d23/d3a/d3c/d5d/da0/f144 0 2024-04-23T10:19:01.950 INFO:tasks.workunit.client.0.smithi026.stdout:7/911: rename dd/d3f/d47/d4c/d60/d75/d10b/d116/d72/dd0/ded to dd/dbc/d11c 0 2024-04-23T10:19:01.952 INFO:tasks.workunit.client.0.smithi026.stdout:2/962: dread d3/dd/d4b/d9c/fee [0,4194304] 0 2024-04-23T10:19:01.953 INFO:tasks.workunit.client.0.smithi026.stdout:3/968: mkdir d0/d1e/d23/d87/df8/d147 0 2024-04-23T10:19:01.956 INFO:tasks.workunit.client.0.smithi026.stdout:2/963: chown d3/d19/d21/d23/d3a/d3c/d5d/f9b 2 1 2024-04-23T10:19:01.958 INFO:tasks.workunit.client.0.smithi026.stdout:7/912: read - dd/d46/fcf zero size 2024-04-23T10:19:01.976 INFO:tasks.workunit.client.0.smithi026.stdout:2/964: dwrite d3/d19/d21/d23/dec/f13b [0,4194304] 0 2024-04-23T10:19:01.980 INFO:tasks.workunit.client.0.smithi026.stdout:7/913: dread dd/d44/f5e [0,4194304] 0 2024-04-23T10:19:01.983 INFO:tasks.workunit.client.0.smithi026.stdout:3/969: rename d0/d4c/f134 to d0/d1e/d23/d87/df8/d124/f148 0 2024-04-23T10:19:01.985 INFO:tasks.workunit.client.0.smithi026.stdout:2/965: mkdir d3/d19/d21/d23/d3a/d3c/d80/d96/d141/d145 0 2024-04-23T10:19:01.995 INFO:tasks.workunit.client.0.smithi026.stdout:7/914: dwrite dd/d46/ff0 [0,4194304] 0 2024-04-23T10:19:02.003 INFO:tasks.workunit.client.0.smithi026.stdout:3/970: creat d0/d1e/d30/d43/df/dcb/d97/f149 x:0 0 0 2024-04-23T10:19:02.004 INFO:tasks.workunit.client.0.smithi026.stdout:3/971: fdatasync d0/d1e/fc7 0 2024-04-23T10:19:02.005 INFO:tasks.workunit.client.0.smithi026.stdout:2/966: dwrite d3/d19/d21/d23/d3a/d3c/d5d/f9b [0,4194304] 0 2024-04-23T10:19:02.007 INFO:tasks.workunit.client.0.smithi026.stdout:7/915: creat dd/d3f/d47/d4c/d60/d75/d10b/d116/d72/dd0/f11d x:0 0 0 2024-04-23T10:19:02.014 INFO:tasks.workunit.client.0.smithi026.stdout:3/972: creat d0/d1e/d23/d87/df8/d124/f14a x:0 0 0 2024-04-23T10:19:02.019 INFO:tasks.workunit.client.0.smithi026.stdout:2/967: mknod d3/dd/d4b/d9c/c146 0 2024-04-23T10:19:02.021 INFO:tasks.workunit.client.0.smithi026.stdout:7/916: mkdir dd/d1d/d113/d9f/dd2/d11b/d11e 0 2024-04-23T10:19:02.024 INFO:tasks.workunit.client.0.smithi026.stdout:3/973: rename d0/d1e/d30/d43/db4/d10c/f98 to d0/d1e/d30/d43/df/d17/d140/f14b 0 2024-04-23T10:19:02.026 INFO:tasks.workunit.client.0.smithi026.stdout:2/968: truncate d3/d19/d21/d23/d3a/d3c/d5d/f7b 1459493 0 2024-04-23T10:19:02.033 INFO:tasks.workunit.client.0.smithi026.stdout:3/974: mkdir d0/d1e/d30/d43/df/d72/dff/d14c 0 2024-04-23T10:19:02.035 INFO:tasks.workunit.client.0.smithi026.stdout:2/969: write d3/d19/d21/d23/d3a/d3c/f7c [1139017,44960] 0 2024-04-23T10:19:02.040 INFO:tasks.workunit.client.0.smithi026.stdout:3/975: mkdir d0/d1e/d23/d87/db3/dee/d39/d93/d14d 0 2024-04-23T10:19:02.042 INFO:tasks.workunit.client.0.smithi026.stdout:3/976: stat d0/d1e/d30/d43/l130 0 2024-04-23T10:19:02.042 INFO:tasks.workunit.client.0.smithi026.stdout:7/917: dwrite dd/d3f/d47/f114 [0,4194304] 0 2024-04-23T10:19:02.044 INFO:tasks.workunit.client.0.smithi026.stdout:2/970: mkdir d3/d19/d1d/d147 0 2024-04-23T10:19:02.046 INFO:tasks.workunit.client.0.smithi026.stdout:2/971: truncate d3/d19/d21/d23/d3a/d65/f99 1407635 0 2024-04-23T10:19:02.054 INFO:tasks.workunit.client.0.smithi026.stdout:3/977: dread - d0/d1e/d23/d52/fcc zero size 2024-04-23T10:19:02.231 INFO:tasks.workunit.client.0.smithi026.stdout:3/978: sync 2024-04-23T10:19:02.243 INFO:tasks.workunit.client.0.smithi026.stdout:3/979: rmdir d0/d1e/d30/d43/d6c/d79/d73 39 2024-04-23T10:19:02.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/918: dwrite dd/d1d/d113/fb5 [0,4194304] 0 2024-04-23T10:19:02.280 INFO:tasks.workunit.client.0.smithi026.stdout:3/980: dread d0/d1e/d23/d87/db3/dee/f35 [0,4194304] 0 2024-04-23T10:19:02.284 INFO:tasks.workunit.client.0.smithi026.stdout:2/972: rename d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f81 to d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/f148 0 2024-04-23T10:19:02.294 INFO:tasks.workunit.client.0.smithi026.stdout:3/981: unlink d0/d4c/l143 0 2024-04-23T10:19:02.296 INFO:tasks.workunit.client.0.smithi026.stdout:2/973: symlink d3/d19/d21/d23/d3a/l149 0 2024-04-23T10:19:02.297 INFO:tasks.workunit.client.0.smithi026.stdout:7/919: creat dd/de5/dfc/f11f x:0 0 0 2024-04-23T10:19:02.299 INFO:tasks.workunit.client.0.smithi026.stdout:7/920: stat dd/d46/fcf 0 2024-04-23T10:19:02.303 INFO:tasks.workunit.client.0.smithi026.stdout:3/982: mknod d0/d1e/d23/d87/df8/d124/c14e 0 2024-04-23T10:19:02.308 INFO:tasks.workunit.client.0.smithi026.stdout:2/974: dread d3/d19/d21/d23/d3a/d3c/d5d/da0/da4/df9/d4c/ff4 [0,4194304] 0 2024-04-23T10:19:02.311 INFO:tasks.workunit.client.0.smithi026.stdout:2/975: read - d3/d19/d21/d23/d3a/d3c/d80/da7/fe1 zero size 2024-04-23T10:19:02.332 INFO:tasks.workunit.client.0.smithi026.stdout:2/976: write d3/dd/f30 [76427,24002] 0 2024-04-23T10:19:02.389 INFO:tasks.workunit.client.0.smithi026.stdout:3/983: sync 2024-04-23T10:19:02.404 INFO:tasks.workunit.client.0.smithi026.stdout:7/921: link dd/d1d/d50/d58/l66 dd/dbc/l120 0 2024-04-23T10:19:02.405 INFO:tasks.workunit.client.0.smithi026.stdout:7/922: stat dd/d1d/d50/d58 0 2024-04-23T10:19:02.414 INFO:tasks.workunit.client.0.smithi026.stdout:7/923: mknod dd/d3f/d47/d4c/d60/d75/d10b/d116/dc6/c121 0 2024-04-23T10:19:02.638 INFO:tasks.workunit.client.0.smithi026.stdout:2/977: getdents d3/d19/d21/d23/d3a/d3c/d80/d96/d141 0 2024-04-23T10:19:02.640 INFO:tasks.workunit.client.0.smithi026.stdout:2/978: dread - d3/dd/df2/f117 zero size 2024-04-23T10:19:02.650 INFO:tasks.workunit.client.0.smithi026.stdout:3/984: rename d0/d1e/d23/d52/l54 to d0/d1e/d23/d87/db3/dee/d39/db7/l14f 0 2024-04-23T10:19:02.653 INFO:tasks.workunit.client.0.smithi026.stdout:2/979: symlink d3/d19/d21/d23/d3a/d3c/d80/d96/d141/d145/l14a 0 2024-04-23T10:19:02.655 INFO:tasks.workunit.client.0.smithi026.stdout:2/980: chown d3/d19/d21/d23/da2 5 1 2024-04-23T10:19:02.661 INFO:tasks.workunit.client.0.smithi026.stdout:2/981: chown d3/d19/d21/c70 3 1 2024-04-23T10:19:02.663 INFO:tasks.workunit.client.0.smithi026.stdout:3/985: truncate d0/d1e/d30/d43/df/d17/f11c 654513 0 2024-04-23T10:19:02.665 INFO:tasks.workunit.client.0.smithi026.stdout:2/982: dread - d3/d19/d21/d23/d3a/d3c/d80/da7/dac/dd9/f137 zero size 2024-04-23T10:19:02.669 INFO:tasks.workunit.client.0.smithi026.stdout:7/924: rename dd/c22 to dd/d1d/d113/c122 0 2024-04-23T10:19:02.673 INFO:tasks.workunit.client.0.smithi026.stdout:2/983: fdatasync d3/d19/d21/d23/f24 0 2024-04-23T10:19:02.677 INFO:tasks.workunit.client.0.smithi026.stdout:3/986: fsync d0/d1e/d23/d87/db3/dee/fc5 0 2024-04-23T10:19:02.680 INFO:tasks.workunit.client.0.smithi026.stdout:7/925: mkdir dd/d1d/de7/d123 0 2024-04-23T10:19:02.681 INFO:tasks.workunit.client.0.smithi026.stdout:7/926: chown dd/d1d/d113/fb5 25125291 1 2024-04-23T10:19:02.705 INFO:tasks.workunit.client.0.smithi026.stdout:7/927: creat dd/d1d/de7/d123/f124 x:0 0 0 2024-04-23T10:19:02.708 INFO:tasks.workunit.client.0.smithi026.stdout:2/984: creat d3/d19/d21/d23/d108/f14b x:0 0 0 2024-04-23T10:19:02.715 INFO:tasks.workunit.client.0.smithi026.stdout:7/928: read dd/d1d/f31 [4184368,10337] 0 2024-04-23T10:19:02.718 INFO:tasks.workunit.client.0.smithi026.stdout:3/987: write d0/d1e/d23/d87/db3/dee/d39/db7/fa6 [1082069,127322] 0 2024-04-23T10:19:02.732 INFO:tasks.workunit.client.0.smithi026.stdout:2/985: dwrite d3/d19/d21/f85 [0,4194304] 0 2024-04-23T10:19:02.757 INFO:tasks.workunit.client.0.smithi026.stdout:3/988: dread d0/d1e/d30/d43/fa [0,4194304] 0 2024-04-23T10:19:02.765 INFO:tasks.workunit.client.0.smithi026.stdout:2/986: mknod d3/d19/c14c 0 2024-04-23T10:19:02.774 INFO:tasks.workunit.client.0.smithi026.stdout:2/987: creat d3/d19/d31/d83/d136/f14d x:0 0 0 2024-04-23T10:19:02.778 INFO:tasks.workunit.client.0.smithi026.stdout:3/989: getdents d0/d1e/d23/d87/db3/dee/d39/db7 0 2024-04-23T10:19:02.780 INFO:tasks.workunit.client.0.smithi026.stdout:3/990: chown d0/d1e/d23/f12d 3206 1 2024-04-23T10:19:02.786 INFO:tasks.workunit.client.0.smithi026.stdout:3/991: fsync d0/d1e/d30/d43/df/dcb/f94 0 2024-04-23T10:19:02.789 INFO:tasks.workunit.client.0.smithi026.stdout:7/929: sync 2024-04-23T10:19:02.791 INFO:tasks.workunit.client.0.smithi026.stdout:2/988: creat d3/d19/d21/d23/d3a/d3c/d5d/da0/f14e x:0 0 0 2024-04-23T10:19:02.800 INFO:tasks.workunit.client.0.smithi026.stdout:2/989: symlink d3/dd/df2/l14f 0 2024-04-23T10:19:02.803 INFO:tasks.workunit.client.0.smithi026.stdout:3/992: getdents d0/d1e/d23/d87 0 2024-04-23T10:19:02.815 INFO:tasks.workunit.client.0.smithi026.stdout:7/930: dwrite dd/d1d/d78/f9b [0,4194304] 0 2024-04-23T10:19:02.820 INFO:tasks.workunit.client.0.smithi026.stdout:2/990: dread d3/d19/d21/fcf [0,4194304] 0 2024-04-23T10:19:02.822 INFO:tasks.workunit.client.0.smithi026.stdout:2/991: write d3/d19/d21/d23/d108/dd8/fe5 [4217238,82988] 0 2024-04-23T10:19:02.822 INFO:tasks.workunit.client.0.smithi026.stdout:3/993: write d0/d1e/d23/d87/db3/dee/f106 [507939,84825] 0 2024-04-23T10:19:02.826 INFO:tasks.workunit.client.0.smithi026.stdout:7/931: mkdir dd/de5/d125 0 2024-04-23T10:19:02.838 INFO:tasks.workunit.client.0.smithi026.stdout:3/994: symlink d0/d1e/d30/d43/d82/l150 0 2024-04-23T10:19:02.841 INFO:tasks.workunit.client.0.smithi026.stdout:3/995: stat d0/d1e/d23/d87/db3/dee/d39/dda 0 2024-04-23T10:19:02.841 INFO:tasks.workunit.client.0.smithi026.stdout:7/932: creat dd/de5/dfc/f126 x:0 0 0 2024-04-23T10:19:02.844 INFO:tasks.workunit.client.0.smithi026.stdout:2/992: creat d3/dd/def/f150 x:0 0 0 2024-04-23T10:19:02.849 INFO:tasks.workunit.client.0.smithi026.stdout:7/933: creat dd/d44/f127 x:0 0 0 2024-04-23T10:19:02.850 INFO:tasks.workunit.client.0.smithi026.stdout:7/934: readlink dd/l18 0 2024-04-23T10:19:02.851 INFO:tasks.workunit.client.0.smithi026.stdout:7/935: write dd/d1d/d50/f5c [3035072,60015] 0 2024-04-23T10:19:02.853 INFO:tasks.workunit.client.0.smithi026.stdout:2/993: symlink d3/d19/d31/l151 0 2024-04-23T10:19:02.856 INFO:tasks.workunit.client.0.smithi026.stdout:7/936: readlink dd/d2c/d48/l53 0 2024-04-23T10:19:02.862 INFO:tasks.workunit.client.0.smithi026.stdout:2/994: mknod d3/d19/d21/d23/d3a/d3c/d80/d96/d141/d143/c152 0 2024-04-23T10:19:02.914 INFO:tasks.workunit.client.0.smithi026.stdout:3/996: sync 2024-04-23T10:19:03.037 INFO:tasks.workunit.client.0.smithi026.stdout:7/937: rename dd/d3f/d47/f114 to dd/d3f/d47/d4c/d60/d75/f128 0 2024-04-23T10:19:03.041 INFO:tasks.workunit.client.0.smithi026.stdout:7/938: truncate dd/d2c/d48/f103 166375 0 2024-04-23T10:19:03.047 INFO:tasks.workunit.client.0.smithi026.stdout:2/995: rename d3/d19/d21/d23/d3a/d3c/fdf to d3/d19/d21/d23/d3a/d3c/d80/f153 0 2024-04-23T10:19:03.074 INFO:tasks.workunit.client.0.smithi026.stdout:3/997: rename d0/d51/fae to d0/d51/d5e/da4/f151 0 2024-04-23T10:19:03.082 INFO:tasks.workunit.client.0.smithi026.stdout:2/996: dread d3/d19/d21/d23/da2/db8/ffd [0,4194304] 0 2024-04-23T10:19:03.086 INFO:tasks.workunit.client.0.smithi026.stdout:3/998: rmdir d0/d1e/d30/d43/df/d72/d8c 39 2024-04-23T10:19:03.089 INFO:tasks.workunit.client.0.smithi026.stdout:7/939: dwrite dd/d3f/d47/d4c/d60/d106/f10e [0,4194304] 0 2024-04-23T10:19:03.093 INFO:tasks.workunit.client.0.smithi026.stdout:3/999: symlink d0/d1e/d30/d43/df/d63/l152 0 2024-04-23T10:19:03.098 INFO:tasks.workunit.client.0.smithi026.stdout:2/997: creat d3/d19/d21/d23/d3a/d3c/d80/d96/d141/d145/f154 x:0 0 0 2024-04-23T10:19:03.120 INFO:tasks.workunit.client.0.smithi026.stdout:7/940: truncate dd/d1d/d78/f54 4197151 0 2024-04-23T10:19:03.125 INFO:tasks.workunit.client.0.smithi026.stdout:2/998: unlink d3/d19/d21/d23/d3a/d3c/d5d/da0/f144 0 2024-04-23T10:19:03.150 INFO:tasks.workunit.client.0.smithi026.stdout:2/999: dwrite d3/f2a [4194304,4194304] 0 2024-04-23T10:19:03.154 INFO:tasks.workunit.client.0.smithi026.stdout:7/941: dread dd/d3f/f73 [0,4194304] 0 2024-04-23T10:19:03.180 INFO:tasks.workunit.client.0.smithi026.stdout:7/942: dwrite dd/d2c/d48/d8d/fd4 [0,4194304] 0 2024-04-23T10:19:03.187 INFO:tasks.workunit.client.0.smithi026.stdout:7/943: truncate dd/f67 730086 0 2024-04-23T10:19:03.191 INFO:tasks.workunit.client.0.smithi026.stdout:7/944: write dd/d1d/de7/d123/f124 [964029,74402] 0 2024-04-23T10:19:03.204 INFO:tasks.workunit.client.0.smithi026.stdout:7/945: dread dd/d1d/d113/fb2 [0,4194304] 0 2024-04-23T10:19:03.209 INFO:tasks.workunit.client.0.smithi026.stdout:7/946: readlink dd/d2c/d48/l53 0 2024-04-23T10:19:03.546 INFO:tasks.workunit.client.0.smithi026.stdout:7/947: truncate dd/d3f/d47/d4c/d60/d75/d10b/d116/d72/fe6 4730942 0 2024-04-23T10:19:03.551 INFO:tasks.workunit.client.0.smithi026.stdout:7/948: fdatasync dd/d3f/d47/d4c/d60/d75/f128 0 2024-04-23T10:19:03.559 INFO:tasks.workunit.client.0.smithi026.stdout:7/949: symlink dd/d1d/d78/l129 0 2024-04-23T10:19:03.562 INFO:tasks.workunit.client.0.smithi026.stdout:7/950: dread dd/d2c/d48/fbe [0,4194304] 0 2024-04-23T10:19:03.566 INFO:tasks.workunit.client.0.smithi026.stdout:7/951: rmdir dd/d1d/de7 39 2024-04-23T10:19:03.585 INFO:tasks.workunit.client.0.smithi026.stdout:7/952: dwrite dd/d46/ff0 [0,4194304] 0 2024-04-23T10:19:03.631 INFO:tasks.workunit.client.0.smithi026.stdout:7/953: dread dd/d3f/d47/d4c/d60/d75/d10b/d116/dc6/fe1 [0,4194304] 0 2024-04-23T10:19:03.648 INFO:tasks.workunit.client.0.smithi026.stdout:7/954: dwrite dd/de5/f118 [0,4194304] 0 2024-04-23T10:19:03.651 INFO:tasks.workunit.client.0.smithi026.stdout:7/955: truncate dd/f107 9110624 0 2024-04-23T10:19:03.692 INFO:tasks.workunit.client.0.smithi026.stdout:7/956: dread dd/d3f/d47/d4c/fcc [0,4194304] 0 2024-04-23T10:19:03.713 INFO:tasks.workunit.client.0.smithi026.stdout:7/957: dwrite dd/ff [0,4194304] 0 2024-04-23T10:19:03.736 INFO:tasks.workunit.client.0.smithi026.stdout:7/958: dwrite dd/d46/fcf [0,4194304] 0 2024-04-23T10:19:03.746 INFO:tasks.workunit.client.0.smithi026.stdout:7/959: mknod dd/d3f/d47/d4c/d60/d75/d10b/d116/d112/c12a 0 2024-04-23T10:19:03.766 INFO:tasks.workunit.client.0.smithi026.stdout:7/960: write dd/d46/f8c [334229,52847] 0 2024-04-23T10:19:03.784 INFO:tasks.workunit.client.0.smithi026.stdout:7/961: dread dd/d3f/d47/d4c/d60/d75/f92 [0,4194304] 0 2024-04-23T10:19:03.794 INFO:tasks.workunit.client.0.smithi026.stdout:7/962: dread dd/d1d/d113/f98 [0,4194304] 0 2024-04-23T10:19:03.940 INFO:tasks.workunit.client.0.smithi026.stdout:7/963: sync 2024-04-23T10:19:03.949 INFO:tasks.workunit.client.0.smithi026.stdout:7/964: dread dd/d1d/d50/f8b [0,4194304] 0 2024-04-23T10:19:03.965 INFO:tasks.workunit.client.0.smithi026.stdout:7/965: rename dd/d3f/d47/f83 to dd/d1d/d113/f12b 0 2024-04-23T10:19:03.974 INFO:tasks.workunit.client.0.smithi026.stdout:7/966: creat dd/d2c/d48/d7e/f12c x:0 0 0 2024-04-23T10:19:03.983 INFO:tasks.workunit.client.0.smithi026.stdout:7/967: creat dd/d44/f12d x:0 0 0 2024-04-23T10:19:03.995 INFO:tasks.workunit.client.0.smithi026.stdout:7/968: unlink dd/d3f/d47/d4c/d60/d75/d10b/d116/fa8 0 2024-04-23T10:19:04.002 INFO:tasks.workunit.client.0.smithi026.stdout:7/969: creat dd/d44/f12e x:0 0 0 2024-04-23T10:19:04.007 INFO:tasks.workunit.client.0.smithi026.stdout:7/970: mkdir dd/d3f/d47/d4c/d60/d106/d12f 0 2024-04-23T10:19:04.016 INFO:tasks.workunit.client.0.smithi026.stdout:7/971: rename dd/f107 to dd/d1d/f130 0 2024-04-23T10:19:04.019 INFO:tasks.workunit.client.0.smithi026.stdout:7/972: chown dd/d2c/l68 23388459 1 2024-04-23T10:19:04.021 INFO:tasks.workunit.client.0.smithi026.stdout:7/973: chown dd/d2c/d48/d8d/fd4 2942616 1 2024-04-23T10:19:04.025 INFO:tasks.workunit.client.0.smithi026.stdout:7/974: chown dd/d1d/d78/cce 80816 1 2024-04-23T10:19:04.029 INFO:tasks.workunit.client.0.smithi026.stdout:7/975: read dd/d3f/d47/d4c/d60/d75/d10b/d116/dc6/fe1 [762853,53700] 0 2024-04-23T10:19:04.031 INFO:tasks.workunit.client.0.smithi026.stdout:7/976: stat dd/d1d/d50/f87 0 2024-04-23T10:19:04.032 INFO:tasks.workunit.client.0.smithi026.stdout:7/977: chown dd/d1d/d113/cf8 6 1 2024-04-23T10:19:04.034 INFO:tasks.workunit.client.0.smithi026.stdout:7/978: readlink dd/d44/lf3 0 2024-04-23T10:19:04.037 INFO:tasks.workunit.client.0.smithi026.stdout:7/979: readlink dd/d3f/l8a 0 2024-04-23T10:19:04.043 INFO:tasks.workunit.client.0.smithi026.stdout:7/980: symlink dd/d3f/d47/d4c/d60/d75/l131 0 2024-04-23T10:19:04.048 INFO:tasks.workunit.client.0.smithi026.stdout:7/981: getdents dd/de5 0 2024-04-23T10:19:04.061 INFO:tasks.workunit.client.0.smithi026.stdout:7/982: rename dd/d3f/d47 to dd/d1d/d113/d9f/dd2/d11b/d132 0 2024-04-23T10:19:04.065 INFO:tasks.workunit.client.0.smithi026.stdout:7/983: stat dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/d10b/d116/d112/c12a 0 2024-04-23T10:19:04.073 INFO:tasks.workunit.client.0.smithi026.stdout:7/984: symlink dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/d10b/d116/d72/l133 0 2024-04-23T10:19:04.076 INFO:tasks.workunit.client.0.smithi026.stdout:7/985: dread - dd/d1d/d113/d9f/dd2/d11b/d132/d4c/ff1 zero size 2024-04-23T10:19:04.149 INFO:tasks.workunit.client.0.smithi026.stdout:7/986: sync 2024-04-23T10:19:04.168 INFO:tasks.workunit.client.0.smithi026.stdout:7/987: dwrite dd/d1d/de7/d123/f124 [0,4194304] 0 2024-04-23T10:19:04.172 INFO:tasks.workunit.client.0.smithi026.stdout:7/988: write dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/f128 [734698,25394] 0 2024-04-23T10:19:04.181 INFO:tasks.workunit.client.0.smithi026.stdout:7/989: truncate dd/d2c/d48/d7e/f93 1850497 0 2024-04-23T10:19:04.194 INFO:tasks.workunit.client.0.smithi026.stdout:7/990: mkdir dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/d10b/d116/dc6/d134 0 2024-04-23T10:19:04.217 INFO:tasks.workunit.client.0.smithi026.stdout:7/991: dwrite dd/d1d/d113/d9f/dd2/d11b/d132/d4c/fcc [0,4194304] 0 2024-04-23T10:19:04.241 INFO:tasks.workunit.client.0.smithi026.stdout:7/992: dread dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/d10b/d116/fbd [0,4194304] 0 2024-04-23T10:19:04.254 INFO:tasks.workunit.client.0.smithi026.stdout:7/993: creat dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60/d75/d10b/d116/d72/f135 x:0 0 0 2024-04-23T10:19:04.257 INFO:tasks.workunit.client.0.smithi026.stdout:7/994: read - dd/dd8/f111 zero size 2024-04-23T10:19:04.357 INFO:tasks.workunit.client.0.smithi026.stdout:7/995: sync 2024-04-23T10:19:04.374 INFO:tasks.workunit.client.0.smithi026.stdout:7/996: readlink dd/d2c/lb7 0 2024-04-23T10:19:04.378 INFO:tasks.workunit.client.0.smithi026.stdout:7/997: rmdir dd/d1d/d113/d9f/dd2/d11b/d132/d4c/d60 39 2024-04-23T10:19:04.388 INFO:tasks.workunit.client.0.smithi026.stdout:7/998: dread dd/d1d/f37 [0,4194304] 0 2024-04-23T10:19:04.396 INFO:tasks.workunit.client.0.smithi026.stdout:7/999: getdents dd/de5/dfc 0 2024-04-23T10:19:04.408 INFO:tasks.workunit.client.0.smithi026.stderr:+ rm -rf -- ./tmp.IyREBomXiq 2024-04-23T10:19:06.666 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:06.669 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:36.709 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:36.713 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:19:49.398 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-23T10:19:49.398 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-23T10:20:06.776 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:06.779 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:18.451 INFO:tasks.quiescer.fs.[cephfs]:Total duration (58.1) is longer than `split_if_longer` (35.0), will split into two consecutive quiesces 2024-04-23T10:20:18.451 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.05 2024-04-23T10:20:18.451 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:20:18.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 Processor -- start 2024-04-23T10:20:18.585 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 -- start start 2024-04-23T10:20:18.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f080015f2b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080015b300 con 0x7f08000cd8a0 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f080015b5e0 con 0x7f0800143f20 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f08065ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0800072420 con 0x7f08000cdc80 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07fffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f08000cd8a0 0x7f08000c9930 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:54082/0 (socket says 172.21.15.26:54082) 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07fffff640 1 -- 172.21.15.26:0/197398942 learned_addr learned my addr 172.21.15.26:0/197398942 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07f77fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f080015f2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3467109706 0 0) 0x7f080015b300 con 0x7f08000cd8a0 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f07ec003530 con 0x7f08000cd8a0 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 755884687 0 0) 0x7f07ec003530 con 0x7f08000cd8a0 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 msgr2=0x7f080015f2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f080015f2b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.589 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.584+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 >> v1:172.21.15.190:6789/0 conn(0x7f0800143f20 legacy=0x7f080006bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f080015b8c0 con 0x7f08000cd8a0 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f07f0001680 con 0x7f08000cd8a0 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 >> v1:172.21.15.26:6789/0 conn(0x7f08000cd8a0 legacy=0x7f08000c9930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f07ec0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07ec003fc0 0x7f07ec004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec004d50 0x7f07ec0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec00bb70 con 0x7f07ec003fc0 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07ec00bd20 con 0x7f07ec004d50 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07ec00bf20 con 0x7f08000cdc80 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07ec003fc0 0x7f07ec004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07fffff640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f07ec0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f0804b4b640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec004d50 0x7f07ec0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 -- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 msgr2=0x7f07ec0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f07ec0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 -- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec004d50 msgr2=0x7f07ec0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec004d50 0x7f07ec0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 -- 172.21.15.26:0/197398942 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07ec003530 con 0x7f07ec003fc0 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07fffff640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08000cdc80 0x7f07ec0039f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:20:18.591 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f0804b4b640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec004d50 0x7f07ec0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:20:18.592 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07f77fe640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07ec003fc0 0x7f07ec004810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ae0 tx=0x7f07e801c9b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=356b0f97b9ee0408 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e80b2070 con 0x7f07ec003fc0 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e80a55a0 con 0x7f07ec003fc0 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.588+0000 7f07ff7fe640 1 -- 172.21.15.26:0/197398942 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e80096b0 con 0x7f07ec003fc0 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/197398942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07ec003fc0 msgr2=0x7f07ec004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 --2- 172.21.15.26:0/197398942 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07ec003fc0 0x7f07ec004810 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ae0 tx=0x7f07e801c9b0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f0804b4b640 1 -- 172.21.15.26:0/197398942 reap_dead start 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/197398942 shutdown_connections 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/197398942 >> 172.21.15.26:0/197398942 conn(0x7f080006fca0 msgr2=0x7f08000700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/197398942 shutdown_connections 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/197398942 wait complete. 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 Processor -- start 2024-04-23T10:20:18.593 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- start start 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec003fc0 0x7f0800141890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 0x7f08001e4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f080006c4c0 con 0x7f08001e7d80 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f080015be80 con 0x7f07ec003fc0 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f080006c640 con 0x7f08001f1120 2024-04-23T10:20:18.596 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39094/0 (socket says 172.21.15.26:39094) 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 -- 172.21.15.26:0/843621917 learned_addr learned my addr 172.21.15.26:0/843621917 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07fffff640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec003fc0 0x7f0800141890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f0804b4b640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 0x7f08001e4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 -- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 msgr2=0x7f08001e4430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 0x7f08001e4430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 -- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec003fc0 msgr2=0x7f0800141890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec003fc0 0x7f0800141890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 -- 172.21.15.26:0/843621917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f08001584d0 con 0x7f08001e7d80 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f0804b4b640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 0x7f08001e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07f77fe640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ae0 tx=0x7f07ec005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e80bc030 con 0x7f08001e7d80 2024-04-23T10:20:18.597 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f07e800f000 con 0x7f08001e7d80 2024-04-23T10:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f07e80b2040 con 0x7f08001e7d80 2024-04-23T10:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f08001587b0 con 0x7f08001e7d80 2024-04-23T10:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.592+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f08000c7a90 con 0x7f08001e7d80 2024-04-23T10:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0800075df0 con 0x7f08001e7d80 2024-04-23T10:20:18.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f07e80bf070 con 0x7f08001e7d80 2024-04-23T10:20:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f07fd7fa640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 0x7f07e006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f07e8121080 con 0x7f08001e7d80 2024-04-23T10:20:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f07fffff640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 0x7f07e006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:18.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.596+0000 7f07fffff640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 0x7f07e006a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07f0000c10 tx=0x7f07f0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:18.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.600+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f07e80166c0 con 0x7f08001e7d80 2024-04-23T10:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.892+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f08001428a0 con 0x7f08001e7d80 2024-04-23T10:20:18.895 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f07fd7fa640 1 -- 172.21.15.26:0/843621917 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f07e80f12b0 con 0x7f08001e7d80 2024-04-23T10:20:18.896 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:20:18.896 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:20:18.896 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:20:18.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 msgr2=0x7f07e006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 0x7f07e006a840 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f07f0000c10 tx=0x7f07f0009040 comp rx=0 tx=0).stop 2024-04-23T10:20:18.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 msgr2=0x7f0800141dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:18.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7f07e8009ae0 tx=0x7f07ec005840 comp rx=0 tx=0).stop 2024-04-23T10:20:18.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 shutdown_connections 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07e0068380 0x7f07e006a840 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f08001f1120 0x7f08001e4430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f08001e7d80 0x7f0800141dd0 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 --2- 172.21.15.26:0/843621917 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07ec003fc0 0x7f0800141890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 >> 172.21.15.26:0/843621917 conn(0x7f080006fca0 msgr2=0x7f0800073830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 shutdown_connections 2024-04-23T10:20:18.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:18.896+0000 7f08065ae640 1 -- 172.21.15.26:0/843621917 wait complete. 2024-04-23T10:20:18.914 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 89.05 --await-for 42.0' 2024-04-23T10:20:18.914 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 89.05 --await-for 42.0 2024-04-23T10:20:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 Processor -- start 2024-04-23T10:20:19.044 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 -- start start 2024-04-23T10:20:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f879c0cd490 0x7f879c0cd8b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f879c0cc9d0 con 0x7f879c073360 2024-04-23T10:20:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f879c073e30 con 0x7f879c0cd490 2024-04-23T10:20:19.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f87a0884640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f879c15ba20 con 0x7f879c073740 2024-04-23T10:20:19.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f879ad9d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f879c0cd490 0x7f879c0cd8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:60636/0 (socket says 172.21.15.26:60636) 2024-04-23T10:20:19.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f8799d9b640 1 -- 172.21.15.26:0/1748981671 learned_addr learned my addr 172.21.15.26:0/1748981671 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f879ad9d640 1 -- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 msgr2=0x7f879c0c58a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f879ad9d640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f879ad9d640 1 -- 172.21.15.26:0/1748981671 >> v1:172.21.15.190:6789/0 conn(0x7f879c073360 legacy=0x7f879c15b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f879ad9d640 1 -- 172.21.15.26:0/1748981671 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c15bd00 con 0x7f879c0cd490 2024-04-23T10:20:19.047 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.044+0000 7f8799d9b640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:20:19.048 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f879ad9d640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c0cd8b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87940097c0 tx=0x7f879401ec90 comp rx=0 tx=0).ready entity=mon.1 client_cookie=1979fce9c9af356d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f879959a640 1 -- 172.21.15.26:0/1748981671 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940b5070 con 0x7f879c0cd490 2024-04-23T10:20:19.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f879959a640 1 -- 172.21.15.26:0/1748981671 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f87940a8990 con 0x7f879c0cd490 2024-04-23T10:20:19.049 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f879959a640 1 -- 172.21.15.26:0/1748981671 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f87940a8d60 con 0x7f879c0cd490 2024-04-23T10:20:19.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 -- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 msgr2=0x7f879c0cd8b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c0cd8b0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f87940097c0 tx=0x7f879401ec90 comp rx=0 tx=0).stop 2024-04-23T10:20:19.050 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 -- 172.21.15.26:0/1748981671 shutdown_connections 2024-04-23T10:20:19.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c0cd8b0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 --2- 172.21.15.26:0/1748981671 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c0c58a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 -- 172.21.15.26:0/1748981671 >> 172.21.15.26:0/1748981671 conn(0x7f879c06cc30 msgr2=0x7f879c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:19.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 -- 172.21.15.26:0/1748981671 shutdown_connections 2024-04-23T10:20:19.051 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 -- 172.21.15.26:0/1748981671 wait complete. 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.048+0000 7f87a0884640 1 Processor -- start 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- start start 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c150b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c14c0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0ccf70 con 0x7f879c073360 2024-04-23T10:20:19.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f879c0ccc90 con 0x7f879c0cd490 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f879c154fd0 con 0x7f879c073740 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39102/0 (socket says 172.21.15.26:39102) 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 -- 172.21.15.26:0/3640162530 learned_addr learned my addr 172.21.15.26:0/3640162530 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879ad9d640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c14c0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f8799d9b640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c150b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 -- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 msgr2=0x7f879c150b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c150b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 -- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 msgr2=0x7f879c14c0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c14c0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 -- 172.21.15.26:0/3640162530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f879c0d16f0 con 0x7f879c073360 2024-04-23T10:20:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f8799d9b640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f879a59c640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c790 tx=0x7f878c00cc50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f878affd640 1 -- 172.21.15.26:0/3640162530 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c016020 con 0x7f879c073360 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f878affd640 1 -- 172.21.15.26:0/3640162530 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c006d60 con 0x7f879c073360 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f879c14dfe0 con 0x7f879c073360 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f878affd640 1 -- 172.21.15.26:0/3640162530 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c003bc0 con 0x7f879c073360 2024-04-23T10:20:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f879c1f14f0 con 0x7f879c073360 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.052+0000 7f878affd640 1 -- 172.21.15.26:0/3640162530 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f878c00a850 con 0x7f879c073360 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f878affd640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f878affd640 1 -- 172.21.15.26:0/3640162530 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f878c086b40 con 0x7f879c073360 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 Processor -- start 2024-04-23T10:20:19.056 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- start start 2024-04-23T10:20:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 0x7f877c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f879c073cb0 tx=0x7f8790008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 0x55f04bfac9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04bfb23c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f04be582a0 con 0x55f04bfb16c0 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f04bdbe5f0 con 0x55f04bfac600 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f04bd59820 con 0x55f04bfb1fe0 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39116/0 (socket says 172.21.15.26:39116) 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 -- 172.21.15.26:0/253113508 learned_addr learned my addr 172.21.15.26:0/253113508 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f879a59c640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 0x55f04bfac9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f879ad9d640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04bfb23c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 -- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 msgr2=0x55f04bfb23c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04bfb23c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 -- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 msgr2=0x55f04bfac9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 0x55f04bfac9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 -- 172.21.15.26:0/253113508 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04be04c00 con 0x55f04bfb16c0 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f879a59c640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 0x55f04bfac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f8799d9b640 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8790011dd0 tx=0x7f8790014000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfcec3c33ff472f3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f877bfff640 1 -- 172.21.15.26:0/253113508 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790011e00 con 0x55f04bfb16c0 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f877bfff640 1 -- 172.21.15.26:0/253113508 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790026070 con 0x55f04bfb16c0 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f877bfff640 1 -- 172.21.15.26:0/253113508 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790021660 con 0x55f04bfb16c0 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- 172.21.15.26:0/253113508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 msgr2=0x55f04bfb1aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7f8790011dd0 tx=0x7f8790014000 comp rx=0 tx=0).stop 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- 172.21.15.26:0/253113508 shutdown_connections 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04bfb23c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfb1aa0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 --2- 172.21.15.26:0/253113508 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfac600 0x55f04bfac9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- 172.21.15.26:0/253113508 >> 172.21.15.26:0/253113508 conn(0x55f04bfad470 msgr2=0x55f04bfaf890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- 172.21.15.26:0/253113508 shutdown_connections 2024-04-23T10:20:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.056+0000 7f87a3a06000 1 -- 172.21.15.26:0/253113508 wait complete. 2024-04-23T10:20:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- start start 2024-04-23T10:20:19.062 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 Processor -- start 2024-04-23T10:20:19.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfac600 0x55f04bfab9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.065 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfb7620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f04bd69c60 con 0x55f04bfb16c0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f04be40bf0 con 0x55f04bfb1fe0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f04be7b560 con 0x55f04bfac600 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 10 client.0 _ll_register_callbacks cb 0x55f04bd95570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39118/0 (socket says 172.21.15.26:39118) 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 -- 172.21.15.26:0/18575306 learned_addr learned my addr 172.21.15.26:0/18575306 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f879a59c640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfac600 0x55f04bfab9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f879ad9d640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfb7620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.066 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 -- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfac600 msgr2=0x55f04bfab9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfac600 0x55f04bfab9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 -- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 msgr2=0x55f04bfb7620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfb7620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 -- 172.21.15.26:0/18575306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04bdf9630 con 0x55f04bfb16c0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f879ad9d640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfb7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f8799d9b640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8790008010 tx=0x7f87900046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7eed5735243d6068 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8790021b10 con 0x55f04bfb16c0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8790021cb0 con 0x55f04bfb16c0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8790026070 con 0x55f04bfb16c0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8790034470 con 0x55f04bfb16c0 2024-04-23T10:20:19.067 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 10 client.5511 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f04bd5e490 con 0x55f04bfb16c0 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8790026070 con 0x55f04bfb16c0 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f8790034610 con 0x55f04bfb16c0 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 10 client.5511 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 10 client.5511 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 20 client.5511 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bfb8360 0x55f04bfb8740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 4 client.5511 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55f04bd587f0 con 0x55f04bfb8360 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f879a59c640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bfb8360 0x55f04bfb8740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f87797fa640 10 client.5511 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.060+0000 7f879a59c640 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bfb8360 0x55f04bfb8740 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7f82539d0c778f11 server_cookie=f7836c14cc4fcd18 in_seq=0 out_seq=0 2024-04-23T10:20:19.068 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87797fa640 1 -- 172.21.15.26:0/18575306 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55f04bd587f0 con 0x55f04bfb8360 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87797fa640 10 client.5511 handle_command_reply: tid=0 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 client.5511 shutdown 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 msgr2=0x55f04bfabf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 crypto rx=0x7f8790008010 tx=0x7f87900046d0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 shutdown_connections 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bfb8360 0x55f04bfb8740 crc :-1 s=READY pgs=154 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfb7620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfb16c0 0x55f04bfabf20 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87797fa640 0 client.5511 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 --2- 172.21.15.26:0/18575306 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfac600 0x55f04bfab9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 >> 172.21.15.26:0/18575306 conn(0x55f04bfad470 msgr2=0x55f04bfb06b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:19.069 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 shutdown_connections 2024-04-23T10:20:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 1 -- 172.21.15.26:0/18575306 wait complete. 2024-04-23T10:20:19.070 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.064+0000 7f87a3a06000 20 client.5511 trim_cache size 0 max 16384 2024-04-23T10:20:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 Processor -- start 2024-04-23T10:20:19.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 -- start start 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb16c0 0x55f04bfb9c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfcc010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f879c1fe8a0 con 0x55f04bfac600 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f879c1fef70 con 0x55f04bfb1fe0 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f879c14b810 con 0x55f04bfb16c0 2024-04-23T10:20:19.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39124/0 (socket says 172.21.15.26:39124) 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 -- 172.21.15.26:0/1162581948 learned_addr learned my addr 172.21.15.26:0/1162581948 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 -- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb16c0 msgr2=0x55f04bfb9c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb16c0 0x55f04bfb9c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.080+0000 7f879a59c640 1 -- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 msgr2=0x55f04bfcc010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879ad9d640 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfcc010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfcc010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 -- 172.21.15.26:0/1162581948 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f04bd59a70 con 0x55f04bfac600 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879ad9d640 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfcc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f878c0562e0 tx=0x7f878c005040 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eab2eb50e6263b4b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f877b7fe640 1 -- 172.21.15.26:0/1162581948 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c072030 con 0x55f04bfac600 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f877b7fe640 1 -- 172.21.15.26:0/1162581948 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c0079f0 con 0x55f04bfac600 2024-04-23T10:20:19.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f877b7fe640 1 -- 172.21.15.26:0/1162581948 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c054680 con 0x55f04bfac600 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1162581948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 msgr2=0x55f04bfb9750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7f878c0562e0 tx=0x7f878c005040 comp rx=0 tx=0).stop 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1162581948 shutdown_connections 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb1fe0 0x55f04bfcc010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb16c0 0x55f04bfb9c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1162581948 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04bfb9750 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1162581948 >> 172.21.15.26:0/1162581948 conn(0x55f04bfad470 msgr2=0x55f04bfc2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1162581948 shutdown_connections 2024-04-23T10:20:19.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1162581948 wait complete. 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- start start 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 Processor -- start 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 0x55f04c025f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04c0264c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55f04bdbd900 con 0x55f04bfac600 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55f04bd88e60 con 0x55f04bfb16c0 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55f04bdc2c20 con 0x55f04bfb1fe0 2024-04-23T10:20:19.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 10 client.0 _ll_register_callbacks cb 0x7f8790011ca0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:39136/0 (socket says 172.21.15.26:39136) 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 -- 172.21.15.26:0/1232226510 learned_addr learned my addr 172.21.15.26:0/1232226510 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f8799d9b640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 0x55f04c025f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 -- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 msgr2=0x55f04c0264c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879ad9d640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04c0264c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04c0264c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 -- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 msgr2=0x55f04c025f80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 0x55f04c025f80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 -- 172.21.15.26:0/1232226510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f04be41080 con 0x55f04bfac600 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f8799d9b640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 0x55f04c025f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f879a59c640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f878c056570 tx=0x7f8790018000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=da8036d6c5234fc4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:19.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f878c072070 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f878c07e130 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f878c0079f0 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f878c07e350 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 10 client.5517 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55f04bd643e0 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f878c0079f0 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f878c00ab40 con 0x55f04bfac600 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 10 client.5517 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 10 client.5517 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 20 client.5517 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bf72290 0x55f04bf726a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:19.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 4 client.5517 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.05, "await_for": 42.0}] 2024-04-23T10:20:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.084+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.05, "await_for": 42.0}) -- 0x55f04bd67940 con 0x55f04bf72290 2024-04-23T10:20:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.088+0000 7f8799d9b640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bf72290 0x55f04bf726a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.088+0000 7f8799d9b640 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bf72290 0x55f04bf726a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3336b5984cbe3f6a server_cookie=ccffada617c786c0 in_seq=0 out_seq=0 2024-04-23T10:20:19.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:19.088+0000 7f87797fa640 10 client.5517 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.196+0000 7f87797fa640 1 -- 172.21.15.26:0/1232226510 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x55f04bd67940 con 0x55f04bf72290 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.196+0000 7f87797fa640 10 client.5517 handle_command_reply: tid=0 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.196+0000 7f87a3a06000 1 client.5517 shutdown 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 msgr2=0x55f04c025a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7f878c056570 tx=0x7f8790018000 comp rx=0 tx=0).stop 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 shutdown_connections 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55f04bf72290 0x55f04bf726a0 crc :-1 s=READY pgs=155 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55f04bfb1fe0 0x55f04c0264c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55f04bfb16c0 0x55f04c025f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 --2- 172.21.15.26:0/1232226510 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55f04bfac600 0x55f04c025a40 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 >> 172.21.15.26:0/1232226510 conn(0x55f04bfad470 msgr2=0x55f04bfcd230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87797fa640 0 client.5517 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 shutdown_connections 2024-04-23T10:20:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 1 -- 172.21.15.26:0/1232226510 wait complete. 2024-04-23T10:20:25.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a3a06000 20 client.5517 trim_cache size 0 max 16384 2024-04-23T10:20:25.201 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 26, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "8ac8d25": { 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 26, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:20:25.202 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 89.0, 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:25.203 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:20:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 msgr2=0x7f877c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 0x7f877c06a840 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f879c073cb0 tx=0x7f8790008040 comp rx=0 tx=0).stop 2024-04-23T10:20:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 msgr2=0x7f879c0d11b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7f878c00c790 tx=0x7f878c00cc50 comp rx=0 tx=0).stop 2024-04-23T10:20:25.204 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 shutdown_connections 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f877c068380 0x7f877c06a840 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f879c0cd490 0x7f879c14c0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f879c073740 0x7f879c150b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 --2- 172.21.15.26:0/3640162530 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f879c073360 0x7f879c0d11b0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 >> 172.21.15.26:0/3640162530 conn(0x7f879c06cc30 msgr2=0x7f879c14f6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 shutdown_connections 2024-04-23T10:20:25.205 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:25.200+0000 7f87a0884640 1 -- 172.21.15.26:0/3640162530 wait complete. 2024-04-23T10:20:25.228 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set '8ac8d25', quiesce took 6.8 seconds. Will release after: 29.05 2024-04-23T10:20:36.849 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:36.852 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:20:54.280 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:20:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.416+0000 7f3ab06be640 1 Processor -- start 2024-04-23T10:20:54.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.416+0000 7f3ab06be640 1 -- start start 2024-04-23T10:20:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3ab06be640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3ab06be640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3ab06be640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3aa815b740 con 0x7f3aa80c8630 2024-04-23T10:20:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3ab06be640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f3aa80c6490 con 0x7f3aa80c8a70 2024-04-23T10:20:54.420 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3ab06be640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80c58c0 con 0x7f3aa80c8250 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aaec5b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aaec5b640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:34446/0 (socket says 172.21.15.26:34446) 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aadc59640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7f3aa80c8630 0x7f3aa8151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:57558/0 (socket says 172.21.15.26:57558) 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:43136/0 (socket says 172.21.15.26:43136) 2024-04-23T10:20:54.421 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aaec5b640 1 -- 172.21.15.26:0/2059039885 learned_addr learned my addr 172.21.15.26:0/2059039885 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 -- 172.21.15.26:0/2059039885 >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 msgr2=0x7f3aa8152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 --2- 172.21.15.26:0/2059039885 >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 -- 172.21.15.26:0/2059039885 >> v1:172.21.15.190:6789/0 conn(0x7f3aa80c8630 legacy=0x7f3aa8151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aae45a640 1 -- 172.21.15.26:0/2059039885 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa80c5b60 con 0x7f3aa80c8250 2024-04-23T10:20:54.422 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.420+0000 7f3aaec5b640 1 --2- 172.21.15.26:0/2059039885 >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:20:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aae45a640 1 --2- 172.21.15.26:0/2059039885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009dc0 tx=0x7f3aa401c8c0 comp rx=0 tx=0).ready entity=mon.2 client_cookie=624b58d2f83d5310 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aad458640 1 -- 172.21.15.26:0/2059039885 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40b2070 con 0x7f3aa80c8250 2024-04-23T10:20:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aad458640 1 -- 172.21.15.26:0/2059039885 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3aa40a5870 con 0x7f3aa80c8250 2024-04-23T10:20:54.424 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aad458640 1 -- 172.21.15.26:0/2059039885 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3aa40a5c40 con 0x7f3aa80c8250 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- 172.21.15.26:0/2059039885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 msgr2=0x7f3aa80c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2059039885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7f3aa4009dc0 tx=0x7f3aa401c8c0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- 172.21.15.26:0/2059039885 shutdown_connections 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2059039885 >> v2:172.21.15.190:3300/0 conn(0x7f3aa80c8a70 0x7f3aa8152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2059039885 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8250 0x7f3aa80c39e0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- 172.21.15.26:0/2059039885 >> 172.21.15.26:0/2059039885 conn(0x7f3aa806b9d0 msgr2=0x7f3aa806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- 172.21.15.26:0/2059039885 shutdown_connections 2024-04-23T10:20:54.425 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- 172.21.15.26:0/2059039885 wait complete. 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 Processor -- start 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- start start 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aa80c8250 0x7f3aa8155040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 0x7f3aa8142010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa80c6920 con 0x7f3aa80c8630 2024-04-23T10:20:54.431 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3aa815b400 con 0x7f3aa80c8250 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3ab06be640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3aa80681d0 con 0x7f3aa80c8a70 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aadc59640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aadc59640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48086/0 (socket says 172.21.15.26:48086) 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aadc59640 1 -- 172.21.15.26:0/2591236502 learned_addr learned my addr 172.21.15.26:0/2591236502 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aaec5b640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 0x7f3aa8142010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.424+0000 7f3aae45a640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aa80c8250 0x7f3aa8155040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 -- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 msgr2=0x7f3aa8142010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 0x7f3aa8142010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 -- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aa80c8250 msgr2=0x7f3aa8155040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aa80c8250 0x7f3aa8155040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 -- 172.21.15.26:0/2591236502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3aa81f34a0 con 0x7f3aa80c8630 2024-04-23T10:20:54.432 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aaec5b640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 0x7f3aa8142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aadc59640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c490 tx=0x7f3a9800c950 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a98018070 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3aa8152fb0 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3a98007480 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3a980047f0 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3aa8155ce0 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3aa8075df0 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3a98004990 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 0x7f3a8c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3a98085f40 con 0x7f3aa80c8630 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aae45a640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 0x7f3a8c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.428+0000 7f3aae45a640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 0x7f3a8c06a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40af000 tx=0x7f3aa40a7070 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.434 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.432+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3a98055a10 con 0x7f3aa80c8630 2024-04-23T10:20:54.628 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.628+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3aa814c6f0 con 0x7f3aa80c8630 2024-04-23T10:20:54.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.628+0000 7f3a9effd640 1 -- 172.21.15.26:0/2591236502 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f3a98059d10 con 0x7f3aa80c8630 2024-04-23T10:20:54.630 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:20:54.630 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:20:54.630 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:20:54.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 msgr2=0x7f3a8c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 0x7f3a8c06a870 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3aa40af000 tx=0x7f3aa40a7070 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 msgr2=0x7f3aa8141ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7f3a9800c490 tx=0x7f3a9800c950 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 shutdown_connections 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3a8c0683b0 0x7f3a8c06a870 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3aa80c8a70 0x7f3aa8142010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3aa80c8630 0x7f3aa8141ad0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 --2- 172.21.15.26:0/2591236502 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3aa80c8250 0x7f3aa8155040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 >> 172.21.15.26:0/2591236502 conn(0x7f3aa806b9d0 msgr2=0x7f3aa8073a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 shutdown_connections 2024-04-23T10:20:54.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.632+0000 7f3ab06be640 1 -- 172.21.15.26:0/2591236502 wait complete. 2024-04-23T10:20:54.646 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id 8ac8d25 --release --await' 2024-04-23T10:20:54.647 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id 8ac8d25 --release --await 2024-04-23T10:20:54.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 Processor -- start 2024-04-23T10:20:54.771 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 -- start start 2024-04-23T10:20:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8be40c8a70 0x7f8be4152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be415b740 con 0x7f8be40c8630 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8be40c40f0 con 0x7f8be40c8250 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bebf6d640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8be40c6490 con 0x7f8be40c8a70 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8be9508640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8be40c8630 0x7f8be4151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50866/0 (socket says 172.21.15.26:50866) 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8be9508640 1 -- 172.21.15.26:0/3267563917 learned_addr learned my addr 172.21.15.26:0/3267563917 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bea50a640 1 --2- 172.21.15.26:0/3267563917 >> v2:172.21.15.26:3300/0 conn(0x7f8be40c8a70 0x7f8be4152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4018651650 0 0) 0x7f8be415b740 con 0x7f8be40c8630 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8bd0003530 con 0x7f8be40c8630 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bea50a640 1 -- 172.21.15.26:0/3267563917 >> v1:172.21.15.190:6789/0 conn(0x7f8be40c8250 legacy=0x7f8be40c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bea50a640 1 -- 172.21.15.26:0/3267563917 >> v1:172.21.15.26:6789/0 conn(0x7f8be40c8630 legacy=0x7f8be4151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1300335141 0 0) 0x7f8bd0003530 con 0x7f8be40c8630 2024-04-23T10:20:54.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.772+0000 7f8bea50a640 1 -- 172.21.15.26:0/3267563917 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be40c58c0 con 0x7f8be40c8a70 2024-04-23T10:20:54.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- 172.21.15.26:0/3267563917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be4152250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009d90 tx=0x7f8bdc01c800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=700dd49777cdc95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bd4001680 con 0x7f8be40c8a70 2024-04-23T10:20:54.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0a6440 con 0x7f8be40c8a70 2024-04-23T10:20:54.775 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8be8d07640 1 -- 172.21.15.26:0/3267563917 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a6810 con 0x7f8be40c8a70 2024-04-23T10:20:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- 172.21.15.26:0/3267563917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 msgr2=0x7f8be4152250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/3267563917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be4152250 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc009d90 tx=0x7f8bdc01c800 comp rx=0 tx=0).stop 2024-04-23T10:20:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- 172.21.15.26:0/3267563917 shutdown_connections 2024-04-23T10:20:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/3267563917 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be4152250 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.776 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- 172.21.15.26:0/3267563917 >> 172.21.15.26:0/3267563917 conn(0x7f8be406b9d0 msgr2=0x7f8be406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- 172.21.15.26:0/3267563917 shutdown_connections 2024-04-23T10:20:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- 172.21.15.26:0/3267563917 wait complete. 2024-04-23T10:20:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 Processor -- start 2024-04-23T10:20:54.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- start start 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be40c8250 0x7f8be415adf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8be40c8630 0x7f8be415a3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8be415b400 con 0x7f8be40c8a70 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8be40721a0 con 0x7f8be40c8250 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bebf6d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8be40c6900 con 0x7f8be40c8630 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48098/0 (socket says 172.21.15.26:48098) 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 -- 172.21.15.26:0/66215184 learned_addr learned my addr 172.21.15.26:0/66215184 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8be9508640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8be40c8630 0x7f8be415a3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8be9d09640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be40c8250 0x7f8be415adf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 -- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8be40c8630 msgr2=0x7f8be415a3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8be40c8630 0x7f8be415a3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 -- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be40c8250 msgr2=0x7f8be415adf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be40c8250 0x7f8be415adf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 -- 172.21.15.26:0/66215184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8be41501e0 con 0x7f8be40c8a70 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bea50a640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01cce0 tx=0x7f8bdc0195a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bda7fc640 1 -- 172.21.15.26:0/66215184 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0a6a90 con 0x7f8be40c8a70 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bda7fc640 1 -- 172.21.15.26:0/66215184 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0a6c30 con 0x7f8be40c8a70 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.776+0000 7f8bda7fc640 1 -- 172.21.15.26:0/66215184 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc003be0 con 0x7f8be40c8a70 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8be41f7d20 con 0x7f8be40c8a70 2024-04-23T10:20:54.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8be4155140 con 0x7f8be40c8a70 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bda7fc640 1 -- 172.21.15.26:0/66215184 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8bdc004030 con 0x7f8be40c8a70 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bda7fc640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 0x7f8bc806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bda7fc640 1 -- 172.21.15.26:0/66215184 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8bdc120f10 con 0x7f8be40c8a70 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 0x7f8bc806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 Processor -- start 2024-04-23T10:20:54.781 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 -- start start 2024-04-23T10:20:54.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 0x7f8bc806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000f70 tx=0x7f8be0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef272e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef62120 0x5581bef62500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5581bed6e660 con 0x5581bef5d8a0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5581bed135d0 con 0x5581bef26f00 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5581bed6a620 con 0x5581bef62120 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48104/0 (socket says 172.21.15.26:48104) 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 -- 172.21.15.26:0/2453121506 learned_addr learned my addr 172.21.15.26:0/2453121506 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9508640 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef272e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bea50a640 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef62120 0x5581bef62500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 -- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef62120 msgr2=0x5581bef62500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef62120 0x5581bef62500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 -- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 msgr2=0x5581bef272e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef272e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 -- 172.21.15.26:0/2453121506 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bed47bd0 con 0x5581bef5d8a0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8be9d09640 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8be00054f0 tx=0x7f8be0010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=498c01b9675bbe29 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.780+0000 7f8bc77fe640 1 -- 172.21.15.26:0/2453121506 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be000d730 con 0x5581bef5d8a0 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc77fe640 1 -- 172.21.15.26:0/2453121506 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8be000d8d0 con 0x5581bef5d8a0 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc77fe640 1 -- 172.21.15.26:0/2453121506 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be000dc80 con 0x5581bef5d8a0 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/2453121506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 msgr2=0x5581bef269c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 crypto rx=0x7f8be00054f0 tx=0x7f8be0010000 comp rx=0 tx=0).stop 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/2453121506 shutdown_connections 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef62120 0x5581bef62500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef272e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/2453121506 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef5d8a0 0x5581bef269c0 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/2453121506 >> 172.21.15.26:0/2453121506 conn(0x5581bee08b00 msgr2=0x5581bef5fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/2453121506 shutdown_connections 2024-04-23T10:20:54.785 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/2453121506 wait complete. 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- start start 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 Processor -- start 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef5c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef5cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5581bee2bd40 con 0x5581bef62120 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5581bed28eb0 con 0x5581bef26f00 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5581bed692a0 con 0x5581bef5d8a0 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 10 client.0 _ll_register_callbacks cb 0x5581bef0ca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.789 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48114/0 (socket says 172.21.15.26:48114) 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 -- 172.21.15.26:0/839801835 learned_addr learned my addr 172.21.15.26:0/839801835 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8be9d09640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef5c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8be9508640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef5cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 -- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 msgr2=0x5581bef5cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef5cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 -- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 msgr2=0x5581bef5c650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef5c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 -- 172.21.15.26:0/839801835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581bedb4b30 con 0x5581bef62120 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bea50a640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0ecd80 tx=0x7f8bdc0a6f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cf2e522a9788b0f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0f4cd0 con 0x5581bef62120 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8bdc0efd70 con 0x5581bef62120 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x5581bed08060 con 0x5581bef62120 2024-04-23T10:20:54.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8bdc0f9590 con 0x5581bef62120 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 10 client.5535 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5581bed0db70 con 0x5581bef62120 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x5581bed08060 con 0x5581bef62120 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f8bdc0ec670 con 0x5581bef62120 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 10 client.5535 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 10 client.5535 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 20 client.5535 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581bef22670 0x5581bef22a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 4 client.5535 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5581bed46e30 con 0x5581bef22670 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.784+0000 7f8be9d09640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581bef22670 0x5581bef22a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8be9d09640 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581bef22670 0x5581bef22a50 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ed727cb0b8ea2237 server_cookie=ad8c068c51d68952 in_seq=0 out_seq=0 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bc4ff9640 10 client.5535 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/839801835 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5581bed46e30 con 0x5581bef22670 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bc4ff9640 10 client.5535 handle_command_reply: tid=0 2024-04-23T10:20:54.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 client.5535 shutdown 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 msgr2=0x5581bef21900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc0ecd80 tx=0x7f8bdc0a6f60 comp rx=0 tx=0).stop 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 shutdown_connections 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581bef22670 0x5581bef22a50 crc :-1 s=READY pgs=159 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581bef21900 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef5cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bc4ff9640 0 client.5535 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/839801835 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581bef5c650 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 >> 172.21.15.26:0/839801835 conn(0x5581bee08b00 msgr2=0x5581bef619a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 shutdown_connections 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 1 -- 172.21.15.26:0/839801835 wait complete. 2024-04-23T10:20:54.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.788+0000 7f8bef0ef000 20 client.5535 trim_cache size 0 max 16384 2024-04-23T10:20:54.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 Processor -- start 2024-04-23T10:20:54.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 -- start start 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581befcbd00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581befcc240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8be4201320 con 0x5581bef62120 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8be42019f0 con 0x5581bef26f00 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8be41f1400 con 0x5581bef5d8a0 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48120/0 (socket says 172.21.15.26:48120) 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 -- 172.21.15.26:0/3444444562 learned_addr learned my addr 172.21.15.26:0/3444444562 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 -- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 msgr2=0x5581befcc240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581befcc240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 -- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 msgr2=0x5581befcbd00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581befcbd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.804+0000 7f8bea50a640 1 -- 172.21.15.26:0/3444444562 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5581bedf05e0 con 0x5581bef62120 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bea50a640 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01cd70 tx=0x7f8bdc0a8000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a402b798ccc6c42 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc6ffd640 1 -- 172.21.15.26:0/3444444562 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0efff0 con 0x5581bef62120 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc6ffd640 1 -- 172.21.15.26:0/3444444562 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0efd70 con 0x5581bef62120 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc6ffd640 1 -- 172.21.15.26:0/3444444562 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8bdc0ec670 con 0x5581bef62120 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/3444444562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 msgr2=0x5581befcc780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01cd70 tx=0x7f8bdc0a8000 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/3444444562 shutdown_connections 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef62120 0x5581befcc780 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581befcc240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/3444444562 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef26f00 0x5581befcbd00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/3444444562 >> 172.21.15.26:0/3444444562 conn(0x5581bee08b00 msgr2=0x5581bef24a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/3444444562 shutdown_connections 2024-04-23T10:20:54.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/3444444562 wait complete. 2024-04-23T10:20:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- start start 2024-04-23T10:20:54.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 Processor -- start 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef7c670 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef62120 0x5581bef7cbb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5581bed6d970 con 0x5581bef26f00 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5581bed238f0 con 0x5581bef62120 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5581bed72c90 con 0x5581bef5d8a0 2024-04-23T10:20:54.812 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 10 client.0 _ll_register_callbacks cb 0x7f8bdc0ecc40 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48122/0 (socket says 172.21.15.26:48122) 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 -- 172.21.15.26:0/65538663 learned_addr learned my addr 172.21.15.26:0/65538663 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9508640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef7c670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 -- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 msgr2=0x5581bef7c670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef7c670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 -- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef62120 msgr2=0x5581bef7cbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef62120 0x5581bef7cbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 -- 172.21.15.26:0/65538663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5581bed00ae0 con 0x5581bef26f00 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9d09640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8be0007dc0 tx=0x7f8be0000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71f9efb857ec71fd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8be000db40 con 0x5581bef26f00 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8be001d040 con 0x5581bef26f00 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f8bdc0efd70 con 0x5581bef26f00 2024-04-23T10:20:54.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8be003a050 con 0x5581bef26f00 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 10 client.5541 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5581bed03d80 con 0x5581bef26f00 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bdc0efd70 con 0x5581bef26f00 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f8be003d020 con 0x5581bef26f00 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 10 client.5541 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 10 client.5541 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 20 client.5541 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581befdc5a0 0x5581befde990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 4 client.5541 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "8ac8d25", "release": true, "await": true}] 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "8ac8d25", "release": true, "await": true}) -- 0x5581bed0c0d0 con 0x5581befdc5a0 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.808+0000 7f8be9508640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581befdc5a0 0x5581befde990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.812+0000 7f8bc4ff9640 10 client.5541 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:54.814 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:54.812+0000 7f8be9508640 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581befdc5a0 0x5581befde990 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=2ac89876840164f0 server_cookie=e5c64a5863604343 in_seq=0 out_seq=0 2024-04-23T10:20:55.285 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bc4ff9640 1 -- 172.21.15.26:0/65538663 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+588 (crc 0 0 0) 0x5581bed0c0d0 con 0x5581befdc5a0 2024-04-23T10:20:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bc4ff9640 10 client.5541 handle_command_reply: tid=0 2024-04-23T10:20:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 client.5541 shutdown 2024-04-23T10:20:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 msgr2=0x5581bef7c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7f8be0007dc0 tx=0x7f8be0000ee0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 shutdown_connections 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5581befdc5a0 0x5581befde990 crc :-1 s=READY pgs=160 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5581bef62120 0x5581bef7cbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5581bef5d8a0 0x5581bef7c670 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 --2- 172.21.15.26:0/65538663 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5581bef26f00 0x5581bef7c130 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 >> 172.21.15.26:0/65538663 conn(0x5581bee08b00 msgr2=0x5581bef252f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bc4ff9640 0 client.5541 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 shutdown_connections 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 1 -- 172.21.15.26:0/65538663 wait complete. 2024-04-23T10:20:55.287 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.284+0000 7f8bef0ef000 20 client.5541 trim_cache size 0 max 16384 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 28, 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "8ac8d25": { 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 28, 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:55.288 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 89.0, 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:55.289 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 msgr2=0x7f8bc806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 0x7f8bc806a840 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f8be0000f70 tx=0x7f8be0009040 comp rx=0 tx=0).stop 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 msgr2=0x7f8be413de50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7f8bdc01cce0 tx=0x7f8bdc0195a0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 shutdown_connections 2024-04-23T10:20:55.290 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8bc8068380 0x7f8bc806a840 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8be40c8a70 0x7f8be413de50 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8be40c8630 0x7f8be415a3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 --2- 172.21.15.26:0/66215184 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8be40c8250 0x7f8be415adf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 >> 172.21.15.26:0/66215184 conn(0x7f8be406b9d0 msgr2=0x7f8be40c4370 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 shutdown_connections 2024-04-23T10:20:55.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.288+0000 7f8bebf6d640 1 -- 172.21.15.26:0/66215184 wait complete. 2024-04-23T10:20:55.311 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set '8ac8d25', seconds elapsed: 36.9 2024-04-23T10:20:55.311 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 29.05 2024-04-23T10:20:55.311 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:20:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 Processor -- start 2024-04-23T10:20:55.433 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 -- start start 2024-04-23T10:20:55.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a6c155350 0x7f2a6c0c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c0cb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.435 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f2a6c0cbcf0 0x7f2a6c15b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c0cca40 con 0x7f2a6c155350 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f2a6c15beb0 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a734aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c0ccc90 con 0x7f2a6c0cda50 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a71246640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a6c155350 0x7f2a6c0c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a71246640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2a6c155350 0x7f2a6c0c59c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48136/0 (socket says 172.21.15.26:48136) 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.432+0000 7f2a71246640 1 -- 172.21.15.26:0/1826424666 learned_addr learned my addr 172.21.15.26:0/1826424666 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71a47640 1 --2- 172.21.15.26:0/1826424666 >> v2:172.21.15.190:3300/0 conn(0x7f2a6c0cbcf0 0x7f2a6c15b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a70a45640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c0cb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 -- 172.21.15.26:0/1826424666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 msgr2=0x7f2a6c0cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c0cb7b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 -- 172.21.15.26:0/1826424666 >> v2:172.21.15.190:3300/0 conn(0x7f2a6c0cbcf0 msgr2=0x7f2a6c15b0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 --2- 172.21.15.26:0/1826424666 >> v2:172.21.15.190:3300/0 conn(0x7f2a6c0cbcf0 0x7f2a6c15b0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.436 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 -- 172.21.15.26:0/1826424666 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c0ccf70 con 0x7f2a6c155350 2024-04-23T10:20:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a70a45640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a71246640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c155350 0x7f2a6c0c59c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0741a0 tx=0x7f2a6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6cc1acb18b5c779c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a63fff640 1 -- 172.21.15.26:0/1826424666 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680b5070 con 0x7f2a6c155350 2024-04-23T10:20:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a63fff640 1 -- 172.21.15.26:0/1826424666 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a680a89d0 con 0x7f2a6c155350 2024-04-23T10:20:55.437 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a63fff640 1 -- 172.21.15.26:0/1826424666 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680a8da0 con 0x7f2a6c155350 2024-04-23T10:20:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 -- 172.21.15.26:0/1826424666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c155350 msgr2=0x7f2a6c0c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.438 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c155350 0x7f2a6c0c59c0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c0741a0 tx=0x7f2a6801ed10 comp rx=0 tx=0).stop 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 -- 172.21.15.26:0/1826424666 shutdown_connections 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1826424666 >> v2:172.21.15.190:3300/0 conn(0x7f2a6c0cbcf0 0x7f2a6c15b0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c0cb7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1826424666 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c155350 0x7f2a6c0c59c0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 -- 172.21.15.26:0/1826424666 >> 172.21.15.26:0/1826424666 conn(0x7f2a6c06cc30 msgr2=0x7f2a6c06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 -- 172.21.15.26:0/1826424666 shutdown_connections 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.436+0000 7f2a734aa640 1 -- 172.21.15.26:0/1826424666 wait complete. 2024-04-23T10:20:55.439 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 Processor -- start 2024-04-23T10:20:55.440 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- start start 2024-04-23T10:20:55.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c14b3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.441 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c155350 0x7f2a6c14b8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c155730 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2a6c0cd530 con 0x7f2a6c155350 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2a6c15e860 con 0x7f2a6c0cda50 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48140/0 (socket says 172.21.15.26:48140) 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 -- 172.21.15.26:0/1406076332 learned_addr learned my addr 172.21.15.26:0/1406076332 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71a47640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c155350 0x7f2a6c14b8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 -- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 msgr2=0x7f2a6c14b3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c14b3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 -- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c155350 msgr2=0x7f2a6c14b8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c155350 0x7f2a6c14b8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 -- 172.21.15.26:0/1406076332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2a6c1517a0 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.442 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a71246640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2a680b3040 tx=0x7f2a6801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680c0070 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2a680b07e0 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2a6c151a60 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2a680b5040 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.443 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2a6c1e7a20 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2a6c075df0 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.440+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2a680c3070 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.444+0000 7f2a61ffb640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 0x7f2a5006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.444+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2a68123d00 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.444+0000 7f2a70a45640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 0x7f2a5006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.444 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.444+0000 7f2a70a45640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 0x7f2a5006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c1547e0 tx=0x7f2a5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.448 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.448+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2a68018870 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.656+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f2a6c0cc610 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.656+0000 7f2a61ffb640 1 -- 172.21.15.26:0/1406076332 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f2a680f3e10 con 0x7f2a6c0cbcf0 2024-04-23T10:20:55.658 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:20:55.658 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:20:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:20:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 msgr2=0x7f2a5006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 0x7f2a5006a840 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7f2a6c1547e0 tx=0x7f2a5c008040 comp rx=0 tx=0).stop 2024-04-23T10:20:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 msgr2=0x7f2a6c150e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7f2a680b3040 tx=0x7f2a6801bab0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 shutdown_connections 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2a50068380 0x7f2a5006a840 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2a6c155350 0x7f2a6c14b8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2a6c0cda50 0x7f2a6c14b3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 --2- 172.21.15.26:0/1406076332 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2a6c0cbcf0 0x7f2a6c150e50 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 >> 172.21.15.26:0/1406076332 conn(0x7f2a6c06cc30 msgr2=0x7f2a6c0cec60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 shutdown_connections 2024-04-23T10:20:55.661 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.660+0000 7f2a734aa640 1 -- 172.21.15.26:0/1406076332 wait complete. 2024-04-23T10:20:55.676 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 89.05 --await-for 42.0' 2024-04-23T10:20:55.676 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 89.05 --await-for 42.0 2024-04-23T10:20:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 Processor -- start 2024-04-23T10:20:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 -- start start 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 0x7f433406d560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f433406daa0 0x7f4334071f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f433406ec50 con 0x7f4334142090 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f4334067ac0 con 0x7f433406daa0 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f433964c640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f433415d110 con 0x7f4334152fd0 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f43337fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f433406daa0 0x7f4334071f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f43327fc640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4334142090 0x7f4334071870 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50874/0 (socket says 172.21.15.26:50874) 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.812+0000 7f43327fc640 1 -- 172.21.15.26:0/928156022 learned_addr learned my addr 172.21.15.26:0/928156022 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4332ffd640 1 --2- 172.21.15.26:0/928156022 >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 0x7f433406d560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f43337fe640 1 -- 172.21.15.26:0/928156022 >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 msgr2=0x7f433406d560 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f43337fe640 1 --2- 172.21.15.26:0/928156022 >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 0x7f433406d560 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f43337fe640 1 -- 172.21.15.26:0/928156022 >> v1:172.21.15.26:6789/0 conn(0x7f4334142090 legacy=0x7f4334071870 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4331ffb640 1 -- 172.21.15.26:0/928156022 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3270174905 0 0) 0x7f433406ec50 con 0x7f4334142090 2024-04-23T10:20:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f43337fe640 1 -- 172.21.15.26:0/928156022 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f433415c500 con 0x7f433406daa0 2024-04-23T10:20:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4332ffd640 1 --2- 172.21.15.26:0/928156022 >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 0x7f433406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f43337fe640 1 --2- 172.21.15.26:0/928156022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f4334071f80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4334067c40 tx=0x7f432c01c900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45097187c9d47514 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4331ffb640 1 -- 172.21.15.26:0/928156022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0b2070 con 0x7f433406daa0 2024-04-23T10:20:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4331ffb640 1 -- 172.21.15.26:0/928156022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432c0a59c0 con 0x7f433406daa0 2024-04-23T10:20:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f4331ffb640 1 -- 172.21.15.26:0/928156022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432c0a5d90 con 0x7f433406daa0 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 -- 172.21.15.26:0/928156022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 msgr2=0x7f4334071f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 --2- 172.21.15.26:0/928156022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f4334071f80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 crypto rx=0x7f4334067c40 tx=0x7f432c01c900 comp rx=0 tx=0).stop 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 -- 172.21.15.26:0/928156022 shutdown_connections 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 --2- 172.21.15.26:0/928156022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f4334071f80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 --2- 172.21.15.26:0/928156022 >> v2:172.21.15.190:3300/0 conn(0x7f4334152fd0 0x7f433406d560 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 -- 172.21.15.26:0/928156022 >> 172.21.15.26:0/928156022 conn(0x7f433406f210 msgr2=0x7f433406f620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 -- 172.21.15.26:0/928156022 shutdown_connections 2024-04-23T10:20:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.816+0000 7f433964c640 1 -- 172.21.15.26:0/928156022 wait complete. 2024-04-23T10:20:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 Processor -- start 2024-04-23T10:20:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- start start 2024-04-23T10:20:55.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 0x7f433415b550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.822 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4334152fd0 0x7f433413b1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43340676a0 con 0x7f433406daa0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f433406deb0 con 0x7f4334142090 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4334067820 con 0x7f4334152fd0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48160/0 (socket says 172.21.15.26:48160) 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 -- 172.21.15.26:0/3570994904 learned_addr learned my addr 172.21.15.26:0/3570994904 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f43337fe640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4334152fd0 0x7f433413b1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f43327fc640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 0x7f433415b550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 -- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4334152fd0 msgr2=0x7f433413b1c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4334152fd0 0x7f433413b1c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 -- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 msgr2=0x7f433415b550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 0x7f433415b550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 -- 172.21.15.26:0/3570994904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f43341372f0 con 0x7f433406daa0 2024-04-23T10:20:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f43327fc640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 0x7f433415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f432400c7f0 tx=0x7f432400ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f431b7fe640 1 -- 172.21.15.26:0/3570994904 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324015070 con 0x7f433406daa0 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f431b7fe640 1 -- 172.21.15.26:0/3570994904 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4324007820 con 0x7f433406daa0 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4334137b10 con 0x7f433406daa0 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f431b7fe640 1 -- 172.21.15.26:0/3570994904 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4324007c10 con 0x7f433406daa0 2024-04-23T10:20:55.824 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.820+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f433415c130 con 0x7f433406daa0 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f431b7fe640 1 -- 172.21.15.26:0/3570994904 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4324018070 con 0x7f433406daa0 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f431b7fe640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 0x7f432006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f431b7fe640 1 -- 172.21.15.26:0/3570994904 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4324086fc0 con 0x7f433406daa0 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 0x7f432006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 Processor -- start 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 -- start start 2024-04-23T10:20:55.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 0x7f432006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43340cce60 tx=0x7f4328009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x5558845989e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588459e3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5558844442a0 con 0x55588459d6c0 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5558843aa5f0 con 0x555884598600 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555884345820 con 0x55588459dfe0 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48166/0 (socket says 172.21.15.26:48166) 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 -- 172.21.15.26:0/1395578165 learned_addr learned my addr 172.21.15.26:0/1395578165 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f4332ffd640 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x5558845989e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43337fe640 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588459e3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 -- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 msgr2=0x55588459e3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588459e3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 -- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 msgr2=0x5558845989e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x5558845989e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 -- 172.21.15.26:0/1395578165 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5558843f0c00 con 0x55588459d6c0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.824+0000 7f43327fc640 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4328007360 tx=0x7f4328010000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6a42de72ef6387d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4318ff9640 1 -- 172.21.15.26:0/1395578165 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432800db50 con 0x55588459d6c0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4318ff9640 1 -- 172.21.15.26:0/1395578165 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432800dcf0 con 0x55588459d6c0 2024-04-23T10:20:55.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4318ff9640 1 -- 172.21.15.26:0/1395578165 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432800dea0 con 0x55588459d6c0 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/1395578165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 msgr2=0x55588459daa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7f4328007360 tx=0x7f4328010000 comp rx=0 tx=0).stop 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/1395578165 shutdown_connections 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588459e3c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x55588459daa0 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1395578165 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x5558845989e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/1395578165 >> 172.21.15.26:0/1395578165 conn(0x555884599470 msgr2=0x55588459b890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/1395578165 shutdown_connections 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/1395578165 wait complete. 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- start start 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 Processor -- start 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459d6c0 0x555884597f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845a3620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555884355c60 con 0x555884598600 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55588442cbf0 con 0x55588459dfe0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555884467560 con 0x55588459d6c0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 10 client.0 _ll_register_callbacks cb 0x555884381570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48170/0 (socket says 172.21.15.26:48170) 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 -- 172.21.15.26:0/3129152166 learned_addr learned my addr 172.21.15.26:0/3129152166 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f43337fe640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845a3620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f43327fc640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459d6c0 0x555884597f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 -- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459d6c0 msgr2=0x555884597f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459d6c0 0x555884597f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 -- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 msgr2=0x5558845a3620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845a3620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 -- 172.21.15.26:0/3129152166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5558843e5630 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4332ffd640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f432405f100 tx=0x7f4324057210 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b8d8c4a45b6c614 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432401f030 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f432405d2b0 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f432800dcf0 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f432405f630 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 10 client.5562 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55588434a490 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432800dcf0 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f43240753a0 con 0x555884598600 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 10 client.5562 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 10 client.5562 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:55.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 20 client.5562 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5558845a4360 0x5558845a4740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 4 client.5562 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.828+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5558843447f0 con 0x5558845a4360 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.832+0000 7f43327fc640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5558845a4360 0x5558845a4740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.832+0000 7f4311ffb640 10 client.5562 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:55.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.832+0000 7f43327fc640 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5558845a4360 0x5558845a4740 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=825b6c13f6bdcb0a server_cookie=ba412304abc27ab0 in_seq=0 out_seq=0 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f4311ffb640 1 -- 172.21.15.26:0/3129152166 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5558843447f0 con 0x5558845a4360 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f4311ffb640 10 client.5562 handle_command_reply: tid=0 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 client.5562 shutdown 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 msgr2=0x5558845979e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7f432405f100 tx=0x7f4324057210 comp rx=0 tx=0).stop 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 shutdown_connections 2024-04-23T10:20:55.836 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5558845a4360 0x5558845a4740 crc :-1 s=READY pgs=161 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845a3620 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459d6c0 0x555884597f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 --2- 172.21.15.26:0/3129152166 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555884598600 0x5558845979e0 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 >> 172.21.15.26:0/3129152166 conn(0x555884599470 msgr2=0x55588459c6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f4311ffb640 0 client.5562 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 shutdown_connections 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 1 -- 172.21.15.26:0/3129152166 wait complete. 2024-04-23T10:20:55.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.836+0000 7f433c7ce000 20 client.5562 trim_cache size 0 max 16384 2024-04-23T10:20:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.852+0000 7f433c7ce000 1 Processor -- start 2024-04-23T10:20:55.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.852+0000 7f433c7ce000 1 -- start start 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555884598600 0x5558845b8010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845b8a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f43342012b0 con 0x55588459d6c0 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4334201980 con 0x55588459dfe0 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f43341ffba0 con 0x555884598600 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.856 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48184/0 (socket says 172.21.15.26:48184) 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 -- 172.21.15.26:0/132469549 learned_addr learned my addr 172.21.15.26:0/132469549 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f4332ffd640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555884598600 0x5558845b8010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43337fe640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845b8a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 -- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555884598600 msgr2=0x5558845b8010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555884598600 0x5558845b8010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 -- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 msgr2=0x5558845b8a90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845b8a90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 -- 172.21.15.26:0/132469549 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555884345a70 con 0x55588459d6c0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43337fe640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f43280015c0 tx=0x7f4328007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28907018a31d9d7d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f4313fff640 1 -- 172.21.15.26:0/132469549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4328035070 con 0x55588459d6c0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f4313fff640 1 -- 172.21.15.26:0/132469549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432802f230 con 0x55588459d6c0 2024-04-23T10:20:55.857 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f4313fff640 1 -- 172.21.15.26:0/132469549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432802f600 con 0x55588459d6c0 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- 172.21.15.26:0/132469549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 msgr2=0x5558845b8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7f43280015c0 tx=0x7f4328007000 comp rx=0 tx=0).stop 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- 172.21.15.26:0/132469549 shutdown_connections 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55588459dfe0 0x5558845b8a90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x5558845b8550 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- 172.21.15.26:0/132469549 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555884598600 0x5558845b8010 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.861 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- 172.21.15.26:0/132469549 >> 172.21.15.26:0/132469549 conn(0x555884599470 msgr2=0x5558845aeec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- 172.21.15.26:0/132469549 shutdown_connections 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- 172.21.15.26:0/132469549 wait complete. 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- start start 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 Processor -- start 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x555884561b10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588455f830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5558843a9900 con 0x55588459d6c0 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555884374e60 con 0x555884598600 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5558843aec20 con 0x55588459dfe0 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f433c7ce000 10 client.0 _ll_register_callbacks cb 0x7f43240046d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48198/0 (socket says 172.21.15.26:48198) 2024-04-23T10:20:55.862 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.856+0000 7f43327fc640 1 -- 172.21.15.26:0/1593357915 learned_addr learned my addr 172.21.15.26:0/1593357915 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4332ffd640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x555884561b10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43337fe640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588455f830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 -- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 msgr2=0x55588455f830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588455f830 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 -- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 msgr2=0x555884561b10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x555884561b10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 -- 172.21.15.26:0/1593357915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55588442d080 con 0x55588459d6c0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4332ffd640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x555884561b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f43327fc640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4328009010 tx=0x7f4328000ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=86993fad53e4449d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f432803d060 con 0x55588459d6c0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f432802f5f0 con 0x55588459d6c0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f432802f230 con 0x55588459d6c0 2024-04-23T10:20:55.863 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4328043050 con 0x55588459d6c0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 10 client.5568 fetch_fsmap learned FSMap version 19 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5558843503e0 con 0x55588459d6c0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f432802f230 con 0x55588459d6c0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4328046020 con 0x55588459d6c0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 10 client.5568 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 10 client.5568 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 20 client.5568 populate_metadata read hostname 'smithi026' 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55588455fd70 0x555884560150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 4 client.5568 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.05, "await_for": 42.0}] 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 89.05, "await_for": 42.0}) -- 0x555884353940 con 0x55588455fd70 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4332ffd640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55588455fd70 0x555884560150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4332ffd640 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55588455fd70 0x555884560150 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aa18e9b86acfb480 server_cookie=1cebdd8b0e8ccc25 in_seq=0 out_seq=0 2024-04-23T10:20:55.864 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:55.860+0000 7f4311ffb640 10 client.5568 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:59.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f4311ffb640 1 -- 172.21.15.26:0/1593357915 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555884353940 con 0x55588455fd70 2024-04-23T10:20:59.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f4311ffb640 10 client.5568 handle_command_reply: tid=0 2024-04-23T10:20:59.805 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 client.5568 shutdown 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 msgr2=0x555884562050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7f4328009010 tx=0x7f4328000ee0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 shutdown_connections 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55588455fd70 0x555884560150 crc :-1 s=READY pgs=162 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55588459dfe0 0x55588455f830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55588459d6c0 0x555884562050 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 --2- 172.21.15.26:0/1593357915 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555884598600 0x555884561b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f4311ffb640 0 client.5568 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 >> 172.21.15.26:0/1593357915 conn(0x555884599470 msgr2=0x5558845a23e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 shutdown_connections 2024-04-23T10:20:59.806 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 1 -- 172.21.15.26:0/1593357915 wait complete. 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433c7ce000 20 client.5568 trim_cache size 0 max 16384 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 30, 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:20:59.807 INFO:teuthology.orchestra.run.smithi026.stdout: "c9a2c6a2": { 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 30, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 89.0, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:20:59.808 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 msgr2=0x7f432006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:59.809 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 0x7f432006a840 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f43340cce60 tx=0x7f4328009040 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 msgr2=0x7f433415a6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.804+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7f432400c7f0 tx=0x7f432400ccb0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 shutdown_connections 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4320068380 0x7f432006a840 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4334152fd0 0x7f433413b1c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4334142090 0x7f433415b550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 --2- 172.21.15.26:0/3570994904 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f433406daa0 0x7f433415a6f0 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 >> 172.21.15.26:0/3570994904 conn(0x7f433406f210 msgr2=0x7f4334140780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 shutdown_connections 2024-04-23T10:20:59.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:20:59.808+0000 7f433964c640 1 -- 172.21.15.26:0/3570994904 wait complete. 2024-04-23T10:20:59.834 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'c9a2c6a2', quiesce took 4.5 seconds. Will release after: 29.05 2024-04-23T10:21:07.038 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:07.041 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:28.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:21:29.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 Processor -- start 2024-04-23T10:21:29.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 -- start start 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f0118151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01180c8a70 0x7f0118152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f011815b740 con 0x7f01180c8250 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f01180c6490 con 0x7f01180c8a70 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f011ccfe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01181525c0 con 0x7f01180c8630 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01180c8a70 0x7f0118152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f01180c8a70 0x7f0118152080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59966/0 (socket says 172.21.15.26:59966) 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 -- 172.21.15.26:0/2347041565 learned_addr learned my addr 172.21.15.26:0/2347041565 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0115d9b640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f0118151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 -- 172.21.15.26:0/2347041565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 msgr2=0x7f0118151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f0118151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 -- 172.21.15.26:0/2347041565 >> v1:172.21.15.190:6789/0 conn(0x7f01180c8250 legacy=0x7f01180c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.019+0000 7f0116d9d640 1 -- 172.21.15.26:0/2347041565 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f01180c40f0 con 0x7f01180c8a70 2024-04-23T10:21:29.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f0116d9d640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8a70 0x7f0118152080 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0110009e80 tx=0x7f011001c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18da02973e58a170 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011559a640 1 -- 172.21.15.26:0/2347041565 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100a55c0 con 0x7f01180c8a70 2024-04-23T10:21:29.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011559a640 1 -- 172.21.15.26:0/2347041565 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f01100a5760 con 0x7f01180c8a70 2024-04-23T10:21:29.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011559a640 1 -- 172.21.15.26:0/2347041565 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f01100a5b30 con 0x7f01180c8a70 2024-04-23T10:21:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- 172.21.15.26:0/2347041565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8a70 msgr2=0x7f0118152080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8a70 0x7f0118152080 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7f0110009e80 tx=0x7f011001c940 comp rx=0 tx=0).stop 2024-04-23T10:21:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- 172.21.15.26:0/2347041565 shutdown_connections 2024-04-23T10:21:29.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8a70 0x7f0118152080 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- 172.21.15.26:0/2347041565 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f0118151b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- 172.21.15.26:0/2347041565 >> 172.21.15.26:0/2347041565 conn(0x7f011806b9d0 msgr2=0x7f011806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- 172.21.15.26:0/2347041565 shutdown_connections 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- 172.21.15.26:0/2347041565 wait complete. 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 Processor -- start 2024-04-23T10:21:29.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- start start 2024-04-23T10:21:29.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f011815a1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01180c8a70 0x7f0118141730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f011815b400 con 0x7f01180c8250 2024-04-23T10:21:29.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f01180721a0 con 0x7f01180c8a70 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011ccfe640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f01180c6920 con 0x7f01180c8630 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59982/0 (socket says 172.21.15.26:59982) 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f011659c640 1 -- 172.21.15.26:0/796516291 learned_addr learned my addr 172.21.15.26:0/796516291 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f0115d9b640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f011815a1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.023+0000 7f0116d9d640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01180c8a70 0x7f0118141730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 -- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 msgr2=0x7f011815a1e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f011815a1e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 -- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01180c8a70 msgr2=0x7f0118141730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01180c8a70 0x7f0118141730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 -- 172.21.15.26:0/796516291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0118145390 con 0x7f01180c8250 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011659c640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f010800c480 tx=0x7f010800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108012830 con 0x7f01180c8250 2024-04-23T10:21:29.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0108017070 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0118145650 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0108012c30 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f01181f2410 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0118075df0 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f010801c460 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0108086c30 con 0x7f01180c8250 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0115d9b640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.027+0000 7f0115d9b640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 0x7f00f806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0118142040 tx=0x7f010c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.031+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0108056dc0 con 0x7f01180c8250 2024-04-23T10:21:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.231+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f01181521a0 con 0x7f01180c8250 2024-04-23T10:21:29.234 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f0106ffd640 1 -- 172.21.15.26:0/796516291 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f01080566c0 con 0x7f01180c8250 2024-04-23T10:21:29.235 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:21:29.235 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:21:29.235 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 msgr2=0x7f00f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 0x7f00f806a840 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f0118142040 tx=0x7f010c008040 comp rx=0 tx=0).stop 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 msgr2=0x7f01181f2c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 crypto rx=0x7f010800c480 tx=0x7f010800c940 comp rx=0 tx=0).stop 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 shutdown_connections 2024-04-23T10:21:29.237 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00f8068380 0x7f00f806a840 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f01180c8a70 0x7f0118141730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f01180c8630 0x7f011815a1e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 --2- 172.21.15.26:0/796516291 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f01180c8250 0x7f01181f2c10 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 >> 172.21.15.26:0/796516291 conn(0x7f011806b9d0 msgr2=0x7f0118142d50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 shutdown_connections 2024-04-23T10:21:29.238 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.235+0000 7f011ccfe640 1 -- 172.21.15.26:0/796516291 wait complete. 2024-04-23T10:21:29.254 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id c9a2c6a2 --release --await' 2024-04-23T10:21:29.254 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id c9a2c6a2 --release --await 2024-04-23T10:21:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 Processor -- start 2024-04-23T10:21:29.384 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 -- start start 2024-04-23T10:21:29.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff44806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4480c5d70 con 0x7ff44814ffa0 2024-04-23T10:21:29.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff4480c6050 con 0x7ff448074100 2024-04-23T10:21:29.385 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44d0b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff4480c6330 con 0x7ff44814fbc0 2024-04-23T10:21:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff43ffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ff44814ffa0 0x7ff4480c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59418/0 (socket says 172.21.15.26:59418) 2024-04-23T10:21:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff43ffff640 1 -- 172.21.15.26:0/1733637150 learned_addr learned my addr 172.21.15.26:0/1733637150 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:21:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff446d9d640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff44806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1951886854 0 0) 0x7ff4480c5d70 con 0x7ff44814ffa0 2024-04-23T10:21:29.386 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff434003530 con 0x7ff44814ffa0 2024-04-23T10:21:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3818707550 0 0) 0x7ff434003530 con 0x7ff44814ffa0 2024-04-23T10:21:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 msgr2=0x7ff44806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.387 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff44806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 >> v1:172.21.15.190:6789/0 conn(0x7ff448074100 legacy=0x7ff4480c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480c6610 con 0x7ff44814ffa0 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7ff430001680 con 0x7ff44814ffa0 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 >> v1:172.21.15.26:6789/0 conn(0x7ff44814ffa0 legacy=0x7ff4480c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff4340039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434003f70 0x7ff434004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff434004d50 0x7ff4340051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff4480c6330 con 0x7ff434004d50 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff43400bab0 con 0x7ff434003f70 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff43400bcb0 con 0x7ff44814fbc0 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff434004d50 0x7ff4340051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.388 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff446d9d640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff4340039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff43ffff640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434003f70 0x7ff434004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 -- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 msgr2=0x7ff4340039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff44814fbc0 0x7ff4340039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 -- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434003f70 msgr2=0x7ff434004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434003f70 0x7ff434004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.389 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.383+0000 7ff44759e640 1 -- 172.21.15.26:0/1733637150 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff434003530 con 0x7ff434004d50 2024-04-23T10:21:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44759e640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff434004d50 0x7ff4340051d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff440001e40 tx=0x7ff44001c760 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7dcce7cbb7da2e41 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440001a90 con 0x7ff434004d50 2024-04-23T10:21:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff440003b80 con 0x7ff434004d50 2024-04-23T10:21:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44659c640 1 -- 172.21.15.26:0/1733637150 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff440005080 con 0x7ff434004d50 2024-04-23T10:21:29.390 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 -- 172.21.15.26:0/1733637150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff434004d50 msgr2=0x7ff4340051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/1733637150 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff434004d50 0x7ff4340051d0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff440001e40 tx=0x7ff44001c760 comp rx=0 tx=0).stop 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44759e640 1 -- 172.21.15.26:0/1733637150 reap_dead start 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 -- 172.21.15.26:0/1733637150 shutdown_connections 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 -- 172.21.15.26:0/1733637150 >> 172.21.15.26:0/1733637150 conn(0x7ff44806b9d0 msgr2=0x7ff44806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 -- 172.21.15.26:0/1733637150 shutdown_connections 2024-04-23T10:21:29.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.387+0000 7ff44d0b4640 1 -- 172.21.15.26:0/1733637150 wait complete. 2024-04-23T10:21:29.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 Processor -- start 2024-04-23T10:21:29.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- start start 2024-04-23T10:21:29.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434004d50 0x7ff4481efc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff448143520 0x7ff44815c300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff448068350 con 0x7ff448141ce0 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4480681d0 con 0x7ff434004d50 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff4480c8930 con 0x7ff448143520 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:59996/0 (socket says 172.21.15.26:59996) 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 -- 172.21.15.26:0/2063622954 learned_addr learned my addr 172.21.15.26:0/2063622954 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434004d50 0x7ff4481efc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44759e640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff448143520 0x7ff44815c300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 -- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff448143520 msgr2=0x7ff44815c300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff448143520 0x7ff44815c300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 -- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434004d50 msgr2=0x7ff4481efc60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434004d50 0x7ff4481efc60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 -- 172.21.15.26:0/2063622954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff4480c79b0 con 0x7ff448141ce0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e8f0 tx=0x7ff43000edb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43f7fe640 1 -- 172.21.15.26:0/2063622954 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43000c8d0 con 0x7ff448141ce0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43f7fe640 1 -- 172.21.15.26:0/2063622954 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff430018070 con 0x7ff448141ce0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43f7fe640 1 -- 172.21.15.26:0/2063622954 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43000ccd0 con 0x7ff448141ce0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff448140c40 con 0x7ff448141ce0 2024-04-23T10:21:29.395 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff448141200 con 0x7ff448141ce0 2024-04-23T10:21:29.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43f7fe640 1 -- 172.21.15.26:0/2063622954 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ff43001d460 con 0x7ff448141ce0 2024-04-23T10:21:29.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.391+0000 7ff43f7fe640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 0x7ff42806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43f7fe640 1 -- 172.21.15.26:0/2063622954 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff430086cf0 con 0x7ff448141ce0 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 0x7ff42806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 Processor -- start 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- start start 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 0x7ff42806a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff438009ae0 tx=0x7ff438008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb238a0 0x555fafaec9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb28120 0x555fafb28500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555faf934660 con 0x555fafaecf00 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555faf8d95d0 con 0x555fafb28120 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555faf930620 con 0x555fafb238a0 2024-04-23T10:21:29.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60010/0 (socket says 172.21.15.26:60010) 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 -- 172.21.15.26:0/1759278901 learned_addr learned my addr 172.21.15.26:0/1759278901 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff446d9d640 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb238a0 0x555fafaec9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 -- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb238a0 msgr2=0x555fafaec9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb238a0 0x555fafaec9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 -- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb28120 msgr2=0x555fafb28500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff44759e640 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb28120 0x555fafb28500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb28120 0x555fafb28500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 -- 172.21.15.26:0/1759278901 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf90dbd0 con 0x555fafaecf00 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43ffff640 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff430005fd0 tx=0x7ff430056400 comp rx=0 tx=0).ready entity=mon.0 client_cookie=763167daf26ed7c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43cff9640 1 -- 172.21.15.26:0/1759278901 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43005f370 con 0x555fafaecf00 2024-04-23T10:21:29.400 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43cff9640 1 -- 172.21.15.26:0/1759278901 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff430054a90 con 0x555fafaecf00 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff43cff9640 1 -- 172.21.15.26:0/1759278901 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff430055be0 con 0x555fafaecf00 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- 172.21.15.26:0/1759278901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 msgr2=0x555fafaed2e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff430005fd0 tx=0x7ff430056400 comp rx=0 tx=0).stop 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- 172.21.15.26:0/1759278901 shutdown_connections 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb28120 0x555fafb28500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafaed2e0 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 --2- 172.21.15.26:0/1759278901 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb238a0 0x555fafaec9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- 172.21.15.26:0/1759278901 >> 172.21.15.26:0/1759278901 conn(0x555faf9ceb00 msgr2=0x555fafb25ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- 172.21.15.26:0/1759278901 shutdown_connections 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- 172.21.15.26:0/1759278901 wait complete. 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 -- start start 2024-04-23T10:21:29.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.395+0000 7ff450236000 1 Processor -- start 2024-04-23T10:21:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb22b90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafae78a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555faf9f1d40 con 0x555fafaecf00 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555faf8eeeb0 con 0x555fafb238a0 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555faf92f2a0 con 0x555fafb28120 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 10 client.0 _ll_register_callbacks cb 0x555fafad2a90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60026/0 (socket says 172.21.15.26:60026) 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 -- 172.21.15.26:0/2845384572 learned_addr learned my addr 172.21.15.26:0/2845384572 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb22b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff44759e640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafae78a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 -- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 msgr2=0x555fafae78a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafae78a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 -- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 msgr2=0x555fafb22b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb22b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 -- 172.21.15.26:0/2845384572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555faf97ab30 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff4380166b0 tx=0x7ff438004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2ff6c12722579a5 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438015790 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff438015930 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x555faf8ce060 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff438015b30 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 10 client.5586 fetch_fsmap learned FSMap version 19 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555faf8d3b70 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x555faf8ce060 con 0x555fafaecf00 2024-04-23T10:21:29.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ff438036080 con 0x555fafaecf00 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 10 client.5586 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 10 client.5586 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 20 client.5586 populate_metadata read hostname 'smithi026' 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafae8640 0x555fafae8a50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 4 client.5586 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x555faf90ce30 con 0x555fafae8640 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafae8640 0x555fafae8a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafae8640 0x555fafae8a50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=ca4f04deea58e578 server_cookie=b1b74214a5cc5ae8 in_seq=0 out_seq=0 2024-04-23T10:21:29.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:29.399+0000 7ff425ffb640 10 client.5586 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:21:30.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff425ffb640 1 -- 172.21.15.26:0/2845384572 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x555faf90ce30 con 0x555fafae8640 2024-04-23T10:21:30.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff425ffb640 10 client.5586 handle_command_reply: tid=0 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 client.5586 shutdown 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 msgr2=0x555fafb22650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff4380166b0 tx=0x7ff438004740 comp rx=0 tx=0).stop 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 shutdown_connections 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafae8640 0x555fafae8a50 crc :-1 s=READY pgs=164 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafae78a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb22b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff425ffb640 0 client.5586 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 --2- 172.21.15.26:0/2845384572 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb22650 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 >> 172.21.15.26:0/2845384572 conn(0x555faf9ceb00 msgr2=0x555fafb279a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 shutdown_connections 2024-04-23T10:21:30.053 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 1 -- 172.21.15.26:0/2845384572 wait complete. 2024-04-23T10:21:30.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.051+0000 7ff450236000 20 client.5586 trim_cache size 0 max 16384 2024-04-23T10:21:30.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.083+0000 7ff450236000 1 Processor -- start 2024-04-23T10:21:30.086 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.083+0000 7ff450236000 1 -- start start 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb92030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb92570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481fcb60 con 0x555fafaecf00 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ff4481fd230 con 0x555fafb238a0 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ff4481f2b80 con 0x555fafb28120 2024-04-23T10:21:30.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60038/0 (socket says 172.21.15.26:60038) 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 -- 172.21.15.26:0/2111359069 learned_addr learned my addr 172.21.15.26:0/2111359069 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff44759e640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb92570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb92030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 -- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 msgr2=0x555fafb92570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb92570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 -- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 msgr2=0x555fafb92030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb92030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 -- 172.21.15.26:0/2111359069 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555faf9b65e0 con 0x555fafaecf00 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff44759e640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb92570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:30.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff43ffff640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:21:30.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff446d9d640 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff438000c10 tx=0x7ff438024000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8cde705f0bcf7480 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff427fff640 1 -- 172.21.15.26:0/2111359069 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438015d70 con 0x555fafaecf00 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff427fff640 1 -- 172.21.15.26:0/2111359069 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438015790 con 0x555fafaecf00 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff427fff640 1 -- 172.21.15.26:0/2111359069 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff438004270 con 0x555fafaecf00 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- 172.21.15.26:0/2111359069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 msgr2=0x555fafb91af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff438000c10 tx=0x7ff438024000 comp rx=0 tx=0).stop 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- 172.21.15.26:0/2111359069 shutdown_connections 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb92570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafb238a0 0x555fafb92030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 --2- 172.21.15.26:0/2111359069 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafaecf00 0x555fafb91af0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- 172.21.15.26:0/2111359069 >> 172.21.15.26:0/2111359069 conn(0x555faf9ceb00 msgr2=0x555fafaeaa30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- 172.21.15.26:0/2111359069 shutdown_connections 2024-04-23T10:21:30.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.087+0000 7ff450236000 1 -- 172.21.15.26:0/2111359069 wait complete. 2024-04-23T10:21:30.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- start start 2024-04-23T10:21:30.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 Processor -- start 2024-04-23T10:21:30.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafaecf00 0x555fafb95f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb96d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x555faf933970 con 0x555fafb238a0 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x555faf8e98f0 con 0x555fafaecf00 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x555faf938c90 con 0x555fafb28120 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 10 client.0 _ll_register_callbacks cb 0x7ff43801a070 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:60052/0 (socket says 172.21.15.26:60052) 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 -- 172.21.15.26:0/573529669 learned_addr learned my addr 172.21.15.26:0/573529669 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff446d9d640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafaecf00 0x555fafb95f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff44759e640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb96d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 -- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 msgr2=0x555fafb96d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb96d50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 -- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafaecf00 msgr2=0x555fafb95f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:21:30.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafaecf00 0x555fafb95f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 -- 172.21.15.26:0/573529669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555faf8c6ae0 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff44759e640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb96d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff43ffff640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff430052ba0 tx=0x7ff43005d050 comp rx=0 tx=0).ready entity=mon.0 client_cookie=918a18ac3c8dc832 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff425ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ff43005f370 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7ff430052e00 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7ff438015790 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7ff43007e300 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 10 client.5592 fetch_fsmap learned FSMap version 19 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x555faf8c9d80 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.091+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff438015790 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7ff430055be0 con 0x555fafb238a0 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 10 client.5592 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 10 client.5592 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:21:30.096 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 20 client.5592 populate_metadata read hostname 'smithi026' 2024-04-23T10:21:30.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafb97770 0x555fafb97b80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:21:30.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 4 client.5592 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "c9a2c6a2", "release": true, "await": true}] 2024-04-23T10:21:30.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "c9a2c6a2", "release": true, "await": true}) -- 0x555faf8d20d0 con 0x555fafb97770 2024-04-23T10:21:30.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff446d9d640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafb97770 0x555fafb97b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:21:30.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff446d9d640 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafb97770 0x555fafb97b80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=a2e1bd88997b95 server_cookie=fa8b724c47d002bf in_seq=0 out_seq=0 2024-04-23T10:21:30.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.095+0000 7ff425ffb640 10 client.5592 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:21:30.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff425ffb640 1 -- 172.21.15.26:0/573529669 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x555faf8d20d0 con 0x555fafb97770 2024-04-23T10:21:30.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff425ffb640 10 client.5592 handle_command_reply: tid=0 2024-04-23T10:21:30.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 client.5592 shutdown 2024-04-23T10:21:30.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 msgr2=0x555fafb96460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:30.524 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 crypto rx=0x7ff430052ba0 tx=0x7ff43005d050 comp rx=0 tx=0).stop 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 shutdown_connections 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x555fafb97770 0x555fafb97b80 crc :-1 s=READY pgs=165 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x555fafb28120 0x555fafb96d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff425ffb640 0 client.5592 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x555fafb238a0 0x555fafb96460 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.525 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 --2- 172.21.15.26:0/573529669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x555fafaecf00 0x555fafb95f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 >> 172.21.15.26:0/573529669 conn(0x555faf9ceb00 msgr2=0x555fafae7840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 shutdown_connections 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 1 -- 172.21.15.26:0/573529669 wait complete. 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff450236000 20 client.5592 trim_cache size 0 max 16384 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:21:30.526 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 32, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "c9a2c6a2": { 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 32, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 89.0, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:21:30.527 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:21:30.528 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 msgr2=0x7ff42806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 0x7ff42806a840 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7ff438009ae0 tx=0x7ff438008040 comp rx=0 tx=0).stop 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 msgr2=0x7ff448148ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.523+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff43000e8f0 tx=0x7ff43000edb0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 shutdown_connections 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ff428068380 0x7ff42806a840 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ff448143520 0x7ff44815c300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ff448141ce0 0x7ff448148ce0 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.529 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 --2- 172.21.15.26:0/2063622954 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ff434004d50 0x7ff4481efc60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:21:30.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 >> 172.21.15.26:0/2063622954 conn(0x7ff44806b9d0 msgr2=0x7ff44806be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:21:30.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 shutdown_connections 2024-04-23T10:21:30.530 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:21:30.527+0000 7ff44d0b4640 1 -- 172.21.15.26:0/2063622954 wait complete. 2024-04-23T10:21:30.566 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'c9a2c6a2', seconds elapsed: 35.3 2024-04-23T10:21:37.160 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:21:37.164 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:07.233 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:07.236 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:37.380 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:22:37.383 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:07.494 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:07.496 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:18.467 DEBUG:tasks.quiescer.fs.[cephfs]:Going to quiesce for duration: 33.6 2024-04-23T10:23:18.467 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:23:18.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.626+0000 7f142409e640 1 Processor -- start 2024-04-23T10:23:18.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.626+0000 7f142409e640 1 -- start start 2024-04-23T10:23:18.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142409e640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f141c151f40 0x7f141c0c9630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142409e640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f141c072ae0 0x7f141c15b390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142409e640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f141c157da0 con 0x7f141c06cfd0 2024-04-23T10:23:18.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142409e640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f141c0c89e0 con 0x7f141c151f40 2024-04-23T10:23:18.631 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142409e640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f141c0c8c80 con 0x7f141c072ae0 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f141c151f40 0x7f141c0c9630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142263b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f141c06cfd0 0x7f141c06f800 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51976/0 (socket says 172.21.15.26:51976) 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f142263b640 1 -- 172.21.15.26:0/40490441 learned_addr learned my addr 172.21.15.26:0/40490441 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 --2- 172.21.15.26:0/40490441 >> v2:172.21.15.26:3300/0 conn(0x7f141c151f40 0x7f141c0c9630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48594/0 (socket says 172.21.15.26:48594) 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421639640 1 --2- 172.21.15.26:0/40490441 >> v2:172.21.15.190:3300/0 conn(0x7f141c072ae0 0x7f141c15b390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1420e38640 1 -- 172.21.15.26:0/40490441 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 395084267 0 0) 0x7f14140014a0 con 0x7f141c06cfd0 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1420e38640 1 -- 172.21.15.26:0/40490441 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f1408003530 con 0x7f141c06cfd0 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 -- 172.21.15.26:0/40490441 >> v2:172.21.15.190:3300/0 conn(0x7f141c072ae0 msgr2=0x7f141c15b390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 --2- 172.21.15.26:0/40490441 >> v2:172.21.15.190:3300/0 conn(0x7f141c072ae0 0x7f141c15b390 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 -- 172.21.15.26:0/40490441 >> v1:172.21.15.26:6789/0 conn(0x7f141c06cfd0 legacy=0x7f141c06f800 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 -- 172.21.15.26:0/40490441 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c158020 con 0x7f141c151f40 2024-04-23T10:23:18.633 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1421e3a640 1 --2- 172.21.15.26:0/40490441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c151f40 0x7f141c0c9630 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f141c15c3f0 tx=0x7f1418020ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=847a49f25f328962 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1420e38640 1 -- 172.21.15.26:0/40490441 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14180b7070 con 0x7f141c151f40 2024-04-23T10:23:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1420e38640 1 -- 172.21.15.26:0/40490441 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14180aaba0 con 0x7f141c151f40 2024-04-23T10:23:18.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.630+0000 7f1420e38640 1 -- 172.21.15.26:0/40490441 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f14180b2440 con 0x7f141c151f40 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/40490441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c151f40 msgr2=0x7f141c0c9630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- 172.21.15.26:0/40490441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c151f40 0x7f141c0c9630 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7f141c15c3f0 tx=0x7f1418020ea0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/40490441 shutdown_connections 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- 172.21.15.26:0/40490441 >> v2:172.21.15.190:3300/0 conn(0x7f141c072ae0 0x7f141c15b390 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- 172.21.15.26:0/40490441 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c151f40 0x7f141c0c9630 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/40490441 >> 172.21.15.26:0/40490441 conn(0x7f141c0ca540 msgr2=0x7f141c0ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/40490441 shutdown_connections 2024-04-23T10:23:18.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/40490441 wait complete. 2024-04-23T10:23:18.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 Processor -- start 2024-04-23T10:23:18.636 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- start start 2024-04-23T10:23:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f141c06cfd0 0x7f141c144b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f141c151f40 0x7f141c145510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f141c0c9b70 con 0x7f141c072ae0 2024-04-23T10:23:18.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f141c1585e0 con 0x7f141c151f40 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f141c0c9170 con 0x7f141c06cfd0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48608/0 (socket says 172.21.15.26:48608) 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 -- 172.21.15.26:0/2065919354 learned_addr learned my addr 172.21.15.26:0/2065919354 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421e3a640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f141c06cfd0 0x7f141c144b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142263b640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f141c151f40 0x7f141c145510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 -- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f141c06cfd0 msgr2=0x7f141c144b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f141c06cfd0 0x7f141c144b50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 -- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f141c151f40 msgr2=0x7f141c145510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f141c151f40 0x7f141c145510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 -- 172.21.15.26:0/2065919354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f141c145090 con 0x7f141c072ae0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f1421639640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e930 tx=0x7f140c00edf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c017070 con 0x7f141c072ae0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f140c00ca00 con 0x7f141c072ae0 2024-04-23T10:23:18.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f141c0c64c0 con 0x7f141c072ae0 2024-04-23T10:23:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f140c00cdb0 con 0x7f141c072ae0 2024-04-23T10:23:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.634+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f141c0c6a80 con 0x7f141c072ae0 2024-04-23T10:23:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f141c075df0 con 0x7f141c072ae0 2024-04-23T10:23:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f140c01a070 con 0x7f141c072ae0 2024-04-23T10:23:18.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f14127fc640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 0x7f140006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f140c086d40 con 0x7f141c072ae0 2024-04-23T10:23:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f1421e3a640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 0x7f140006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:18.641 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.638+0000 7f1421e3a640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 0x7f140006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14180b4000 tx=0x7f1418008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:18.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.642+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f140c056950 con 0x7f141c072ae0 2024-04-23T10:23:18.854 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f141c15c230 con 0x7f141c072ae0 2024-04-23T10:23:18.855 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f14127fc640 1 -- 172.21.15.26:0/2065919354 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f140c05ac50 con 0x7f141c072ae0 2024-04-23T10:23:18.855 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:23:18.856 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:23:18.856 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 msgr2=0x7f140006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 0x7f140006a840 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f14180b4000 tx=0x7f1418008040 comp rx=0 tx=0).stop 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 msgr2=0x7f141c0cd870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x7f140c00e930 tx=0x7f140c00edf0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.854+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 shutdown_connections 2024-04-23T10:23:18.858 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1400068380 0x7f140006a840 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f141c151f40 0x7f141c145510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f141c072ae0 0x7f141c0cd870 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 --2- 172.21.15.26:0/2065919354 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f141c06cfd0 0x7f141c144b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 >> 172.21.15.26:0/2065919354 conn(0x7f141c0ca540 msgr2=0x7f141c0c7d30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 shutdown_connections 2024-04-23T10:23:18.859 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:18.858+0000 7f142409e640 1 -- 172.21.15.26:0/2065919354 wait complete. 2024-04-23T10:23:18.875 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db / --timeout 60 --expiration 93.6 --await-for 42.0' 2024-04-23T10:23:18.875 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db / --timeout 60 --expiration 93.6 --await-for 42.0 2024-04-23T10:23:19.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 Processor -- start 2024-04-23T10:23:19.015 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 -- start start 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff8c1552f0 0x7eff8c0ccc60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0cb8a0 0x7eff8c0d0930 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 0x7eff8c15e9e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7eff8c0cd1a0 con 0x7eff8c1552f0 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7eff8c15b240 con 0x7eff8c0d0e70 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff940ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff8c15b520 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff8c1552f0 0x7eff8c0ccc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7eff8c1552f0 0x7eff8c0ccc60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48624/0 (socket says 172.21.15.26:48624) 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 -- 172.21.15.26:0/2674142011 learned_addr learned my addr 172.21.15.26:0/2674142011 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 -- 172.21.15.26:0/2674142011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0cb8a0 msgr2=0x7eff8c0d0930 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 --2- 172.21.15.26:0/2674142011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0cb8a0 0x7eff8c0d0930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.017 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 -- 172.21.15.26:0/2674142011 >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 msgr2=0x7eff8c15e9e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff92657640 1 --2- 172.21.15.26:0/2674142011 >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 0x7eff8c15e9e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 --2- 172.21.15.26:0/2674142011 >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 0x7eff8c15e9e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff91e56640 1 -- 172.21.15.26:0/2674142011 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8c15b800 con 0x7eff8c1552f0 2024-04-23T10:23:19.018 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.014+0000 7eff92657640 1 --2- 172.21.15.26:0/2674142011 >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 0x7eff8c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff91e56640 1 --2- 172.21.15.26:0/2674142011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c1552f0 0x7eff8c0ccc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0b4af0 tx=0x7eff8801c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=36220ac6115b2a0f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff90e54640 1 -- 172.21.15.26:0/2674142011 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880ab5f0 con 0x7eff8c1552f0 2024-04-23T10:23:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff90e54640 1 -- 172.21.15.26:0/2674142011 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff880b0070 con 0x7eff8c1552f0 2024-04-23T10:23:19.019 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff90e54640 1 -- 172.21.15.26:0/2674142011 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880ab9b0 con 0x7eff8c1552f0 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- 172.21.15.26:0/2674142011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c1552f0 msgr2=0x7eff8c0ccc60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- 172.21.15.26:0/2674142011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c1552f0 0x7eff8c0ccc60 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7eff8c0b4af0 tx=0x7eff8801c520 comp rx=0 tx=0).stop 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- 172.21.15.26:0/2674142011 shutdown_connections 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- 172.21.15.26:0/2674142011 >> v2:172.21.15.190:3300/0 conn(0x7eff8c0d0e70 0x7eff8c15e9e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- 172.21.15.26:0/2674142011 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0cb8a0 0x7eff8c0d0930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- 172.21.15.26:0/2674142011 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c1552f0 0x7eff8c0ccc60 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- 172.21.15.26:0/2674142011 >> 172.21.15.26:0/2674142011 conn(0x7eff8c06c0d0 msgr2=0x7eff8c06d610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- 172.21.15.26:0/2674142011 shutdown_connections 2024-04-23T10:23:19.020 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- 172.21.15.26:0/2674142011 wait complete. 2024-04-23T10:23:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 Processor -- start 2024-04-23T10:23:19.021 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 -- start start 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.018+0000 7eff940ba640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0d0e70 0x7eff8c0ca160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 0x7eff8c156d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c0cc100 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c1556d0 con 0x7eff8c1552f0 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff8c0cdc60 con 0x7eff8c0d0e70 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48638/0 (socket says 172.21.15.26:48638) 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 -- 172.21.15.26:0/2413807790 learned_addr learned my addr 172.21.15.26:0/2413807790 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91655640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0d0e70 0x7eff8c0ca160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff92657640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 0x7eff8c156d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 -- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0d0e70 msgr2=0x7eff8c0ca160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0d0e70 0x7eff8c0ca160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 -- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 msgr2=0x7eff8c156d00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 0x7eff8c156d00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 -- 172.21.15.26:0/2413807790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7eff8c14f150 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff92657640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 0x7eff8c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91e56640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7eff880ad040 tx=0x7eff8801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 -- 172.21.15.26:0/2413807790 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880be5f0 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 -- 172.21.15.26:0/2413807790 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff880be7b0 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7eff8c14eb90 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 -- 172.21.15.26:0/2413807790 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880beba0 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7eff8c1f3a90 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 -- 172.21.15.26:0/2413807790 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7eff880b43f0 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 0x7eff7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff827fc640 1 -- 172.21.15.26:0/2413807790 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff881211b0 con 0x7eff8c0cb8a0 2024-04-23T10:23:19.025 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff91655640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 0x7eff7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff9723c000 1 Processor -- start 2024-04-23T10:23:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.022+0000 7eff9723c000 1 -- start start 2024-04-23T10:23:19.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91655640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 0x7eff7006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006fd0 tx=0x7eff7c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569069e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690b6c0 0x55755690baa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5575567b22a0 con 0x55755690bfe0 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5575567185f0 con 0x55755690b6c0 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5575566b3820 con 0x557556906600 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48650/0 (socket says 172.21.15.26:48650) 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 -- 172.21.15.26:0/1181996105 learned_addr learned my addr 172.21.15.26:0/1181996105 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91655640 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690b6c0 0x55755690baa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91e56640 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569069e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 -- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 msgr2=0x5575569069e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569069e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 -- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690b6c0 msgr2=0x55755690baa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690b6c0 0x55755690baa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 -- 172.21.15.26:0/1181996105 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55755675ec00 con 0x55755690bfe0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7eff8400d4e0 tx=0x7eff8400d9a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64e4df1648526e18 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff6f7fe640 1 -- 172.21.15.26:0/1181996105 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8401a070 con 0x55755690bfe0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff6f7fe640 1 -- 172.21.15.26:0/1181996105 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8400b760 con 0x55755690bfe0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff6f7fe640 1 -- 172.21.15.26:0/1181996105 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff8400bb70 con 0x55755690bfe0 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- 172.21.15.26:0/1181996105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 msgr2=0x55755690c3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7eff8400d4e0 tx=0x7eff8400d9a0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.029 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- 172.21.15.26:0/1181996105 shutdown_connections 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690bfe0 0x55755690c3c0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690b6c0 0x55755690baa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- 172.21.15.26:0/1181996105 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569069e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- 172.21.15.26:0/1181996105 >> 172.21.15.26:0/1181996105 conn(0x557556907470 msgr2=0x557556909890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- 172.21.15.26:0/1181996105 shutdown_connections 2024-04-23T10:23:19.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- 172.21.15.26:0/1181996105 wait complete. 2024-04-23T10:23:19.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- start start 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 Processor -- start 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690b6c0 0x557556905f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556911830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5575566c3c60 con 0x557556906600 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55755679abf0 con 0x55755690bfe0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5575567d5560 con 0x55755690b6c0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff9723c000 10 client.0 _ll_register_callbacks cb 0x5575566ef570 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91e56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91e56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48652/0 (socket says 172.21.15.26:48652) 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91e56640 1 -- 172.21.15.26:0/1813495714 learned_addr learned my addr 172.21.15.26:0/1813495714 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff92657640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556911830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.026+0000 7eff91655640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690b6c0 0x557556905f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.033 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 -- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690b6c0 msgr2=0x557556905f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690b6c0 0x557556905f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 -- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 msgr2=0x557556911830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556911830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 -- 172.21.15.26:0/1813495714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557556753630 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91e56640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7eff8801ca00 tx=0x7eff880f13e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=248e12ef44c26ee1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff880f5090 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff88109180 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff8400b760 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7eff880f9950 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 10 client.5613 fetch_fsmap learned FSMap version 19 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5575566b8490 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff8400b760 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7eff880f9ba0 con 0x557556906600 2024-04-23T10:23:19.034 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 10 client.5613 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 10 client.5613 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 20 client.5613 populate_metadata read hostname 'smithi026' 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5575569125d0 0x5575569129e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 4 client.5613 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5575566b27f0 con 0x5575569125d0 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91655640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5575569125d0 0x5575569129e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff91655640 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5575569125d0 0x5575569129e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=aec8074ae190c08 server_cookie=a580caca3f02b358 in_seq=0 out_seq=0 2024-04-23T10:23:19.035 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.030+0000 7eff6cff9640 10 client.5613 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff6cff9640 1 -- 172.21.15.26:0/1813495714 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5575566b27f0 con 0x5575569125d0 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff6cff9640 10 client.5613 handle_command_reply: tid=0 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 client.5613 shutdown 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 msgr2=0x5575569059e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 crypto rx=0x7eff8801ca00 tx=0x7eff880f13e0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 shutdown_connections 2024-04-23T10:23:19.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5575569125d0 0x5575569129e0 crc :-1 s=READY pgs=258 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556911830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690b6c0 0x557556905f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 --2- 172.21.15.26:0/1813495714 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x557556906600 0x5575569059e0 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff6cff9640 0 client.5613 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 >> 172.21.15.26:0/1813495714 conn(0x557556907470 msgr2=0x55755690a6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 shutdown_connections 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 1 -- 172.21.15.26:0/1813495714 wait complete. 2024-04-23T10:23:19.037 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.034+0000 7eff9723c000 20 client.5613 trim_cache size 0 max 16384 2024-04-23T10:23:19.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 Processor -- start 2024-04-23T10:23:19.052 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 -- start start 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569789e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556979460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c2017f0 con 0x55755690b6c0 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7eff8c201ec0 con 0x55755690bfe0 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7eff8c1fff90 con 0x557556906600 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48666/0 (socket says 172.21.15.26:48666) 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 -- 172.21.15.26:0/1642977870 learned_addr learned my addr 172.21.15.26:0/1642977870 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.054 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 -- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 msgr2=0x5575569789e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff92657640 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556979460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569789e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 -- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 msgr2=0x557556979460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556979460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 -- 172.21.15.26:0/1642977870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5575566b3a70 con 0x55755690b6c0 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff92657640 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556979460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff91655640 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00dbc0 tx=0x7eff7c013000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3f4a4f41d20a734c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.050+0000 7eff6effd640 1 -- 172.21.15.26:0/1642977870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c00de30 con 0x55755690b6c0 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6effd640 1 -- 172.21.15.26:0/1642977870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c024930 con 0x55755690b6c0 2024-04-23T10:23:19.055 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6effd640 1 -- 172.21.15.26:0/1642977870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c024ae0 con 0x55755690b6c0 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1642977870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 msgr2=0x557556978f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7eff7c00dbc0 tx=0x7eff7c013000 comp rx=0 tx=0).stop 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1642977870 shutdown_connections 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55755690bfe0 0x557556979460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x557556978f20 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.058 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- 172.21.15.26:0/1642977870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x557556906600 0x5575569789e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1642977870 >> 172.21.15.26:0/1642977870 conn(0x557556907470 msgr2=0x557556926010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1642977870 shutdown_connections 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1642977870 wait complete. 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- start start 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 Processor -- start 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 0x5575568ce5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690bfe0 0x5575568cf030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x557556717900 con 0x55755690b6c0 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5575566e2e60 con 0x557556906600 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55755671cc20 con 0x55755690bfe0 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 10 client.0 _ll_register_callbacks cb 0x7eff880094d0 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:48682/0 (socket says 172.21.15.26:48682) 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 -- 172.21.15.26:0/1093071051 learned_addr learned my addr 172.21.15.26:0/1093071051 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:19.059 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91e56640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 0x5575568ce5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 -- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690bfe0 msgr2=0x5575568cf030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690bfe0 0x5575568cf030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 -- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 msgr2=0x5575568ce5b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 0x5575568ce5b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 -- 172.21.15.26:0/1093071051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55755679b080 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91e56640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 0x5575568ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91655640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7eff7c024800 tx=0x7eff7c0046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6fa9f52a3fc0e3a server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7eff7c024db0 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7eff7c00f040 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7eff7c024930 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7eff7c0059d0 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 10 client.5619 fetch_fsmap learned FSMap version 19 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5575566be3e0 con 0x55755690b6c0 2024-04-23T10:23:19.060 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff7c024930 con 0x55755690b6c0 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7eff7c043080 con 0x55755690b6c0 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 10 client.5619 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 10 client.5619 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 20 client.5619 populate_metadata read hostname 'smithi026' 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557556985a80 0x557556987e70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 4 client.5619 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 93.6, "await_for": 42.0}] 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "roots": ["/"], "timeout": 60.0, "expiration": 93.6, "await_for": 42.0}) -- 0x5575566c1940 con 0x557556985a80 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.054+0000 7eff91e56640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557556985a80 0x557556987e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.058+0000 7eff91e56640 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557556985a80 0x557556987e70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=26c959ba3f1ec8d9 server_cookie=3dfaf2ec54da00bd in_seq=0 out_seq=0 2024-04-23T10:23:19.061 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.058+0000 7eff6cff9640 10 client.5619 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff6cff9640 1 -- 172.21.15.26:0/1093071051 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x5575566c1940 con 0x557556985a80 2024-04-23T10:23:19.838 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff6cff9640 10 client.5619 handle_command_reply: tid=0 2024-04-23T10:23:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 client.5619 shutdown 2024-04-23T10:23:19.839 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 msgr2=0x5575568ceaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7eff7c024800 tx=0x7eff7c0046d0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 shutdown_connections 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x557556985a80 0x557556987e70 crc :-1 s=READY pgs=259 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55755690bfe0 0x5575568cf030 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55755690b6c0 0x5575568ceaf0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 --2- 172.21.15.26:0/1093071051 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x557556906600 0x5575568ce5b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff6cff9640 0 client.5619 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 >> 172.21.15.26:0/1093071051 conn(0x557556907470 msgr2=0x5575569268a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 shutdown_connections 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 1 -- 172.21.15.26:0/1093071051 wait complete. 2024-04-23T10:23:19.840 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff9723c000 20 client.5619 trim_cache size 0 max 16384 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 34, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "eb021968": { 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 34, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:23:19.841 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 93.6, 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "QUIESCED", 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:19.842 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:19.843 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:23:19.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 msgr2=0x7eff7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 0x7eff7006a840 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7eff7c006fd0 tx=0x7eff7c008040 comp rx=0 tx=0).stop 2024-04-23T10:23:19.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 msgr2=0x7eff8c0c7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7eff880ad040 tx=0x7eff8801ad60 comp rx=0 tx=0).stop 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 shutdown_connections 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7eff70068380 0x7eff7006a840 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7eff8c1552f0 0x7eff8c156d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7eff8c0d0e70 0x7eff8c0ca160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 --2- 172.21.15.26:0/2413807790 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7eff8c0cb8a0 0x7eff8c0c7dc0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 >> 172.21.15.26:0/2413807790 conn(0x7eff8c06c0d0 msgr2=0x7eff8c0cf620 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 shutdown_connections 2024-04-23T10:23:19.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:19.838+0000 7eff940ba640 1 -- 172.21.15.26:0/2413807790 wait complete. 2024-04-23T10:23:19.861 INFO:tasks.quiescer.fs.[cephfs]:Successfully quiesced set 'eb021968', quiesce took 1.4 seconds. Will release after: 33.6 2024-04-23T10:23:37.539 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:37.542 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:23:53.462 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:23:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.598+0000 7f17bec26640 1 Processor -- start 2024-04-23T10:23:53.598 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 -- start start 2024-04-23T10:23:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 0x7f17b806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.599 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f17b80c5d70 con 0x7f17b814fbc0 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f17b80c6050 con 0x7f17b814ffa0 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bec26640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17b80c6330 con 0x7f17b8074100 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17b7fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 0x7f17b806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:57778/0 (socket says 172.21.15.26:57778) 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 -- 172.21.15.26:0/3933055323 learned_addr learned my addr 172.21.15.26:0/3933055323 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 -- 172.21.15.26:0/3933055323 >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 msgr2=0x7f17b806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.600 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 --2- 172.21.15.26:0/3933055323 >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 0x7f17b806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 -- 172.21.15.26:0/3933055323 >> v1:172.21.15.190:6789/0 conn(0x7f17b814fbc0 legacy=0x7f17b80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17bd1c3640 1 -- 172.21.15.26:0/3933055323 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b80c6610 con 0x7f17b8074100 2024-04-23T10:23:53.601 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.602+0000 7f17b7fff640 1 --2- 172.21.15.26:0/3933055323 >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 0x7f17b806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:23:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bd1c3640 1 --2- 172.21.15.26:0/3933055323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009e50 tx=0x7f17b001ca30 comp rx=0 tx=0).ready entity=mon.2 client_cookie=72448650988bc239 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17b77fe640 1 -- 172.21.15.26:0/3933055323 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00a5920 con 0x7f17b8074100 2024-04-23T10:23:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17b77fe640 1 -- 172.21.15.26:0/3933055323 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17b00a5ac0 con 0x7f17b8074100 2024-04-23T10:23:53.603 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17b77fe640 1 -- 172.21.15.26:0/3933055323 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17b00ad3f0 con 0x7f17b8074100 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- 172.21.15.26:0/3933055323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 msgr2=0x7f17b80c7250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 --2- 172.21.15.26:0/3933055323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f17b0009e50 tx=0x7f17b001ca30 comp rx=0 tx=0).stop 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- 172.21.15.26:0/3933055323 shutdown_connections 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 --2- 172.21.15.26:0/3933055323 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b8074100 0x7f17b80c7250 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 --2- 172.21.15.26:0/3933055323 >> v2:172.21.15.190:3300/0 conn(0x7f17b814ffa0 0x7f17b806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- 172.21.15.26:0/3933055323 >> 172.21.15.26:0/3933055323 conn(0x7f17b806b9d0 msgr2=0x7f17b806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- 172.21.15.26:0/3933055323 shutdown_connections 2024-04-23T10:23:53.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- 172.21.15.26:0/3933055323 wait complete. 2024-04-23T10:23:53.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 Processor -- start 2024-04-23T10:23:53.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.606+0000 7f17bec26640 1 -- start start 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17b8074100 0x7f17b81f46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b814ffa0 0x7f17b8152ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80c8ab0 con 0x7f17b814fbc0 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f17b80c8930 con 0x7f17b8074100 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f17b8166090 con 0x7f17b814ffa0 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53614/0 (socket says 172.21.15.26:53614) 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 -- 172.21.15.26:0/2651384116 learned_addr learned my addr 172.21.15.26:0/2651384116 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bc9c2640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17b8074100 0x7f17b81f46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bd1c3640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b814ffa0 0x7f17b8152ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 -- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b814ffa0 msgr2=0x7f17b8152ec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b814ffa0 0x7f17b8152ec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 -- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17b8074100 msgr2=0x7f17b81f46d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17b8074100 0x7f17b81f46d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 -- 172.21.15.26:0/2651384116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f17b8150900 con 0x7f17b814fbc0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b7fff640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00e9b0 tx=0x7f17ac00ee70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac017070 con 0x7f17b814fbc0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f17ac00ca00 con 0x7f17b814fbc0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f17b814b420 con 0x7f17b814fbc0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f17ac00cdd0 con 0x7f17b814fbc0 2024-04-23T10:23:53.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f17b815c450 con 0x7f17b814fbc0 2024-04-23T10:23:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f17b8075df0 con 0x7f17b814fbc0 2024-04-23T10:23:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f17ac01a070 con 0x7f17b814fbc0 2024-04-23T10:23:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f17ac086d90 con 0x7f17b814fbc0 2024-04-23T10:23:53.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.610+0000 7f17bc9c2640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.614+0000 7f17bc9c2640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001650 tx=0x7f17a8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.614+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f17ac056ea0 con 0x7f17b814fbc0 2024-04-23T10:23:53.815 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.818+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f17b8163620 con 0x7f17b814fbc0 2024-04-23T10:23:53.817 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.818+0000 7f17b57fa640 1 -- 172.21.15.26:0/2651384116 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f17ac0567a0 con 0x7f17b814fbc0 2024-04-23T10:23:53.817 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:23:53.817 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:23:53.817 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:23:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 msgr2=0x7f17a406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 0x7f17a406a840 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f17a8001650 tx=0x7f17a8009040 comp rx=0 tx=0).stop 2024-04-23T10:23:53.819 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 msgr2=0x7f17b81503c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x7f17ac00e9b0 tx=0x7f17ac00ee70 comp rx=0 tx=0).stop 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 shutdown_connections 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f17a4068380 0x7f17a406a840 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f17b814ffa0 0x7f17b8152ec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f17b814fbc0 0x7f17b81503c0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 --2- 172.21.15.26:0/2651384116 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f17b8074100 0x7f17b81f46d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 >> 172.21.15.26:0/2651384116 conn(0x7f17b806b9d0 msgr2=0x7f17b814dab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 shutdown_connections 2024-04-23T10:23:53.820 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.822+0000 7f17bec26640 1 -- 172.21.15.26:0/2651384116 wait complete. 2024-04-23T10:23:53.836 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --set-id eb021968 --release --await' 2024-04-23T10:23:53.836 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --set-id eb021968 --release --await 2024-04-23T10:23:53.963 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 Processor -- start 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 -- start start 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd38806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd38814ffa0 0x7fd3880c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd3880c5d70 con 0x7fd388074100 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd3880c6050 con 0x7fd38814ffa0 2024-04-23T10:23:53.964 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd38d3fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd3880c6330 con 0x7fd38814fbc0 2024-04-23T10:23:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3867fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd38814ffa0 0x7fd3880c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.965 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3877fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd388074100 0x7fd3880c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:37160/0 (socket says 172.21.15.26:37160) 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3877fe640 1 -- 172.21.15.26:0/3712160677 learned_addr learned my addr 172.21.15.26:0/3712160677 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd386ffd640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd38806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3867fc640 1 -- 172.21.15.26:0/3712160677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 msgr2=0x7fd38806f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3867fc640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd38806f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3867fc640 1 -- 172.21.15.26:0/3712160677 >> v1:172.21.15.26:6789/0 conn(0x7fd388074100 legacy=0x7fd3880c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd385ffb640 1 -- 172.21.15.26:0/3712160677 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2089432259 0 0) 0x7fd3880c5d70 con 0x7fd388074100 2024-04-23T10:23:53.966 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.966+0000 7fd3867fc640 1 -- 172.21.15.26:0/3712160677 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd3880c6610 con 0x7fd38814ffa0 2024-04-23T10:23:53.967 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd3867fc640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38814ffa0 0x7fd3880c8220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd3780097c0 tx=0x7fd37801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25fdce88dc0e3739 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd385ffb640 1 -- 172.21.15.26:0/3712160677 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780aa620 con 0x7fd38814ffa0 2024-04-23T10:23:53.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd385ffb640 1 -- 172.21.15.26:0/3712160677 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780af070 con 0x7fd38814ffa0 2024-04-23T10:23:53.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd385ffb640 1 -- 172.21.15.26:0/3712160677 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780aa9e0 con 0x7fd38814ffa0 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- 172.21.15.26:0/3712160677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38814ffa0 msgr2=0x7fd3880c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38814ffa0 0x7fd3880c8220 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7fd3780097c0 tx=0x7fd37801c4a0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- 172.21.15.26:0/3712160677 shutdown_connections 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd38814ffa0 0x7fd3880c8220 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/3712160677 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd38806f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- 172.21.15.26:0/3712160677 >> 172.21.15.26:0/3712160677 conn(0x7fd38806b9d0 msgr2=0x7fd38806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- 172.21.15.26:0/3712160677 shutdown_connections 2024-04-23T10:23:53.969 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- 172.21.15.26:0/3712160677 wait complete. 2024-04-23T10:23:53.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 Processor -- start 2024-04-23T10:23:53.970 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.970+0000 7fd38d3fa640 1 -- start start 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd388145450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38814ffa0 0x7fd388149fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd388166420 con 0x7fd388074100 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881662a0 con 0x7fd38814ffa0 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd3881665a0 con 0x7fd38814fbc0 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53634/0 (socket says 172.21.15.26:53634) 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 -- 172.21.15.26:0/2828351522 learned_addr learned my addr 172.21.15.26:0/2828351522 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd3877fe640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38814ffa0 0x7fd388149fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd388145450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 -- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 msgr2=0x7fd388145450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd388145450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 -- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38814ffa0 msgr2=0x7fd388149fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38814ffa0 0x7fd388149fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 -- 172.21.15.26:0/2828351522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd388159cd0 con 0x7fd388074100 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd388145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd37000d800 tx=0x7fd37000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 -- 172.21.15.26:0/2828351522 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37000b6c0 con 0x7fd388074100 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 -- 172.21.15.26:0/2828351522 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370019070 con 0x7fd388074100 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd3881f1ef0 con 0x7fd388074100 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 -- 172.21.15.26:0/2828351522 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37000ba60 con 0x7fd388074100 2024-04-23T10:23:53.973 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd3881f24b0 con 0x7fd388074100 2024-04-23T10:23:53.976 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 -- 172.21.15.26:0/2828351522 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd37000bc00 con 0x7fd388074100 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 0x7fd36806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd37f7fe640 1 -- 172.21.15.26:0/2828351522 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd3700873e0 con 0x7fd388074100 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.974+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 0x7fd36806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 Processor -- start 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- start start 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 0x7fd36806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3780ae000 tx=0x7fd3780a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e920d8a0 0x55e9e91d69c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e9212500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e9e901e660 con 0x55e9e91d6f00 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e9e8fc35d0 con 0x55e9e920d8a0 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e9e901a620 con 0x55e9e9212120 2024-04-23T10:23:53.977 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53644/0 (socket says 172.21.15.26:53644) 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 -- 172.21.15.26:0/2009453676 learned_addr learned my addr 172.21.15.26:0/2009453676 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e920d8a0 0x55e9e91d69c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3877fe640 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e9212500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 -- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 msgr2=0x55e9e9212500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e9212500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 -- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e920d8a0 msgr2=0x55e9e91d69c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e920d8a0 0x55e9e91d69c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 -- 172.21.15.26:0/2009453676 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e8ff7bd0 con 0x55e9e91d6f00 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd37801cd40 tx=0x7fd378004740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9b50069cd8b2852 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd37cff9640 1 -- 172.21.15.26:0/2009453676 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ba070 con 0x55e9e91d6f00 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd37cff9640 1 -- 172.21.15.26:0/2009453676 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd3780af040 con 0x55e9e91d6f00 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd37cff9640 1 -- 172.21.15.26:0/2009453676 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ca880 con 0x55e9e91d6f00 2024-04-23T10:23:53.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- 172.21.15.26:0/2009453676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 msgr2=0x55e9e91d72e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 crypto rx=0x7fd37801cd40 tx=0x7fd378004740 comp rx=0 tx=0).stop 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- 172.21.15.26:0/2009453676 shutdown_connections 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e9212500 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e91d72e0 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 --2- 172.21.15.26:0/2009453676 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e920d8a0 0x55e9e91d69c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- 172.21.15.26:0/2009453676 >> 172.21.15.26:0/2009453676 conn(0x55e9e90b8b00 msgr2=0x55e9e920fee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- 172.21.15.26:0/2009453676 shutdown_connections 2024-04-23T10:23:53.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- 172.21.15.26:0/2009453676 wait complete. 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 -- start start 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.978+0000 7fd39057c000 1 Processor -- start 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e920cb90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e91d1900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e9e90dbd40 con 0x55e9e91d6f00 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e9e8fd8eb0 con 0x55e9e9212120 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e9e90192a0 con 0x55e9e920d8a0 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 10 client.0 _ll_register_callbacks cb 0x55e9e91bca90 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53654/0 (socket says 172.21.15.26:53654) 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 -- 172.21.15.26:0/2301987498 learned_addr learned my addr 172.21.15.26:0/2301987498 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e920cb90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd3877fe640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e91d1900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 -- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 msgr2=0x55e9e920cb90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e920cb90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 -- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 msgr2=0x55e9e91d1900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e91d1900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 -- 172.21.15.26:0/2301987498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e9064b30 con 0x55e9e91d6f00 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd3877fe640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e91d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b4b0 tx=0x7fd370056d50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b165c2c1da16553c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd37005f9c0 con 0x55e9e91d6f00 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd3700533c0 con 0x55e9e91d6f00 2024-04-23T10:23:53.984 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x55e9e8fb8060 con 0x55e9e91d6f00 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd37005f530 con 0x55e9e91d6f00 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 10 client.5637 fetch_fsmap learned FSMap version 19 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e9e8fbdb70 con 0x55e9e91d6f00 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x55e9e8fb8060 con 0x55e9e91d6f00 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fd370013070 con 0x55e9e91d6f00 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 10 client.5637 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 10 client.5637 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 20 client.5637 populate_metadata read hostname 'smithi026' 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e91d26a0 0x55e9e91d2a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 4 client.5637 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x55e9e8ff6e30 con 0x55e9e91d26a0 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e91d26a0 0x55e9e91d2a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e91d26a0 0x55e9e91d2a80 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=e1ab8116fea5cf44 server_cookie=cb8b23f709a32bac in_seq=0 out_seq=0 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 10 client.5637 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:53.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 1 -- 172.21.15.26:0/2301987498 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x55e9e8ff6e30 con 0x55e9e91d26a0 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd365ffb640 10 client.5637 handle_command_reply: tid=0 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.982+0000 7fd39057c000 1 client.5637 shutdown 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 msgr2=0x55e9e920c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7fd37000b4b0 tx=0x7fd370056d50 comp rx=0 tx=0).stop 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 shutdown_connections 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e91d26a0 0x55e9e91d2a80 crc :-1 s=READY pgs=263 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e91d1900 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e920cb90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd365ffb640 0 client.5637 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 --2- 172.21.15.26:0/2301987498 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e920c650 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 >> 172.21.15.26:0/2301987498 conn(0x55e9e90b8b00 msgr2=0x55e9e92119a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 shutdown_connections 2024-04-23T10:23:53.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 1 -- 172.21.15.26:0/2301987498 wait complete. 2024-04-23T10:23:53.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:53.986+0000 7fd39057c000 20 client.5637 trim_cache size 0 max 16384 2024-04-23T10:23:53.999 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 Processor -- start 2024-04-23T10:23:54.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 -- start start 2024-04-23T10:23:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e9283a80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e9283fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd3881ff9d0 con 0x55e9e91d6f00 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd3882000a0 con 0x55e9e9212120 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd3881fe120 con 0x55e9e920d8a0 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53658/0 (socket says 172.21.15.26:53658) 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 -- 172.21.15.26:0/3824987439 learned_addr learned my addr 172.21.15.26:0/3824987439 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd3867fc640 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e9283a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd3877fe640 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e9283fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 -- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 msgr2=0x55e9e9283a80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e9283a80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 -- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 msgr2=0x55e9e9283fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:54.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e9283fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 -- 172.21.15.26:0/3824987439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e9e90a05e0 con 0x55e9e91d6f00 2024-04-23T10:23:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd386ffd640 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd3700073f0 tx=0x7fd37006e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5ed8894438d72330 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd367fff640 1 -- 172.21.15.26:0/3824987439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3700566b0 con 0x55e9e91d6f00 2024-04-23T10:23:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd367fff640 1 -- 172.21.15.26:0/3824987439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370083070 con 0x55e9e91d6f00 2024-04-23T10:23:54.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd367fff640 1 -- 172.21.15.26:0/3824987439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd370052ff0 con 0x55e9e91d6f00 2024-04-23T10:23:54.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 -- 172.21.15.26:0/3824987439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 msgr2=0x55e9e9283540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.002+0000 7fd39057c000 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7fd3700073f0 tx=0x7fd37006e000 comp rx=0 tx=0).stop 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/3824987439 shutdown_connections 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e9212120 0x55e9e9283fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e920d8a0 0x55e9e9283a80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- 172.21.15.26:0/3824987439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e91d6f00 0x55e9e9283540 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/3824987439 >> 172.21.15.26:0/3824987439 conn(0x55e9e90b8b00 msgr2=0x55e9e91d5320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/3824987439 shutdown_connections 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/3824987439 wait complete. 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- start start 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 Processor -- start 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e91d6f00 0x55e9e922de80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e92857e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x55e9e901d970 con 0x55e9e920d8a0 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x55e9e8fd38f0 con 0x55e9e91d6f00 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x55e9e9022c90 con 0x55e9e9212120 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 10 client.0 _ll_register_callbacks cb 0x7fd37000bf30 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53670/0 (socket says 172.21.15.26:53670) 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 -- 172.21.15.26:0/2609469043 learned_addr learned my addr 172.21.15.26:0/2609469043 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e91d6f00 0x55e9e922de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3877fe640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e92857e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 -- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 msgr2=0x55e9e92857e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e92857e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 -- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e91d6f00 msgr2=0x55e9e922de80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e91d6f00 0x55e9e922de80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 -- 172.21.15.26:0/2609469043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e9e8fb0ae0 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd3867fc640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3780aa710 tx=0x7fd3780046d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f003bd3dcaef3641 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd3780ba040 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd3780d1d50 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7fd370083070 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fd3780d1370 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 10 client.5643 fetch_fsmap learned FSMap version 19 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x55e9e8fb3d80 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd370083070 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7fd3780d1510 con 0x55e9e920d8a0 2024-04-23T10:23:54.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 10 client.5643 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 10 client.5643 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 20 client.5643 populate_metadata read hostname 'smithi026' 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e9283e70 0x55e9e9284280 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 4 client.5643 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "set_id": "eb021968", "release": true, "await": true}] 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "set_id": "eb021968", "release": true, "await": true}) -- 0x55e9e8fbc0d0 con 0x55e9e9283e70 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e9283e70 0x55e9e9284280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd386ffd640 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e9283e70 0x55e9e9284280 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=7ad7bb5c673e447d server_cookie=580f3f60c1d855f7 in_seq=0 out_seq=0 2024-04-23T10:23:54.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.006+0000 7fd365ffb640 10 client.5643 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd365ffb640 1 -- 172.21.15.26:0/2609469043 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+589 (crc 0 0 0) 0x55e9e8fbc0d0 con 0x55e9e9283e70 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd365ffb640 10 client.5643 handle_command_reply: tid=0 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 client.5643 shutdown 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 msgr2=0x55e9e92852a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7fd3780aa710 tx=0x7fd3780046d0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.159 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 shutdown_connections 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x55e9e9283e70 0x55e9e9284280 crc :-1 s=READY pgs=264 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x55e9e9212120 0x55e9e92857e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x55e9e920d8a0 0x55e9e92852a0 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 --2- 172.21.15.26:0/2609469043 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x55e9e91d6f00 0x55e9e922de80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 >> 172.21.15.26:0/2609469043 conn(0x55e9e90b8b00 msgr2=0x55e9e922cf20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd365ffb640 0 client.5643 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 shutdown_connections 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 1 -- 172.21.15.26:0/2609469043 wait complete. 2024-04-23T10:23:54.160 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd39057c000 20 client.5643 trim_cache size 0 max 16384 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 36, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": { 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "eb021968": { 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "version": 36, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "age_ref": 0.0, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: }, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "timeout": 60.0, 2024-04-23T10:23:54.161 INFO:teuthology.orchestra.run.smithi026.stdout: "expiration": 93.6, 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "members": { 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "file:/": { 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "excluded": false, 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "state": { 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "name": "RELEASED", 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: "age": 0.0 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout: } 2024-04-23T10:23:54.162 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 msgr2=0x7fd36806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 0x7fd36806a840 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7fd3780ae000 tx=0x7fd3780a7000 comp rx=0 tx=0).stop 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 msgr2=0x7fd3881f5c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7fd37000d800 tx=0x7fd37000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 shutdown_connections 2024-04-23T10:23:54.163 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd368068380 0x7fd36806a840 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd38814ffa0 0x7fd388149fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd38814fbc0 0x7fd388145450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 --2- 172.21.15.26:0/2828351522 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd388074100 0x7fd3881f5c10 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 >> 172.21.15.26:0/2828351522 conn(0x7fd38806b9d0 msgr2=0x7fd388071030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 shutdown_connections 2024-04-23T10:23:54.164 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:23:54.162+0000 7fd38d3fa640 1 -- 172.21.15.26:0/2828351522 wait complete. 2024-04-23T10:23:54.187 INFO:tasks.quiescer.fs.[cephfs]:Successfully released set 'eb021968', seconds elapsed: 35.7 2024-04-23T10:24:07.980 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:07.982 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:27.732 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-04-23T10:24:27.732 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-23T10:24:28.225 DEBUG:teuthology.parallel:result is None 2024-04-23T10:24:28.225 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:24:28.726 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-23T10:24:28.727 DEBUG:teuthology.run_tasks:Unwinding manager quiescer 2024-04-23T10:24:28.736 INFO:tasks.quiescer:joining Quiescers 2024-04-23T10:24:28.736 WARNING:tasks.quiescer:The quiescer is requested to stop, running cancel all 2024-04-23T10:24:28.736 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:24:28.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 Processor -- start 2024-04-23T10:24:28.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 -- start start 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fe4d014ffa0 0x7fe4d006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4d00c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe4d00c5d70 con 0x7fe4d014fbc0 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fe4d00c6050 con 0x7fe4d014ffa0 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.873+0000 7fe4d686d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d00c6330 con 0x7fe4d0074100 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cffff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe4d014fbc0 0x7fe4d00c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50238/0 (socket says 172.21.15.26:50238) 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cffff640 1 -- 172.21.15.26:0/4284767405 learned_addr learned my addr 172.21.15.26:0/4284767405 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:28.876 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4d00c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1605232534 0 0) 0x7fe4d00c5d70 con 0x7fe4d014fbc0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe4b8003530 con 0x7fe4d014fbc0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/4284767405 >> v2:172.21.15.190:3300/0 conn(0x7fe4d014ffa0 0x7fe4d006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 140906930 0 0) 0x7fe4b8003530 con 0x7fe4d014fbc0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 msgr2=0x7fe4d00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4d00c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 >> v2:172.21.15.190:3300/0 conn(0x7fe4d014ffa0 msgr2=0x7fe4d006f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 --2- 172.21.15.26:0/4284767405 >> v2:172.21.15.190:3300/0 conn(0x7fe4d014ffa0 0x7fe4d006f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d00c6610 con 0x7fe4d014fbc0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fe4c0001680 con 0x7fe4d014fbc0 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4d00c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 >> v1:172.21.15.26:6789/0 conn(0x7fe4d014fbc0 legacy=0x7fe4d00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4b80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b8003fb0 0x7fe4b8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b8004d50 0x7fe4b80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00c6050 con 0x7fe4b8003fb0 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00c6330 con 0x7fe4b8004d50 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe4b800bab0 con 0x7fe4d0074100 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b8003fb0 0x7fe4b8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cffff640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4b80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b8004d50 0x7fe4b80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 -- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 msgr2=0x7fe4b80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4d0074100 0x7fe4b80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 -- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b8004d50 msgr2=0x7fe4b80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b8004d50 0x7fe4b80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 -- 172.21.15.26:0/4284767405 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4b8003530 con 0x7fe4b8003fb0 2024-04-23T10:24:28.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4b8004d50 0x7fe4b80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:28.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b8003fb0 0x7fe4b8004810 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400ba30 tx=0x7fe4c401c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a5c3fac13413179 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c400b600 con 0x7fe4b8003fb0 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c40b1070 con 0x7fe4b8003fb0 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.877+0000 7fe4ceffd640 1 -- 172.21.15.26:0/4284767405 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c40ac8c0 con 0x7fe4b8003fb0 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/4284767405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b8003fb0 msgr2=0x7fe4b8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 --2- 172.21.15.26:0/4284767405 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4b8003fb0 0x7fe4b8004810 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7fe4c400ba30 tx=0x7fe4c401c6e0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 -- 172.21.15.26:0/4284767405 reap_dead start 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/4284767405 shutdown_connections 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/4284767405 >> 172.21.15.26:0/4284767405 conn(0x7fe4d006b9d0 msgr2=0x7fe4d006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/4284767405 shutdown_connections 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/4284767405 wait complete. 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 Processor -- start 2024-04-23T10:24:28.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- start start 2024-04-23T10:24:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b8003fb0 0x7fe4d0152f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4d0159730 0x7fe4d00cbbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d0068350 con 0x7fe4d015a770 2024-04-23T10:24:28.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe4d00681d0 con 0x7fe4d0159730 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe4d00c8930 con 0x7fe4b8003fb0 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42596/0 (socket says 172.21.15.26:42596) 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 -- 172.21.15.26:0/1065401578 learned_addr learned my addr 172.21.15.26:0/1065401578 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4cf7fe640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4d0159730 0x7fe4d00cbbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4cffff640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b8003fb0 0x7fe4d0152f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 -- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b8003fb0 msgr2=0x7fe4d0152f10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b8003fb0 0x7fe4d0152f10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 -- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4d0159730 msgr2=0x7fe4d00cbbb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4d0159730 0x7fe4d00cbbb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 -- 172.21.15.26:0/1065401578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe4d015b130 con 0x7fe4d015a770 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d4e0a640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe4d015a080 tx=0x7fe4c800f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c800fdd0 con 0x7fe4d015a770 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4c801a070 con 0x7fe4d015a770 2024-04-23T10:24:28.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe4d01589a0 con 0x7fe4d015a770 2024-04-23T10:24:28.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe4c8014630 con 0x7fe4d015a770 2024-04-23T10:24:28.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.881+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe4d0158f60 con 0x7fe4d015a770 2024-04-23T10:24:28.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe4d0075df0 con 0x7fe4d015a770 2024-04-23T10:24:28.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe4c80147d0 con 0x7fe4d015a770 2024-04-23T10:24:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4ccff9640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 0x7fe4bc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe4c80872d0 con 0x7fe4d015a770 2024-04-23T10:24:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4cffff640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 0x7fe4bc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:28.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.885+0000 7fe4cffff640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 0x7fe4bc06a870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c10 tx=0x7fe4c0009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:28.888 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:28.889+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe4d015b130 con 0x7fe4d015a770 2024-04-23T10:24:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.173+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7fe4d00c7df0 con 0x7fe4d015a770 2024-04-23T10:24:29.172 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.173+0000 7fe4ccff9640 1 -- 172.21.15.26:0/1065401578 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7fe4c8056d80 con 0x7fe4d015a770 2024-04-23T10:24:29.173 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:29.173 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:24:29.173 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 msgr2=0x7fe4bc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 0x7fe4bc06a870 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe4c0000c10 tx=0x7fe4c0009040 comp rx=0 tx=0).stop 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 msgr2=0x7fe4d015abf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7fe4d015a080 tx=0x7fe4c800f520 comp rx=0 tx=0).stop 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 shutdown_connections 2024-04-23T10:24:29.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe4bc0683b0 0x7fe4bc06a870 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe4d015a770 0x7fe4d015abf0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe4d0159730 0x7fe4d00cbbb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 --2- 172.21.15.26:0/1065401578 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe4b8003fb0 0x7fe4d0152f10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 >> 172.21.15.26:0/1065401578 conn(0x7fe4d006b9d0 msgr2=0x7fe4d0072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 shutdown_connections 2024-04-23T10:24:29.176 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.177+0000 7fe4d686d640 1 -- 172.21.15.26:0/1065401578 wait complete. 2024-04-23T10:24:29.192 DEBUG:tasks.quiescer.fs.[cephfs]:Running ceph command: 'tell mds.4287 quiesce db --cancel --all' 2024-04-23T10:24:29.192 DEBUG:teuthology.orchestra.run.smithi026:> timeout 75 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell mds.4287 quiesce db --cancel --all 2024-04-23T10:24:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 Processor -- start 2024-04-23T10:24:29.315 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 -- start start 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4b040c4f50 0x7f4b040c5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0415ba00 con 0x7f4b041525d0 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4b0415bce0 con 0x7f4b041521f0 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b0a3f7640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4b040c4240 con 0x7f4b040c4f50 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b037fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4b041525d0 0x7f4b04158760 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50246/0 (socket says 172.21.15.26:50246) 2024-04-23T10:24:29.316 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657683639 learned_addr learned my addr 172.21.15.26:0/2657683639 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b08994640 1 --2- 172.21.15.26:0/2657683639 >> v2:172.21.15.190:3300/0 conn(0x7f4b040c4f50 0x7f4b040c5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1517733236 0 0) 0x7f4b0415ba00 con 0x7f4b041525d0 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4aec003530 con 0x7f4b041525d0 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 39179114 0 0) 0x7f4aec003530 con 0x7f4b041525d0 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 >> v2:172.21.15.190:3300/0 conn(0x7f4b040c4f50 msgr2=0x7f4b040c5360 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 --2- 172.21.15.26:0/2657683639 >> v2:172.21.15.190:3300/0 conn(0x7f4b040c4f50 0x7f4b040c5360 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 >> v1:172.21.15.190:6789/0 conn(0x7f4b041521f0 legacy=0x7f4b040c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b0415bfc0 con 0x7f4b041525d0 2024-04-23T10:24:29.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4af8001680 con 0x7f4b041525d0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 >> v1:172.21.15.26:6789/0 conn(0x7f4b041525d0 legacy=0x7f4b04158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4aec0039c0 0x7f4aec003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 0x7f4aec004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec0051d0 0x7f4aec00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b040c4240 con 0x7f4aec004810 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4aec00c070 con 0x7f4aec0039c0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4aec00c270 con 0x7f4aec0051d0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 0x7f4aec004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4aec0039c0 0x7f4aec003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.317+0000 7f4b08994640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec0051d0 0x7f4aec00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec0051d0 msgr2=0x7f4aec00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec0051d0 0x7f4aec00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4aec0039c0 msgr2=0x7f4aec003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4aec0039c0 0x7f4aec003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b08994640 1 -- 172.21.15.26:0/2657683639 reap_dead start 2024-04-23T10:24:29.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657683639 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4aec003530 con 0x7f4aec004810 2024-04-23T10:24:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 0x7f4aec004c90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c240 tx=0x7f4af801f370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=567549bc82a42545 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007d20 con 0x7f4aec004810 2024-04-23T10:24:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8005ae0 con 0x7f4aec004810 2024-04-23T10:24:29.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b02ffd640 1 -- 172.21.15.26:0/2657683639 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007070 con 0x7f4aec004810 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 msgr2=0x7f4aec004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 0x7f4aec004c90 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f4af800c240 tx=0x7f4af801f370 comp rx=0 tx=0).stop 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2657683639 shutdown_connections 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2657683639 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4aec004810 0x7f4aec004c90 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2657683639 >> 172.21.15.26:0/2657683639 conn(0x7f4b040c9130 msgr2=0x7f4b040c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2657683639 shutdown_connections 2024-04-23T10:24:29.322 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.321+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2657683639 wait complete. 2024-04-23T10:24:29.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 Processor -- start 2024-04-23T10:24:29.323 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- start start 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec004810 0x7f4b041508b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b041e3900 0x7f4b0414bf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b0406cc50 con 0x7f4b041f0160 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4b04158240 con 0x7f4b041e3900 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4b0406cdd0 con 0x7f4aec004810 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42614/0 (socket says 172.21.15.26:42614) 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 -- 172.21.15.26:0/2254484439 learned_addr learned my addr 172.21.15.26:0/2254484439 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.325 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec004810 0x7f4b041508b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b041e3900 0x7f4b0414bf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 -- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec004810 msgr2=0x7f4b041508b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec004810 0x7f4b041508b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 -- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b041e3900 msgr2=0x7f4b0414bf00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b041e3900 0x7f4b0414bf00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 -- 172.21.15.26:0/2254484439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4b041f0b20 con 0x7f4b041f0160 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b08994640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4b040c04c0 tx=0x7f4afc00f1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b00ff9640 1 -- 172.21.15.26:0/2254484439 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc00fce0 con 0x7f4b041f0160 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b00ff9640 1 -- 172.21.15.26:0/2254484439 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc01d070 con 0x7f4b041f0160 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4b040cb6f0 con 0x7f4b041f0160 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b00ff9640 1 -- 172.21.15.26:0/2254484439 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc015670 con 0x7f4b041f0160 2024-04-23T10:24:29.326 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.325+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4b040cb990 con 0x7f4b041f0160 2024-04-23T10:24:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b00ff9640 1 -- 172.21.15.26:0/2254484439 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4afc015810 con 0x7f4b041f0160 2024-04-23T10:24:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b00ff9640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 0x7f4af006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b00ff9640 1 -- 172.21.15.26:0/2254484439 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4afc087760 con 0x7f4b041f0160 2024-04-23T10:24:29.327 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 0x7f4af006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 Processor -- start 2024-04-23T10:24:29.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 -- start start 2024-04-23T10:24:29.328 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 0x7f4af006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000c10 tx=0x7f4af4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42fa570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42faab0 0x5646a42ff460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5646a41a5b30 con 0x5646a42ff9a0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5646a410c2c0 con 0x5646a42faab0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5646a40c54c0 con 0x5646a42fa190 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42622/0 (socket says 172.21.15.26:42622) 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 -- 172.21.15.26:0/1739707895 learned_addr learned my addr 172.21.15.26:0/1739707895 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b03fff640 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42fa570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b037fe640 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42faab0 0x5646a42ff460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 -- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 msgr2=0x5646a42fa570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.330 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42fa570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 -- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42faab0 msgr2=0x5646a42ff460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42faab0 0x5646a42ff460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 -- 172.21.15.26:0/1739707895 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a4106eb0 con 0x5646a42ff9a0 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.329+0000 7f4b08994640 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4afc085810 tx=0x7f4afc00ffc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f628f2de9c21de73 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae9ffb640 1 -- 172.21.15.26:0/1739707895 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc05b520 con 0x5646a42ff9a0 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae9ffb640 1 -- 172.21.15.26:0/1739707895 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc05fde0 con 0x5646a42ff9a0 2024-04-23T10:24:29.331 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae9ffb640 1 -- 172.21.15.26:0/1739707895 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4afc0537e0 con 0x5646a42ff9a0 2024-04-23T10:24:29.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/1739707895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 msgr2=0x5646a42ffd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f4afc085810 tx=0x7f4afc00ffc0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/1739707895 shutdown_connections 2024-04-23T10:24:29.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42ff9a0 0x5646a42ffd80 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42faab0 0x5646a42ff460 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1739707895 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42fa570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/1739707895 >> 172.21.15.26:0/1739707895 conn(0x5646a42fb210 msgr2=0x5646a42fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/1739707895 shutdown_connections 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/1739707895 wait complete. 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- start start 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 Processor -- start 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42fa190 0x5646a42f9570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42ff9a0 0x5646a4304f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5646a4108280 con 0x5646a42faab0 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5646a40ca9d0 con 0x5646a42fa190 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5646a40b11b0 con 0x5646a42ff9a0 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 10 client.0 _ll_register_callbacks cb 0x5646a41c0700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42628/0 (socket says 172.21.15.26:42628) 2024-04-23T10:24:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657469754 learned_addr learned my addr 172.21.15.26:0/2657469754 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42fa190 0x5646a42f9570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b08994640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42ff9a0 0x5646a4304f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42ff9a0 msgr2=0x5646a4304f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42ff9a0 0x5646a4304f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42fa190 msgr2=0x5646a42f9570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42fa190 0x5646a42f9570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 -- 172.21.15.26:0/2657469754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a408fe70 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b037fe640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4af801f1a0 tx=0x7f4af801dbb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8fd31f379c02cb9d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8001480 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4afc05fde0 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4af8001620 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4af80047f0 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 10 client.5661 fetch_fsmap learned FSMap version 19 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5646a40c5710 con 0x5646a42faab0 2024-04-23T10:24:29.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4afc05fde0 con 0x5646a42faab0 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4af8004990 con 0x5646a42faab0 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 10 client.5661 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 10 client.5661 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 20 client.5661 populate_metadata read hostname 'smithi026' 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a4305cb0 0x5646a4306090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 4 client.5661 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "get_command_descriptions"}] 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.333+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "get_command_descriptions"}) -- 0x5646a40a5df0 con 0x5646a4305cb0 2024-04-23T10:24:29.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a4305cb0 0x5646a4306090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b03fff640 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a4305cb0 0x5646a4306090 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=3df7e13fc1ef368 server_cookie=55d20b294a6ed520 in_seq=0 out_seq=0 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4ae2ffd640 10 client.5661 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/2657469754 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+23246 (crc 0 0 0) 0x5646a40a5df0 con 0x5646a4305cb0 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4ae2ffd640 10 client.5661 handle_command_reply: tid=0 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 client.5661 shutdown 2024-04-23T10:24:29.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 msgr2=0x5646a42f9ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f4af801f1a0 tx=0x7f4af801dbb0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 shutdown_connections 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a4305cb0 0x5646a4306090 crc :-1 s=READY pgs=290 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42ff9a0 0x5646a4304f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42faab0 0x5646a42f9ab0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4ae2ffd640 0 client.5661 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 --2- 172.21.15.26:0/2657469754 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a42fa190 0x5646a42f9570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 >> 172.21.15.26:0/2657469754 conn(0x5646a42fb210 msgr2=0x5646a42fd600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 shutdown_connections 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 1 -- 172.21.15.26:0/2657469754 wait complete. 2024-04-23T10:24:29.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.337+0000 7f4b0d579000 20 client.5661 trim_cache size 0 max 16384 2024-04-23T10:24:29.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 Processor -- start 2024-04-23T10:24:29.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- start start 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a43070a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42ba8f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4b041faab0 con 0x5646a42fb210 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4b041fb180 con 0x5646a4304b30 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4b040cb020 con 0x5646a42fa190 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42640/0 (socket says 172.21.15.26:42640) 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 -- 172.21.15.26:0/1299314665 learned_addr learned my addr 172.21.15.26:0/1299314665 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b03fff640 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a43070a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b08994640 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42ba8f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 -- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 msgr2=0x5646a42ba8f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42ba8f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 -- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 msgr2=0x5646a43070a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a43070a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 -- 172.21.15.26:0/1299314665 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5646a418e9f0 con 0x5646a42fb210 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b037fe640 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4af801fc10 tx=0x7f4af8007000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f468869fa31e5571 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4ae97fa640 1 -- 172.21.15.26:0/1299314665 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8001480 con 0x5646a42fb210 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4ae97fa640 1 -- 172.21.15.26:0/1299314665 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8001620 con 0x5646a42fb210 2024-04-23T10:24:29.357 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4ae97fa640 1 -- 172.21.15.26:0/1299314665 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8007270 con 0x5646a42fb210 2024-04-23T10:24:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- 172.21.15.26:0/1299314665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 msgr2=0x5646a43075e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f4af801fc10 tx=0x7f4af8007000 comp rx=0 tx=0).stop 2024-04-23T10:24:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- 172.21.15.26:0/1299314665 shutdown_connections 2024-04-23T10:24:29.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a42ba8f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43075e0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 --2- 172.21.15.26:0/1299314665 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a43070a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- 172.21.15.26:0/1299314665 >> 172.21.15.26:0/1299314665 conn(0x5646a431b040 msgr2=0x5646a42c2e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- 172.21.15.26:0/1299314665 shutdown_connections 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- 172.21.15.26:0/1299314665 wait complete. 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 -- start start 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.357+0000 7f4b0d579000 1 Processor -- start 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a43780b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a4338020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x5646a410b5d0 con 0x5646a42fb210 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x5646a40ac3d0 con 0x5646a4304b30 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x5646a41108f0 con 0x5646a42fa190 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 10 client.0 _ll_register_callbacks cb 0x7f4aec003700 invalidate_ino_cb 0 invalidate_dentry_cb 0 switch_interrupt_cb 0 remount_cb 0 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42650/0 (socket says 172.21.15.26:42650) 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 -- 172.21.15.26:0/3272772477 learned_addr learned my addr 172.21.15.26:0/3272772477 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b03fff640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a43780b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b08994640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a4338020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 -- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 msgr2=0x5646a43780b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a43780b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 -- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 msgr2=0x5646a4338020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a4338020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 -- 172.21.15.26:0/3272772477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5646a40d6d90 con 0x5646a42fb210 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b03fff640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a43780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b08994640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a4338020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b037fe640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009010 tx=0x7f4af8007900 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ddb3a6fc0464acbe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 10 client.0 ms_handle_connect on v2:172.21.15.26:3300/0 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4af8001480 con 0x5646a42fb210 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=fsmap handle=1) -- 0x7f4af8001620 con 0x5646a42fb210 2024-04-23T10:24:29.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mon.0 v2:172.21.15.26:3300/0 2 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f4af80075b0 con 0x5646a42fb210 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f4af80d2480 con 0x5646a42fb210 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 10 client.5667 fetch_fsmap learned FSMap version 19 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,fsmap=19,monmap=2+}) -- 0x5646a40b13a0 con 0x5646a42fb210 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mon.0 v2:172.21.15.26:3300/0 4 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4af8001620 con 0x5646a42fb210 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mon.0 v2:172.21.15.26:3300/0 5 ==== fsmap(e 19) ==== 4792+0+0 (secure 0 0 0) 0x7f4af80da030 con 0x5646a42fb210 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 10 client.5667 fetch_fsmap finished waiting for FSMap version 19 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 10 client.5667 resolve_mds: validated gid 4287 aka daemon mds.f 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 20 client.5667 populate_metadata read hostname 'smithi026' 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a42faab0 0x5646a4338560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 4 client.5667 mds_command: new command op to 4287 tid=0 multi_id=0 [{"prefix": "quiesce db", "cancel": true, "all": true}] 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 --> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] -- command(tid 0: {"prefix": "quiesce db", "cancel": true, "all": true}) -- 0x5646a4119ce0 con 0x5646a42faab0 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b03fff640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a42faab0 0x5646a4338560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b03fff640 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a42faab0 0x5646a4338560 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=mds.0 client_cookie=d09b69f8d42a7372 server_cookie=59b22ff51c0de012 in_seq=0 out_seq=0 2024-04-23T10:24:29.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 10 client.5667 ms_handle_connect on v2:172.21.15.190:6834/585421961 2024-04-23T10:24:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 1 -- 172.21.15.26:0/3272772477 <== mds.0 v2:172.21.15.190:6834/585421961 1 ==== command_reply(tid 0: 0 ) ==== 8+0+79 (crc 0 0 0) 0x5646a4119ce0 con 0x5646a42faab0 2024-04-23T10:24:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 10 client.5667 handle_command_reply: tid=0 2024-04-23T10:24:29.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 client.5667 shutdown 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 msgr2=0x5646a43785f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f4af8009010 tx=0x7f4af8007900 comp rx=0 tx=0).stop 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 shutdown_connections 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:6834/585421961,v1:172.21.15.190:6838/585421961] conn(0x5646a42faab0 0x5646a4338560 crc :-1 s=READY pgs=291 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x5646a4304b30 0x5646a4338020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x5646a42fb210 0x5646a43785f0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 --2- 172.21.15.26:0/3272772477 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x5646a42fa190 0x5646a43780b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4ae2ffd640 0 client.5667 ms_handle_reset on v2:172.21.15.190:6834/585421961 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 >> 172.21.15.26:0/3272772477 conn(0x5646a431b040 msgr2=0x5646a4306920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 shutdown_connections 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 1 -- 172.21.15.26:0/3272772477 wait complete. 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0d579000 20 client.5667 trim_cache size 0 max 16384 2024-04-23T10:24:29.365 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "epoch": 19, 2024-04-23T10:24:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "leader": 4287, 2024-04-23T10:24:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "set_version": 36, 2024-04-23T10:24:29.366 INFO:teuthology.orchestra.run.smithi026.stdout: "sets": {} 2024-04-23T10:24:29.366 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 msgr2=0x7f4af006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 0x7f4af006a840 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7f4af4000c10 tx=0x7f4af4009040 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 msgr2=0x7f4b041f05e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.361+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f4b040c04c0 tx=0x7f4afc00f1b0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 shutdown_connections 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4af0068380 0x7f4af006a840 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4b041f0160 0x7f4b041f05e0 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4b041e3900 0x7f4b0414bf00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 --2- 172.21.15.26:0/2254484439 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4aec004810 0x7f4b041508b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 >> 172.21.15.26:0/2254484439 conn(0x7f4b040c9130 msgr2=0x7f4b040c1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 shutdown_connections 2024-04-23T10:24:29.367 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.365+0000 7f4b0a3f7640 1 -- 172.21.15.26:0/2254484439 wait complete. 2024-04-23T10:24:29.379 INFO:tasks.quiescer:done joining Quiescers 2024-04-23T10:24:29.379 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-04-23T10:24:29.390 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-04-23T10:24:29.390 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:24:29.390 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:24:29.395 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:24:29.395 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:24:29.442 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:29.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 Processor -- start 2024-04-23T10:24:29.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 -- start start 2024-04-23T10:24:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd2e8074100 0x7fd2e806f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e80c5d70 con 0x7fd2e814fbc0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd2e80c6050 con 0x7fd2e814ffa0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ee410640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd2e80c6330 con 0x7fd2e8074100 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd2e814fbc0 0x7fd2e80c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50252/0 (socket says 172.21.15.26:50252) 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e7fff640 1 -- 172.21.15.26:0/2671037099 learned_addr learned my addr 172.21.15.26:0/2671037099 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ec9ad640 1 --2- 172.21.15.26:0/2671037099 >> v2:172.21.15.190:3300/0 conn(0x7fd2e8074100 0x7fd2e806f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1169358185 0 0) 0x7fd2e80c5d70 con 0x7fd2e814fbc0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2d0003530 con 0x7fd2e814fbc0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.1 v1:172.21.15.190:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2418195370 0 0) 0x7fd2e80c6050 con 0x7fd2e814ffa0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 --> v1:172.21.15.190:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd2e80c5d70 con 0x7fd2e814ffa0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1781241153 0 0) 0x7fd2d0003530 con 0x7fd2e814fbc0 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ec9ad640 1 -- 172.21.15.26:0/2671037099 >> v1:172.21.15.190:6789/0 conn(0x7fd2e814ffa0 legacy=0x7fd2e80c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ec9ad640 1 -- 172.21.15.26:0/2671037099 >> v1:172.21.15.26:6789/0 conn(0x7fd2e814fbc0 legacy=0x7fd2e80c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.605+0000 7fd2ec9ad640 1 -- 172.21.15.26:0/2671037099 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e80c6610 con 0x7fd2e8074100 2024-04-23T10:24:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ec9ad640 1 --2- 172.21.15.26:0/2671037099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e8074100 0x7fd2e806f700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009dc0 tx=0x7fd2e001c870 comp rx=0 tx=0).ready entity=mon.1 client_cookie=3c7d615d2511bee0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2e00b2070 con 0x7fd2e8074100 2024-04-23T10:24:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2e00a5710 con 0x7fd2e8074100 2024-04-23T10:24:29.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2e6ffd640 1 -- 172.21.15.26:0/2671037099 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8001680 con 0x7fd2e8074100 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- 172.21.15.26:0/2671037099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e8074100 msgr2=0x7fd2e806f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 --2- 172.21.15.26:0/2671037099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e8074100 0x7fd2e806f700 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7fd2e0009dc0 tx=0x7fd2e001c870 comp rx=0 tx=0).stop 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- 172.21.15.26:0/2671037099 shutdown_connections 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 --2- 172.21.15.26:0/2671037099 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e8074100 0x7fd2e806f700 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- 172.21.15.26:0/2671037099 >> 172.21.15.26:0/2671037099 conn(0x7fd2e806b9d0 msgr2=0x7fd2e806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- 172.21.15.26:0/2671037099 shutdown_connections 2024-04-23T10:24:29.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- 172.21.15.26:0/2671037099 wait complete. 2024-04-23T10:24:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 Processor -- start 2024-04-23T10:24:29.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.609+0000 7fd2ee410640 1 -- start start 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 0x7fd2e81f57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e814ffa0 0x7fd2e81f5cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e8167630 con 0x7fd2e8074100 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd2e81674b0 con 0x7fd2e814ffa0 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd2e81677b0 con 0x7fd2e814fbc0 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42666/0 (socket says 172.21.15.26:42666) 2024-04-23T10:24:29.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 -- 172.21.15.26:0/3115358899 learned_addr learned my addr 172.21.15.26:0/3115358899 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ec9ad640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e814ffa0 0x7fd2e81f5cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e77fe640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 0x7fd2e81f57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 -- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 msgr2=0x7fd2e81f57b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 0x7fd2e81f57b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 -- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e814ffa0 msgr2=0x7fd2e81f5cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e814ffa0 0x7fd2e81f5cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 -- 172.21.15.26:0/3115358899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd2e806be50 con 0x7fd2e8074100 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e77fe640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 0x7fd2e81f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e7fff640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c7b0 tx=0x7fd2d800cc70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d8017070 con 0x7fd2e8074100 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd2d8005d10 con 0x7fd2e8074100 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd2d800ce60 con 0x7fd2e8074100 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd2e80cbf10 con 0x7fd2e8074100 2024-04-23T10:24:29.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd2e8160ed0 con 0x7fd2e8074100 2024-04-23T10:24:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd2e8075df0 con 0x7fd2e8074100 2024-04-23T10:24:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd2d801a070 con 0x7fd2e8074100 2024-04-23T10:24:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 0x7fd2d406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd2d8086380 con 0x7fd2e8074100 2024-04-23T10:24:29.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e77fe640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 0x7fd2d406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.613+0000 7fd2e77fe640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 0x7fd2d406a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e81f6870 tx=0x7fd2dc009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.617 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.617+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd2d80565b0 con 0x7fd2e8074100 2024-04-23T10:24:29.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.785+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fd2e81f63c0 con 0x7fd2e8074100 2024-04-23T10:24:29.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.785+0000 7fd2e4ff9640 1 -- 172.21.15.26:0/3115358899 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7fd2d8055eb0 con 0x7fd2e8074100 2024-04-23T10:24:29.784 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:29.784 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 msgr2=0x7fd2d406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 0x7fd2d406a870 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x7fd2e81f6870 tx=0x7fd2dc009040 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 msgr2=0x7fd2e8160990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fd2d800c7b0 tx=0x7fd2d800cc70 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 shutdown_connections 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd2d40683b0 0x7fd2d406a870 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd2e814ffa0 0x7fd2e81f5cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd2e814fbc0 0x7fd2e81f57b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 --2- 172.21.15.26:0/3115358899 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd2e8074100 0x7fd2e8160990 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 >> 172.21.15.26:0/3115358899 conn(0x7fd2e806b9d0 msgr2=0x7fd2e814c020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 shutdown_connections 2024-04-23T10:24:29.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.789+0000 7fd2ee410640 1 -- 172.21.15.26:0/3115358899 wait complete. 2024-04-23T10:24:29.805 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:24:29.805 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:24:29.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.933+0000 7f2f7a0ae640 1 Processor -- start 2024-04-23T10:24:29.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.933+0000 7f2f7a0ae640 1 -- start start 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f7a0ae640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f7414ffa0 0x7f2f7406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f7a0ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f74074100 0x7f2f740c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f7a0ae640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2f740c5d70 con 0x7f2f7414fbc0 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f7a0ae640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f2f740c6050 con 0x7f2f7414ffa0 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f7a0ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2f740c6330 con 0x7f2f74074100 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f6affd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f2f7414ffa0 0x7f2f7406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f737fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f2f7414fbc0 0x7f2f740c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50268/0 (socket says 172.21.15.26:50268) 2024-04-23T10:24:29.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f737fe640 1 -- 172.21.15.26:0/682893140 learned_addr learned my addr 172.21.15.26:0/682893140 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f72ffd640 1 -- 172.21.15.26:0/682893140 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1203619586 0 0) 0x7f2f740c5d70 con 0x7f2f7414fbc0 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f72ffd640 1 -- 172.21.15.26:0/682893140 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2f60003530 con 0x7f2f7414fbc0 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f6affd640 1 -- 172.21.15.26:0/682893140 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f74074100 msgr2=0x7f2f740c7250 unknown :-1 s=STATE_CONNECTING_RE l=0).mark_down 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f6affd640 1 --2- 172.21.15.26:0/682893140 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f74074100 0x7f2f740c7250 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f6affd640 1 -- 172.21.15.26:0/682893140 >> v1:172.21.15.26:6789/0 conn(0x7f2f7414fbc0 legacy=0x7f2f740c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.937+0000 7f2f6affd640 1 -- 172.21.15.26:0/682893140 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f740c6610 con 0x7f2f7414ffa0 2024-04-23T10:24:29.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f6affd640 1 --2- 172.21.15.26:0/682893140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7414ffa0 0x7f2f7406f700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0097c0 tx=0x7f2f5c01c4c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5876676a2980c9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f72ffd640 1 -- 172.21.15.26:0/682893140 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0a6040 con 0x7f2f7414ffa0 2024-04-23T10:24:29.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f72ffd640 1 -- 172.21.15.26:0/682893140 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f5c0af070 con 0x7f2f7414ffa0 2024-04-23T10:24:29.938 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f72ffd640 1 -- 172.21.15.26:0/682893140 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f5c0aa860 con 0x7f2f7414ffa0 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/682893140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7414ffa0 msgr2=0x7f2f7406f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/682893140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7414ffa0 0x7f2f7406f700 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0097c0 tx=0x7f2f5c01c4c0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/682893140 shutdown_connections 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/682893140 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f74074100 0x7f2f740c7250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/682893140 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f7414ffa0 0x7f2f7406f700 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/682893140 >> 172.21.15.26:0/682893140 conn(0x7f2f7406b9d0 msgr2=0x7f2f7406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/682893140 shutdown_connections 2024-04-23T10:24:29.939 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/682893140 wait complete. 2024-04-23T10:24:29.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 Processor -- start 2024-04-23T10:24:29.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.941+0000 7f2f7a0ae640 1 -- start start 2024-04-23T10:24:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7414fbc0 0x7f2f7415af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f7414ffa0 0x7f2f7415b4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740c8ab0 con 0x7f2f74074100 2024-04-23T10:24:29.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f2f740c8930 con 0x7f2f7414fbc0 2024-04-23T10:24:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f2f74166090 con 0x7f2f7414ffa0 2024-04-23T10:24:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42686/0 (socket says 172.21.15.26:42686) 2024-04-23T10:24:29.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 -- 172.21.15.26:0/540325669 learned_addr learned my addr 172.21.15.26:0/540325669 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 -- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f7414ffa0 msgr2=0x7f2f7415b4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f7414ffa0 0x7f2f7415b4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 -- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7414fbc0 msgr2=0x7f2f7415af80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7414fbc0 0x7f2f7415af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 -- 172.21.15.26:0/540325669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2f7415d0b0 con 0x7f2f74074100 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f737fe640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c480 tx=0x7f2f6400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64017070 con 0x7f2f74074100 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2f64005cf0 con 0x7f2f74074100 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f2f7415a1c0 con 0x7f2f74074100 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f2f64007290 con 0x7f2f74074100 2024-04-23T10:24:29.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f2f7415a780 con 0x7f2f74074100 2024-04-23T10:24:29.945 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2f580052a0 con 0x7f2f74074100 2024-04-23T10:24:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f2f6401a070 con 0x7f2f74074100 2024-04-23T10:24:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.945+0000 7f2f70ff9640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 0x7f2f5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:29.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.949+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f2f640861e0 con 0x7f2f74074100 2024-04-23T10:24:29.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.949+0000 7f2f6affd640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 0x7f2f5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:29.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.949+0000 7f2f6affd640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 0x7f2f5406a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0ae000 tx=0x7f2f5c004740 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:29.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:29.953+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f2f64056370 con 0x7f2f74074100 2024-04-23T10:24:30.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.149+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7f2f58005da0 con 0x7f2f74074100 2024-04-23T10:24:30.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.149+0000 7f2f70ff9640 1 -- 172.21.15.26:0/540325669 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7f2f6405c030 con 0x7f2f74074100 2024-04-23T10:24:30.148 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 msgr2=0x7f2f5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 0x7f2f5406a870 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7f2f5c0ae000 tx=0x7f2f5c004740 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 msgr2=0x7f2f7415ca90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7f2f6400c480 tx=0x7f2f6400c940 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 shutdown_connections 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f2f540683b0 0x7f2f5406a870 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f2f7414ffa0 0x7f2f7415b4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f2f7414fbc0 0x7f2f7415af80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 --2- 172.21.15.26:0/540325669 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f2f74074100 0x7f2f7415ca90 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.151 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 >> 172.21.15.26:0/540325669 conn(0x7f2f7406b9d0 msgr2=0x7f2f740cb5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 shutdown_connections 2024-04-23T10:24:30.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.153+0000 7f2f7a0ae640 1 -- 172.21.15.26:0/540325669 wait complete. 2024-04-23T10:24:30.166 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:24:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 Processor -- start 2024-04-23T10:24:30.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 -- start start 2024-04-23T10:24:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3230152e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.293 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f32300ca950 con 0x7f32300676a0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3230158fc0 con 0x7f323006dce0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f32383b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f323006e950 con 0x7f323006e0c0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f32300676a0 0x7f3230163860 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50278/0 (socket says 172.21.15.26:50278) 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 -- 172.21.15.26:0/1173664144 learned_addr learned my addr 172.21.15.26:0/1173664144 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3235950640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3230152e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4107582688 0 0) 0x7f32300ca950 con 0x7f32300676a0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3218003530 con 0x7f32300676a0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3530086520 0 0) 0x7f3218003530 con 0x7f32300676a0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 msgr2=0x7f3230152e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3230152e50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 >> v1:172.21.15.190:6789/0 conn(0x7f323006dce0 legacy=0x7f323015a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3230159280 con 0x7f32300676a0 2024-04-23T10:24:30.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f3228001680 con 0x7f32300676a0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 >> v1:172.21.15.26:6789/0 conn(0x7f32300676a0 legacy=0x7f3230163860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32180039f0 0x7f3218003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3218004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3218004d50 0x7f32180051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f323006e950 con 0x7f3218004d50 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f321800ba80 con 0x7f32180039f0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f321800bc80 con 0x7f323006e0c0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3218004d50 0x7f32180051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3235950640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3218004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236151640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32180039f0 0x7f3218003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 -- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 msgr2=0x7f3218004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f323006e0c0 0x7f3218004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 -- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32180039f0 msgr2=0x7f3218003e10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:30.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f32180039f0 0x7f3218003e10 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.293+0000 7f3236952640 1 -- 172.21.15.26:0/1173664144 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3218003530 con 0x7f3218004d50 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f3236952640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3218004d50 0x7f32180051d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f32300ccf20 tx=0x7f322801cc00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2113da543876bd82 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228007d00 con 0x7f3218004d50 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280a9020 con 0x7f3218004d50 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f323514f640 1 -- 172.21.15.26:0/1173664144 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f32280a5b00 con 0x7f3218004d50 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- 172.21.15.26:0/1173664144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3218004d50 msgr2=0x7f32180051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 --2- 172.21.15.26:0/1173664144 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3218004d50 0x7f32180051d0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7f32300ccf20 tx=0x7f322801cc00 comp rx=0 tx=0).stop 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f3236952640 1 -- 172.21.15.26:0/1173664144 reap_dead start 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- 172.21.15.26:0/1173664144 shutdown_connections 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- 172.21.15.26:0/1173664144 >> 172.21.15.26:0/1173664144 conn(0x7f32300c9a70 msgr2=0x7f32300c9e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- 172.21.15.26:0/1173664144 shutdown_connections 2024-04-23T10:24:30.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- 172.21.15.26:0/1173664144 wait complete. 2024-04-23T10:24:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 Processor -- start 2024-04-23T10:24:30.299 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.297+0000 7f32383b5640 1 -- start start 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3218004d50 0x7f32301588f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3230149870 0x7f32301f1aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3230159b20 con 0x7f323015c8c0 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3230159840 con 0x7f3218004d50 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f323006e5a0 con 0x7f3230149870 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42704/0 (socket says 172.21.15.26:42704) 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 -- 172.21.15.26:0/353620183 learned_addr learned my addr 172.21.15.26:0/353620183 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236151640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3218004d50 0x7f32301588f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3235950640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3230149870 0x7f32301f1aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 -- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3230149870 msgr2=0x7f32301f1aa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3230149870 0x7f32301f1aa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 -- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3218004d50 msgr2=0x7f32301588f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3218004d50 0x7f32301588f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 -- 172.21.15.26:0/353620183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f32300c2030 con 0x7f323015c8c0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236952640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32280ab040 tx=0x7f3218005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228007d00 con 0x7f323015c8c0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32280b3070 con 0x7f323015c8c0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f32301f1fe0 con 0x7f323015c8c0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3228001c40 con 0x7f323015c8c0 2024-04-23T10:24:30.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f32300c2580 con 0x7f323015c8c0 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f32300c2780 con 0x7f323015c8c0 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3228004c20 con 0x7f323015c8c0 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 0x7f321c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3228120840 con 0x7f323015c8c0 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.301+0000 7f3236151640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 0x7f321c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.305+0000 7f3236151640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 0x7f321c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3220005210 tx=0x7f3220009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.309+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f32300c2780 con 0x7f323015c8c0 2024-04-23T10:24:30.470 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f3230075df0 con 0x7f323015c8c0 2024-04-23T10:24:30.471 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f322effd640 1 -- 172.21.15.26:0/353620183 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f32301f1fe0 con 0x7f323015c8c0 2024-04-23T10:24:30.471 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 msgr2=0x7f321c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 0x7f321c06a840 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f3220005210 tx=0x7f3220009040 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 msgr2=0x7f32300c8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 crypto rx=0x7f32280ab040 tx=0x7f3218005840 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 shutdown_connections 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f321c068380 0x7f321c06a840 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f323015c8c0 0x7f32300c8f10 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3230149870 0x7f32301f1aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 --2- 172.21.15.26:0/353620183 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3218004d50 0x7f32301588f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.474 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.473+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 >> 172.21.15.26:0/353620183 conn(0x7f32300c9a70 msgr2=0x7f32300b2b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.477+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 shutdown_connections 2024-04-23T10:24:30.475 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.477+0000 7f32383b5640 1 -- 172.21.15.26:0/353620183 wait complete. 2024-04-23T10:24:30.491 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:24:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.605+0000 7fbe70e84640 1 Processor -- start 2024-04-23T10:24:30.605 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.605+0000 7fbe70e84640 1 -- start start 2024-04-23T10:24:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c8800 0x7fbe6c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe6c0c4b40 0x7fbe6c0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fbe6c0c8be0 con 0x7fbe6c0c5780 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fbe6c158090 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6c1585c0 con 0x7fbe6c0c8800 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fbe6c0c4b40 0x7fbe6c0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe6ad9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fbe6c0c5780 0x7fbe6c0c5c10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50280/0 (socket says 172.21.15.26:50280) 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe6ad9d640 1 -- 172.21.15.26:0/234709940 learned_addr learned my addr 172.21.15.26:0/234709940 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe6a59c640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c8800 0x7fbe6c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 -- 172.21.15.26:0/234709940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c8800 msgr2=0x7fbe6c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c8800 0x7fbe6c0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 -- 172.21.15.26:0/234709940 >> v1:172.21.15.26:6789/0 conn(0x7fbe6c0c5780 legacy=0x7fbe6c0c5c10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 -- 172.21.15.26:0/234709940 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c0c4790 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe69d9b640 1 -- 172.21.15.26:0/234709940 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1729624685 0 0) 0x7fbe6c0c8be0 con 0x7fbe6c0c5780 2024-04-23T10:24:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe61d9b640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c0c3f20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097c0 tx=0x7fbe5401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2bddd59fb2710ee6 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe69d9b640 1 -- 172.21.15.26:0/234709940 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe540b0070 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe69d9b640 1 -- 172.21.15.26:0/234709940 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe540ab600 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.609 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe69d9b640 1 -- 172.21.15.26:0/234709940 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe540ab9d0 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- 172.21.15.26:0/234709940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c4b40 msgr2=0x7fbe6c0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c0c3f20 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fbe540097c0 tx=0x7fbe5401c380 comp rx=0 tx=0).stop 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- 172.21.15.26:0/234709940 shutdown_connections 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c0c3f20 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 --2- 172.21.15.26:0/234709940 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c8800 0x7fbe6c0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.609+0000 7fbe70e84640 1 -- 172.21.15.26:0/234709940 >> 172.21.15.26:0/234709940 conn(0x7fbe6c06b9d0 msgr2=0x7fbe6c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- 172.21.15.26:0/234709940 shutdown_connections 2024-04-23T10:24:30.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- 172.21.15.26:0/234709940 wait complete. 2024-04-23T10:24:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 Processor -- start 2024-04-23T10:24:30.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- start start 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c154050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c5780 0x7fbe6c152150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c068790 con 0x7fbe6c0c8800 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fbe6c068610 con 0x7fbe6c0c4b40 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fbe6c0681d0 con 0x7fbe6c0c5780 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42736/0 (socket says 172.21.15.26:42736) 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 -- 172.21.15.26:0/2700680616 learned_addr learned my addr 172.21.15.26:0/2700680616 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 -- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c5780 msgr2=0x7fbe6c152150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c5780 0x7fbe6c152150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 -- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe6c0c4b40 msgr2=0x7fbe6c154050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6a59c640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c154050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c154050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 -- 172.21.15.26:0/2700680616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fbe6c14bd00 con 0x7fbe6c0c8800 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe6ad9d640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c730 tx=0x7fbe6400cbf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe64018070 con 0x7fbe6c0c8800 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe6400ce40 con 0x7fbe6c0c8800 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fbe6c0736d0 con 0x7fbe6c0c8800 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fbe6400a880 con 0x7fbe6c0c8800 2024-04-23T10:24:30.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fbe6c154970 con 0x7fbe6c0c8800 2024-04-23T10:24:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.613+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fbe6c075df0 con 0x7fbe6c0c8800 2024-04-23T10:24:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.617+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fbe6401b070 con 0x7fbe6c0c8800 2024-04-23T10:24:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.617+0000 7fbe637fe640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 0x7fbe4c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.617+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fbe640866f0 con 0x7fbe6c0c8800 2024-04-23T10:24:30.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.617+0000 7fbe6a59c640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 0x7fbe4c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.617+0000 7fbe6a59c640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 0x7fbe4c06a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0096f0 tx=0x7fbe5c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.618 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.621+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fbe64056870 con 0x7fbe6c0c8800 2024-04-23T10:24:30.773 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.773+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fbe6c06f840 con 0x7fbe6c0c8800 2024-04-23T10:24:30.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe637fe640 1 -- 172.21.15.26:0/2700680616 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fbe64056170 con 0x7fbe6c0c8800 2024-04-23T10:24:30.774 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 msgr2=0x7fbe4c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 0x7fbe4c06a870 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fbe5c0096f0 tx=0x7fbe5c008040 comp rx=0 tx=0).stop 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 msgr2=0x7fbe6c14c7a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fbe6400c730 tx=0x7fbe6400cbf0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 shutdown_connections 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fbe4c0683b0 0x7fbe4c06a870 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.777 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fbe6c0c8800 0x7fbe6c14c7a0 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fbe6c0c5780 0x7fbe6c152150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 --2- 172.21.15.26:0/2700680616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fbe6c0c4b40 0x7fbe6c154050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 >> 172.21.15.26:0/2700680616 conn(0x7fbe6c06b9d0 msgr2=0x7fbe6c0c5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 shutdown_connections 2024-04-23T10:24:30.778 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.777+0000 7fbe70e84640 1 -- 172.21.15.26:0/2700680616 wait complete. 2024-04-23T10:24:30.793 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:24:30.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 Processor -- start 2024-04-23T10:24:30.906 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 -- start start 2024-04-23T10:24:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88140c8250 0x7f88140c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814152250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f881415b740 con 0x7f88140c8630 2024-04-23T10:24:30.908 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f88140c6490 con 0x7f88140c8250 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f881a90c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f88140c58c0 con 0x7f88140c8a70 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8813fff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f88140c8250 0x7f88140c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f88137fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f88140c8630 0x7f8814151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50282/0 (socket says 172.21.15.26:50282) 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f88137fe640 1 -- 172.21.15.26:0/4031679198 learned_addr learned my addr 172.21.15.26:0/4031679198 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8818ea9640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814152250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8813fff640 1 -- 172.21.15.26:0/4031679198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 msgr2=0x7f8814152250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8813fff640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814152250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8813fff640 1 -- 172.21.15.26:0/4031679198 >> v1:172.21.15.26:6789/0 conn(0x7f88140c8630 legacy=0x7f8814151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8812ffd640 1 -- 172.21.15.26:0/4031679198 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1162510371 0 0) 0x7f881415b740 con 0x7f88140c8630 2024-04-23T10:24:30.909 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.909+0000 7f8813fff640 1 -- 172.21.15.26:0/4031679198 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f88140c5b60 con 0x7f88140c8250 2024-04-23T10:24:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f88140c39e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f88040097c0 tx=0x7f880401c410 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b1b23b7411f44efe server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8812ffd640 1 -- 172.21.15.26:0/4031679198 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b0070 con 0x7f88140c8250 2024-04-23T10:24:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8812ffd640 1 -- 172.21.15.26:0/4031679198 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88040ab600 con 0x7f88140c8250 2024-04-23T10:24:30.910 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8812ffd640 1 -- 172.21.15.26:0/4031679198 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040ab9d0 con 0x7f88140c8250 2024-04-23T10:24:30.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/4031679198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 msgr2=0x7f88140c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f88140c39e0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7f88040097c0 tx=0x7f880401c410 comp rx=0 tx=0).stop 2024-04-23T10:24:30.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/4031679198 shutdown_connections 2024-04-23T10:24:30.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814152250 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.911 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- 172.21.15.26:0/4031679198 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f88140c39e0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/4031679198 >> 172.21.15.26:0/4031679198 conn(0x7f881406b9d0 msgr2=0x7f881406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/4031679198 shutdown_connections 2024-04-23T10:24:30.912 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/4031679198 wait complete. 2024-04-23T10:24:30.913 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 Processor -- start 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- start start 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88140c8630 0x7f881413fd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f88140c6920 con 0x7f88140c8250 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f881415b400 con 0x7f88140c8630 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f88140681d0 con 0x7f88140c8a70 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42750/0 (socket says 172.21.15.26:42750) 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 -- 172.21.15.26:0/793241540 learned_addr learned my addr 172.21.15.26:0/793241540 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8818ea9640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 -- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 msgr2=0x7f8814072650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.914 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f88137fe640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88140c8630 0x7f881413fd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 -- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88140c8630 msgr2=0x7f881413fd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88140c8630 0x7f881413fd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 -- 172.21.15.26:0/793241540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8814138dd0 con 0x7f88140c8250 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8813fff640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f88040097c0 tx=0x7f880401ac50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b0050 con 0x7f88140c8250 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f88040bc070 con 0x7f88140c8250 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f88040b5a70 con 0x7f88140c8250 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8814073f40 con 0x7f88140c8250 2024-04-23T10:24:30.915 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.913+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f88140744e0 con 0x7f88140c8250 2024-04-23T10:24:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8814075df0 con 0x7f88140c8250 2024-04-23T10:24:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f88040ab480 con 0x7f88140c8250 2024-04-23T10:24:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f8810ff9640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 0x7f880006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8804122120 con 0x7f88140c8250 2024-04-23T10:24:30.916 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f88137fe640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 0x7f880006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:30.917 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.917+0000 7f88137fe640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 0x7f880006a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88141436a0 tx=0x7f8808009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:30.919 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:30.921+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8804016090 con 0x7f88140c8250 2024-04-23T10:24:31.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8814071e50 con 0x7f88140c8250 2024-04-23T10:24:31.079 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f8810ff9640 1 -- 172.21.15.26:0/793241540 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f88040f22e0 con 0x7f88140c8250 2024-04-23T10:24:31.080 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:24:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 msgr2=0x7f880006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 0x7f880006a870 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f88141436a0 tx=0x7f8808009040 comp rx=0 tx=0).stop 2024-04-23T10:24:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 msgr2=0x7f8814141a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7f88040097c0 tx=0x7f880401ac50 comp rx=0 tx=0).stop 2024-04-23T10:24:31.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 shutdown_connections 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f88000683b0 0x7f880006a870 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f88140c8a70 0x7f8814072650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f88140c8630 0x7f881413fd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 --2- 172.21.15.26:0/793241540 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f88140c8250 0x7f8814141a00 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.081+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 >> 172.21.15.26:0/793241540 conn(0x7f881406b9d0 msgr2=0x7f881414ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.085+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 shutdown_connections 2024-04-23T10:24:31.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.085+0000 7f881a90c640 1 -- 172.21.15.26:0/793241540 wait complete. 2024-04-23T10:24:31.098 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:24:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 Processor -- start 2024-04-23T10:24:31.212 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 -- start start 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82180c95a0 0x7f82180c8030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f82180c9980 0x7f8218073b20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f82181593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8218073590 con 0x7f82180c95a0 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f82180c8570 con 0x7f82180c9980 2024-04-23T10:24:31.214 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821cf68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f82180c8800 con 0x7f8218158f80 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82180c95a0 0x7f82180c8030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f82180c95a0 0x7f82180c8030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42758/0 (socket says 172.21.15.26:42758) 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.213+0000 7f821659c640 1 -- 172.21.15.26:0/3033715566 learned_addr learned my addr 172.21.15.26:0/3033715566 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 -- 172.21.15.26:0/3033715566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 msgr2=0x7f82181593b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 --2- 172.21.15.26:0/3033715566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f82181593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 -- 172.21.15.26:0/3033715566 >> v2:172.21.15.190:3300/0 conn(0x7f82180c9980 msgr2=0x7f8218073b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 --2- 172.21.15.26:0/3033715566 >> v2:172.21.15.190:3300/0 conn(0x7f82180c9980 0x7f8218073b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.215 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 -- 172.21.15.26:0/3033715566 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f82180c8aa0 con 0x7f82180c95a0 2024-04-23T10:24:31.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821659c640 1 --2- 172.21.15.26:0/3033715566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180c8030 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f82180c8c70 tx=0x7f820801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=393f8ca811595e95 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821559a640 1 -- 172.21.15.26:0/3033715566 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82080b5070 con 0x7f82180c95a0 2024-04-23T10:24:31.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821559a640 1 -- 172.21.15.26:0/3033715566 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82080a89d0 con 0x7f82180c95a0 2024-04-23T10:24:31.216 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821559a640 1 -- 172.21.15.26:0/3033715566 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82080a8da0 con 0x7f82180c95a0 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 -- 172.21.15.26:0/3033715566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 msgr2=0x7f82180c8030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 --2- 172.21.15.26:0/3033715566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180c8030 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 crypto rx=0x7f82180c8c70 tx=0x7f820801ed10 comp rx=0 tx=0).stop 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 -- 172.21.15.26:0/3033715566 shutdown_connections 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 --2- 172.21.15.26:0/3033715566 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f82181593b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 --2- 172.21.15.26:0/3033715566 >> v2:172.21.15.190:3300/0 conn(0x7f82180c9980 0x7f8218073b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.217 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 --2- 172.21.15.26:0/3033715566 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180c8030 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 -- 172.21.15.26:0/3033715566 >> 172.21.15.26:0/3033715566 conn(0x7f8218070ee0 msgr2=0x7f82180712f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 -- 172.21.15.26:0/3033715566 shutdown_connections 2024-04-23T10:24:31.218 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.217+0000 7f821cf68640 1 -- 172.21.15.26:0/3033715566 wait complete. 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 Processor -- start 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- start start 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 0x7f821814bdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f821806dc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f82180c6420 con 0x7f82180c95a0 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f82180c6140 con 0x7f82180c9980 2024-04-23T10:24:31.220 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8218074060 con 0x7f8218158f80 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42768/0 (socket says 172.21.15.26:42768) 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 -- 172.21.15.26:0/3068113386 learned_addr learned my addr 172.21.15.26:0/3068113386 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 -- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 msgr2=0x7f821806dc20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8215d9b640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 0x7f821814bdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8216d9d640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f821806dc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f821806dc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 -- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 msgr2=0x7f821814bdb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 0x7f821814bdb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 -- 172.21.15.26:0/3068113386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f821814b150 con 0x7f82180c95a0 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8215d9b640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 0x7f821814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821659c640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f82080b3040 tx=0x7f820801bab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.221 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82080c0070 con 0x7f82180c95a0 2024-04-23T10:24:31.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f82080b08d0 con 0x7f82180c95a0 2024-04-23T10:24:31.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f821806cb80 con 0x7f82180c95a0 2024-04-23T10:24:31.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f82080b5040 con 0x7f82180c95a0 2024-04-23T10:24:31.222 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f821806d140 con 0x7f82180c95a0 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8218075df0 con 0x7f82180c95a0 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f82080c3070 con 0x7f82180c95a0 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 0x7f81f806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8208123e50 con 0x7f82180c95a0 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.221+0000 7f8215d9b640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 0x7f81f806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.223 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.225+0000 7f8215d9b640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 0x7f81f806a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f821806e830 tx=0x7f820c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.226 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.225+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8208018870 con 0x7f82180c95a0 2024-04-23T10:24:31.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.405+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f8218156b50 con 0x7f82180c95a0 2024-04-23T10:24:31.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.405+0000 7f8206ffd640 1 -- 172.21.15.26:0/3068113386 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f82080f3f60 con 0x7f82180c95a0 2024-04-23T10:24:31.406 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-23T10:24:31.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 msgr2=0x7f81f806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 0x7f81f806a840 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f821806e830 tx=0x7f820c008040 comp rx=0 tx=0).stop 2024-04-23T10:24:31.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 msgr2=0x7f82180ce710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f82080b3040 tx=0x7f820801bab0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 shutdown_connections 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f81f8068380 0x7f81f806a840 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8218158f80 0x7f821806dc20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f82180c9980 0x7f821814bdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 --2- 172.21.15.26:0/3068113386 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f82180c95a0 0x7f82180ce710 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 >> 172.21.15.26:0/3068113386 conn(0x7f8218070ee0 msgr2=0x7f8218159390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 shutdown_connections 2024-04-23T10:24:31.409 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.409+0000 7f821cf68640 1 -- 172.21.15.26:0/3068113386 wait complete. 2024-04-23T10:24:31.426 DEBUG:teuthology.orchestra.run.smithi026:> set -ex 2024-04-23T10:24:31.426 DEBUG:teuthology.orchestra.run.smithi026:> dd if=/proc/self/mounts of=/dev/stdout 2024-04-23T10:24:31.432 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 Processor -- start 2024-04-23T10:24:31.602 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 -- start start 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07480c8800 0x7f07480c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480c8be0 con 0x7f07480c5e90 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f07480c4790 con 0x7f07480c4b40 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f074d35c640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0748158090 con 0x7f07480c8800 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f0746ffd640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f07480c8800 0x7f07480c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f07477fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f07480c5e90 0x7f0748161eb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:50288/0 (socket says 172.21.15.26:50288) 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f07477fe640 1 -- 172.21.15.26:0/190760377 learned_addr learned my addr 172.21.15.26:0/190760377 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f0746ffd640 1 -- 172.21.15.26:0/190760377 >> v1:172.21.15.190:6789/0 conn(0x7f07480c4b40 legacy=0x7f07480c5780 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f0746ffd640 1 -- 172.21.15.26:0/190760377 >> v1:172.21.15.26:6789/0 conn(0x7f07480c5e90 legacy=0x7f0748161eb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f0746ffd640 1 -- 172.21.15.26:0/190760377 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481582e0 con 0x7f07480c8800 2024-04-23T10:24:31.604 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.605+0000 7f0745ffb640 1 -- 172.21.15.26:0/190760377 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2884196670 0 0) 0x7f07480c8be0 con 0x7f07480c5e90 2024-04-23T10:24:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0746ffd640 1 --2- 172.21.15.26:0/190760377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c8800 0x7f07480c39e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f073c0097c0 tx=0x7f073c01c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f1799851061b443e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0745ffb640 1 -- 172.21.15.26:0/190760377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c0b0070 con 0x7f07480c8800 2024-04-23T10:24:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0745ffb640 1 -- 172.21.15.26:0/190760377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073c0ab600 con 0x7f07480c8800 2024-04-23T10:24:31.606 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0745ffb640 1 -- 172.21.15.26:0/190760377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f073c0ab9d0 con 0x7f07480c8800 2024-04-23T10:24:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- 172.21.15.26:0/190760377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c8800 msgr2=0x7f07480c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 --2- 172.21.15.26:0/190760377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c8800 0x7f07480c39e0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f073c0097c0 tx=0x7f073c01c340 comp rx=0 tx=0).stop 2024-04-23T10:24:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- 172.21.15.26:0/190760377 shutdown_connections 2024-04-23T10:24:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 --2- 172.21.15.26:0/190760377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c8800 0x7f07480c39e0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.607 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- 172.21.15.26:0/190760377 >> 172.21.15.26:0/190760377 conn(0x7f074806b9d0 msgr2=0x7f074806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- 172.21.15.26:0/190760377 shutdown_connections 2024-04-23T10:24:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- 172.21.15.26:0/190760377 wait complete. 2024-04-23T10:24:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 Processor -- start 2024-04-23T10:24:31.608 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- start start 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 0x7f07481f5b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 0x7f07481472f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f07480c52f0 con 0x7f07480c5e90 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f07481585c0 con 0x7f07480c4b40 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f074d35c640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f07480681d0 con 0x7f07480c8800 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:42784/0 (socket says 172.21.15.26:42784) 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 -- 172.21.15.26:0/745401022 learned_addr learned my addr 172.21.15.26:0/745401022 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:31.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0746ffd640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 0x7f07481f5b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07477fe640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 0x7f07481472f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 -- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 msgr2=0x7f07481472f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 0x7f07481472f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 -- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 msgr2=0x7f07481f5b90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 0x7f07481f5b90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 -- 172.21.15.26:0/745401022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07481f38d0 con 0x7f07480c5e90 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07477fe640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 0x7f07481472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f0746ffd640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 0x7f07481f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f07467fc640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f073800b410 tx=0x7f073800b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738015030 con 0x7f07480c5e90 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0738004020 con 0x7f07480c5e90 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.609+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0738004450 con 0x7f07480c5e90 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07481f6460 con 0x7f07480c5e90 2024-04-23T10:24:31.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0748153460 con 0x7f07480c5e90 2024-04-23T10:24:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0748075df0 con 0x7f07480c5e90 2024-04-23T10:24:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0738018070 con 0x7f07480c5e90 2024-04-23T10:24:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f072f7fe640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 0x7f073406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0738086900 con 0x7f07480c5e90 2024-04-23T10:24:31.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f0746ffd640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 0x7f073406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.613+0000 7f0746ffd640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 0x7f073406a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ad000 tx=0x7f073c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.617+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0738056aa0 con 0x7f07480c5e90 2024-04-23T10:24:31.779 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.781+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f0748074550 con 0x7f07480c5e90 2024-04-23T10:24:31.780 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.781+0000 7f072f7fe640 1 -- 172.21.15.26:0/745401022 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7f07380563a0 con 0x7f07480c5e90 2024-04-23T10:24:31.780 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:31.781 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 msgr2=0x7f073406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 0x7f073406a870 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f073c0ad000 tx=0x7f073c008040 comp rx=0 tx=0).stop 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 msgr2=0x7f0748146db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f073800b410 tx=0x7f073800b8d0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 shutdown_connections 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f07340683b0 0x7f073406a870 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f07480c8800 0x7f07481472f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f07480c5e90 0x7f0748146db0 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 --2- 172.21.15.26:0/745401022 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f07480c4b40 0x7f07481f5b90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 >> 172.21.15.26:0/745401022 conn(0x7f074806b9d0 msgr2=0x7f0748156a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 shutdown_connections 2024-04-23T10:24:31.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.785+0000 7f074d35c640 1 -- 172.21.15.26:0/745401022 wait complete. 2024-04-23T10:24:31.799 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-23T10:12:20.954549+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs_metadata', 'create_time': '2024-04-23T10:12:32.504271+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs_data', 'create_time': '2024-04-23T10:12:33.352859+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '20', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.05000000074505806}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.3799999952316284, 'score_stable': 1.3799999952316284, 'optimal_score': 1, 'raw_score_acting': 1.3799999952316284, 'raw_score_stable': 1.3799999952316284, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'cephfs_data_ec', 'create_time': '2024-04-23T10:12:37.057299+0000', 'flags': 5, 'flags_names': 'hashpspool,ec_overwrites', 'type': 3, 'size': 4, 'min_size': 3, 'crush_rule': 1, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': 'cephfs_data_ec', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 8192, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_min': 64, 'target_size_ratio': 0.8999999761581421}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-04-23T10:24:31.799 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-04-23T10:24:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 Processor -- start 2024-04-23T10:24:31.922 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 -- start start 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe810070850 0x7fe810070000 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8100c9bc0 0x7fe8100c8d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe8100c57c0 con 0x7fe810152fe0 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe810070540 con 0x7fe810070850 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe814841640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe8100c6cf0 con 0x7fe8100c9bc0 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80dd9b640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe810070850 0x7fe810070000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80e59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fe810152fe0 0x7fe81006cee0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51360/0 (socket says 172.21.15.26:51360) 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80e59c640 1 -- 172.21.15.26:0/3275671753 learned_addr learned my addr 172.21.15.26:0/3275671753 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80dd9b640 1 -- 172.21.15.26:0/3275671753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8100c9bc0 msgr2=0x7fe8100c8d50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80dd9b640 1 --2- 172.21.15.26:0/3275671753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8100c9bc0 0x7fe8100c8d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80dd9b640 1 -- 172.21.15.26:0/3275671753 >> v1:172.21.15.26:6789/0 conn(0x7fe810152fe0 legacy=0x7fe81006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80d59a640 1 -- 172.21.15.26:0/3275671753 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1628304309 0 0) 0x7fe8100c57c0 con 0x7fe810152fe0 2024-04-23T10:24:31.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.925+0000 7fe80dd9b640 1 -- 172.21.15.26:0/3275671753 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe8100c6f20 con 0x7fe810070850 2024-04-23T10:24:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80dd9b640 1 --2- 172.21.15.26:0/3275671753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810070850 0x7fe810070000 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097c0 tx=0x7fe7f801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a8bfb81b62a404bc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80d59a640 1 -- 172.21.15.26:0/3275671753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80b2070 con 0x7fe810070850 2024-04-23T10:24:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80d59a640 1 -- 172.21.15.26:0/3275671753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe7f80ad640 con 0x7fe810070850 2024-04-23T10:24:31.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80d59a640 1 -- 172.21.15.26:0/3275671753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe7f80ada10 con 0x7fe810070850 2024-04-23T10:24:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- 172.21.15.26:0/3275671753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810070850 msgr2=0x7fe810070000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- 172.21.15.26:0/3275671753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810070850 0x7fe810070000 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7fe7f80097c0 tx=0x7fe7f801c4a0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- 172.21.15.26:0/3275671753 shutdown_connections 2024-04-23T10:24:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- 172.21.15.26:0/3275671753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe8100c9bc0 0x7fe8100c8d50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.928 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- 172.21.15.26:0/3275671753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810070850 0x7fe810070000 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- 172.21.15.26:0/3275671753 >> 172.21.15.26:0/3275671753 conn(0x7fe8100ca540 msgr2=0x7fe8100ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:31.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- 172.21.15.26:0/3275671753 shutdown_connections 2024-04-23T10:24:31.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- 172.21.15.26:0/3275671753 wait complete. 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 Processor -- start 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- start start 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8100c9bc0 0x7fe810148470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe810152fe0 0x7fe8101489b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe8101533c0 con 0x7fe810147d50 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe8100c96a0 con 0x7fe8100c9bc0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe814841640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe810153540 con 0x7fe810152fe0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80ed9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49708/0 (socket says 172.21.15.26:49708) 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.929+0000 7fe80ed9d640 1 -- 172.21.15.26:0/613947798 learned_addr learned my addr 172.21.15.26:0/613947798 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80dd9b640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe810152fe0 0x7fe8101489b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80e59c640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8100c9bc0 0x7fe810148470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 -- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe810152fe0 msgr2=0x7fe8101489b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe810152fe0 0x7fe8101489b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 -- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8100c9bc0 msgr2=0x7fe810148470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8100c9bc0 0x7fe810148470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 -- 172.21.15.26:0/613947798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe810146e60 con 0x7fe810147d50 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80ed9d640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b9e0 tx=0x7fe80800bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808019070 con 0x7fe810147d50 2024-04-23T10:24:31.932 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe80800cac0 con 0x7fe810147d50 2024-04-23T10:24:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe810147140 con 0x7fe810147d50 2024-04-23T10:24:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe808014440 con 0x7fe810147d50 2024-04-23T10:24:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe810147700 con 0x7fe810147d50 2024-04-23T10:24:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe810147940 con 0x7fe810147d50 2024-04-23T10:24:31.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe80801c070 con 0x7fe810147d50 2024-04-23T10:24:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 0x7fe7f006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe808086a50 con 0x7fe810147d50 2024-04-23T10:24:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80e59c640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 0x7fe7f006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:31.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.933+0000 7fe80e59c640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 0x7fe7f006a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe800000f70 tx=0x7fe800009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:31.937 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:31.937+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe808056c80 con 0x7fe810147d50 2024-04-23T10:24:32.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) -- 0x7fe810075df0 con 0x7fe810147d50 2024-04-23T10:24:32.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe806ffd640 1 -- 172.21.15.26:0/613947798 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v26) ==== 93+0+10 (secure 0 0 0) 0x7fe808056580 con 0x7fe810147d50 2024-04-23T10:24:32.099 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 1 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 msgr2=0x7fe7f006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 0x7fe7f006a870 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7fe800000f70 tx=0x7fe800009040 comp rx=0 tx=0).stop 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 msgr2=0x7fe810144650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 crypto rx=0x7fe80800b9e0 tx=0x7fe80800bea0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 shutdown_connections 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe7f00683b0 0x7fe7f006a870 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.101 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe810147d50 0x7fe810144650 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe810152fe0 0x7fe8101489b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 --2- 172.21.15.26:0/613947798 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe8100c9bc0 0x7fe810148470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 >> 172.21.15.26:0/613947798 conn(0x7fe8100ca540 msgr2=0x7fe81006b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 shutdown_connections 2024-04-23T10:24:32.102 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.101+0000 7fe814841640 1 -- 172.21.15.26:0/613947798 wait complete. 2024-04-23T10:24:32.117 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_metadata pg_num 2024-04-23T10:24:32.242 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 Processor -- start 2024-04-23T10:24:32.243 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 -- start start 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f1884155350 0x7f18840c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188415bc10 con 0x7f188415b0b0 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f188415beb0 con 0x7f18840cda50 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f188a6d8640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f18840cca40 con 0x7f1884155350 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1888c75640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f188415b0b0 0x7f188415b500 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51370/0 (socket says 172.21.15.26:51370) 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1888c75640 1 -- 172.21.15.26:0/3502959921 learned_addr learned my addr 172.21.15.26:0/3502959921 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 --2- 172.21.15.26:0/3502959921 >> v2:172.21.15.190:3300/0 conn(0x7f1884155350 0x7f18840c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3228460279 0 0) 0x7f188415bc10 con 0x7f188415b0b0 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f186c003530 con 0x7f188415b0b0 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3037169423 0 0) 0x7f186c003530 con 0x7f188415b0b0 2024-04-23T10:24:32.246 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 >> v2:172.21.15.190:3300/0 conn(0x7f1884155350 msgr2=0x7f18840c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 --2- 172.21.15.26:0/3502959921 >> v2:172.21.15.190:3300/0 conn(0x7f1884155350 0x7f18840c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 >> v1:172.21.15.190:6789/0 conn(0x7f18840cda50 legacy=0x7f18840cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18840ccc90 con 0x7f188415b0b0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f187c0016a0 con 0x7f188415b0b0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 >> v1:172.21.15.26:6789/0 conn(0x7f188415b0b0 legacy=0x7f188415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f186c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f186c004810 0x7f186c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f186c0051d0 0x7f186c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f18840cca40 con 0x7f186c0039c0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f186c00c080 con 0x7f186c004810 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f186c00c280 con 0x7f186c0051d0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f186c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1888c75640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f186c0051d0 0x7f186c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.247 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f18837fe640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f186c004810 0x7f186c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 -- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f186c0051d0 msgr2=0x7f186c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f186c0051d0 0x7f186c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 -- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f186c004810 msgr2=0x7f186c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f186c004810 0x7f186c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1888c75640 1 -- 172.21.15.26:0/3502959921 reap_dead start 2024-04-23T10:24:32.248 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.245+0000 7f1883fff640 1 -- 172.21.15.26:0/3502959921 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f186c003530 con 0x7f186c0039c0 2024-04-23T10:24:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f1883fff640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f186c003de0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1874009fc0 tx=0x7f187401cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69c4befec09d25cd server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740b2070 con 0x7f186c0039c0 2024-04-23T10:24:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18740a5b80 con 0x7f186c0039c0 2024-04-23T10:24:32.251 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f1882ffd640 1 -- 172.21.15.26:0/3502959921 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1874009c10 con 0x7f186c0039c0 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 msgr2=0x7f186c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f186c003de0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7f1874009fc0 tx=0x7f187401cc80 comp rx=0 tx=0).stop 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- 172.21.15.26:0/3502959921 shutdown_connections 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 --2- 172.21.15.26:0/3502959921 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f186c003de0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- 172.21.15.26:0/3502959921 >> 172.21.15.26:0/3502959921 conn(0x7f188406cc30 msgr2=0x7f188406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- 172.21.15.26:0/3502959921 shutdown_connections 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- 172.21.15.26:0/3502959921 wait complete. 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 Processor -- start 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.249+0000 7f188a6d8640 1 -- start start 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18841563c0 0x7f18841f5210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415df80 0x7f188414b620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f18840cd530 con 0x7f186c0039c0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f18840cd250 con 0x7f18841563c0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1884155730 con 0x7f188415df80 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49730/0 (socket says 172.21.15.26:49730) 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 -- 172.21.15.26:0/4202706667 learned_addr learned my addr 172.21.15.26:0/4202706667 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f18837fe640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18841563c0 0x7f18841f5210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1888c75640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415df80 0x7f188414b620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 -- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415df80 msgr2=0x7f188414b620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415df80 0x7f188414b620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 -- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18841563c0 msgr2=0x7f18841f5210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18841563c0 0x7f18841f5210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 -- 172.21.15.26:0/4202706667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f18841f4750 con 0x7f186c0039c0 2024-04-23T10:24:32.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1883fff640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f18740b0040 tx=0x7f1874009750 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740b2040 con 0x7f186c0039c0 2024-04-23T10:24:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f18740a5980 con 0x7f186c0039c0 2024-04-23T10:24:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f18740039a0 con 0x7f186c0039c0 2024-04-23T10:24:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f18841581f0 con 0x7f186c0039c0 2024-04-23T10:24:32.254 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f18841f4a10 con 0x7f186c0039c0 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1884075df0 con 0x7f186c0039c0 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f18740bf030 con 0x7f186c0039c0 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1874121500 con 0x7f186c0039c0 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.253+0000 7f18837fe640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.257+0000 7f18837fe640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 0x7f187006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f188414f590 tx=0x7f1878009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.257 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.257+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f18740c6020 con 0x7f186c0039c0 2024-04-23T10:24:32.415 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.417+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"} v 0) -- 0x7f18840cad80 con 0x7f186c0039c0 2024-04-23T10:24:32.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.417+0000 7f1880ff9640 1 -- 172.21.15.26:0/4202706667 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_metadata", "var": "pg_num"}]=0 v26) ==== 104+0+11 (secure 0 0 0) 0x7f1874016990 con 0x7f186c0039c0 2024-04-23T10:24:32.416 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:24:32.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 msgr2=0x7f187006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 0x7f187006a840 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f188414f590 tx=0x7f1878009040 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 msgr2=0x7f18841503f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7f18740b0040 tx=0x7f1874009750 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 shutdown_connections 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1870068380 0x7f187006a840 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f188415df80 0x7f188414b620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f18841563c0 0x7f18841f5210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 --2- 172.21.15.26:0/4202706667 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f186c0039c0 0x7f18841503f0 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 >> 172.21.15.26:0/4202706667 conn(0x7f188406cc30 msgr2=0x7f1884154350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 shutdown_connections 2024-04-23T10:24:32.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.421+0000 7f188a6d8640 1 -- 172.21.15.26:0/4202706667 wait complete. 2024-04-23T10:24:32.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data pg_num 2024-04-23T10:24:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.549+0000 7fef97a63640 1 Processor -- start 2024-04-23T10:24:32.549 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.549+0000 7fef97a63640 1 -- start start 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef97a63640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fef900c8630 0x7fef90151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef97a63640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef90152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef97a63640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef9015b740 con 0x7fef900c8250 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef97a63640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fef900c6490 con 0x7fef900c8630 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef97a63640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef901525c0 con 0x7fef900c8a70 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef957ff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fef900c8250 0x7fef900c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51372/0 (socket says 172.21.15.26:51372) 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef957ff640 1 -- 172.21.15.26:0/342167362 learned_addr learned my addr 172.21.15.26:0/342167362 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef94ffe640 1 --2- 172.21.15.26:0/342167362 >> v2:172.21.15.190:3300/0 conn(0x7fef900c8630 0x7fef90151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef90152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514705115 0 0) 0x7fef9015b740 con 0x7fef900c8250 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fef7c003530 con 0x7fef900c8250 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2560181694 0 0) 0x7fef7c003530 con 0x7fef900c8250 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 msgr2=0x7fef90152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef90152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 >> v2:172.21.15.190:3300/0 conn(0x7fef900c8630 msgr2=0x7fef90151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 --2- 172.21.15.26:0/342167362 >> v2:172.21.15.190:3300/0 conn(0x7fef900c8630 0x7fef90151b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef900c40f0 con 0x7fef900c8250 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fef8c001680 con 0x7fef900c8250 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 >> v1:172.21.15.26:6789/0 conn(0x7fef900c8250 legacy=0x7fef900c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef7c0039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef7c003f40 0x7fef7c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c004d50 0x7fef7c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fef900c6490 con 0x7fef7c004d50 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef901525c0 con 0x7fef7c003f40 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef7c00ba20 con 0x7fef900c8a70 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c004d50 0x7fef7c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef957ff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef7c0039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 -- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 msgr2=0x7fef7c0039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef7c0039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 -- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef7c003f40 msgr2=0x7fef7c004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef7c003f40 0x7fef7c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef96000640 1 -- 172.21.15.26:0/342167362 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7c003530 con 0x7fef7c004d50 2024-04-23T10:24:32.556 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.553+0000 7fef957ff640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef900c8a70 0x7fef7c0039c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef96000640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c004d50 0x7fef7c0051d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fef8800e170 tx=0x7fef8801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d7a1f271b3e3d8a1 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef880b2070 con 0x7fef7c004d50 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef880a5c70 con 0x7fef7c004d50 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef87fff640 1 -- 172.21.15.26:0/342167362 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef88009c10 con 0x7fef7c004d50 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/342167362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c004d50 msgr2=0x7fef7c0051d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 --2- 172.21.15.26:0/342167362 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef7c004d50 0x7fef7c0051d0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fef8800e170 tx=0x7fef8801cc60 comp rx=0 tx=0).stop 2024-04-23T10:24:32.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef96000640 1 -- 172.21.15.26:0/342167362 reap_dead start 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/342167362 shutdown_connections 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/342167362 >> 172.21.15.26:0/342167362 conn(0x7fef9006b9d0 msgr2=0x7fef9006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/342167362 shutdown_connections 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/342167362 wait complete. 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 Processor -- start 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- start start 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef7c004d50 0x7fef9015a0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 0x7fef90144f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fef900c5e40 con 0x7fef9006f1b0 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fef900c58c0 con 0x7fef9014c050 2024-04-23T10:24:32.561 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fef900c6120 con 0x7fef7c004d50 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49742/0 (socket says 172.21.15.26:49742) 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 -- 172.21.15.26:0/3311030239 learned_addr learned my addr 172.21.15.26:0/3311030239 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef957ff640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef7c004d50 0x7fef9015a0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef96000640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 0x7fef90144f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 -- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef7c004d50 msgr2=0x7fef9015a0b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef7c004d50 0x7fef9015a0b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 -- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 msgr2=0x7fef90144f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 0x7fef90144f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 -- 172.21.15.26:0/3311030239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef9015a6f0 con 0x7fef9006f1b0 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef96000640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 0x7fef90144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:32.562 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef94ffe640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e7f0 tx=0x7fef8000ecb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef80017070 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef8000c8e0 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef9015aa50 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fef8000eea0 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.557+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef9015b010 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef9015b210 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fef8001a070 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef85ffb640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 0x7fef7406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fef80086be0 con 0x7fef9006f1b0 2024-04-23T10:24:32.563 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef957ff640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 0x7fef7406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.561+0000 7fef957ff640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 0x7fef7406a870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0017f0 tx=0x7fef8c001620 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.565+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fef9015b210 con 0x7fef9006f1b0 2024-04-23T10:24:32.722 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"} v 0) -- 0x7fef90075df0 con 0x7fef9006f1b0 2024-04-23T10:24:32.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef85ffb640 1 -- 172.21.15.26:0/3311030239 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data", "var": "pg_num"}]=0 v26) ==== 100+0+11 (secure 0 0 0) 0x7fef80056ce0 con 0x7fef9006f1b0 2024-04-23T10:24:32.723 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 64 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 msgr2=0x7fef7406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 0x7fef7406a870 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7fef8c0017f0 tx=0x7fef8c001620 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 msgr2=0x7fef901e58d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fef8000e7f0 tx=0x7fef8000ecb0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 shutdown_connections 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fef740683b0 0x7fef7406a870 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fef9014c050 0x7fef90144f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fef9006f1b0 0x7fef901e58d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 --2- 172.21.15.26:0/3311030239 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fef7c004d50 0x7fef9015a0b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 >> 172.21.15.26:0/3311030239 conn(0x7fef9006b9d0 msgr2=0x7fef9006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 shutdown_connections 2024-04-23T10:24:32.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.725+0000 7fef97a63640 1 -- 172.21.15.26:0/3311030239 wait complete. 2024-04-23T10:24:32.741 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs_data_ec pg_num 2024-04-23T10:24:32.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 Processor -- start 2024-04-23T10:24:32.868 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 -- start start 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f5c06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f8f5c074100 0x7f8f5c0c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f5c0c5d70 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f8f5c0c6050 con 0x7f8f5c074100 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f6131a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c0c6330 con 0x7f8f5c14ffa0 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f5affd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8f5c14fbc0 0x7f8f5c0c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51386/0 (socket says 172.21.15.26:51386) 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.869+0000 7f8f5affd640 1 -- 172.21.15.26:0/100497387 learned_addr learned my addr 172.21.15.26:0/100497387 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5b7fe640 1 --2- 172.21.15.26:0/100497387 >> v2:172.21.15.190:3300/0 conn(0x7f8f5c074100 0x7f8f5c0c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.870 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5a7fc640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f5c06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3986525221 0 0) 0x7f8f5c0c5d70 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f48003530 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 780304847 0 0) 0x7f8f48003530 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 msgr2=0x7f8f5c06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f5c06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 >> v2:172.21.15.190:3300/0 conn(0x7f8f5c074100 msgr2=0x7f8f5c0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 --2- 172.21.15.26:0/100497387 >> v2:172.21.15.190:3300/0 conn(0x7f8f5c074100 0x7f8f5c0c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c0c6610 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f8f4c001680 con 0x7f8f5c14fbc0 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 >> v1:172.21.15.26:6789/0 conn(0x7f8f5c14fbc0 legacy=0x7f8f5c0c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.872 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f480039c0 0x7f8f48003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f48004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0c6050 con 0x7f8f480039c0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0c6330 con 0x7f8f48004d50 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8f4800b9d0 con 0x7f8f5c14ffa0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f480039c0 0x7f8f48003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5a7fc640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f48004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5b7fe640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 -- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 msgr2=0x7f8f48004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c14ffa0 0x7f8f48004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 -- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f48004d50 msgr2=0x7f8f480051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 -- 172.21.15.26:0/100497387 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f48003530 con 0x7f8f480039c0 2024-04-23T10:24:32.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5b7fe640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f48004d50 0x7f8f480051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5affd640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f480039c0 0x7f8f48003de0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00c240 tx=0x7f8f4c01cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=359b53f5fade64c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c007d40 con 0x7f8f480039c0 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f4c0a9020 con 0x7f8f480039c0 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f59ffb640 1 -- 172.21.15.26:0/100497387 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4c0a5bc0 con 0x7f8f480039c0 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f6131a640 1 -- 172.21.15.26:0/100497387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f480039c0 msgr2=0x7f8f48003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f6131a640 1 --2- 172.21.15.26:0/100497387 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f480039c0 0x7f8f48003de0 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c00c240 tx=0x7f8f4c01cca0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.873+0000 7f8f5b7fe640 1 -- 172.21.15.26:0/100497387 reap_dead start 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/100497387 shutdown_connections 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/100497387 >> 172.21.15.26:0/100497387 conn(0x7f8f5c06b9d0 msgr2=0x7f8f5c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/100497387 shutdown_connections 2024-04-23T10:24:32.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/100497387 wait complete. 2024-04-23T10:24:32.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 Processor -- start 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- start start 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 0x7f8f5c1527f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c15ca00 0x7f8f5c14a700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c0c8930 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8f5c06fb10 con 0x7f8f480039c0 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8f5c0c8ab0 con 0x7f8f5c15ca00 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49774/0 (socket says 172.21.15.26:49774) 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 -- 172.21.15.26:0/2088821490 learned_addr learned my addr 172.21.15.26:0/2088821490 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5affd640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 0x7f8f5c1527f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5b7fe640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c15ca00 0x7f8f5c14a700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 -- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c15ca00 msgr2=0x7f8f5c14a700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c15ca00 0x7f8f5c14a700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 -- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 msgr2=0x7f8f5c1527f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 0x7f8f5c1527f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 -- 172.21.15.26:0/2088821490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f5c1f6610 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5affd640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 0x7f8f5c1527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f5a7fc640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8f44007f30 tx=0x7f8f44011660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f4401a020 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f44016470 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8f44016840 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f5c1f6b70 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.877+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f5c15c2e0 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f5c075df0 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8f4401d020 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f537fe640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 0x7f8f3c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:32.880 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8f44087c00 con 0x7f8f5c14d1f0 2024-04-23T10:24:32.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f5affd640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 0x7f8f3c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:32.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.881+0000 7f8f5affd640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 0x7f8f3c06a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0aa000 tx=0x7f8f5c0735f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:32.883 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:32.885+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8f4408e080 con 0x7f8f5c14d1f0 2024-04-23T10:24:33.042 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.041+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"} v 0) -- 0x7f8f5c06bde0 con 0x7f8f5c14d1f0 2024-04-23T10:24:33.043 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f537fe640 1 -- 172.21.15.26:0/2088821490 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs_data_ec", "var": "pg_num"}]=0 v26) ==== 103+0+11 (secure 0 0 0) 0x7f8f44024030 con 0x7f8f5c14d1f0 2024-04-23T10:24:33.043 INFO:teuthology.orchestra.run.smithi026.stdout:pg_num: 32 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 msgr2=0x7f8f3c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 0x7f8f3c06a840 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8f4c0aa000 tx=0x7f8f5c0735f0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 msgr2=0x7f8f5c14a1c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f8f44007f30 tx=0x7f8f44011660 comp rx=0 tx=0).stop 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 shutdown_connections 2024-04-23T10:24:33.045 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8f3c068380 0x7f8f3c06a840 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8f5c15ca00 0x7f8f5c14a700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8f5c14d1f0 0x7f8f5c14a1c0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 --2- 172.21.15.26:0/2088821490 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8f480039c0 0x7f8f5c1527f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 >> 172.21.15.26:0/2088821490 conn(0x7f8f5c06b9d0 msgr2=0x7f8f5c072890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 shutdown_connections 2024-04-23T10:24:33.046 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.045+0000 7f8f6131a640 1 -- 172.21.15.26:0/2088821490 wait complete. 2024-04-23T10:24:33.061 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-04-23T10:24:33.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 Processor -- start 2024-04-23T10:24:33.175 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 -- start start 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e7415c350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e7415c890 con 0x7f3e740c6af0 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3e740c7440 con 0x7f3e740c3710 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e7a209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3e740c7720 con 0x7f3e74152fe0 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e72ffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3e740c6af0 0x7f3e740c3da0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51392/0 (socket says 172.21.15.26:51392) 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e72ffd640 1 -- 172.21.15.26:0/1197807067 learned_addr learned my addr 172.21.15.26:0/1197807067 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2530064513 0 0) 0x7f3e7415c890 con 0x7f3e740c6af0 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e7415c350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.178 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f3e5c003530 con 0x7f3e740c6af0 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1296817286 0 0) 0x7f3e5c003530 con 0x7f3e740c6af0 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 msgr2=0x7f3e7415c350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e7415c350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 >> v1:172.21.15.190:6789/0 conn(0x7f3e740c3710 legacy=0x7f3e741636c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e740c6010 con 0x7f3e740c6af0 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f3e68001680 con 0x7f3e740c6af0 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 >> v1:172.21.15.26:6789/0 conn(0x7f3e740c6af0 legacy=0x7f3e740c3da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e5c0039f0 0x7f3e5c003e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c004810 0x7f3e5c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e5c005210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740c7720 con 0x7f3e5c0039f0 2024-04-23T10:24:33.179 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e5c00bb90 con 0x7f3e5c004810 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3e5c00bd90 con 0x7f3e74152fe0 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e5c0039f0 0x7f3e5c003e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e73fff640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e5c005210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e72ffd640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c004810 0x7f3e5c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 -- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 msgr2=0x7f3e5c005210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e74152fe0 0x7f3e5c005210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 -- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c004810 msgr2=0x7f3e5c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c004810 0x7f3e5c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e737fe640 1 -- 172.21.15.26:0/1197807067 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e5c003530 con 0x7f3e5c0039f0 2024-04-23T10:24:33.180 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.177+0000 7f3e72ffd640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c004810 0x7f3e5c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e737fe640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e5c0039f0 0x7f3e5c003e10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3e64007360 tx=0x7f3e6401ce40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71d5486f0be4d0b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e640b2070 con 0x7f3e5c0039f0 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e640a5d40 con 0x7f3e5c0039f0 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e727fc640 1 -- 172.21.15.26:0/1197807067 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e64009be0 con 0x7f3e5c0039f0 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- 172.21.15.26:0/1197807067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e5c0039f0 msgr2=0x7f3e5c003e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 --2- 172.21.15.26:0/1197807067 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e5c0039f0 0x7f3e5c003e10 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f3e64007360 tx=0x7f3e6401ce40 comp rx=0 tx=0).stop 2024-04-23T10:24:33.182 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e73fff640 1 -- 172.21.15.26:0/1197807067 reap_dead start 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- 172.21.15.26:0/1197807067 shutdown_connections 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- 172.21.15.26:0/1197807067 >> 172.21.15.26:0/1197807067 conn(0x7f3e7406b9d0 msgr2=0x7f3e7406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- 172.21.15.26:0/1197807067 shutdown_connections 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- 172.21.15.26:0/1197807067 wait complete. 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 Processor -- start 2024-04-23T10:24:33.183 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.181+0000 7f3e7a209640 1 -- start start 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c0039f0 0x7f3e74072f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 0x7f3e74071cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3e74074080 con 0x7f3e740721f0 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3e740c65d0 con 0x7f3e5c0039f0 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3e7406c4f0 con 0x7f3e7413c160 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49802/0 (socket says 172.21.15.26:49802) 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 -- 172.21.15.26:0/498150781 learned_addr learned my addr 172.21.15.26:0/498150781 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:33.185 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e737fe640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c0039f0 0x7f3e74072f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e72ffd640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 0x7f3e74071cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 -- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 msgr2=0x7f3e74071cb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 0x7f3e74071cb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 -- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c0039f0 msgr2=0x7f3e74072f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c0039f0 0x7f3e74072f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 -- 172.21.15.26:0/498150781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3e74073460 con 0x7f3e740721f0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e72ffd640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 0x7f3e74071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e73fff640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3e740710d0 tx=0x7f3e6c00d890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c018070 con 0x7f3e740721f0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3e6c003600 con 0x7f3e740721f0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3e6c003a30 con 0x7f3e740721f0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3e740715e0 con 0x7f3e740721f0 2024-04-23T10:24:33.186 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3e74144dd0 con 0x7f3e740721f0 2024-04-23T10:24:33.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3e74075df0 con 0x7f3e740721f0 2024-04-23T10:24:33.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3e6c01b070 con 0x7f3e740721f0 2024-04-23T10:24:33.187 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 0x7f3e6006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:33.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.185+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3e6c086230 con 0x7f3e740721f0 2024-04-23T10:24:33.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.189+0000 7f3e737fe640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 0x7f3e6006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:33.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.189+0000 7f3e737fe640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 0x7f3e6006a870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e640af000 tx=0x7f3e64004a50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:33.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.193+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3e6c056460 con 0x7f3e740721f0 2024-04-23T10:24:33.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.361+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) -- 0x7f3e740c4830 con 0x7f3e740721f0 2024-04-23T10:24:33.360 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.361+0000 7f3e5bfff640 1 -- 172.21.15.26:0/498150781 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 0 entries v26) ==== 80+0+0 (secure 0 0 0) 0x7f3e6c055d60 con 0x7f3e740721f0 2024-04-23T10:24:33.360 INFO:teuthology.orchestra.run.smithi026.stderr:listed 0 entries 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 msgr2=0x7f3e6006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 0x7f3e6006a870 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7f3e640af000 tx=0x7f3e64004a50 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 msgr2=0x7f3e74148780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f3e740710d0 tx=0x7f3e6c00d890 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 shutdown_connections 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3e600683b0 0x7f3e6006a870 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3e740721f0 0x7f3e74148780 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3e7413c160 0x7f3e74071cb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 --2- 172.21.15.26:0/498150781 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3e5c0039f0 0x7f3e74072f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:33.363 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 >> 172.21.15.26:0/498150781 conn(0x7f3e7406b9d0 msgr2=0x7f3e740c4b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:33.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 shutdown_connections 2024-04-23T10:24:33.364 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:33.365+0000 7f3e7a209640 1 -- 172.21.15.26:0/498150781 wait complete. 2024-04-23T10:24:33.378 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi026.front.sepia.ceph.com... 2024-04-23T10:24:33.378 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:24:33.379 DEBUG:teuthology.orchestra.run.smithi026:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-04-23T10:24:33.388 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi026.stderr:ceph-fuse[35719]: fuse finished with error 0 and tester_r 0 2024-04-23T10:24:33.389 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:24:38.026 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:38.029 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:24:39.490 INFO:tasks.cephfs.mount:Cleaning up mount ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:24:39.490 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:24:39.491 DEBUG:teuthology.orchestra.run.smithi026:> (cd /home/ubuntu/cephtest && exec rmdir -- /home/ubuntu/cephtest/mnt.0) 2024-04-23T10:24:39.498 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:24:39.498 DEBUG:teuthology.orchestra.run.smithi026:> ip netns list 2024-04-23T10:24:39.547 INFO:teuthology.orchestra.run.smithi026.stdout:ceph-ns--home-ubuntu-cephtest-mnt.0 (id: 0) 2024-04-23T10:24:39.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:24:39.548 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip netns delete ceph-ns--home-ubuntu-cephtest-mnt.0 2024-04-23T10:24:39.604 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-04-23T10:24:39.604 DEBUG:teuthology.orchestra.run.smithi026:> sudo ip link delete ceph-brx 2024-04-23T10:24:39.792 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-23T10:24:39.801 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-23T10:24:39.801 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:24:39.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.933+0000 7f00c3f4f640 1 Processor -- start 2024-04-23T10:24:39.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.933+0000 7f00c3f4f640 1 -- start start 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c3f4f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc14fbc0 0x7f00bc06f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c3f4f640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00bc14ffa0 0x7f00bc0c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c3f4f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f00bc0c5d70 con 0x7f00bc074100 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c3f4f640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f00bc0c6050 con 0x7f00bc14ffa0 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c3f4f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f00bc0c6330 con 0x7f00bc14fbc0 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00bc14ffa0 0x7f00bc0c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f00bc14ffa0 0x7f00bc0c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49810/0 (socket says 172.21.15.26:49810) 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 -- 172.21.15.26:0/3838693798 learned_addr learned my addr 172.21.15.26:0/3838693798 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:39.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c1ceb640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc14fbc0 0x7f00bc06f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 -- 172.21.15.26:0/3838693798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc14fbc0 msgr2=0x7f00bc06f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:39.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc14fbc0 0x7f00bc06f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 -- 172.21.15.26:0/3838693798 >> v1:172.21.15.190:6789/0 conn(0x7f00bc074100 legacy=0x7f00bc0c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.937+0000 7f00c14ea640 1 -- 172.21.15.26:0/3838693798 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc0c6610 con 0x7f00bc14ffa0 2024-04-23T10:24:39.940 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c14ea640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14ffa0 0x7f00bc0c8220 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009870 tx=0x7f00ac01c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72357a8fe12edb05 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:39.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c0ce9640 1 -- 172.21.15.26:0/3838693798 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a9640 con 0x7f00bc14ffa0 2024-04-23T10:24:39.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c0ce9640 1 -- 172.21.15.26:0/3838693798 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac0a97e0 con 0x7f00bc14ffa0 2024-04-23T10:24:39.941 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c0ce9640 1 -- 172.21.15.26:0/3838693798 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a9bb0 con 0x7f00bc14ffa0 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3838693798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14ffa0 msgr2=0x7f00bc0c8220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14ffa0 0x7f00bc0c8220 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f00ac009870 tx=0x7f00ac01c560 comp rx=0 tx=0).stop 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3838693798 shutdown_connections 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14ffa0 0x7f00bc0c8220 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3838693798 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc14fbc0 0x7f00bc06f700 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.942 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.941+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3838693798 >> 172.21.15.26:0/3838693798 conn(0x7f00bc06b9d0 msgr2=0x7f00bc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:39.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3838693798 shutdown_connections 2024-04-23T10:24:39.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3838693798 wait complete. 2024-04-23T10:24:39.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 Processor -- start 2024-04-23T10:24:39.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- start start 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00bc074100 0x7f00bc142b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc0cb790 0x7f00bc13d400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc166420 con 0x7f00bc14fbc0 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f00bc1662a0 con 0x7f00bc074100 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c3f4f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f00bc1665a0 con 0x7f00bc0cb790 2024-04-23T10:24:39.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49818/0 (socket says 172.21.15.26:49818) 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 -- 172.21.15.26:0/3820480427 learned_addr learned my addr 172.21.15.26:0/3820480427 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c1ceb640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00bc074100 0x7f00bc142b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c24ec640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc0cb790 0x7f00bc13d400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 -- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc0cb790 msgr2=0x7f00bc13d400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc0cb790 0x7f00bc13d400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 -- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00bc074100 msgr2=0x7f00bc142b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00bc074100 0x7f00bc142b40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 -- 172.21.15.26:0/3820480427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f00bc0cbd30 con 0x7f00bc14fbc0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00c14ea640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0ab040 tx=0x7f00ac01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0a9640 con 0x7f00bc14fbc0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.945+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f00ac0b1820 con 0x7f00bc14fbc0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f00ac0b1c10 con 0x7f00bc14fbc0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f00bc0c3a80 con 0x7f00bc14fbc0 2024-04-23T10:24:39.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f00bc163010 con 0x7f00bc14fbc0 2024-04-23T10:24:39.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f00bc075df0 con 0x7f00bc14fbc0 2024-04-23T10:24:39.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00ac0a83a0 con 0x7f00bc14fbc0 2024-04-23T10:24:39.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00b27fc640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 0x7f00a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:39.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f00ac121540 con 0x7f00bc14fbc0 2024-04-23T10:24:39.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00c1ceb640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 0x7f00a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:39.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.949+0000 7f00c1ceb640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 0x7f00a006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f00b80073f0 tx=0x7f00b800b040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:39.952 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:39.953+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f00ac0c3030 con 0x7f00bc14fbc0 2024-04-23T10:24:40.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.113+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f00bc0c7df0 con 0x7f00a0068380 2024-04-23T10:24:40.138 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.141+0000 7f00b27fc640 1 -- 172.21.15.26:0/3820480427 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334569 (secure 0 0 0) 0x7f00bc0c7df0 con 0x7f00a0068380 2024-04-23T10:24:40.142 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:40.145 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:24:40.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 msgr2=0x7f00a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.145 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 0x7f00a006a840 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f00b80073f0 tx=0x7f00b800b040 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 msgr2=0x7f00bc0c4240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 crypto rx=0x7f00ac0ab040 tx=0x7f00ac01ada0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 shutdown_connections 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f00a0068380 0x7f00a006a840 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f00bc0cb790 0x7f00bc13d400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f00bc14fbc0 0x7f00bc0c4240 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 --2- 172.21.15.26:0/3820480427 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f00bc074100 0x7f00bc142b40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 >> 172.21.15.26:0/3820480427 conn(0x7f00bc06b9d0 msgr2=0x7f00bc06ed70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 shutdown_connections 2024-04-23T10:24:40.146 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.145+0000 7f00c3f4f640 1 -- 172.21.15.26:0/3820480427 wait complete. 2024-04-23T10:24:40.162 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-23T10:24:39.209610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48930,"ondisk_log_size":48930,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":82,"apply_latency_ms":82,"commit_latency_ns":82000000,"apply_latency_ns":82000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3528333,"num_objects":-403,"num_object_clones":0,"num_object_copies":-1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-403,"num_whiteouts":0,"num_read":12,"num_read_kb":54,"num_write":468,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005183"},"pg_stats":[{"pgid":"2.1f","version":"26'118","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.924273+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:24:27.924273+0000","last_peered":"2024-04-23T10:24:27.924273+0000","last_clean":"2024-04-23T10:24:27.924273+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:27.924273+0000","last_undegraded":"2024-04-23T10:24:27.924273+0000","last_fullsized":"2024-04-23T10:24:27.924273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544970+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:24:33.544970+0000","last_peered":"2024-04-23T10:24:33.544970+0000","last_clean":"2024-04-23T10:24:33.544970+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:33.544970+0000","last_undegraded":"2024-04-23T10:24:33.544970+0000","last_fullsized":"2024-04-23T10:24:33.544970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.015013+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:24:30.015013+0000","last_peered":"2024-04-23T10:24:30.015013+0000","last_clean":"2024-04-23T10:24:30.015013+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:24:30.015013+0000","last_undegraded":"2024-04-23T10:24:30.015013+0000","last_fullsized":"2024-04-23T10:24:30.015013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'473","reported_seq":504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.079668+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:24:25.079668+0000","last_peered":"2024-04-23T10:24:25.079668+0000","last_clean":"2024-04-23T10:24:25.079668+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:25.079668+0000","last_undegraded":"2024-04-23T10:24:25.079668+0000","last_fullsized":"2024-04-23T10:24:25.079668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.548547+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:24:33.548547+0000","last_peered":"2024-04-23T10:24:33.548547+0000","last_clean":"2024-04-23T10:24:33.548547+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:33.548547+0000","last_undegraded":"2024-04-23T10:24:33.548547+0000","last_fullsized":"2024-04-23T10:24:33.548547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":913,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.010030+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:24:30.010030+0000","last_peered":"2024-04-23T10:24:30.010030+0000","last_clean":"2024-04-23T10:24:30.010030+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:30.010030+0000","last_undegraded":"2024-04-23T10:24:30.010030+0000","last_fullsized":"2024-04-23T10:24:30.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'340","reported_seq":370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.049614+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:24:29.049614+0000","last_peered":"2024-04-23T10:24:29.049614+0000","last_clean":"2024-04-23T10:24:29.049614+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:29.049614+0000","last_undegraded":"2024-04-23T10:24:29.049614+0000","last_fullsized":"2024-04-23T10:24:29.049614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484064+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:24:33.484064+0000","last_peered":"2024-04-23T10:24:33.484064+0000","last_clean":"2024-04-23T10:24:33.484064+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:33.484064+0000","last_undegraded":"2024-04-23T10:24:33.484064+0000","last_fullsized":"2024-04-23T10:24:33.484064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.979936+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:24:29.979936+0000","last_peered":"2024-04-23T10:24:29.979936+0000","last_clean":"2024-04-23T10:24:29.979936+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:29.979936+0000","last_undegraded":"2024-04-23T10:24:29.979936+0000","last_fullsized":"2024-04-23T10:24:29.979936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'280","reported_seq":310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.005526+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:24:28.005526+0000","last_peered":"2024-04-23T10:24:28.005526+0000","last_clean":"2024-04-23T10:24:28.005526+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:28.005526+0000","last_undegraded":"2024-04-23T10:24:28.005526+0000","last_fullsized":"2024-04-23T10:24:28.005526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484949+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:24:33.484949+0000","last_peered":"2024-04-23T10:24:33.484949+0000","last_clean":"2024-04-23T10:24:33.484949+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:24:33.484949+0000","last_undegraded":"2024-04-23T10:24:33.484949+0000","last_fullsized":"2024-04-23T10:24:33.484949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.936877+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:24:29.936877+0000","last_peered":"2024-04-23T10:24:29.936877+0000","last_clean":"2024-04-23T10:24:29.936877+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:29.936877+0000","last_undegraded":"2024-04-23T10:24:29.936877+0000","last_fullsized":"2024-04-23T10:24:29.936877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.472721+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:24:33.472721+0000","last_peered":"2024-04-23T10:24:33.472721+0000","last_clean":"2024-04-23T10:24:33.472721+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:33.472721+0000","last_undegraded":"2024-04-23T10:24:33.472721+0000","last_fullsized":"2024-04-23T10:24:33.472721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'179","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.873263+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:24:25.873263+0000","last_peered":"2024-04-23T10:24:25.873263+0000","last_clean":"2024-04-23T10:24:25.873263+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:25.873263+0000","last_undegraded":"2024-04-23T10:24:25.873263+0000","last_fullsized":"2024-04-23T10:24:25.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060435+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:24:29.060435+0000","last_peered":"2024-04-23T10:24:29.060435+0000","last_clean":"2024-04-23T10:24:29.060435+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:29.060435+0000","last_undegraded":"2024-04-23T10:24:29.060435+0000","last_fullsized":"2024-04-23T10:24:29.060435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560764+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:24:33.560764+0000","last_peered":"2024-04-23T10:24:33.560764+0000","last_clean":"2024-04-23T10:24:33.560764+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:33.560764+0000","last_undegraded":"2024-04-23T10:24:33.560764+0000","last_fullsized":"2024-04-23T10:24:33.560764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'218","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.053169+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:24:25.053169+0000","last_peered":"2024-04-23T10:24:25.053169+0000","last_clean":"2024-04-23T10:24:25.053169+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:25.053169+0000","last_undegraded":"2024-04-23T10:24:25.053169+0000","last_fullsized":"2024-04-23T10:24:25.053169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917527+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:24:29.917527+0000","last_peered":"2024-04-23T10:24:29.917527+0000","last_clean":"2024-04-23T10:24:29.917527+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:29.917527+0000","last_undegraded":"2024-04-23T10:24:29.917527+0000","last_fullsized":"2024-04-23T10:24:29.917527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564275+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:24:33.564275+0000","last_peered":"2024-04-23T10:24:33.564275+0000","last_clean":"2024-04-23T10:24:33.564275+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:33.564275+0000","last_undegraded":"2024-04-23T10:24:33.564275+0000","last_fullsized":"2024-04-23T10:24:33.564275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.882235+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:24:23.882235+0000","last_peered":"2024-04-23T10:24:23.882235+0000","last_clean":"2024-04-23T10:24:23.882235+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:23.882235+0000","last_undegraded":"2024-04-23T10:24:23.882235+0000","last_fullsized":"2024-04-23T10:24:23.882235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.004676+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:24:30.004676+0000","last_peered":"2024-04-23T10:24:30.004676+0000","last_clean":"2024-04-23T10:24:30.004676+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:30.004676+0000","last_undegraded":"2024-04-23T10:24:30.004676+0000","last_fullsized":"2024-04-23T10:24:30.004676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.469317+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:24:33.469317+0000","last_peered":"2024-04-23T10:24:33.469317+0000","last_clean":"2024-04-23T10:24:33.469317+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:33.469317+0000","last_undegraded":"2024-04-23T10:24:33.469317+0000","last_fullsized":"2024-04-23T10:24:33.469317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'475","reported_seq":506,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875874+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:24:25.875874+0000","last_peered":"2024-04-23T10:24:25.875874+0000","last_clean":"2024-04-23T10:24:25.875874+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:25.875874+0000","last_undegraded":"2024-04-23T10:24:25.875874+0000","last_fullsized":"2024-04-23T10:24:25.875874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.018213+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:24:30.018213+0000","last_peered":"2024-04-23T10:24:30.018213+0000","last_clean":"2024-04-23T10:24:30.018213+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:30.018213+0000","last_undegraded":"2024-04-23T10:24:30.018213+0000","last_fullsized":"2024-04-23T10:24:30.018213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560778+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:24:33.560778+0000","last_peered":"2024-04-23T10:24:33.560778+0000","last_clean":"2024-04-23T10:24:33.560778+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:33.560778+0000","last_undegraded":"2024-04-23T10:24:33.560778+0000","last_fullsized":"2024-04-23T10:24:33.560778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'80","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.943277+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:24:27.943277+0000","last_peered":"2024-04-23T10:24:27.943277+0000","last_clean":"2024-04-23T10:24:27.943277+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:27.943277+0000","last_undegraded":"2024-04-23T10:24:27.943277+0000","last_fullsized":"2024-04-23T10:24:27.943277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":960,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.945497+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:24:29.945497+0000","last_peered":"2024-04-23T10:24:29.945497+0000","last_clean":"2024-04-23T10:24:29.945497+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:29.945497+0000","last_undegraded":"2024-04-23T10:24:29.945497+0000","last_fullsized":"2024-04-23T10:24:29.945497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541259+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:24:33.541259+0000","last_peered":"2024-04-23T10:24:33.541259+0000","last_clean":"2024-04-23T10:24:33.541259+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:33.541259+0000","last_undegraded":"2024-04-23T10:24:33.541259+0000","last_fullsized":"2024-04-23T10:24:33.541259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'476","reported_seq":507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.750104+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:24:30.750104+0000","last_peered":"2024-04-23T10:24:30.750104+0000","last_clean":"2024-04-23T10:24:30.750104+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:30.750104+0000","last_undegraded":"2024-04-23T10:24:30.750104+0000","last_fullsized":"2024-04-23T10:24:30.750104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.105305+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:24:29.105305+0000","last_peered":"2024-04-23T10:24:29.105305+0000","last_clean":"2024-04-23T10:24:29.105305+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:29.105305+0000","last_undegraded":"2024-04-23T10:24:29.105305+0000","last_fullsized":"2024-04-23T10:24:29.105305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.435786+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:24:33.435786+0000","last_peered":"2024-04-23T10:24:33.435786+0000","last_clean":"2024-04-23T10:24:33.435786+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:33.435786+0000","last_undegraded":"2024-04-23T10:24:33.435786+0000","last_fullsized":"2024-04-23T10:24:33.435786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'228","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.015506+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:24:25.015506+0000","last_peered":"2024-04-23T10:24:25.015506+0000","last_clean":"2024-04-23T10:24:25.015506+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:25.015506+0000","last_undegraded":"2024-04-23T10:24:25.015506+0000","last_fullsized":"2024-04-23T10:24:25.015506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.009539+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:24:30.009539+0000","last_peered":"2024-04-23T10:24:30.009539+0000","last_clean":"2024-04-23T10:24:30.009539+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:30.009539+0000","last_undegraded":"2024-04-23T10:24:30.009539+0000","last_fullsized":"2024-04-23T10:24:30.009539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549700+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:24:33.549700+0000","last_peered":"2024-04-23T10:24:33.549700+0000","last_clean":"2024-04-23T10:24:33.549700+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:33.549700+0000","last_undegraded":"2024-04-23T10:24:33.549700+0000","last_fullsized":"2024-04-23T10:24:33.549700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875263+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:24:25.875263+0000","last_peered":"2024-04-23T10:24:25.875263+0000","last_clean":"2024-04-23T10:24:25.875263+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:25.875263+0000","last_undegraded":"2024-04-23T10:24:25.875263+0000","last_fullsized":"2024-04-23T10:24:25.875263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.949787+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:24:29.949787+0000","last_peered":"2024-04-23T10:24:29.949787+0000","last_clean":"2024-04-23T10:24:29.949787+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:29.949787+0000","last_undegraded":"2024-04-23T10:24:29.949787+0000","last_fullsized":"2024-04-23T10:24:29.949787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560629+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:24:33.560629+0000","last_peered":"2024-04-23T10:24:33.560629+0000","last_clean":"2024-04-23T10:24:33.560629+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:33.560629+0000","last_undegraded":"2024-04-23T10:24:33.560629+0000","last_fullsized":"2024-04-23T10:24:33.560629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1260","reported_seq":1291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:15.892836+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:24:15.892836+0000","last_peered":"2024-04-23T10:24:15.892836+0000","last_clean":"2024-04-23T10:24:15.892836+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:15.892836+0000","last_undegraded":"2024-04-23T10:24:15.892836+0000","last_fullsized":"2024-04-23T10:24:15.892836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.038327+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:24:30.038327+0000","last_peered":"2024-04-23T10:24:30.038327+0000","last_clean":"2024-04-23T10:24:30.038327+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:30.038327+0000","last_undegraded":"2024-04-23T10:24:30.038327+0000","last_fullsized":"2024-04-23T10:24:30.038327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.439036+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:24:33.439036+0000","last_peered":"2024-04-23T10:24:33.439036+0000","last_clean":"2024-04-23T10:24:33.439036+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:33.439036+0000","last_undegraded":"2024-04-23T10:24:33.439036+0000","last_fullsized":"2024-04-23T10:24:33.439036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'678","reported_seq":1305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:31.909387+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:24:31.909387+0000","last_peered":"2024-04-23T10:24:31.909387+0000","last_clean":"2024-04-23T10:24:31.909387+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:31.909387+0000","last_undegraded":"2024-04-23T10:24:31.909387+0000","last_fullsized":"2024-04-23T10:24:31.909387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.961324+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:24:29.961324+0000","last_peered":"2024-04-23T10:24:29.961324+0000","last_clean":"2024-04-23T10:24:29.961324+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:29.961324+0000","last_undegraded":"2024-04-23T10:24:29.961324+0000","last_fullsized":"2024-04-23T10:24:29.961324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551035+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:24:33.551035+0000","last_peered":"2024-04-23T10:24:33.551035+0000","last_clean":"2024-04-23T10:24:33.551035+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:33.551035+0000","last_undegraded":"2024-04-23T10:24:33.551035+0000","last_fullsized":"2024-04-23T10:24:33.551035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'821","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.130128+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:24:28.130128+0000","last_peered":"2024-04-23T10:24:28.130128+0000","last_clean":"2024-04-23T10:24:28.130128+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:28.130128+0000","last_undegraded":"2024-04-23T10:24:28.130128+0000","last_fullsized":"2024-04-23T10:24:28.130128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.968924+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:24:29.968924+0000","last_peered":"2024-04-23T10:24:29.968924+0000","last_clean":"2024-04-23T10:24:29.968924+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:29.968924+0000","last_undegraded":"2024-04-23T10:24:29.968924+0000","last_fullsized":"2024-04-23T10:24:29.968924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.543989+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:24:33.543989+0000","last_peered":"2024-04-23T10:24:33.543989+0000","last_clean":"2024-04-23T10:24:33.543989+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:33.543989+0000","last_undegraded":"2024-04-23T10:24:33.543989+0000","last_fullsized":"2024-04-23T10:24:33.543989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060231+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:24:29.060231+0000","last_peered":"2024-04-23T10:24:29.060231+0000","last_clean":"2024-04-23T10:24:29.060231+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:29.060231+0000","last_undegraded":"2024-04-23T10:24:29.060231+0000","last_fullsized":"2024-04-23T10:24:29.060231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:22:26.305857+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:22:26.305857+0000","last_peered":"2024-04-23T10:22:26.305857+0000","last_clean":"2024-04-23T10:22:26.305857+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:22:26.305857+0000","last_undegraded":"2024-04-23T10:22:26.305857+0000","last_fullsized":"2024-04-23T10:22:26.305857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.984831+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:24:29.984831+0000","last_peered":"2024-04-23T10:24:29.984831+0000","last_clean":"2024-04-23T10:24:29.984831+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:29.984831+0000","last_undegraded":"2024-04-23T10:24:29.984831+0000","last_fullsized":"2024-04-23T10:24:29.984831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502905+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:24:33.502905+0000","last_peered":"2024-04-23T10:24:33.502905+0000","last_clean":"2024-04-23T10:24:33.502905+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:33.502905+0000","last_undegraded":"2024-04-23T10:24:33.502905+0000","last_fullsized":"2024-04-23T10:24:33.502905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.940375+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:24:29.940375+0000","last_peered":"2024-04-23T10:24:29.940375+0000","last_clean":"2024-04-23T10:24:29.940375+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:29.940375+0000","last_undegraded":"2024-04-23T10:24:29.940375+0000","last_fullsized":"2024-04-23T10:24:29.940375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.922885+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:24:29.922885+0000","last_peered":"2024-04-23T10:24:29.922885+0000","last_clean":"2024-04-23T10:24:29.922885+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:29.922885+0000","last_undegraded":"2024-04-23T10:24:29.922885+0000","last_fullsized":"2024-04-23T10:24:29.922885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.553149+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:24:33.553149+0000","last_peered":"2024-04-23T10:24:33.553149+0000","last_clean":"2024-04-23T10:24:33.553149+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:33.553149+0000","last_undegraded":"2024-04-23T10:24:33.553149+0000","last_fullsized":"2024-04-23T10:24:33.553149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'596","reported_seq":627,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.987525+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:24:24.987525+0000","last_peered":"2024-04-23T10:24:24.987525+0000","last_clean":"2024-04-23T10:24:24.987525+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:24.987525+0000","last_undegraded":"2024-04-23T10:24:24.987525+0000","last_fullsized":"2024-04-23T10:24:24.987525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.136676+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:24:29.136676+0000","last_peered":"2024-04-23T10:24:29.136676+0000","last_clean":"2024-04-23T10:24:29.136676+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:29.136676+0000","last_undegraded":"2024-04-23T10:24:29.136676+0000","last_fullsized":"2024-04-23T10:24:29.136676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507457+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:24:33.507457+0000","last_peered":"2024-04-23T10:24:33.507457+0000","last_clean":"2024-04-23T10:24:33.507457+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:33.507457+0000","last_undegraded":"2024-04-23T10:24:33.507457+0000","last_fullsized":"2024-04-23T10:24:33.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'411","reported_seq":441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:18.824761+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:24:18.824761+0000","last_peered":"2024-04-23T10:24:18.824761+0000","last_clean":"2024-04-23T10:24:18.824761+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:18.824761+0000","last_undegraded":"2024-04-23T10:24:18.824761+0000","last_fullsized":"2024-04-23T10:24:18.824761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.019063+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:24:30.019063+0000","last_peered":"2024-04-23T10:24:30.019063+0000","last_clean":"2024-04-23T10:24:30.019063+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:24:30.019063+0000","last_undegraded":"2024-04-23T10:24:30.019063+0000","last_fullsized":"2024-04-23T10:24:30.019063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502372+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:24:33.502372+0000","last_peered":"2024-04-23T10:24:33.502372+0000","last_clean":"2024-04-23T10:24:33.502372+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:24:33.502372+0000","last_undegraded":"2024-04-23T10:24:33.502372+0000","last_fullsized":"2024-04-23T10:24:33.502372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'184","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.124538+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:24:29.124538+0000","last_peered":"2024-04-23T10:24:29.124538+0000","last_clean":"2024-04-23T10:24:29.124538+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:29.124538+0000","last_undegraded":"2024-04-23T10:24:29.124538+0000","last_fullsized":"2024-04-23T10:24:29.124538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.022137+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:24:30.022137+0000","last_peered":"2024-04-23T10:24:30.022137+0000","last_clean":"2024-04-23T10:24:30.022137+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:30.022137+0000","last_undegraded":"2024-04-23T10:24:30.022137+0000","last_fullsized":"2024-04-23T10:24:30.022137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.498935+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:24:33.498935+0000","last_peered":"2024-04-23T10:24:33.498935+0000","last_clean":"2024-04-23T10:24:33.498935+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:33.498935+0000","last_undegraded":"2024-04-23T10:24:33.498935+0000","last_fullsized":"2024-04-23T10:24:33.498935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'235","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:34.310965+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:24:34.310965+0000","last_peered":"2024-04-23T10:24:34.310965+0000","last_clean":"2024-04-23T10:24:34.310965+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:34.310965+0000","last_undegraded":"2024-04-23T10:24:34.310965+0000","last_fullsized":"2024-04-23T10:24:34.310965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.976890+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:24:29.976890+0000","last_peered":"2024-04-23T10:24:29.976890+0000","last_clean":"2024-04-23T10:24:29.976890+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:29.976890+0000","last_undegraded":"2024-04-23T10:24:29.976890+0000","last_fullsized":"2024-04-23T10:24:29.976890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559222+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:24:33.559222+0000","last_peered":"2024-04-23T10:24:33.559222+0000","last_clean":"2024-04-23T10:24:33.559222+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:33.559222+0000","last_undegraded":"2024-04-23T10:24:33.559222+0000","last_fullsized":"2024-04-23T10:24:33.559222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'75","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:21.921579+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:24:21.921579+0000","last_peered":"2024-04-23T10:24:21.921579+0000","last_clean":"2024-04-23T10:24:21.921579+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:21.921579+0000","last_undegraded":"2024-04-23T10:24:21.921579+0000","last_fullsized":"2024-04-23T10:24:21.921579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.138272+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:24:29.138272+0000","last_peered":"2024-04-23T10:24:29.138272+0000","last_clean":"2024-04-23T10:24:29.138272+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:29.138272+0000","last_undegraded":"2024-04-23T10:24:29.138272+0000","last_fullsized":"2024-04-23T10:24:29.138272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504309+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:24:33.504309+0000","last_peered":"2024-04-23T10:24:33.504309+0000","last_clean":"2024-04-23T10:24:33.504309+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:33.504309+0000","last_undegraded":"2024-04-23T10:24:33.504309+0000","last_fullsized":"2024-04-23T10:24:33.504309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'72","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.905924+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:24:29.905924+0000","last_peered":"2024-04-23T10:24:29.905924+0000","last_clean":"2024-04-23T10:24:29.905924+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:29.905924+0000","last_undegraded":"2024-04-23T10:24:29.905924+0000","last_fullsized":"2024-04-23T10:24:29.905924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.954554+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:24:29.954554+0000","last_peered":"2024-04-23T10:24:29.954554+0000","last_clean":"2024-04-23T10:24:29.954554+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:29.954554+0000","last_undegraded":"2024-04-23T10:24:29.954554+0000","last_fullsized":"2024-04-23T10:24:29.954554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.558092+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:24:33.558092+0000","last_peered":"2024-04-23T10:24:33.558092+0000","last_clean":"2024-04-23T10:24:33.558092+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:33.558092+0000","last_undegraded":"2024-04-23T10:24:33.558092+0000","last_fullsized":"2024-04-23T10:24:33.558092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'560","reported_seq":590,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:16.384742+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:24:16.384742+0000","last_peered":"2024-04-23T10:24:16.384742+0000","last_clean":"2024-04-23T10:24:16.384742+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:16.384742+0000","last_undegraded":"2024-04-23T10:24:16.384742+0000","last_fullsized":"2024-04-23T10:24:16.384742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.035161+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:24:30.035161+0000","last_peered":"2024-04-23T10:24:30.035161+0000","last_clean":"2024-04-23T10:24:30.035161+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:24:30.035161+0000","last_undegraded":"2024-04-23T10:24:30.035161+0000","last_fullsized":"2024-04-23T10:24:30.035161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554735+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:24:33.554735+0000","last_peered":"2024-04-23T10:24:33.554735+0000","last_clean":"2024-04-23T10:24:33.554735+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:24:33.554735+0000","last_undegraded":"2024-04-23T10:24:33.554735+0000","last_fullsized":"2024-04-23T10:24:33.554735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'413","reported_seq":444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.015396+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:24:23.015396+0000","last_peered":"2024-04-23T10:24:23.015396+0000","last_clean":"2024-04-23T10:24:23.015396+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:23.015396+0000","last_undegraded":"2024-04-23T10:24:23.015396+0000","last_fullsized":"2024-04-23T10:24:23.015396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.935827+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:24:29.935827+0000","last_peered":"2024-04-23T10:24:29.935827+0000","last_clean":"2024-04-23T10:24:29.935827+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:29.935827+0000","last_undegraded":"2024-04-23T10:24:29.935827+0000","last_fullsized":"2024-04-23T10:24:29.935827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503506+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:24:33.503506+0000","last_peered":"2024-04-23T10:24:33.503506+0000","last_clean":"2024-04-23T10:24:33.503506+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:33.503506+0000","last_undegraded":"2024-04-23T10:24:33.503506+0000","last_fullsized":"2024-04-23T10:24:33.503506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'298","reported_seq":328,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.275896+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:24:30.275896+0000","last_peered":"2024-04-23T10:24:30.275896+0000","last_clean":"2024-04-23T10:24:30.275896+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:30.275896+0000","last_undegraded":"2024-04-23T10:24:30.275896+0000","last_fullsized":"2024-04-23T10:24:30.275896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.978436+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:24:29.978436+0000","last_peered":"2024-04-23T10:24:29.978436+0000","last_clean":"2024-04-23T10:24:29.978436+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:29.978436+0000","last_undegraded":"2024-04-23T10:24:29.978436+0000","last_fullsized":"2024-04-23T10:24:29.978436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.547587+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:24:33.547587+0000","last_peered":"2024-04-23T10:24:33.547587+0000","last_clean":"2024-04-23T10:24:33.547587+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:33.547587+0000","last_undegraded":"2024-04-23T10:24:33.547587+0000","last_fullsized":"2024-04-23T10:24:33.547587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'274","reported_seq":304,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.953756+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:24:27.953756+0000","last_peered":"2024-04-23T10:24:27.953756+0000","last_clean":"2024-04-23T10:24:27.953756+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:27.953756+0000","last_undegraded":"2024-04-23T10:24:27.953756+0000","last_fullsized":"2024-04-23T10:24:27.953756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.029718+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:24:30.029718+0000","last_peered":"2024-04-23T10:24:30.029718+0000","last_clean":"2024-04-23T10:24:30.029718+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:30.029718+0000","last_undegraded":"2024-04-23T10:24:30.029718+0000","last_fullsized":"2024-04-23T10:24:30.029718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503116+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:24:33.503116+0000","last_peered":"2024-04-23T10:24:33.503116+0000","last_clean":"2024-04-23T10:24:33.503116+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:33.503116+0000","last_undegraded":"2024-04-23T10:24:33.503116+0000","last_fullsized":"2024-04-23T10:24:33.503116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.397534+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:24:33.397534+0000","last_peered":"2024-04-23T10:24:33.397534+0000","last_clean":"2024-04-23T10:24:33.397534+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:33.397534+0000","last_undegraded":"2024-04-23T10:24:33.397534+0000","last_fullsized":"2024-04-23T10:24:33.397534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.026126+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:24:30.026126+0000","last_peered":"2024-04-23T10:24:30.026126+0000","last_clean":"2024-04-23T10:24:30.026126+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:30.026126+0000","last_undegraded":"2024-04-23T10:24:30.026126+0000","last_fullsized":"2024-04-23T10:24:30.026126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.992752+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:24:29.992752+0000","last_peered":"2024-04-23T10:24:29.992752+0000","last_clean":"2024-04-23T10:24:29.992752+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:29.992752+0000","last_undegraded":"2024-04-23T10:24:29.992752+0000","last_fullsized":"2024-04-23T10:24:29.992752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.561905+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:24:33.561905+0000","last_peered":"2024-04-23T10:24:33.561905+0000","last_clean":"2024-04-23T10:24:33.561905+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:33.561905+0000","last_undegraded":"2024-04-23T10:24:33.561905+0000","last_fullsized":"2024-04-23T10:24:33.561905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1046","reported_seq":1076,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.915613+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:24:23.915613+0000","last_peered":"2024-04-23T10:24:23.915613+0000","last_clean":"2024-04-23T10:24:23.915613+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:23.915613+0000","last_undegraded":"2024-04-23T10:24:23.915613+0000","last_fullsized":"2024-04-23T10:24:23.915613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.993724+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:24:28.993724+0000","last_peered":"2024-04-23T10:24:28.993724+0000","last_clean":"2024-04-23T10:24:28.993724+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:28.993724+0000","last_undegraded":"2024-04-23T10:24:28.993724+0000","last_fullsized":"2024-04-23T10:24:28.993724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554764+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:24:33.554764+0000","last_peered":"2024-04-23T10:24:33.554764+0000","last_clean":"2024-04-23T10:24:33.554764+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:33.554764+0000","last_undegraded":"2024-04-23T10:24:33.554764+0000","last_fullsized":"2024-04-23T10:24:33.554764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'152","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.916439+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:24:23.916439+0000","last_peered":"2024-04-23T10:24:23.916439+0000","last_clean":"2024-04-23T10:24:23.916439+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:23.916439+0000","last_undegraded":"2024-04-23T10:24:23.916439+0000","last_fullsized":"2024-04-23T10:24:23.916439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:22.944498+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:24:22.944498+0000","last_peered":"2024-04-23T10:24:22.944498+0000","last_clean":"2024-04-23T10:24:22.944498+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:22.944498+0000","last_undegraded":"2024-04-23T10:24:22.944498+0000","last_fullsized":"2024-04-23T10:24:22.944498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564241+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:24:33.564241+0000","last_peered":"2024-04-23T10:24:33.564241+0000","last_clean":"2024-04-23T10:24:33.564241+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:33.564241+0000","last_undegraded":"2024-04-23T10:24:33.564241+0000","last_fullsized":"2024-04-23T10:24:33.564241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.960197+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:24:29.960197+0000","last_peered":"2024-04-23T10:24:29.960197+0000","last_clean":"2024-04-23T10:24:29.960197+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:29.960197+0000","last_undegraded":"2024-04-23T10:24:29.960197+0000","last_fullsized":"2024-04-23T10:24:29.960197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'112","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.927138+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:24:24.927138+0000","last_peered":"2024-04-23T10:24:24.927138+0000","last_clean":"2024-04-23T10:24:24.927138+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:24.927138+0000","last_undegraded":"2024-04-23T10:24:24.927138+0000","last_fullsized":"2024-04-23T10:24:24.927138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473116+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:24:33.473116+0000","last_peered":"2024-04-23T10:24:33.473116+0000","last_clean":"2024-04-23T10:24:33.473116+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:33.473116+0000","last_undegraded":"2024-04-23T10:24:33.473116+0000","last_fullsized":"2024-04-23T10:24:33.473116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.131318+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:24:29.131318+0000","last_peered":"2024-04-23T10:24:29.131318+0000","last_clean":"2024-04-23T10:24:29.131318+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:24:29.131318+0000","last_undegraded":"2024-04-23T10:24:29.131318+0000","last_fullsized":"2024-04-23T10:24:29.131318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559932+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:24:33.559932+0000","last_peered":"2024-04-23T10:24:33.559932+0000","last_clean":"2024-04-23T10:24:33.559932+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:33.559932+0000","last_undegraded":"2024-04-23T10:24:33.559932+0000","last_fullsized":"2024-04-23T10:24:33.559932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541987+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:24:33.541987+0000","last_peered":"2024-04-23T10:24:33.541987+0000","last_clean":"2024-04-23T10:24:33.541987+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:33.541987+0000","last_undegraded":"2024-04-23T10:24:33.541987+0000","last_fullsized":"2024-04-23T10:24:33.541987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549732+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:24:33.549732+0000","last_peered":"2024-04-23T10:24:33.549732+0000","last_clean":"2024-04-23T10:24:33.549732+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:33.549732+0000","last_undegraded":"2024-04-23T10:24:33.549732+0000","last_fullsized":"2024-04-23T10:24:33.549732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.562847+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:24:33.562847+0000","last_peered":"2024-04-23T10:24:33.562847+0000","last_clean":"2024-04-23T10:24:33.562847+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:33.562847+0000","last_undegraded":"2024-04-23T10:24:33.562847+0000","last_fullsized":"2024-04-23T10:24:33.562847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.552147+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:24:33.552147+0000","last_peered":"2024-04-23T10:24:33.552147+0000","last_clean":"2024-04-23T10:24:33.552147+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:33.552147+0000","last_undegraded":"2024-04-23T10:24:33.552147+0000","last_fullsized":"2024-04-23T10:24:33.552147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560580+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:24:33.560580+0000","last_peered":"2024-04-23T10:24:33.560580+0000","last_clean":"2024-04-23T10:24:33.560580+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:33.560580+0000","last_undegraded":"2024-04-23T10:24:33.560580+0000","last_fullsized":"2024-04-23T10:24:33.560580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502105+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:24:33.502105+0000","last_peered":"2024-04-23T10:24:33.502105+0000","last_clean":"2024-04-23T10:24:33.502105+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:33.502105+0000","last_undegraded":"2024-04-23T10:24:33.502105+0000","last_fullsized":"2024-04-23T10:24:33.502105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544972+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:24:33.544972+0000","last_peered":"2024-04-23T10:24:33.544972+0000","last_clean":"2024-04-23T10:24:33.544972+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:33.544972+0000","last_undegraded":"2024-04-23T10:24:33.544972+0000","last_fullsized":"2024-04-23T10:24:33.544972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549783+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:24:33.549783+0000","last_peered":"2024-04-23T10:24:33.549783+0000","last_clean":"2024-04-23T10:24:33.549783+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:33.549783+0000","last_undegraded":"2024-04-23T10:24:33.549783+0000","last_fullsized":"2024-04-23T10:24:33.549783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.545594+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:24:33.545594+0000","last_peered":"2024-04-23T10:24:33.545594+0000","last_clean":"2024-04-23T10:24:33.545594+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:33.545594+0000","last_undegraded":"2024-04-23T10:24:33.545594+0000","last_fullsized":"2024-04-23T10:24:33.545594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501556+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:24:33.501556+0000","last_peered":"2024-04-23T10:24:33.501556+0000","last_clean":"2024-04-23T10:24:33.501556+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:33.501556+0000","last_undegraded":"2024-04-23T10:24:33.501556+0000","last_fullsized":"2024-04-23T10:24:33.501556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564160+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:24:33.564160+0000","last_peered":"2024-04-23T10:24:33.564160+0000","last_clean":"2024-04-23T10:24:33.564160+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:33.564160+0000","last_undegraded":"2024-04-23T10:24:33.564160+0000","last_fullsized":"2024-04-23T10:24:33.564160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473964+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:24:33.473964+0000","last_peered":"2024-04-23T10:24:33.473964+0000","last_clean":"2024-04-23T10:24:33.473964+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:33.473964+0000","last_undegraded":"2024-04-23T10:24:33.473964+0000","last_fullsized":"2024-04-23T10:24:33.473964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554626+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:24:33.554626+0000","last_peered":"2024-04-23T10:24:33.554626+0000","last_clean":"2024-04-23T10:24:33.554626+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:33.554626+0000","last_undegraded":"2024-04-23T10:24:33.554626+0000","last_fullsized":"2024-04-23T10:24:33.554626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.546876+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:24:33.546876+0000","last_peered":"2024-04-23T10:24:33.546876+0000","last_clean":"2024-04-23T10:24:33.546876+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:33.546876+0000","last_undegraded":"2024-04-23T10:24:33.546876+0000","last_fullsized":"2024-04-23T10:24:33.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501448+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:24:33.501448+0000","last_peered":"2024-04-23T10:24:33.501448+0000","last_clean":"2024-04-23T10:24:33.501448+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:33.501448+0000","last_undegraded":"2024-04-23T10:24:33.501448+0000","last_fullsized":"2024-04-23T10:24:33.501448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555566+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:24:33.555566+0000","last_peered":"2024-04-23T10:24:33.555566+0000","last_clean":"2024-04-23T10:24:33.555566+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:33.555566+0000","last_undegraded":"2024-04-23T10:24:33.555566+0000","last_fullsized":"2024-04-23T10:24:33.555566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.467678+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:24:33.467678+0000","last_peered":"2024-04-23T10:24:33.467678+0000","last_clean":"2024-04-23T10:24:33.467678+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:33.467678+0000","last_undegraded":"2024-04-23T10:24:33.467678+0000","last_fullsized":"2024-04-23T10:24:33.467678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560655+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:24:33.560655+0000","last_peered":"2024-04-23T10:24:33.560655+0000","last_clean":"2024-04-23T10:24:33.560655+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:33.560655+0000","last_undegraded":"2024-04-23T10:24:33.560655+0000","last_fullsized":"2024-04-23T10:24:33.560655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.556154+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:24:33.556154+0000","last_peered":"2024-04-23T10:24:33.556154+0000","last_clean":"2024-04-23T10:24:33.556154+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:33.556154+0000","last_undegraded":"2024-04-23T10:24:33.556154+0000","last_fullsized":"2024-04-23T10:24:33.556154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.477633+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:24:33.477633+0000","last_peered":"2024-04-23T10:24:33.477633+0000","last_clean":"2024-04-23T10:24:33.477633+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:33.477633+0000","last_undegraded":"2024-04-23T10:24:33.477633+0000","last_fullsized":"2024-04-23T10:24:33.477633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.481582+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:24:33.481582+0000","last_peered":"2024-04-23T10:24:33.481582+0000","last_clean":"2024-04-23T10:24:33.481582+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:33.481582+0000","last_undegraded":"2024-04-23T10:24:33.481582+0000","last_fullsized":"2024-04-23T10:24:33.481582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.489052+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:24:33.489052+0000","last_peered":"2024-04-23T10:24:33.489052+0000","last_clean":"2024-04-23T10:24:33.489052+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:33.489052+0000","last_undegraded":"2024-04-23T10:24:33.489052+0000","last_fullsized":"2024-04-23T10:24:33.489052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507582+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:24:33.507582+0000","last_peered":"2024-04-23T10:24:33.507582+0000","last_clean":"2024-04-23T10:24:33.507582+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:33.507582+0000","last_undegraded":"2024-04-23T10:24:33.507582+0000","last_fullsized":"2024-04-23T10:24:33.507582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551211+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:24:33.551211+0000","last_peered":"2024-04-23T10:24:33.551211+0000","last_clean":"2024-04-23T10:24:33.551211+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:33.551211+0000","last_undegraded":"2024-04-23T10:24:33.551211+0000","last_fullsized":"2024-04-23T10:24:33.551211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559120+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:24:33.559120+0000","last_peered":"2024-04-23T10:24:33.559120+0000","last_clean":"2024-04-23T10:24:33.559120+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:24:33.559120+0000","last_undegraded":"2024-04-23T10:24:33.559120+0000","last_fullsized":"2024-04-23T10:24:33.559120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559225+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:24:33.559225+0000","last_peered":"2024-04-23T10:24:33.559225+0000","last_clean":"2024-04-23T10:24:33.559225+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:33.559225+0000","last_undegraded":"2024-04-23T10:24:33.559225+0000","last_fullsized":"2024-04-23T10:24:33.559225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554394+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:24:33.554394+0000","last_peered":"2024-04-23T10:24:33.554394+0000","last_clean":"2024-04-23T10:24:33.554394+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:33.554394+0000","last_undegraded":"2024-04-23T10:24:33.554394+0000","last_fullsized":"2024-04-23T10:24:33.554394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559435+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:24:33.559435+0000","last_peered":"2024-04-23T10:24:33.559435+0000","last_clean":"2024-04-23T10:24:33.559435+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:33.559435+0000","last_undegraded":"2024-04-23T10:24:33.559435+0000","last_fullsized":"2024-04-23T10:24:33.559435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555603+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:24:33.555603+0000","last_peered":"2024-04-23T10:24:33.555603+0000","last_clean":"2024-04-23T10:24:33.555603+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:33.555603+0000","last_undegraded":"2024-04-23T10:24:33.555603+0000","last_fullsized":"2024-04-23T10:24:33.555603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.431229+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:24:33.431229+0000","last_peered":"2024-04-23T10:24:33.431229+0000","last_clean":"2024-04-23T10:24:33.431229+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:33.431229+0000","last_undegraded":"2024-04-23T10:24:33.431229+0000","last_fullsized":"2024-04-23T10:24:33.431229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504628+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:24:33.504628+0000","last_peered":"2024-04-23T10:24:33.504628+0000","last_clean":"2024-04-23T10:24:33.504628+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:24:33.504628+0000","last_undegraded":"2024-04-23T10:24:33.504628+0000","last_fullsized":"2024-04-23T10:24:33.504628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10774,"ondisk_log_size":10774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:24:40.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:24:40.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 Processor -- start 2024-04-23T10:24:40.333 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 -- start start 2024-04-23T10:24:40.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c4406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c440c5d70 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9c440c6050 con 0x7f9c4414fbc0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.333+0000 7f9c4a5ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440c6330 con 0x7f9c44074100 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f9c4414ffa0 0x7f9c440c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51408/0 (socket says 172.21.15.26:51408) 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 -- 172.21.15.26:0/2307704288 learned_addr learned my addr 172.21.15.26:0/2307704288 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c48b8a640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c4406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3126703895 0 0) 0x7f9c440c5d70 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f9c2c003530 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3901939458 0 0) 0x7f9c2c003530 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 msgr2=0x7f9c4406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c4406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 >> v1:172.21.15.190:6789/0 conn(0x7f9c4414fbc0 legacy=0x7f9c440c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c440c6610 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f9c38001680 con 0x7f9c4414ffa0 2024-04-23T10:24:40.336 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 >> v1:172.21.15.26:6789/0 conn(0x7f9c4414ffa0 legacy=0x7f9c440c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c2c0039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2c003f70 0x7f9c2c004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c004d50 0x7f9c2c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440c6330 con 0x7f9c2c003f70 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c2c00bab0 con 0x7f9c2c004d50 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c2c00bcb0 con 0x7f9c44074100 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2c003f70 0x7f9c2c004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c48b8a640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c004d50 0x7f9c2c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c43fff640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c2c0039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 -- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 msgr2=0x7f9c2c0039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c44074100 0x7f9c2c0039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 -- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c004d50 msgr2=0x7f9c2c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c004d50 0x7f9c2c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 -- 172.21.15.26:0/2307704288 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c2c003530 con 0x7f9c2c003f70 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c437fe640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2c003f70 0x7f9c2c004810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800c1c0 tx=0x7f9c3801f3d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1a92a3f0b84b691 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38007d00 con 0x7f9c2c003f70 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38005b00 con 0x7f9c2c003f70 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.337+0000 7f9c42ffd640 1 -- 172.21.15.26:0/2307704288 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38007070 con 0x7f9c2c003f70 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/2307704288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2c003f70 msgr2=0x7f9c2c004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/2307704288 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c2c003f70 0x7f9c2c004810 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f9c3800c1c0 tx=0x7f9c3801f3d0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c48b8a640 1 -- 172.21.15.26:0/2307704288 reap_dead start 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/2307704288 shutdown_connections 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/2307704288 >> 172.21.15.26:0/2307704288 conn(0x7f9c4406b9d0 msgr2=0x7f9c4406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/2307704288 shutdown_connections 2024-04-23T10:24:40.339 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/2307704288 wait complete. 2024-04-23T10:24:40.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 Processor -- start 2024-04-23T10:24:40.340 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- start start 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c003f70 0x7f9c44150cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c441ef560 0x7f9c44149670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9c44068350 con 0x7f9c441533c0 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9c440681d0 con 0x7f9c2c003f70 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9c440c8930 con 0x7f9c441ef560 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49824/0 (socket says 172.21.15.26:49824) 2024-04-23T10:24:40.342 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 -- 172.21.15.26:0/43501950 learned_addr learned my addr 172.21.15.26:0/43501950 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c43fff640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c003f70 0x7f9c44150cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c48b8a640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c441ef560 0x7f9c44149670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 -- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c441ef560 msgr2=0x7f9c44149670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c441ef560 0x7f9c44149670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 -- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c003f70 msgr2=0x7f9c44150cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c003f70 0x7f9c44150cf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 -- 172.21.15.26:0/43501950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9c441524a0 con 0x7f9c441533c0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c437fe640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9c3801f200 tx=0x7f9c2c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38005cb0 con 0x7f9c441533c0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9c38005e50 con 0x7f9c441533c0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9c44152780 con 0x7f9c441533c0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9c38004a30 con 0x7f9c441533c0 2024-04-23T10:24:40.343 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.341+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9c4415d330 con 0x7f9c441533c0 2024-04-23T10:24:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9c44075df0 con 0x7f9c441533c0 2024-04-23T10:24:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9c380ba030 con 0x7f9c441533c0 2024-04-23T10:24:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c40ff9640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 0x7f9c3006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.344 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9c38123810 con 0x7f9c441533c0 2024-04-23T10:24:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c43fff640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 0x7f9c3006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.345 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.345+0000 7f9c43fff640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 0x7f9c3006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c34005450 tx=0x7f9c34009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.348 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.349+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9c380c1030 con 0x7f9c441533c0 2024-04-23T10:24:40.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.509+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f9c4414d190 con 0x7f9c30068380 2024-04-23T10:24:40.533 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.533+0000 7f9c40ff9640 1 -- 172.21.15.26:0/43501950 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334569 (secure 0 0 0) 0x7f9c4414d190 con 0x7f9c30068380 2024-04-23T10:24:40.536 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:40.538 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:24:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 msgr2=0x7f9c3006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 0x7f9c3006a840 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f9c34005450 tx=0x7f9c34009040 comp rx=0 tx=0).stop 2024-04-23T10:24:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 msgr2=0x7f9c4415c6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f9c3801f200 tx=0x7f9c2c005840 comp rx=0 tx=0).stop 2024-04-23T10:24:40.539 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 shutdown_connections 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9c30068380 0x7f9c3006a840 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9c441ef560 0x7f9c44149670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9c441533c0 0x7f9c4415c6f0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 --2- 172.21.15.26:0/43501950 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9c2c003f70 0x7f9c44150cf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 >> 172.21.15.26:0/43501950 conn(0x7f9c4406b9d0 msgr2=0x7f9c4414c9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 shutdown_connections 2024-04-23T10:24:40.540 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.541+0000 7f9c4a5ed640 1 -- 172.21.15.26:0/43501950 wait complete. 2024-04-23T10:24:40.556 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-23T10:24:39.209610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48930,"ondisk_log_size":48930,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":82,"apply_latency_ms":82,"commit_latency_ns":82000000,"apply_latency_ns":82000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3528333,"num_objects":-403,"num_object_clones":0,"num_object_copies":-1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-403,"num_whiteouts":0,"num_read":12,"num_read_kb":54,"num_write":468,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005183"},"pg_stats":[{"pgid":"2.1f","version":"26'118","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.924273+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:24:27.924273+0000","last_peered":"2024-04-23T10:24:27.924273+0000","last_clean":"2024-04-23T10:24:27.924273+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:27.924273+0000","last_undegraded":"2024-04-23T10:24:27.924273+0000","last_fullsized":"2024-04-23T10:24:27.924273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544970+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:24:33.544970+0000","last_peered":"2024-04-23T10:24:33.544970+0000","last_clean":"2024-04-23T10:24:33.544970+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:33.544970+0000","last_undegraded":"2024-04-23T10:24:33.544970+0000","last_fullsized":"2024-04-23T10:24:33.544970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.015013+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:24:30.015013+0000","last_peered":"2024-04-23T10:24:30.015013+0000","last_clean":"2024-04-23T10:24:30.015013+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:24:30.015013+0000","last_undegraded":"2024-04-23T10:24:30.015013+0000","last_fullsized":"2024-04-23T10:24:30.015013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'473","reported_seq":504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.079668+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:24:25.079668+0000","last_peered":"2024-04-23T10:24:25.079668+0000","last_clean":"2024-04-23T10:24:25.079668+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:25.079668+0000","last_undegraded":"2024-04-23T10:24:25.079668+0000","last_fullsized":"2024-04-23T10:24:25.079668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.548547+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:24:33.548547+0000","last_peered":"2024-04-23T10:24:33.548547+0000","last_clean":"2024-04-23T10:24:33.548547+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:33.548547+0000","last_undegraded":"2024-04-23T10:24:33.548547+0000","last_fullsized":"2024-04-23T10:24:33.548547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":913,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.010030+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:24:30.010030+0000","last_peered":"2024-04-23T10:24:30.010030+0000","last_clean":"2024-04-23T10:24:30.010030+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:30.010030+0000","last_undegraded":"2024-04-23T10:24:30.010030+0000","last_fullsized":"2024-04-23T10:24:30.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'340","reported_seq":370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.049614+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:24:29.049614+0000","last_peered":"2024-04-23T10:24:29.049614+0000","last_clean":"2024-04-23T10:24:29.049614+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:29.049614+0000","last_undegraded":"2024-04-23T10:24:29.049614+0000","last_fullsized":"2024-04-23T10:24:29.049614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484064+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:24:33.484064+0000","last_peered":"2024-04-23T10:24:33.484064+0000","last_clean":"2024-04-23T10:24:33.484064+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:33.484064+0000","last_undegraded":"2024-04-23T10:24:33.484064+0000","last_fullsized":"2024-04-23T10:24:33.484064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.979936+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:24:29.979936+0000","last_peered":"2024-04-23T10:24:29.979936+0000","last_clean":"2024-04-23T10:24:29.979936+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:29.979936+0000","last_undegraded":"2024-04-23T10:24:29.979936+0000","last_fullsized":"2024-04-23T10:24:29.979936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'280","reported_seq":310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.005526+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:24:28.005526+0000","last_peered":"2024-04-23T10:24:28.005526+0000","last_clean":"2024-04-23T10:24:28.005526+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:28.005526+0000","last_undegraded":"2024-04-23T10:24:28.005526+0000","last_fullsized":"2024-04-23T10:24:28.005526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484949+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:24:33.484949+0000","last_peered":"2024-04-23T10:24:33.484949+0000","last_clean":"2024-04-23T10:24:33.484949+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:24:33.484949+0000","last_undegraded":"2024-04-23T10:24:33.484949+0000","last_fullsized":"2024-04-23T10:24:33.484949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.936877+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:24:29.936877+0000","last_peered":"2024-04-23T10:24:29.936877+0000","last_clean":"2024-04-23T10:24:29.936877+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:29.936877+0000","last_undegraded":"2024-04-23T10:24:29.936877+0000","last_fullsized":"2024-04-23T10:24:29.936877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.472721+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:24:33.472721+0000","last_peered":"2024-04-23T10:24:33.472721+0000","last_clean":"2024-04-23T10:24:33.472721+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:33.472721+0000","last_undegraded":"2024-04-23T10:24:33.472721+0000","last_fullsized":"2024-04-23T10:24:33.472721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'179","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.873263+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:24:25.873263+0000","last_peered":"2024-04-23T10:24:25.873263+0000","last_clean":"2024-04-23T10:24:25.873263+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:25.873263+0000","last_undegraded":"2024-04-23T10:24:25.873263+0000","last_fullsized":"2024-04-23T10:24:25.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060435+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:24:29.060435+0000","last_peered":"2024-04-23T10:24:29.060435+0000","last_clean":"2024-04-23T10:24:29.060435+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:29.060435+0000","last_undegraded":"2024-04-23T10:24:29.060435+0000","last_fullsized":"2024-04-23T10:24:29.060435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560764+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:24:33.560764+0000","last_peered":"2024-04-23T10:24:33.560764+0000","last_clean":"2024-04-23T10:24:33.560764+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:33.560764+0000","last_undegraded":"2024-04-23T10:24:33.560764+0000","last_fullsized":"2024-04-23T10:24:33.560764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'218","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.053169+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:24:25.053169+0000","last_peered":"2024-04-23T10:24:25.053169+0000","last_clean":"2024-04-23T10:24:25.053169+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:25.053169+0000","last_undegraded":"2024-04-23T10:24:25.053169+0000","last_fullsized":"2024-04-23T10:24:25.053169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917527+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:24:29.917527+0000","last_peered":"2024-04-23T10:24:29.917527+0000","last_clean":"2024-04-23T10:24:29.917527+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:29.917527+0000","last_undegraded":"2024-04-23T10:24:29.917527+0000","last_fullsized":"2024-04-23T10:24:29.917527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564275+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:24:33.564275+0000","last_peered":"2024-04-23T10:24:33.564275+0000","last_clean":"2024-04-23T10:24:33.564275+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:33.564275+0000","last_undegraded":"2024-04-23T10:24:33.564275+0000","last_fullsized":"2024-04-23T10:24:33.564275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.882235+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:24:23.882235+0000","last_peered":"2024-04-23T10:24:23.882235+0000","last_clean":"2024-04-23T10:24:23.882235+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:23.882235+0000","last_undegraded":"2024-04-23T10:24:23.882235+0000","last_fullsized":"2024-04-23T10:24:23.882235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.004676+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:24:30.004676+0000","last_peered":"2024-04-23T10:24:30.004676+0000","last_clean":"2024-04-23T10:24:30.004676+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:30.004676+0000","last_undegraded":"2024-04-23T10:24:30.004676+0000","last_fullsized":"2024-04-23T10:24:30.004676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.469317+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:24:33.469317+0000","last_peered":"2024-04-23T10:24:33.469317+0000","last_clean":"2024-04-23T10:24:33.469317+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:33.469317+0000","last_undegraded":"2024-04-23T10:24:33.469317+0000","last_fullsized":"2024-04-23T10:24:33.469317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'475","reported_seq":506,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875874+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:24:25.875874+0000","last_peered":"2024-04-23T10:24:25.875874+0000","last_clean":"2024-04-23T10:24:25.875874+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:25.875874+0000","last_undegraded":"2024-04-23T10:24:25.875874+0000","last_fullsized":"2024-04-23T10:24:25.875874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.018213+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:24:30.018213+0000","last_peered":"2024-04-23T10:24:30.018213+0000","last_clean":"2024-04-23T10:24:30.018213+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:30.018213+0000","last_undegraded":"2024-04-23T10:24:30.018213+0000","last_fullsized":"2024-04-23T10:24:30.018213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560778+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:24:33.560778+0000","last_peered":"2024-04-23T10:24:33.560778+0000","last_clean":"2024-04-23T10:24:33.560778+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:33.560778+0000","last_undegraded":"2024-04-23T10:24:33.560778+0000","last_fullsized":"2024-04-23T10:24:33.560778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'80","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.943277+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:24:27.943277+0000","last_peered":"2024-04-23T10:24:27.943277+0000","last_clean":"2024-04-23T10:24:27.943277+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:27.943277+0000","last_undegraded":"2024-04-23T10:24:27.943277+0000","last_fullsized":"2024-04-23T10:24:27.943277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":960,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.945497+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:24:29.945497+0000","last_peered":"2024-04-23T10:24:29.945497+0000","last_clean":"2024-04-23T10:24:29.945497+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:29.945497+0000","last_undegraded":"2024-04-23T10:24:29.945497+0000","last_fullsized":"2024-04-23T10:24:29.945497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541259+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:24:33.541259+0000","last_peered":"2024-04-23T10:24:33.541259+0000","last_clean":"2024-04-23T10:24:33.541259+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:33.541259+0000","last_undegraded":"2024-04-23T10:24:33.541259+0000","last_fullsized":"2024-04-23T10:24:33.541259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'476","reported_seq":507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.750104+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:24:30.750104+0000","last_peered":"2024-04-23T10:24:30.750104+0000","last_clean":"2024-04-23T10:24:30.750104+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:30.750104+0000","last_undegraded":"2024-04-23T10:24:30.750104+0000","last_fullsized":"2024-04-23T10:24:30.750104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.105305+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:24:29.105305+0000","last_peered":"2024-04-23T10:24:29.105305+0000","last_clean":"2024-04-23T10:24:29.105305+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:29.105305+0000","last_undegraded":"2024-04-23T10:24:29.105305+0000","last_fullsized":"2024-04-23T10:24:29.105305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.435786+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:24:33.435786+0000","last_peered":"2024-04-23T10:24:33.435786+0000","last_clean":"2024-04-23T10:24:33.435786+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:33.435786+0000","last_undegraded":"2024-04-23T10:24:33.435786+0000","last_fullsized":"2024-04-23T10:24:33.435786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'228","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.015506+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:24:25.015506+0000","last_peered":"2024-04-23T10:24:25.015506+0000","last_clean":"2024-04-23T10:24:25.015506+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:25.015506+0000","last_undegraded":"2024-04-23T10:24:25.015506+0000","last_fullsized":"2024-04-23T10:24:25.015506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.009539+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:24:30.009539+0000","last_peered":"2024-04-23T10:24:30.009539+0000","last_clean":"2024-04-23T10:24:30.009539+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:30.009539+0000","last_undegraded":"2024-04-23T10:24:30.009539+0000","last_fullsized":"2024-04-23T10:24:30.009539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549700+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:24:33.549700+0000","last_peered":"2024-04-23T10:24:33.549700+0000","last_clean":"2024-04-23T10:24:33.549700+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:33.549700+0000","last_undegraded":"2024-04-23T10:24:33.549700+0000","last_fullsized":"2024-04-23T10:24:33.549700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875263+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:24:25.875263+0000","last_peered":"2024-04-23T10:24:25.875263+0000","last_clean":"2024-04-23T10:24:25.875263+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:25.875263+0000","last_undegraded":"2024-04-23T10:24:25.875263+0000","last_fullsized":"2024-04-23T10:24:25.875263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.949787+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:24:29.949787+0000","last_peered":"2024-04-23T10:24:29.949787+0000","last_clean":"2024-04-23T10:24:29.949787+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:29.949787+0000","last_undegraded":"2024-04-23T10:24:29.949787+0000","last_fullsized":"2024-04-23T10:24:29.949787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560629+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:24:33.560629+0000","last_peered":"2024-04-23T10:24:33.560629+0000","last_clean":"2024-04-23T10:24:33.560629+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:33.560629+0000","last_undegraded":"2024-04-23T10:24:33.560629+0000","last_fullsized":"2024-04-23T10:24:33.560629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1260","reported_seq":1291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:15.892836+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:24:15.892836+0000","last_peered":"2024-04-23T10:24:15.892836+0000","last_clean":"2024-04-23T10:24:15.892836+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:15.892836+0000","last_undegraded":"2024-04-23T10:24:15.892836+0000","last_fullsized":"2024-04-23T10:24:15.892836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.038327+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:24:30.038327+0000","last_peered":"2024-04-23T10:24:30.038327+0000","last_clean":"2024-04-23T10:24:30.038327+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:30.038327+0000","last_undegraded":"2024-04-23T10:24:30.038327+0000","last_fullsized":"2024-04-23T10:24:30.038327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.439036+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:24:33.439036+0000","last_peered":"2024-04-23T10:24:33.439036+0000","last_clean":"2024-04-23T10:24:33.439036+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:33.439036+0000","last_undegraded":"2024-04-23T10:24:33.439036+0000","last_fullsized":"2024-04-23T10:24:33.439036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'678","reported_seq":1305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:31.909387+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:24:31.909387+0000","last_peered":"2024-04-23T10:24:31.909387+0000","last_clean":"2024-04-23T10:24:31.909387+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:31.909387+0000","last_undegraded":"2024-04-23T10:24:31.909387+0000","last_fullsized":"2024-04-23T10:24:31.909387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.961324+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:24:29.961324+0000","last_peered":"2024-04-23T10:24:29.961324+0000","last_clean":"2024-04-23T10:24:29.961324+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:29.961324+0000","last_undegraded":"2024-04-23T10:24:29.961324+0000","last_fullsized":"2024-04-23T10:24:29.961324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551035+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:24:33.551035+0000","last_peered":"2024-04-23T10:24:33.551035+0000","last_clean":"2024-04-23T10:24:33.551035+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:33.551035+0000","last_undegraded":"2024-04-23T10:24:33.551035+0000","last_fullsized":"2024-04-23T10:24:33.551035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'821","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.130128+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:24:28.130128+0000","last_peered":"2024-04-23T10:24:28.130128+0000","last_clean":"2024-04-23T10:24:28.130128+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:28.130128+0000","last_undegraded":"2024-04-23T10:24:28.130128+0000","last_fullsized":"2024-04-23T10:24:28.130128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.968924+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:24:29.968924+0000","last_peered":"2024-04-23T10:24:29.968924+0000","last_clean":"2024-04-23T10:24:29.968924+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:29.968924+0000","last_undegraded":"2024-04-23T10:24:29.968924+0000","last_fullsized":"2024-04-23T10:24:29.968924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.543989+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:24:33.543989+0000","last_peered":"2024-04-23T10:24:33.543989+0000","last_clean":"2024-04-23T10:24:33.543989+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:33.543989+0000","last_undegraded":"2024-04-23T10:24:33.543989+0000","last_fullsized":"2024-04-23T10:24:33.543989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060231+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:24:29.060231+0000","last_peered":"2024-04-23T10:24:29.060231+0000","last_clean":"2024-04-23T10:24:29.060231+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:29.060231+0000","last_undegraded":"2024-04-23T10:24:29.060231+0000","last_fullsized":"2024-04-23T10:24:29.060231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:22:26.305857+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:22:26.305857+0000","last_peered":"2024-04-23T10:22:26.305857+0000","last_clean":"2024-04-23T10:22:26.305857+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:22:26.305857+0000","last_undegraded":"2024-04-23T10:22:26.305857+0000","last_fullsized":"2024-04-23T10:22:26.305857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.984831+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:24:29.984831+0000","last_peered":"2024-04-23T10:24:29.984831+0000","last_clean":"2024-04-23T10:24:29.984831+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:29.984831+0000","last_undegraded":"2024-04-23T10:24:29.984831+0000","last_fullsized":"2024-04-23T10:24:29.984831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502905+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:24:33.502905+0000","last_peered":"2024-04-23T10:24:33.502905+0000","last_clean":"2024-04-23T10:24:33.502905+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:33.502905+0000","last_undegraded":"2024-04-23T10:24:33.502905+0000","last_fullsized":"2024-04-23T10:24:33.502905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.940375+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:24:29.940375+0000","last_peered":"2024-04-23T10:24:29.940375+0000","last_clean":"2024-04-23T10:24:29.940375+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:29.940375+0000","last_undegraded":"2024-04-23T10:24:29.940375+0000","last_fullsized":"2024-04-23T10:24:29.940375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.922885+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:24:29.922885+0000","last_peered":"2024-04-23T10:24:29.922885+0000","last_clean":"2024-04-23T10:24:29.922885+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:29.922885+0000","last_undegraded":"2024-04-23T10:24:29.922885+0000","last_fullsized":"2024-04-23T10:24:29.922885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.553149+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:24:33.553149+0000","last_peered":"2024-04-23T10:24:33.553149+0000","last_clean":"2024-04-23T10:24:33.553149+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:33.553149+0000","last_undegraded":"2024-04-23T10:24:33.553149+0000","last_fullsized":"2024-04-23T10:24:33.553149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'596","reported_seq":627,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.987525+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:24:24.987525+0000","last_peered":"2024-04-23T10:24:24.987525+0000","last_clean":"2024-04-23T10:24:24.987525+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:24.987525+0000","last_undegraded":"2024-04-23T10:24:24.987525+0000","last_fullsized":"2024-04-23T10:24:24.987525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.136676+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:24:29.136676+0000","last_peered":"2024-04-23T10:24:29.136676+0000","last_clean":"2024-04-23T10:24:29.136676+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:29.136676+0000","last_undegraded":"2024-04-23T10:24:29.136676+0000","last_fullsized":"2024-04-23T10:24:29.136676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507457+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:24:33.507457+0000","last_peered":"2024-04-23T10:24:33.507457+0000","last_clean":"2024-04-23T10:24:33.507457+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:33.507457+0000","last_undegraded":"2024-04-23T10:24:33.507457+0000","last_fullsized":"2024-04-23T10:24:33.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'411","reported_seq":441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:18.824761+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:24:18.824761+0000","last_peered":"2024-04-23T10:24:18.824761+0000","last_clean":"2024-04-23T10:24:18.824761+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:18.824761+0000","last_undegraded":"2024-04-23T10:24:18.824761+0000","last_fullsized":"2024-04-23T10:24:18.824761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.019063+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:24:30.019063+0000","last_peered":"2024-04-23T10:24:30.019063+0000","last_clean":"2024-04-23T10:24:30.019063+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:24:30.019063+0000","last_undegraded":"2024-04-23T10:24:30.019063+0000","last_fullsized":"2024-04-23T10:24:30.019063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502372+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:24:33.502372+0000","last_peered":"2024-04-23T10:24:33.502372+0000","last_clean":"2024-04-23T10:24:33.502372+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:24:33.502372+0000","last_undegraded":"2024-04-23T10:24:33.502372+0000","last_fullsized":"2024-04-23T10:24:33.502372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'184","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.124538+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:24:29.124538+0000","last_peered":"2024-04-23T10:24:29.124538+0000","last_clean":"2024-04-23T10:24:29.124538+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:29.124538+0000","last_undegraded":"2024-04-23T10:24:29.124538+0000","last_fullsized":"2024-04-23T10:24:29.124538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.022137+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:24:30.022137+0000","last_peered":"2024-04-23T10:24:30.022137+0000","last_clean":"2024-04-23T10:24:30.022137+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:30.022137+0000","last_undegraded":"2024-04-23T10:24:30.022137+0000","last_fullsized":"2024-04-23T10:24:30.022137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.498935+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:24:33.498935+0000","last_peered":"2024-04-23T10:24:33.498935+0000","last_clean":"2024-04-23T10:24:33.498935+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:33.498935+0000","last_undegraded":"2024-04-23T10:24:33.498935+0000","last_fullsized":"2024-04-23T10:24:33.498935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'235","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:34.310965+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:24:34.310965+0000","last_peered":"2024-04-23T10:24:34.310965+0000","last_clean":"2024-04-23T10:24:34.310965+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:34.310965+0000","last_undegraded":"2024-04-23T10:24:34.310965+0000","last_fullsized":"2024-04-23T10:24:34.310965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.976890+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:24:29.976890+0000","last_peered":"2024-04-23T10:24:29.976890+0000","last_clean":"2024-04-23T10:24:29.976890+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:29.976890+0000","last_undegraded":"2024-04-23T10:24:29.976890+0000","last_fullsized":"2024-04-23T10:24:29.976890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559222+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:24:33.559222+0000","last_peered":"2024-04-23T10:24:33.559222+0000","last_clean":"2024-04-23T10:24:33.559222+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:33.559222+0000","last_undegraded":"2024-04-23T10:24:33.559222+0000","last_fullsized":"2024-04-23T10:24:33.559222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'75","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:21.921579+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:24:21.921579+0000","last_peered":"2024-04-23T10:24:21.921579+0000","last_clean":"2024-04-23T10:24:21.921579+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:21.921579+0000","last_undegraded":"2024-04-23T10:24:21.921579+0000","last_fullsized":"2024-04-23T10:24:21.921579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.138272+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:24:29.138272+0000","last_peered":"2024-04-23T10:24:29.138272+0000","last_clean":"2024-04-23T10:24:29.138272+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:29.138272+0000","last_undegraded":"2024-04-23T10:24:29.138272+0000","last_fullsized":"2024-04-23T10:24:29.138272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504309+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:24:33.504309+0000","last_peered":"2024-04-23T10:24:33.504309+0000","last_clean":"2024-04-23T10:24:33.504309+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:33.504309+0000","last_undegraded":"2024-04-23T10:24:33.504309+0000","last_fullsized":"2024-04-23T10:24:33.504309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'72","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.905924+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:24:29.905924+0000","last_peered":"2024-04-23T10:24:29.905924+0000","last_clean":"2024-04-23T10:24:29.905924+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:29.905924+0000","last_undegraded":"2024-04-23T10:24:29.905924+0000","last_fullsized":"2024-04-23T10:24:29.905924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.954554+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:24:29.954554+0000","last_peered":"2024-04-23T10:24:29.954554+0000","last_clean":"2024-04-23T10:24:29.954554+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:29.954554+0000","last_undegraded":"2024-04-23T10:24:29.954554+0000","last_fullsized":"2024-04-23T10:24:29.954554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.558092+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:24:33.558092+0000","last_peered":"2024-04-23T10:24:33.558092+0000","last_clean":"2024-04-23T10:24:33.558092+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:33.558092+0000","last_undegraded":"2024-04-23T10:24:33.558092+0000","last_fullsized":"2024-04-23T10:24:33.558092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'560","reported_seq":590,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:16.384742+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:24:16.384742+0000","last_peered":"2024-04-23T10:24:16.384742+0000","last_clean":"2024-04-23T10:24:16.384742+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:16.384742+0000","last_undegraded":"2024-04-23T10:24:16.384742+0000","last_fullsized":"2024-04-23T10:24:16.384742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.035161+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:24:30.035161+0000","last_peered":"2024-04-23T10:24:30.035161+0000","last_clean":"2024-04-23T10:24:30.035161+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:24:30.035161+0000","last_undegraded":"2024-04-23T10:24:30.035161+0000","last_fullsized":"2024-04-23T10:24:30.035161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554735+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:24:33.554735+0000","last_peered":"2024-04-23T10:24:33.554735+0000","last_clean":"2024-04-23T10:24:33.554735+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:24:33.554735+0000","last_undegraded":"2024-04-23T10:24:33.554735+0000","last_fullsized":"2024-04-23T10:24:33.554735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'413","reported_seq":444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.015396+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:24:23.015396+0000","last_peered":"2024-04-23T10:24:23.015396+0000","last_clean":"2024-04-23T10:24:23.015396+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:23.015396+0000","last_undegraded":"2024-04-23T10:24:23.015396+0000","last_fullsized":"2024-04-23T10:24:23.015396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.935827+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:24:29.935827+0000","last_peered":"2024-04-23T10:24:29.935827+0000","last_clean":"2024-04-23T10:24:29.935827+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:29.935827+0000","last_undegraded":"2024-04-23T10:24:29.935827+0000","last_fullsized":"2024-04-23T10:24:29.935827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503506+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:24:33.503506+0000","last_peered":"2024-04-23T10:24:33.503506+0000","last_clean":"2024-04-23T10:24:33.503506+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:33.503506+0000","last_undegraded":"2024-04-23T10:24:33.503506+0000","last_fullsized":"2024-04-23T10:24:33.503506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'298","reported_seq":328,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.275896+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:24:30.275896+0000","last_peered":"2024-04-23T10:24:30.275896+0000","last_clean":"2024-04-23T10:24:30.275896+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:30.275896+0000","last_undegraded":"2024-04-23T10:24:30.275896+0000","last_fullsized":"2024-04-23T10:24:30.275896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.978436+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:24:29.978436+0000","last_peered":"2024-04-23T10:24:29.978436+0000","last_clean":"2024-04-23T10:24:29.978436+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:29.978436+0000","last_undegraded":"2024-04-23T10:24:29.978436+0000","last_fullsized":"2024-04-23T10:24:29.978436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.547587+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:24:33.547587+0000","last_peered":"2024-04-23T10:24:33.547587+0000","last_clean":"2024-04-23T10:24:33.547587+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:33.547587+0000","last_undegraded":"2024-04-23T10:24:33.547587+0000","last_fullsized":"2024-04-23T10:24:33.547587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'274","reported_seq":304,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.953756+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:24:27.953756+0000","last_peered":"2024-04-23T10:24:27.953756+0000","last_clean":"2024-04-23T10:24:27.953756+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:27.953756+0000","last_undegraded":"2024-04-23T10:24:27.953756+0000","last_fullsized":"2024-04-23T10:24:27.953756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.029718+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:24:30.029718+0000","last_peered":"2024-04-23T10:24:30.029718+0000","last_clean":"2024-04-23T10:24:30.029718+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:30.029718+0000","last_undegraded":"2024-04-23T10:24:30.029718+0000","last_fullsized":"2024-04-23T10:24:30.029718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503116+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:24:33.503116+0000","last_peered":"2024-04-23T10:24:33.503116+0000","last_clean":"2024-04-23T10:24:33.503116+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:33.503116+0000","last_undegraded":"2024-04-23T10:24:33.503116+0000","last_fullsized":"2024-04-23T10:24:33.503116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.397534+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:24:33.397534+0000","last_peered":"2024-04-23T10:24:33.397534+0000","last_clean":"2024-04-23T10:24:33.397534+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:33.397534+0000","last_undegraded":"2024-04-23T10:24:33.397534+0000","last_fullsized":"2024-04-23T10:24:33.397534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.026126+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:24:30.026126+0000","last_peered":"2024-04-23T10:24:30.026126+0000","last_clean":"2024-04-23T10:24:30.026126+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:30.026126+0000","last_undegraded":"2024-04-23T10:24:30.026126+0000","last_fullsized":"2024-04-23T10:24:30.026126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.992752+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:24:29.992752+0000","last_peered":"2024-04-23T10:24:29.992752+0000","last_clean":"2024-04-23T10:24:29.992752+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:29.992752+0000","last_undegraded":"2024-04-23T10:24:29.992752+0000","last_fullsized":"2024-04-23T10:24:29.992752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.561905+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:24:33.561905+0000","last_peered":"2024-04-23T10:24:33.561905+0000","last_clean":"2024-04-23T10:24:33.561905+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:33.561905+0000","last_undegraded":"2024-04-23T10:24:33.561905+0000","last_fullsized":"2024-04-23T10:24:33.561905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1046","reported_seq":1076,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.915613+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:24:23.915613+0000","last_peered":"2024-04-23T10:24:23.915613+0000","last_clean":"2024-04-23T10:24:23.915613+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:23.915613+0000","last_undegraded":"2024-04-23T10:24:23.915613+0000","last_fullsized":"2024-04-23T10:24:23.915613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.993724+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:24:28.993724+0000","last_peered":"2024-04-23T10:24:28.993724+0000","last_clean":"2024-04-23T10:24:28.993724+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:28.993724+0000","last_undegraded":"2024-04-23T10:24:28.993724+0000","last_fullsized":"2024-04-23T10:24:28.993724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554764+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:24:33.554764+0000","last_peered":"2024-04-23T10:24:33.554764+0000","last_clean":"2024-04-23T10:24:33.554764+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:33.554764+0000","last_undegraded":"2024-04-23T10:24:33.554764+0000","last_fullsized":"2024-04-23T10:24:33.554764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'152","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.916439+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:24:23.916439+0000","last_peered":"2024-04-23T10:24:23.916439+0000","last_clean":"2024-04-23T10:24:23.916439+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:23.916439+0000","last_undegraded":"2024-04-23T10:24:23.916439+0000","last_fullsized":"2024-04-23T10:24:23.916439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:22.944498+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:24:22.944498+0000","last_peered":"2024-04-23T10:24:22.944498+0000","last_clean":"2024-04-23T10:24:22.944498+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:22.944498+0000","last_undegraded":"2024-04-23T10:24:22.944498+0000","last_fullsized":"2024-04-23T10:24:22.944498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564241+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:24:33.564241+0000","last_peered":"2024-04-23T10:24:33.564241+0000","last_clean":"2024-04-23T10:24:33.564241+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:33.564241+0000","last_undegraded":"2024-04-23T10:24:33.564241+0000","last_fullsized":"2024-04-23T10:24:33.564241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.960197+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:24:29.960197+0000","last_peered":"2024-04-23T10:24:29.960197+0000","last_clean":"2024-04-23T10:24:29.960197+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:29.960197+0000","last_undegraded":"2024-04-23T10:24:29.960197+0000","last_fullsized":"2024-04-23T10:24:29.960197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'112","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.927138+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:24:24.927138+0000","last_peered":"2024-04-23T10:24:24.927138+0000","last_clean":"2024-04-23T10:24:24.927138+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:24.927138+0000","last_undegraded":"2024-04-23T10:24:24.927138+0000","last_fullsized":"2024-04-23T10:24:24.927138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473116+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:24:33.473116+0000","last_peered":"2024-04-23T10:24:33.473116+0000","last_clean":"2024-04-23T10:24:33.473116+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:33.473116+0000","last_undegraded":"2024-04-23T10:24:33.473116+0000","last_fullsized":"2024-04-23T10:24:33.473116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.131318+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:24:29.131318+0000","last_peered":"2024-04-23T10:24:29.131318+0000","last_clean":"2024-04-23T10:24:29.131318+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:24:29.131318+0000","last_undegraded":"2024-04-23T10:24:29.131318+0000","last_fullsized":"2024-04-23T10:24:29.131318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559932+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:24:33.559932+0000","last_peered":"2024-04-23T10:24:33.559932+0000","last_clean":"2024-04-23T10:24:33.559932+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:33.559932+0000","last_undegraded":"2024-04-23T10:24:33.559932+0000","last_fullsized":"2024-04-23T10:24:33.559932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541987+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:24:33.541987+0000","last_peered":"2024-04-23T10:24:33.541987+0000","last_clean":"2024-04-23T10:24:33.541987+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:33.541987+0000","last_undegraded":"2024-04-23T10:24:33.541987+0000","last_fullsized":"2024-04-23T10:24:33.541987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549732+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:24:33.549732+0000","last_peered":"2024-04-23T10:24:33.549732+0000","last_clean":"2024-04-23T10:24:33.549732+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:33.549732+0000","last_undegraded":"2024-04-23T10:24:33.549732+0000","last_fullsized":"2024-04-23T10:24:33.549732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.562847+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:24:33.562847+0000","last_peered":"2024-04-23T10:24:33.562847+0000","last_clean":"2024-04-23T10:24:33.562847+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:33.562847+0000","last_undegraded":"2024-04-23T10:24:33.562847+0000","last_fullsized":"2024-04-23T10:24:33.562847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.552147+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:24:33.552147+0000","last_peered":"2024-04-23T10:24:33.552147+0000","last_clean":"2024-04-23T10:24:33.552147+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:33.552147+0000","last_undegraded":"2024-04-23T10:24:33.552147+0000","last_fullsized":"2024-04-23T10:24:33.552147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560580+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:24:33.560580+0000","last_peered":"2024-04-23T10:24:33.560580+0000","last_clean":"2024-04-23T10:24:33.560580+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:33.560580+0000","last_undegraded":"2024-04-23T10:24:33.560580+0000","last_fullsized":"2024-04-23T10:24:33.560580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502105+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:24:33.502105+0000","last_peered":"2024-04-23T10:24:33.502105+0000","last_clean":"2024-04-23T10:24:33.502105+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:33.502105+0000","last_undegraded":"2024-04-23T10:24:33.502105+0000","last_fullsized":"2024-04-23T10:24:33.502105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544972+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:24:33.544972+0000","last_peered":"2024-04-23T10:24:33.544972+0000","last_clean":"2024-04-23T10:24:33.544972+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:33.544972+0000","last_undegraded":"2024-04-23T10:24:33.544972+0000","last_fullsized":"2024-04-23T10:24:33.544972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549783+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:24:33.549783+0000","last_peered":"2024-04-23T10:24:33.549783+0000","last_clean":"2024-04-23T10:24:33.549783+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:33.549783+0000","last_undegraded":"2024-04-23T10:24:33.549783+0000","last_fullsized":"2024-04-23T10:24:33.549783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.545594+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:24:33.545594+0000","last_peered":"2024-04-23T10:24:33.545594+0000","last_clean":"2024-04-23T10:24:33.545594+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:33.545594+0000","last_undegraded":"2024-04-23T10:24:33.545594+0000","last_fullsized":"2024-04-23T10:24:33.545594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501556+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:24:33.501556+0000","last_peered":"2024-04-23T10:24:33.501556+0000","last_clean":"2024-04-23T10:24:33.501556+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:33.501556+0000","last_undegraded":"2024-04-23T10:24:33.501556+0000","last_fullsized":"2024-04-23T10:24:33.501556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564160+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:24:33.564160+0000","last_peered":"2024-04-23T10:24:33.564160+0000","last_clean":"2024-04-23T10:24:33.564160+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:33.564160+0000","last_undegraded":"2024-04-23T10:24:33.564160+0000","last_fullsized":"2024-04-23T10:24:33.564160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473964+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:24:33.473964+0000","last_peered":"2024-04-23T10:24:33.473964+0000","last_clean":"2024-04-23T10:24:33.473964+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:33.473964+0000","last_undegraded":"2024-04-23T10:24:33.473964+0000","last_fullsized":"2024-04-23T10:24:33.473964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554626+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:24:33.554626+0000","last_peered":"2024-04-23T10:24:33.554626+0000","last_clean":"2024-04-23T10:24:33.554626+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:33.554626+0000","last_undegraded":"2024-04-23T10:24:33.554626+0000","last_fullsized":"2024-04-23T10:24:33.554626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.546876+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:24:33.546876+0000","last_peered":"2024-04-23T10:24:33.546876+0000","last_clean":"2024-04-23T10:24:33.546876+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:33.546876+0000","last_undegraded":"2024-04-23T10:24:33.546876+0000","last_fullsized":"2024-04-23T10:24:33.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501448+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:24:33.501448+0000","last_peered":"2024-04-23T10:24:33.501448+0000","last_clean":"2024-04-23T10:24:33.501448+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:33.501448+0000","last_undegraded":"2024-04-23T10:24:33.501448+0000","last_fullsized":"2024-04-23T10:24:33.501448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555566+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:24:33.555566+0000","last_peered":"2024-04-23T10:24:33.555566+0000","last_clean":"2024-04-23T10:24:33.555566+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:33.555566+0000","last_undegraded":"2024-04-23T10:24:33.555566+0000","last_fullsized":"2024-04-23T10:24:33.555566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.467678+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:24:33.467678+0000","last_peered":"2024-04-23T10:24:33.467678+0000","last_clean":"2024-04-23T10:24:33.467678+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:33.467678+0000","last_undegraded":"2024-04-23T10:24:33.467678+0000","last_fullsized":"2024-04-23T10:24:33.467678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560655+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:24:33.560655+0000","last_peered":"2024-04-23T10:24:33.560655+0000","last_clean":"2024-04-23T10:24:33.560655+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:33.560655+0000","last_undegraded":"2024-04-23T10:24:33.560655+0000","last_fullsized":"2024-04-23T10:24:33.560655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.556154+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:24:33.556154+0000","last_peered":"2024-04-23T10:24:33.556154+0000","last_clean":"2024-04-23T10:24:33.556154+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:33.556154+0000","last_undegraded":"2024-04-23T10:24:33.556154+0000","last_fullsized":"2024-04-23T10:24:33.556154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.477633+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:24:33.477633+0000","last_peered":"2024-04-23T10:24:33.477633+0000","last_clean":"2024-04-23T10:24:33.477633+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:33.477633+0000","last_undegraded":"2024-04-23T10:24:33.477633+0000","last_fullsized":"2024-04-23T10:24:33.477633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.481582+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:24:33.481582+0000","last_peered":"2024-04-23T10:24:33.481582+0000","last_clean":"2024-04-23T10:24:33.481582+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:33.481582+0000","last_undegraded":"2024-04-23T10:24:33.481582+0000","last_fullsized":"2024-04-23T10:24:33.481582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.489052+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:24:33.489052+0000","last_peered":"2024-04-23T10:24:33.489052+0000","last_clean":"2024-04-23T10:24:33.489052+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:33.489052+0000","last_undegraded":"2024-04-23T10:24:33.489052+0000","last_fullsized":"2024-04-23T10:24:33.489052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507582+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:24:33.507582+0000","last_peered":"2024-04-23T10:24:33.507582+0000","last_clean":"2024-04-23T10:24:33.507582+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:33.507582+0000","last_undegraded":"2024-04-23T10:24:33.507582+0000","last_fullsized":"2024-04-23T10:24:33.507582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551211+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:24:33.551211+0000","last_peered":"2024-04-23T10:24:33.551211+0000","last_clean":"2024-04-23T10:24:33.551211+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:33.551211+0000","last_undegraded":"2024-04-23T10:24:33.551211+0000","last_fullsized":"2024-04-23T10:24:33.551211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559120+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:24:33.559120+0000","last_peered":"2024-04-23T10:24:33.559120+0000","last_clean":"2024-04-23T10:24:33.559120+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:24:33.559120+0000","last_undegraded":"2024-04-23T10:24:33.559120+0000","last_fullsized":"2024-04-23T10:24:33.559120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559225+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:24:33.559225+0000","last_peered":"2024-04-23T10:24:33.559225+0000","last_clean":"2024-04-23T10:24:33.559225+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:33.559225+0000","last_undegraded":"2024-04-23T10:24:33.559225+0000","last_fullsized":"2024-04-23T10:24:33.559225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554394+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:24:33.554394+0000","last_peered":"2024-04-23T10:24:33.554394+0000","last_clean":"2024-04-23T10:24:33.554394+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:33.554394+0000","last_undegraded":"2024-04-23T10:24:33.554394+0000","last_fullsized":"2024-04-23T10:24:33.554394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559435+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:24:33.559435+0000","last_peered":"2024-04-23T10:24:33.559435+0000","last_clean":"2024-04-23T10:24:33.559435+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:33.559435+0000","last_undegraded":"2024-04-23T10:24:33.559435+0000","last_fullsized":"2024-04-23T10:24:33.559435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555603+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:24:33.555603+0000","last_peered":"2024-04-23T10:24:33.555603+0000","last_clean":"2024-04-23T10:24:33.555603+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:33.555603+0000","last_undegraded":"2024-04-23T10:24:33.555603+0000","last_fullsized":"2024-04-23T10:24:33.555603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.431229+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:24:33.431229+0000","last_peered":"2024-04-23T10:24:33.431229+0000","last_clean":"2024-04-23T10:24:33.431229+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:33.431229+0000","last_undegraded":"2024-04-23T10:24:33.431229+0000","last_fullsized":"2024-04-23T10:24:33.431229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504628+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:24:33.504628+0000","last_peered":"2024-04-23T10:24:33.504628+0000","last_clean":"2024-04-23T10:24:33.504628+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:24:33.504628+0000","last_undegraded":"2024-04-23T10:24:33.504628+0000","last_fullsized":"2024-04-23T10:24:33.504628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10774,"ondisk_log_size":10774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:24:40.561 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-23T10:24:40.561 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:24:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.721+0000 7f13e3333640 1 Processor -- start 2024-04-23T10:24:40.721 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.721+0000 7f13e3333640 1 -- start start 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f13dc0c8800 0x7f13dc0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13dc0c4b40 0x7f13dc0c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c5780 0x7f13dc0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc158090 con 0x7f13dc0c4b40 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f13dc1585c0 con 0x7f13dc0c8800 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e3333640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13dc0c52f0 con 0x7f13dc0c5780 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13dc0c4b40 0x7f13dc0c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f13dc0c4b40 0x7f13dc0c3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49834/0 (socket says 172.21.15.26:49834) 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 -- 172.21.15.26:0/3431561309 learned_addr learned my addr 172.21.15.26:0/3431561309 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:40.723 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e10cf640 1 --2- 172.21.15.26:0/3431561309 >> v2:172.21.15.190:3300/0 conn(0x7f13dc0c8800 0x7f13dc0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e18d0640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c5780 0x7f13dc0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 -- 172.21.15.26:0/3431561309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c5780 msgr2=0x7f13dc0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c5780 0x7f13dc0c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 -- 172.21.15.26:0/3431561309 >> v2:172.21.15.190:3300/0 conn(0x7f13dc0c8800 msgr2=0x7f13dc0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 --2- 172.21.15.26:0/3431561309 >> v2:172.21.15.190:3300/0 conn(0x7f13dc0c8800 0x7f13dc0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.724 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 -- 172.21.15.26:0/3431561309 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc0c6130 con 0x7f13dc0c4b40 2024-04-23T10:24:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13e08ce640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c4b40 0x7f13dc0c3f20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f13dc070da0 tx=0x7f13d801e8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=25e6d17991ea63cc server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13cffff640 1 -- 172.21.15.26:0/3431561309 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ad070 con 0x7f13dc0c4b40 2024-04-23T10:24:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13cffff640 1 -- 172.21.15.26:0/3431561309 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8004230 con 0x7f13dc0c4b40 2024-04-23T10:24:40.725 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.725+0000 7f13cffff640 1 -- 172.21.15.26:0/3431561309 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80a76e0 con 0x7f13dc0c4b40 2024-04-23T10:24:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/3431561309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c4b40 msgr2=0x7f13dc0c3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.726 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c4b40 0x7f13dc0c3f20 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f13dc070da0 tx=0x7f13d801e8b0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/3431561309 shutdown_connections 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c5780 0x7f13dc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- 172.21.15.26:0/3431561309 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c4b40 0x7f13dc0c3f20 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- 172.21.15.26:0/3431561309 >> v2:172.21.15.190:3300/0 conn(0x7f13dc0c8800 0x7f13dc0c39e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/3431561309 >> 172.21.15.26:0/3431561309 conn(0x7f13dc06b9d0 msgr2=0x7f13dc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/3431561309 shutdown_connections 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/3431561309 wait complete. 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 Processor -- start 2024-04-23T10:24:40.727 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- start start 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c4b40 0x7f13dc0c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0c8800 0x7f13dc14a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc074280 con 0x7f13dc0c5780 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f13dc073fa0 con 0x7f13dc0c8800 2024-04-23T10:24:40.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f13dc068610 con 0x7f13dc0c4b40 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49840/0 (socket says 172.21.15.26:49840) 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 -- 172.21.15.26:0/397016352 learned_addr learned my addr 172.21.15.26:0/397016352 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e10cf640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c4b40 0x7f13dc0c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 -- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c4b40 msgr2=0x7f13dc0c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c4b40 0x7f13dc0c5bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e18d0640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0c8800 0x7f13dc14a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 -- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0c8800 msgr2=0x7f13dc14a160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0c8800 0x7f13dc14a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 -- 172.21.15.26:0/397016352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f13dc152020 con 0x7f13dc0c5780 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e08ce640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f13d801f150 tx=0x7f13d801b650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80b7070 con 0x7f13dc0c5780 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f13d8003820 con 0x7f13dc0c5780 2024-04-23T10:24:40.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f13dc14b950 con 0x7f13dc0c5780 2024-04-23T10:24:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f13d80ad050 con 0x7f13dc0c5780 2024-04-23T10:24:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.729+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f13dc1522c0 con 0x7f13dc0c5780 2024-04-23T10:24:40.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f13dc075df0 con 0x7f13dc0c5780 2024-04-23T10:24:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f13d80040f0 con 0x7f13dc0c5780 2024-04-23T10:24:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13cdffb640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 0x7f13c006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f13d8121430 con 0x7f13dc0c5780 2024-04-23T10:24:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13e10cf640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 0x7f13c006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:40.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.733+0000 7f13e10cf640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 0x7f13c006a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13d00096f0 tx=0x7f13d0008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:40.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.737+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f13d80185c0 con 0x7f13dc0c5780 2024-04-23T10:24:40.894 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.897+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f13dc074550 con 0x7f13c0068380 2024-04-23T10:24:40.918 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.917+0000 7f13cdffb640 1 -- 172.21.15.26:0/397016352 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334569 (secure 0 0 0) 0x7f13dc074550 con 0x7f13c0068380 2024-04-23T10:24:40.922 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:40.923 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:24:40.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 msgr2=0x7f13c006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 0x7f13c006a840 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f13d00096f0 tx=0x7f13d0008040 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 msgr2=0x7f13dc14af80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f13d801f150 tx=0x7f13d801b650 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 shutdown_connections 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f13c0068380 0x7f13c006a840 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f13dc0c8800 0x7f13dc14a160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f13dc0c5780 0x7f13dc14af80 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 --2- 172.21.15.26:0/397016352 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f13dc0c4b40 0x7f13dc0c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 >> 172.21.15.26:0/397016352 conn(0x7f13dc06b9d0 msgr2=0x7f13dc150f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 shutdown_connections 2024-04-23T10:24:40.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:40.925+0000 7f13e3333640 1 -- 172.21.15.26:0/397016352 wait complete. 2024-04-23T10:24:40.941 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":388,"stamp":"2024-04-23T10:24:39.209610+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48930,"ondisk_log_size":48930,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":82,"apply_latency_ms":82,"commit_latency_ns":82000000,"apply_latency_ns":82000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-3528333,"num_objects":-403,"num_object_clones":0,"num_object_copies":-1612,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-403,"num_whiteouts":0,"num_read":12,"num_read_kb":54,"num_write":468,"num_write_kb":967,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005183"},"pg_stats":[{"pgid":"2.1f","version":"26'118","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.924273+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:24:27.924273+0000","last_peered":"2024-04-23T10:24:27.924273+0000","last_clean":"2024-04-23T10:24:27.924273+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:27.924273+0000","last_undegraded":"2024-04-23T10:24:27.924273+0000","last_fullsized":"2024-04-23T10:24:27.924273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544970+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:24:33.544970+0000","last_peered":"2024-04-23T10:24:33.544970+0000","last_clean":"2024-04-23T10:24:33.544970+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:33.544970+0000","last_undegraded":"2024-04-23T10:24:33.544970+0000","last_fullsized":"2024-04-23T10:24:33.544970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.015013+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:24:30.015013+0000","last_peered":"2024-04-23T10:24:30.015013+0000","last_clean":"2024-04-23T10:24:30.015013+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:24:30.015013+0000","last_undegraded":"2024-04-23T10:24:30.015013+0000","last_fullsized":"2024-04-23T10:24:30.015013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'473","reported_seq":504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.079668+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:24:25.079668+0000","last_peered":"2024-04-23T10:24:25.079668+0000","last_clean":"2024-04-23T10:24:25.079668+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:25.079668+0000","last_undegraded":"2024-04-23T10:24:25.079668+0000","last_fullsized":"2024-04-23T10:24:25.079668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.548547+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:24:33.548547+0000","last_peered":"2024-04-23T10:24:33.548547+0000","last_clean":"2024-04-23T10:24:33.548547+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:33.548547+0000","last_undegraded":"2024-04-23T10:24:33.548547+0000","last_fullsized":"2024-04-23T10:24:33.548547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":913,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.010030+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:24:30.010030+0000","last_peered":"2024-04-23T10:24:30.010030+0000","last_clean":"2024-04-23T10:24:30.010030+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:30.010030+0000","last_undegraded":"2024-04-23T10:24:30.010030+0000","last_fullsized":"2024-04-23T10:24:30.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'340","reported_seq":370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.049614+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:24:29.049614+0000","last_peered":"2024-04-23T10:24:29.049614+0000","last_clean":"2024-04-23T10:24:29.049614+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:29.049614+0000","last_undegraded":"2024-04-23T10:24:29.049614+0000","last_fullsized":"2024-04-23T10:24:29.049614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484064+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:24:33.484064+0000","last_peered":"2024-04-23T10:24:33.484064+0000","last_clean":"2024-04-23T10:24:33.484064+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:33.484064+0000","last_undegraded":"2024-04-23T10:24:33.484064+0000","last_fullsized":"2024-04-23T10:24:33.484064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.979936+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:24:29.979936+0000","last_peered":"2024-04-23T10:24:29.979936+0000","last_clean":"2024-04-23T10:24:29.979936+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:29.979936+0000","last_undegraded":"2024-04-23T10:24:29.979936+0000","last_fullsized":"2024-04-23T10:24:29.979936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'280","reported_seq":310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.005526+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:24:28.005526+0000","last_peered":"2024-04-23T10:24:28.005526+0000","last_clean":"2024-04-23T10:24:28.005526+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:28.005526+0000","last_undegraded":"2024-04-23T10:24:28.005526+0000","last_fullsized":"2024-04-23T10:24:28.005526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484949+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:24:33.484949+0000","last_peered":"2024-04-23T10:24:33.484949+0000","last_clean":"2024-04-23T10:24:33.484949+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:24:33.484949+0000","last_undegraded":"2024-04-23T10:24:33.484949+0000","last_fullsized":"2024-04-23T10:24:33.484949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.936877+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:24:29.936877+0000","last_peered":"2024-04-23T10:24:29.936877+0000","last_clean":"2024-04-23T10:24:29.936877+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:29.936877+0000","last_undegraded":"2024-04-23T10:24:29.936877+0000","last_fullsized":"2024-04-23T10:24:29.936877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.472721+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:24:33.472721+0000","last_peered":"2024-04-23T10:24:33.472721+0000","last_clean":"2024-04-23T10:24:33.472721+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:33.472721+0000","last_undegraded":"2024-04-23T10:24:33.472721+0000","last_fullsized":"2024-04-23T10:24:33.472721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'179","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.873263+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:24:25.873263+0000","last_peered":"2024-04-23T10:24:25.873263+0000","last_clean":"2024-04-23T10:24:25.873263+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:25.873263+0000","last_undegraded":"2024-04-23T10:24:25.873263+0000","last_fullsized":"2024-04-23T10:24:25.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060435+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:24:29.060435+0000","last_peered":"2024-04-23T10:24:29.060435+0000","last_clean":"2024-04-23T10:24:29.060435+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:29.060435+0000","last_undegraded":"2024-04-23T10:24:29.060435+0000","last_fullsized":"2024-04-23T10:24:29.060435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560764+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:24:33.560764+0000","last_peered":"2024-04-23T10:24:33.560764+0000","last_clean":"2024-04-23T10:24:33.560764+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:33.560764+0000","last_undegraded":"2024-04-23T10:24:33.560764+0000","last_fullsized":"2024-04-23T10:24:33.560764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'218","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.053169+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:24:25.053169+0000","last_peered":"2024-04-23T10:24:25.053169+0000","last_clean":"2024-04-23T10:24:25.053169+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:25.053169+0000","last_undegraded":"2024-04-23T10:24:25.053169+0000","last_fullsized":"2024-04-23T10:24:25.053169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917527+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:24:29.917527+0000","last_peered":"2024-04-23T10:24:29.917527+0000","last_clean":"2024-04-23T10:24:29.917527+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:29.917527+0000","last_undegraded":"2024-04-23T10:24:29.917527+0000","last_fullsized":"2024-04-23T10:24:29.917527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564275+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:24:33.564275+0000","last_peered":"2024-04-23T10:24:33.564275+0000","last_clean":"2024-04-23T10:24:33.564275+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:33.564275+0000","last_undegraded":"2024-04-23T10:24:33.564275+0000","last_fullsized":"2024-04-23T10:24:33.564275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.882235+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:24:23.882235+0000","last_peered":"2024-04-23T10:24:23.882235+0000","last_clean":"2024-04-23T10:24:23.882235+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:23.882235+0000","last_undegraded":"2024-04-23T10:24:23.882235+0000","last_fullsized":"2024-04-23T10:24:23.882235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.004676+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:24:30.004676+0000","last_peered":"2024-04-23T10:24:30.004676+0000","last_clean":"2024-04-23T10:24:30.004676+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:30.004676+0000","last_undegraded":"2024-04-23T10:24:30.004676+0000","last_fullsized":"2024-04-23T10:24:30.004676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.469317+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:24:33.469317+0000","last_peered":"2024-04-23T10:24:33.469317+0000","last_clean":"2024-04-23T10:24:33.469317+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:33.469317+0000","last_undegraded":"2024-04-23T10:24:33.469317+0000","last_fullsized":"2024-04-23T10:24:33.469317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'475","reported_seq":506,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875874+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:24:25.875874+0000","last_peered":"2024-04-23T10:24:25.875874+0000","last_clean":"2024-04-23T10:24:25.875874+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:25.875874+0000","last_undegraded":"2024-04-23T10:24:25.875874+0000","last_fullsized":"2024-04-23T10:24:25.875874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.018213+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:24:30.018213+0000","last_peered":"2024-04-23T10:24:30.018213+0000","last_clean":"2024-04-23T10:24:30.018213+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:30.018213+0000","last_undegraded":"2024-04-23T10:24:30.018213+0000","last_fullsized":"2024-04-23T10:24:30.018213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560778+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:24:33.560778+0000","last_peered":"2024-04-23T10:24:33.560778+0000","last_clean":"2024-04-23T10:24:33.560778+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:33.560778+0000","last_undegraded":"2024-04-23T10:24:33.560778+0000","last_fullsized":"2024-04-23T10:24:33.560778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'80","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.943277+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:24:27.943277+0000","last_peered":"2024-04-23T10:24:27.943277+0000","last_clean":"2024-04-23T10:24:27.943277+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:27.943277+0000","last_undegraded":"2024-04-23T10:24:27.943277+0000","last_fullsized":"2024-04-23T10:24:27.943277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":960,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.945497+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:24:29.945497+0000","last_peered":"2024-04-23T10:24:29.945497+0000","last_clean":"2024-04-23T10:24:29.945497+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:29.945497+0000","last_undegraded":"2024-04-23T10:24:29.945497+0000","last_fullsized":"2024-04-23T10:24:29.945497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541259+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:24:33.541259+0000","last_peered":"2024-04-23T10:24:33.541259+0000","last_clean":"2024-04-23T10:24:33.541259+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:33.541259+0000","last_undegraded":"2024-04-23T10:24:33.541259+0000","last_fullsized":"2024-04-23T10:24:33.541259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'476","reported_seq":507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.750104+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:24:30.750104+0000","last_peered":"2024-04-23T10:24:30.750104+0000","last_clean":"2024-04-23T10:24:30.750104+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:30.750104+0000","last_undegraded":"2024-04-23T10:24:30.750104+0000","last_fullsized":"2024-04-23T10:24:30.750104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.105305+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:24:29.105305+0000","last_peered":"2024-04-23T10:24:29.105305+0000","last_clean":"2024-04-23T10:24:29.105305+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:29.105305+0000","last_undegraded":"2024-04-23T10:24:29.105305+0000","last_fullsized":"2024-04-23T10:24:29.105305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.435786+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:24:33.435786+0000","last_peered":"2024-04-23T10:24:33.435786+0000","last_clean":"2024-04-23T10:24:33.435786+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:33.435786+0000","last_undegraded":"2024-04-23T10:24:33.435786+0000","last_fullsized":"2024-04-23T10:24:33.435786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'228","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.015506+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:24:25.015506+0000","last_peered":"2024-04-23T10:24:25.015506+0000","last_clean":"2024-04-23T10:24:25.015506+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:25.015506+0000","last_undegraded":"2024-04-23T10:24:25.015506+0000","last_fullsized":"2024-04-23T10:24:25.015506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.009539+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:24:30.009539+0000","last_peered":"2024-04-23T10:24:30.009539+0000","last_clean":"2024-04-23T10:24:30.009539+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:30.009539+0000","last_undegraded":"2024-04-23T10:24:30.009539+0000","last_fullsized":"2024-04-23T10:24:30.009539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549700+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:24:33.549700+0000","last_peered":"2024-04-23T10:24:33.549700+0000","last_clean":"2024-04-23T10:24:33.549700+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:33.549700+0000","last_undegraded":"2024-04-23T10:24:33.549700+0000","last_fullsized":"2024-04-23T10:24:33.549700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875263+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:24:25.875263+0000","last_peered":"2024-04-23T10:24:25.875263+0000","last_clean":"2024-04-23T10:24:25.875263+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:25.875263+0000","last_undegraded":"2024-04-23T10:24:25.875263+0000","last_fullsized":"2024-04-23T10:24:25.875263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.949787+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:24:29.949787+0000","last_peered":"2024-04-23T10:24:29.949787+0000","last_clean":"2024-04-23T10:24:29.949787+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:29.949787+0000","last_undegraded":"2024-04-23T10:24:29.949787+0000","last_fullsized":"2024-04-23T10:24:29.949787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560629+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:24:33.560629+0000","last_peered":"2024-04-23T10:24:33.560629+0000","last_clean":"2024-04-23T10:24:33.560629+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:33.560629+0000","last_undegraded":"2024-04-23T10:24:33.560629+0000","last_fullsized":"2024-04-23T10:24:33.560629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1260","reported_seq":1291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:15.892836+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:24:15.892836+0000","last_peered":"2024-04-23T10:24:15.892836+0000","last_clean":"2024-04-23T10:24:15.892836+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:15.892836+0000","last_undegraded":"2024-04-23T10:24:15.892836+0000","last_fullsized":"2024-04-23T10:24:15.892836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.038327+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:24:30.038327+0000","last_peered":"2024-04-23T10:24:30.038327+0000","last_clean":"2024-04-23T10:24:30.038327+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:30.038327+0000","last_undegraded":"2024-04-23T10:24:30.038327+0000","last_fullsized":"2024-04-23T10:24:30.038327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.439036+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:24:33.439036+0000","last_peered":"2024-04-23T10:24:33.439036+0000","last_clean":"2024-04-23T10:24:33.439036+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:33.439036+0000","last_undegraded":"2024-04-23T10:24:33.439036+0000","last_fullsized":"2024-04-23T10:24:33.439036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'678","reported_seq":1305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:31.909387+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:24:31.909387+0000","last_peered":"2024-04-23T10:24:31.909387+0000","last_clean":"2024-04-23T10:24:31.909387+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:31.909387+0000","last_undegraded":"2024-04-23T10:24:31.909387+0000","last_fullsized":"2024-04-23T10:24:31.909387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.961324+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:24:29.961324+0000","last_peered":"2024-04-23T10:24:29.961324+0000","last_clean":"2024-04-23T10:24:29.961324+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:29.961324+0000","last_undegraded":"2024-04-23T10:24:29.961324+0000","last_fullsized":"2024-04-23T10:24:29.961324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551035+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:24:33.551035+0000","last_peered":"2024-04-23T10:24:33.551035+0000","last_clean":"2024-04-23T10:24:33.551035+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:33.551035+0000","last_undegraded":"2024-04-23T10:24:33.551035+0000","last_fullsized":"2024-04-23T10:24:33.551035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'821","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.130128+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:24:28.130128+0000","last_peered":"2024-04-23T10:24:28.130128+0000","last_clean":"2024-04-23T10:24:28.130128+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:28.130128+0000","last_undegraded":"2024-04-23T10:24:28.130128+0000","last_fullsized":"2024-04-23T10:24:28.130128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.968924+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:24:29.968924+0000","last_peered":"2024-04-23T10:24:29.968924+0000","last_clean":"2024-04-23T10:24:29.968924+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:29.968924+0000","last_undegraded":"2024-04-23T10:24:29.968924+0000","last_fullsized":"2024-04-23T10:24:29.968924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.543989+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:24:33.543989+0000","last_peered":"2024-04-23T10:24:33.543989+0000","last_clean":"2024-04-23T10:24:33.543989+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:33.543989+0000","last_undegraded":"2024-04-23T10:24:33.543989+0000","last_fullsized":"2024-04-23T10:24:33.543989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060231+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:24:29.060231+0000","last_peered":"2024-04-23T10:24:29.060231+0000","last_clean":"2024-04-23T10:24:29.060231+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:29.060231+0000","last_undegraded":"2024-04-23T10:24:29.060231+0000","last_fullsized":"2024-04-23T10:24:29.060231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:22:26.305857+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:22:26.305857+0000","last_peered":"2024-04-23T10:22:26.305857+0000","last_clean":"2024-04-23T10:22:26.305857+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:22:26.305857+0000","last_undegraded":"2024-04-23T10:22:26.305857+0000","last_fullsized":"2024-04-23T10:22:26.305857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.984831+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:24:29.984831+0000","last_peered":"2024-04-23T10:24:29.984831+0000","last_clean":"2024-04-23T10:24:29.984831+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:29.984831+0000","last_undegraded":"2024-04-23T10:24:29.984831+0000","last_fullsized":"2024-04-23T10:24:29.984831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502905+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:24:33.502905+0000","last_peered":"2024-04-23T10:24:33.502905+0000","last_clean":"2024-04-23T10:24:33.502905+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:33.502905+0000","last_undegraded":"2024-04-23T10:24:33.502905+0000","last_fullsized":"2024-04-23T10:24:33.502905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.940375+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:24:29.940375+0000","last_peered":"2024-04-23T10:24:29.940375+0000","last_clean":"2024-04-23T10:24:29.940375+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:29.940375+0000","last_undegraded":"2024-04-23T10:24:29.940375+0000","last_fullsized":"2024-04-23T10:24:29.940375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.922885+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:24:29.922885+0000","last_peered":"2024-04-23T10:24:29.922885+0000","last_clean":"2024-04-23T10:24:29.922885+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:29.922885+0000","last_undegraded":"2024-04-23T10:24:29.922885+0000","last_fullsized":"2024-04-23T10:24:29.922885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.553149+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:24:33.553149+0000","last_peered":"2024-04-23T10:24:33.553149+0000","last_clean":"2024-04-23T10:24:33.553149+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:33.553149+0000","last_undegraded":"2024-04-23T10:24:33.553149+0000","last_fullsized":"2024-04-23T10:24:33.553149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'596","reported_seq":627,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.987525+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:24:24.987525+0000","last_peered":"2024-04-23T10:24:24.987525+0000","last_clean":"2024-04-23T10:24:24.987525+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:24.987525+0000","last_undegraded":"2024-04-23T10:24:24.987525+0000","last_fullsized":"2024-04-23T10:24:24.987525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.136676+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:24:29.136676+0000","last_peered":"2024-04-23T10:24:29.136676+0000","last_clean":"2024-04-23T10:24:29.136676+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:29.136676+0000","last_undegraded":"2024-04-23T10:24:29.136676+0000","last_fullsized":"2024-04-23T10:24:29.136676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507457+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:24:33.507457+0000","last_peered":"2024-04-23T10:24:33.507457+0000","last_clean":"2024-04-23T10:24:33.507457+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:33.507457+0000","last_undegraded":"2024-04-23T10:24:33.507457+0000","last_fullsized":"2024-04-23T10:24:33.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'411","reported_seq":441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:18.824761+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:24:18.824761+0000","last_peered":"2024-04-23T10:24:18.824761+0000","last_clean":"2024-04-23T10:24:18.824761+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:18.824761+0000","last_undegraded":"2024-04-23T10:24:18.824761+0000","last_fullsized":"2024-04-23T10:24:18.824761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.019063+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:24:30.019063+0000","last_peered":"2024-04-23T10:24:30.019063+0000","last_clean":"2024-04-23T10:24:30.019063+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:24:30.019063+0000","last_undegraded":"2024-04-23T10:24:30.019063+0000","last_fullsized":"2024-04-23T10:24:30.019063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502372+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:24:33.502372+0000","last_peered":"2024-04-23T10:24:33.502372+0000","last_clean":"2024-04-23T10:24:33.502372+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:24:33.502372+0000","last_undegraded":"2024-04-23T10:24:33.502372+0000","last_fullsized":"2024-04-23T10:24:33.502372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'184","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.124538+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:24:29.124538+0000","last_peered":"2024-04-23T10:24:29.124538+0000","last_clean":"2024-04-23T10:24:29.124538+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:29.124538+0000","last_undegraded":"2024-04-23T10:24:29.124538+0000","last_fullsized":"2024-04-23T10:24:29.124538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.022137+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:24:30.022137+0000","last_peered":"2024-04-23T10:24:30.022137+0000","last_clean":"2024-04-23T10:24:30.022137+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:30.022137+0000","last_undegraded":"2024-04-23T10:24:30.022137+0000","last_fullsized":"2024-04-23T10:24:30.022137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.498935+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:24:33.498935+0000","last_peered":"2024-04-23T10:24:33.498935+0000","last_clean":"2024-04-23T10:24:33.498935+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:33.498935+0000","last_undegraded":"2024-04-23T10:24:33.498935+0000","last_fullsized":"2024-04-23T10:24:33.498935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'235","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:34.310965+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:24:34.310965+0000","last_peered":"2024-04-23T10:24:34.310965+0000","last_clean":"2024-04-23T10:24:34.310965+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:34.310965+0000","last_undegraded":"2024-04-23T10:24:34.310965+0000","last_fullsized":"2024-04-23T10:24:34.310965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.976890+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:24:29.976890+0000","last_peered":"2024-04-23T10:24:29.976890+0000","last_clean":"2024-04-23T10:24:29.976890+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:29.976890+0000","last_undegraded":"2024-04-23T10:24:29.976890+0000","last_fullsized":"2024-04-23T10:24:29.976890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559222+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:24:33.559222+0000","last_peered":"2024-04-23T10:24:33.559222+0000","last_clean":"2024-04-23T10:24:33.559222+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:33.559222+0000","last_undegraded":"2024-04-23T10:24:33.559222+0000","last_fullsized":"2024-04-23T10:24:33.559222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'75","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:21.921579+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:24:21.921579+0000","last_peered":"2024-04-23T10:24:21.921579+0000","last_clean":"2024-04-23T10:24:21.921579+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:21.921579+0000","last_undegraded":"2024-04-23T10:24:21.921579+0000","last_fullsized":"2024-04-23T10:24:21.921579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.138272+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:24:29.138272+0000","last_peered":"2024-04-23T10:24:29.138272+0000","last_clean":"2024-04-23T10:24:29.138272+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:29.138272+0000","last_undegraded":"2024-04-23T10:24:29.138272+0000","last_fullsized":"2024-04-23T10:24:29.138272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504309+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:24:33.504309+0000","last_peered":"2024-04-23T10:24:33.504309+0000","last_clean":"2024-04-23T10:24:33.504309+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:33.504309+0000","last_undegraded":"2024-04-23T10:24:33.504309+0000","last_fullsized":"2024-04-23T10:24:33.504309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'72","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.905924+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:24:29.905924+0000","last_peered":"2024-04-23T10:24:29.905924+0000","last_clean":"2024-04-23T10:24:29.905924+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:29.905924+0000","last_undegraded":"2024-04-23T10:24:29.905924+0000","last_fullsized":"2024-04-23T10:24:29.905924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.954554+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:24:29.954554+0000","last_peered":"2024-04-23T10:24:29.954554+0000","last_clean":"2024-04-23T10:24:29.954554+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:29.954554+0000","last_undegraded":"2024-04-23T10:24:29.954554+0000","last_fullsized":"2024-04-23T10:24:29.954554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.558092+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:24:33.558092+0000","last_peered":"2024-04-23T10:24:33.558092+0000","last_clean":"2024-04-23T10:24:33.558092+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:33.558092+0000","last_undegraded":"2024-04-23T10:24:33.558092+0000","last_fullsized":"2024-04-23T10:24:33.558092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'560","reported_seq":590,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:16.384742+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:24:16.384742+0000","last_peered":"2024-04-23T10:24:16.384742+0000","last_clean":"2024-04-23T10:24:16.384742+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:16.384742+0000","last_undegraded":"2024-04-23T10:24:16.384742+0000","last_fullsized":"2024-04-23T10:24:16.384742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.035161+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:24:30.035161+0000","last_peered":"2024-04-23T10:24:30.035161+0000","last_clean":"2024-04-23T10:24:30.035161+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:24:30.035161+0000","last_undegraded":"2024-04-23T10:24:30.035161+0000","last_fullsized":"2024-04-23T10:24:30.035161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554735+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:24:33.554735+0000","last_peered":"2024-04-23T10:24:33.554735+0000","last_clean":"2024-04-23T10:24:33.554735+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:24:33.554735+0000","last_undegraded":"2024-04-23T10:24:33.554735+0000","last_fullsized":"2024-04-23T10:24:33.554735+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'413","reported_seq":444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.015396+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:24:23.015396+0000","last_peered":"2024-04-23T10:24:23.015396+0000","last_clean":"2024-04-23T10:24:23.015396+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:23.015396+0000","last_undegraded":"2024-04-23T10:24:23.015396+0000","last_fullsized":"2024-04-23T10:24:23.015396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.935827+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:24:29.935827+0000","last_peered":"2024-04-23T10:24:29.935827+0000","last_clean":"2024-04-23T10:24:29.935827+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:29.935827+0000","last_undegraded":"2024-04-23T10:24:29.935827+0000","last_fullsized":"2024-04-23T10:24:29.935827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503506+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:24:33.503506+0000","last_peered":"2024-04-23T10:24:33.503506+0000","last_clean":"2024-04-23T10:24:33.503506+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:33.503506+0000","last_undegraded":"2024-04-23T10:24:33.503506+0000","last_fullsized":"2024-04-23T10:24:33.503506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'298","reported_seq":328,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.275896+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:24:30.275896+0000","last_peered":"2024-04-23T10:24:30.275896+0000","last_clean":"2024-04-23T10:24:30.275896+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:30.275896+0000","last_undegraded":"2024-04-23T10:24:30.275896+0000","last_fullsized":"2024-04-23T10:24:30.275896+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.978436+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:24:29.978436+0000","last_peered":"2024-04-23T10:24:29.978436+0000","last_clean":"2024-04-23T10:24:29.978436+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:29.978436+0000","last_undegraded":"2024-04-23T10:24:29.978436+0000","last_fullsized":"2024-04-23T10:24:29.978436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.547587+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:24:33.547587+0000","last_peered":"2024-04-23T10:24:33.547587+0000","last_clean":"2024-04-23T10:24:33.547587+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:33.547587+0000","last_undegraded":"2024-04-23T10:24:33.547587+0000","last_fullsized":"2024-04-23T10:24:33.547587+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'274","reported_seq":304,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.953756+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:24:27.953756+0000","last_peered":"2024-04-23T10:24:27.953756+0000","last_clean":"2024-04-23T10:24:27.953756+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:27.953756+0000","last_undegraded":"2024-04-23T10:24:27.953756+0000","last_fullsized":"2024-04-23T10:24:27.953756+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.029718+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:24:30.029718+0000","last_peered":"2024-04-23T10:24:30.029718+0000","last_clean":"2024-04-23T10:24:30.029718+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:30.029718+0000","last_undegraded":"2024-04-23T10:24:30.029718+0000","last_fullsized":"2024-04-23T10:24:30.029718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503116+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:24:33.503116+0000","last_peered":"2024-04-23T10:24:33.503116+0000","last_clean":"2024-04-23T10:24:33.503116+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:33.503116+0000","last_undegraded":"2024-04-23T10:24:33.503116+0000","last_fullsized":"2024-04-23T10:24:33.503116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":102,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.397534+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:24:33.397534+0000","last_peered":"2024-04-23T10:24:33.397534+0000","last_clean":"2024-04-23T10:24:33.397534+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:33.397534+0000","last_undegraded":"2024-04-23T10:24:33.397534+0000","last_fullsized":"2024-04-23T10:24:33.397534+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.026126+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:24:30.026126+0000","last_peered":"2024-04-23T10:24:30.026126+0000","last_clean":"2024-04-23T10:24:30.026126+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:30.026126+0000","last_undegraded":"2024-04-23T10:24:30.026126+0000","last_fullsized":"2024-04-23T10:24:30.026126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":925,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.992752+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:24:29.992752+0000","last_peered":"2024-04-23T10:24:29.992752+0000","last_clean":"2024-04-23T10:24:29.992752+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:29.992752+0000","last_undegraded":"2024-04-23T10:24:29.992752+0000","last_fullsized":"2024-04-23T10:24:29.992752+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.561905+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:24:33.561905+0000","last_peered":"2024-04-23T10:24:33.561905+0000","last_clean":"2024-04-23T10:24:33.561905+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:33.561905+0000","last_undegraded":"2024-04-23T10:24:33.561905+0000","last_fullsized":"2024-04-23T10:24:33.561905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1046","reported_seq":1076,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.915613+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:24:23.915613+0000","last_peered":"2024-04-23T10:24:23.915613+0000","last_clean":"2024-04-23T10:24:23.915613+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:23.915613+0000","last_undegraded":"2024-04-23T10:24:23.915613+0000","last_fullsized":"2024-04-23T10:24:23.915613+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.993724+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:24:28.993724+0000","last_peered":"2024-04-23T10:24:28.993724+0000","last_clean":"2024-04-23T10:24:28.993724+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:28.993724+0000","last_undegraded":"2024-04-23T10:24:28.993724+0000","last_fullsized":"2024-04-23T10:24:28.993724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554764+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:24:33.554764+0000","last_peered":"2024-04-23T10:24:33.554764+0000","last_clean":"2024-04-23T10:24:33.554764+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:33.554764+0000","last_undegraded":"2024-04-23T10:24:33.554764+0000","last_fullsized":"2024-04-23T10:24:33.554764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'152","reported_seq":181,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.916439+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:24:23.916439+0000","last_peered":"2024-04-23T10:24:23.916439+0000","last_clean":"2024-04-23T10:24:23.916439+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:23.916439+0000","last_undegraded":"2024-04-23T10:24:23.916439+0000","last_fullsized":"2024-04-23T10:24:23.916439+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:22.944498+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:24:22.944498+0000","last_peered":"2024-04-23T10:24:22.944498+0000","last_clean":"2024-04-23T10:24:22.944498+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:22.944498+0000","last_undegraded":"2024-04-23T10:24:22.944498+0000","last_fullsized":"2024-04-23T10:24:22.944498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564241+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:24:33.564241+0000","last_peered":"2024-04-23T10:24:33.564241+0000","last_clean":"2024-04-23T10:24:33.564241+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:33.564241+0000","last_undegraded":"2024-04-23T10:24:33.564241+0000","last_fullsized":"2024-04-23T10:24:33.564241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.960197+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:24:29.960197+0000","last_peered":"2024-04-23T10:24:29.960197+0000","last_clean":"2024-04-23T10:24:29.960197+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:29.960197+0000","last_undegraded":"2024-04-23T10:24:29.960197+0000","last_fullsized":"2024-04-23T10:24:29.960197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'112","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.927138+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:24:24.927138+0000","last_peered":"2024-04-23T10:24:24.927138+0000","last_clean":"2024-04-23T10:24:24.927138+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:24.927138+0000","last_undegraded":"2024-04-23T10:24:24.927138+0000","last_fullsized":"2024-04-23T10:24:24.927138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473116+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:24:33.473116+0000","last_peered":"2024-04-23T10:24:33.473116+0000","last_clean":"2024-04-23T10:24:33.473116+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:33.473116+0000","last_undegraded":"2024-04-23T10:24:33.473116+0000","last_fullsized":"2024-04-23T10:24:33.473116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.131318+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:24:29.131318+0000","last_peered":"2024-04-23T10:24:29.131318+0000","last_clean":"2024-04-23T10:24:29.131318+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:24:29.131318+0000","last_undegraded":"2024-04-23T10:24:29.131318+0000","last_fullsized":"2024-04-23T10:24:29.131318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559932+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:24:33.559932+0000","last_peered":"2024-04-23T10:24:33.559932+0000","last_clean":"2024-04-23T10:24:33.559932+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:33.559932+0000","last_undegraded":"2024-04-23T10:24:33.559932+0000","last_fullsized":"2024-04-23T10:24:33.559932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541987+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:24:33.541987+0000","last_peered":"2024-04-23T10:24:33.541987+0000","last_clean":"2024-04-23T10:24:33.541987+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:33.541987+0000","last_undegraded":"2024-04-23T10:24:33.541987+0000","last_fullsized":"2024-04-23T10:24:33.541987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549732+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:24:33.549732+0000","last_peered":"2024-04-23T10:24:33.549732+0000","last_clean":"2024-04-23T10:24:33.549732+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:33.549732+0000","last_undegraded":"2024-04-23T10:24:33.549732+0000","last_fullsized":"2024-04-23T10:24:33.549732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.562847+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:24:33.562847+0000","last_peered":"2024-04-23T10:24:33.562847+0000","last_clean":"2024-04-23T10:24:33.562847+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:33.562847+0000","last_undegraded":"2024-04-23T10:24:33.562847+0000","last_fullsized":"2024-04-23T10:24:33.562847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.552147+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:24:33.552147+0000","last_peered":"2024-04-23T10:24:33.552147+0000","last_clean":"2024-04-23T10:24:33.552147+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:33.552147+0000","last_undegraded":"2024-04-23T10:24:33.552147+0000","last_fullsized":"2024-04-23T10:24:33.552147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560580+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:24:33.560580+0000","last_peered":"2024-04-23T10:24:33.560580+0000","last_clean":"2024-04-23T10:24:33.560580+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:33.560580+0000","last_undegraded":"2024-04-23T10:24:33.560580+0000","last_fullsized":"2024-04-23T10:24:33.560580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502105+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:24:33.502105+0000","last_peered":"2024-04-23T10:24:33.502105+0000","last_clean":"2024-04-23T10:24:33.502105+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:33.502105+0000","last_undegraded":"2024-04-23T10:24:33.502105+0000","last_fullsized":"2024-04-23T10:24:33.502105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544972+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:24:33.544972+0000","last_peered":"2024-04-23T10:24:33.544972+0000","last_clean":"2024-04-23T10:24:33.544972+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:33.544972+0000","last_undegraded":"2024-04-23T10:24:33.544972+0000","last_fullsized":"2024-04-23T10:24:33.544972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549783+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:24:33.549783+0000","last_peered":"2024-04-23T10:24:33.549783+0000","last_clean":"2024-04-23T10:24:33.549783+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:33.549783+0000","last_undegraded":"2024-04-23T10:24:33.549783+0000","last_fullsized":"2024-04-23T10:24:33.549783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.545594+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:24:33.545594+0000","last_peered":"2024-04-23T10:24:33.545594+0000","last_clean":"2024-04-23T10:24:33.545594+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:33.545594+0000","last_undegraded":"2024-04-23T10:24:33.545594+0000","last_fullsized":"2024-04-23T10:24:33.545594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501556+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:24:33.501556+0000","last_peered":"2024-04-23T10:24:33.501556+0000","last_clean":"2024-04-23T10:24:33.501556+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:33.501556+0000","last_undegraded":"2024-04-23T10:24:33.501556+0000","last_fullsized":"2024-04-23T10:24:33.501556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564160+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:24:33.564160+0000","last_peered":"2024-04-23T10:24:33.564160+0000","last_clean":"2024-04-23T10:24:33.564160+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:33.564160+0000","last_undegraded":"2024-04-23T10:24:33.564160+0000","last_fullsized":"2024-04-23T10:24:33.564160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473964+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:24:33.473964+0000","last_peered":"2024-04-23T10:24:33.473964+0000","last_clean":"2024-04-23T10:24:33.473964+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:33.473964+0000","last_undegraded":"2024-04-23T10:24:33.473964+0000","last_fullsized":"2024-04-23T10:24:33.473964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554626+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:24:33.554626+0000","last_peered":"2024-04-23T10:24:33.554626+0000","last_clean":"2024-04-23T10:24:33.554626+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:33.554626+0000","last_undegraded":"2024-04-23T10:24:33.554626+0000","last_fullsized":"2024-04-23T10:24:33.554626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.546876+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:24:33.546876+0000","last_peered":"2024-04-23T10:24:33.546876+0000","last_clean":"2024-04-23T10:24:33.546876+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:33.546876+0000","last_undegraded":"2024-04-23T10:24:33.546876+0000","last_fullsized":"2024-04-23T10:24:33.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501448+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:24:33.501448+0000","last_peered":"2024-04-23T10:24:33.501448+0000","last_clean":"2024-04-23T10:24:33.501448+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:33.501448+0000","last_undegraded":"2024-04-23T10:24:33.501448+0000","last_fullsized":"2024-04-23T10:24:33.501448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555566+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:24:33.555566+0000","last_peered":"2024-04-23T10:24:33.555566+0000","last_clean":"2024-04-23T10:24:33.555566+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:33.555566+0000","last_undegraded":"2024-04-23T10:24:33.555566+0000","last_fullsized":"2024-04-23T10:24:33.555566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.467678+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:24:33.467678+0000","last_peered":"2024-04-23T10:24:33.467678+0000","last_clean":"2024-04-23T10:24:33.467678+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:33.467678+0000","last_undegraded":"2024-04-23T10:24:33.467678+0000","last_fullsized":"2024-04-23T10:24:33.467678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560655+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:24:33.560655+0000","last_peered":"2024-04-23T10:24:33.560655+0000","last_clean":"2024-04-23T10:24:33.560655+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:33.560655+0000","last_undegraded":"2024-04-23T10:24:33.560655+0000","last_fullsized":"2024-04-23T10:24:33.560655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.556154+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:24:33.556154+0000","last_peered":"2024-04-23T10:24:33.556154+0000","last_clean":"2024-04-23T10:24:33.556154+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:33.556154+0000","last_undegraded":"2024-04-23T10:24:33.556154+0000","last_fullsized":"2024-04-23T10:24:33.556154+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.477633+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:24:33.477633+0000","last_peered":"2024-04-23T10:24:33.477633+0000","last_clean":"2024-04-23T10:24:33.477633+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:33.477633+0000","last_undegraded":"2024-04-23T10:24:33.477633+0000","last_fullsized":"2024-04-23T10:24:33.477633+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.481582+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:24:33.481582+0000","last_peered":"2024-04-23T10:24:33.481582+0000","last_clean":"2024-04-23T10:24:33.481582+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:33.481582+0000","last_undegraded":"2024-04-23T10:24:33.481582+0000","last_fullsized":"2024-04-23T10:24:33.481582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.489052+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:24:33.489052+0000","last_peered":"2024-04-23T10:24:33.489052+0000","last_clean":"2024-04-23T10:24:33.489052+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:33.489052+0000","last_undegraded":"2024-04-23T10:24:33.489052+0000","last_fullsized":"2024-04-23T10:24:33.489052+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507582+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:24:33.507582+0000","last_peered":"2024-04-23T10:24:33.507582+0000","last_clean":"2024-04-23T10:24:33.507582+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:33.507582+0000","last_undegraded":"2024-04-23T10:24:33.507582+0000","last_fullsized":"2024-04-23T10:24:33.507582+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551211+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:24:33.551211+0000","last_peered":"2024-04-23T10:24:33.551211+0000","last_clean":"2024-04-23T10:24:33.551211+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:33.551211+0000","last_undegraded":"2024-04-23T10:24:33.551211+0000","last_fullsized":"2024-04-23T10:24:33.551211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559120+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:24:33.559120+0000","last_peered":"2024-04-23T10:24:33.559120+0000","last_clean":"2024-04-23T10:24:33.559120+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:24:33.559120+0000","last_undegraded":"2024-04-23T10:24:33.559120+0000","last_fullsized":"2024-04-23T10:24:33.559120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559225+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:24:33.559225+0000","last_peered":"2024-04-23T10:24:33.559225+0000","last_clean":"2024-04-23T10:24:33.559225+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:33.559225+0000","last_undegraded":"2024-04-23T10:24:33.559225+0000","last_fullsized":"2024-04-23T10:24:33.559225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554394+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:24:33.554394+0000","last_peered":"2024-04-23T10:24:33.554394+0000","last_clean":"2024-04-23T10:24:33.554394+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:33.554394+0000","last_undegraded":"2024-04-23T10:24:33.554394+0000","last_fullsized":"2024-04-23T10:24:33.554394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559435+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:24:33.559435+0000","last_peered":"2024-04-23T10:24:33.559435+0000","last_clean":"2024-04-23T10:24:33.559435+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:33.559435+0000","last_undegraded":"2024-04-23T10:24:33.559435+0000","last_fullsized":"2024-04-23T10:24:33.559435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555603+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:24:33.555603+0000","last_peered":"2024-04-23T10:24:33.555603+0000","last_clean":"2024-04-23T10:24:33.555603+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:33.555603+0000","last_undegraded":"2024-04-23T10:24:33.555603+0000","last_fullsized":"2024-04-23T10:24:33.555603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.431229+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:24:33.431229+0000","last_peered":"2024-04-23T10:24:33.431229+0000","last_clean":"2024-04-23T10:24:33.431229+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:33.431229+0000","last_undegraded":"2024-04-23T10:24:33.431229+0000","last_fullsized":"2024-04-23T10:24:33.431229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504628+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:24:33.504628+0000","last_peered":"2024-04-23T10:24:33.504628+0000","last_clean":"2024-04-23T10:24:33.504628+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:24:33.504628+0000","last_undegraded":"2024-04-23T10:24:33.504628+0000","last_fullsized":"2024-04-23T10:24:33.504628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10774,"ondisk_log_size":10774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574999,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574997,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":19,"apply_latency_ms":19,"commit_latency_ns":19000000,"apply_latency_ns":19000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574997,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574999,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574999,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":16,"apply_latency_ms":16,"commit_latency_ns":16000000,"apply_latency_ns":16000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574999,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574998,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574999,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":21,"apply_latency_ms":21,"commit_latency_ns":21000000,"apply_latency_ns":21000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:24:40.946 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:24:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 Processor -- start 2024-04-23T10:24:41.112 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 -- start start 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2880c8630 0x7fe288151b40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 0x7fe288152080 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe28815b740 con 0x7fe2880c8250 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fe2880c6490 con 0x7fe2880c8630 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe28d8ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2881525c0 con 0x7fe2880c8a70 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2880c8630 0x7fe288151b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fe2880c8630 0x7fe288151b40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49852/0 (socket says 172.21.15.26:49852) 2024-04-23T10:24:41.114 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 -- 172.21.15.26:0/2189990363 learned_addr learned my addr 172.21.15.26:0/2189990363 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe286ffd640 1 --1- 172.21.15.26:0/2189990363 >> v1:172.21.15.26:6789/0 conn(0x7fe2880c8250 0x7fe2880c39e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:51418/0 (socket says 172.21.15.26:51418) 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2877fe640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 0x7fe288152080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 -- 172.21.15.26:0/2189990363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 msgr2=0x7fe288152080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 0x7fe288152080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 -- 172.21.15.26:0/2189990363 >> v1:172.21.15.26:6789/0 conn(0x7fe2880c8250 legacy=0x7fe2880c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2867fc640 1 -- 172.21.15.26:0/2189990363 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe2880c40f0 con 0x7fe2880c8630 2024-04-23T10:24:41.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.113+0000 7fe2877fe640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 0x7fe288152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe2867fc640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8630 0x7fe288151b40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bb10 tx=0x7fe27c01eba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec44baf2f78c27bb server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe285ffb640 1 -- 172.21.15.26:0/2189990363 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0b4070 con 0x7fe2880c8630 2024-04-23T10:24:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe285ffb640 1 -- 172.21.15.26:0/2189990363 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe27c0a7970 con 0x7fe2880c8630 2024-04-23T10:24:41.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe285ffb640 1 -- 172.21.15.26:0/2189990363 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe27c0a7d40 con 0x7fe2880c8630 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2189990363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8630 msgr2=0x7fe288151b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8630 0x7fe288151b40 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 crypto rx=0x7fe27c00bb10 tx=0x7fe27c01eba0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2189990363 shutdown_connections 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8a70 0x7fe288152080 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2189990363 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8630 0x7fe288151b40 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2189990363 >> 172.21.15.26:0/2189990363 conn(0x7fe28806b9d0 msgr2=0x7fe28806bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2189990363 shutdown_connections 2024-04-23T10:24:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.117+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2189990363 wait complete. 2024-04-23T10:24:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 Processor -- start 2024-04-23T10:24:41.118 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- start start 2024-04-23T10:24:41.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 0x7fe288073900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 0x7fe288153020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fe28815b400 con 0x7fe2880c8a70 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fe2880721a0 con 0x7fe2880c8630 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fe2880c6900 con 0x7fe2880c8250 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:49868/0 (socket says 172.21.15.26:49868) 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 -- 172.21.15.26:0/2802467979 learned_addr learned my addr 172.21.15.26:0/2802467979 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2867fc640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 0x7fe288153020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe286ffd640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 0x7fe288073900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 -- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 msgr2=0x7fe288073900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 0x7fe288073900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 -- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 msgr2=0x7fe288153020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 0x7fe288153020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 -- 172.21.15.26:0/2802467979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe288152840 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe286ffd640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 0x7fe288073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2867fc640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 0x7fe288153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe2877fe640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c820 tx=0x7fe28000cce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280015020 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe280004240 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe288154f20 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fe280003620 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe2881f0720 con 0x7fe2880c8a70 2024-04-23T10:24:41.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe288075df0 con 0x7fe2880c8a70 2024-04-23T10:24:41.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fe280018020 con 0x7fe2880c8a70 2024-04-23T10:24:41.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.121+0000 7fe26ffff640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 0x7fe27406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:41.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.125+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fe280086e70 con 0x7fe2880c8a70 2024-04-23T10:24:41.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.125+0000 7fe286ffd640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 0x7fe27406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:41.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.125+0000 7fe286ffd640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 0x7fe27406a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe2780012f0 tx=0x7fe278009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:41.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.129+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fe28001f020 con 0x7fe2880c8a70 2024-04-23T10:24:41.286 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.289+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fe2881521a0 con 0x7fe2880c8a70 2024-04-23T10:24:41.289 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.289+0000 7fe26ffff640 1 -- 172.21.15.26:0/2802467979 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7fe280057000 con 0x7fe2880c8a70 2024-04-23T10:24:41.289 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:41.289 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:24:41.291 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 msgr2=0x7fe27406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 0x7fe27406a840 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fe2780012f0 tx=0x7fe278009040 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 msgr2=0x7fe288144cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7fe28000c820 tx=0x7fe28000cce0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 shutdown_connections 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fe274068380 0x7fe27406a840 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fe2880c8a70 0x7fe288144cb0 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fe2880c8630 0x7fe288153020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 --2- 172.21.15.26:0/2802467979 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fe2880c8250 0x7fe288073900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 >> 172.21.15.26:0/2802467979 conn(0x7fe28806b9d0 msgr2=0x7fe28814cd00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 shutdown_connections 2024-04-23T10:24:41.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:41.293+0000 7fe28d8ed640 1 -- 172.21.15.26:0/2802467979 wait complete. 2024-04-23T10:24:42.309 INFO:tasks.ceph:Scrubbing osd.0 2024-04-23T10:24:42.309 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:42.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 Processor -- start 2024-04-23T10:24:42.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 -- start start 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fb2bc0c5fa0 0x7fb2bc15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 0x7fb2bc152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb2bc06ce60 con 0x7fb2bc0c6380 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fb2bc0c8890 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c3c56640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc15c970 con 0x7fb2bc15d340 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c21f3640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb2bc0c6380 0x7fb2bc06b9d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48356/0 (socket says 172.21.15.26:48356) 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c21f3640 1 -- 172.21.15.26:0/3302246664 learned_addr learned my addr 172.21.15.26:0/3302246664 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/3302246664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 0x7fb2bc152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c19f2640 1 --2- 172.21.15.26:0/3302246664 >> v2:172.21.15.190:3300/0 conn(0x7fb2bc0c5fa0 0x7fb2bc15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 23148926 0 0) 0x7fb2bc06ce60 con 0x7fb2bc0c6380 2024-04-23T10:24:42.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb2a8003530 con 0x7fb2bc0c6380 2024-04-23T10:24:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c11f1640 1 -- 172.21.15.26:0/3302246664 >> v2:172.21.15.190:3300/0 conn(0x7fb2bc0c5fa0 msgr2=0x7fb2bc15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/3302246664 >> v2:172.21.15.190:3300/0 conn(0x7fb2bc0c5fa0 0x7fb2bc15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c11f1640 1 -- 172.21.15.26:0/3302246664 >> v1:172.21.15.26:6789/0 conn(0x7fb2bc0c6380 legacy=0x7fb2bc06b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3511603963 0 0) 0x7fb2a8003530 con 0x7fb2bc0c6380 2024-04-23T10:24:42.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.453+0000 7fb2c11f1640 1 -- 172.21.15.26:0/3302246664 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc0c8ae0 con 0x7fb2bc15d340 2024-04-23T10:24:42.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/3302246664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 0x7fb2bc152cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0097c0 tx=0x7fb2ac01c270 comp rx=0 tx=0).ready entity=mon.2 client_cookie=23295732d192b376 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2ac0b0070 con 0x7fb2bc15d340 2024-04-23T10:24:42.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2ac0ab400 con 0x7fb2bc15d340 2024-04-23T10:24:42.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c09f0640 1 -- 172.21.15.26:0/3302246664 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b4001a00 con 0x7fb2bc15d340 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- 172.21.15.26:0/3302246664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 msgr2=0x7fb2bc152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/3302246664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 0x7fb2bc152cf0 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0097c0 tx=0x7fb2ac01c270 comp rx=0 tx=0).stop 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- 172.21.15.26:0/3302246664 shutdown_connections 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/3302246664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc15d340 0x7fb2bc152cf0 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/3302246664 >> v2:172.21.15.190:3300/0 conn(0x7fb2bc0c5fa0 0x7fb2bc15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- 172.21.15.26:0/3302246664 >> 172.21.15.26:0/3302246664 conn(0x7fb2bc0c9130 msgr2=0x7fb2bc0c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- 172.21.15.26:0/3302246664 shutdown_connections 2024-04-23T10:24:42.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- 172.21.15.26:0/3302246664 wait complete. 2024-04-23T10:24:42.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 Processor -- start 2024-04-23T10:24:42.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.457+0000 7fb2c3c56640 1 -- start start 2024-04-23T10:24:42.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 0x7fb2bc161b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc0c6380 0x7fb2bc146de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15d340 0x7fb2bc147320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc06cc10 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb2bc06ca90 con 0x7fb2bc15d340 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb2bc0c6fa0 con 0x7fb2bc0c6380 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 0x7fb2bc161b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 0x7fb2bc161b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53044/0 (socket says 172.21.15.26:53044) 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 -- 172.21.15.26:0/445678220 learned_addr learned my addr 172.21.15.26:0/445678220 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c21f3640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15d340 0x7fb2bc147320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc0c6380 0x7fb2bc146de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 -- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc0c6380 msgr2=0x7fb2bc146de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb2bc0c6380 0x7fb2bc146de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 -- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15d340 msgr2=0x7fb2bc147320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb2bc15d340 0x7fb2bc147320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb2bc071340 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c19f2640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 0x7fb2bc161b30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800e870 tx=0x7fb2b800ec70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b8017070 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b800c940 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb2bc0c4700 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb2b800ccf0 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb2bc0c4cc0 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb2bc147860 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb2b801a070 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb2a0068380 0x7fb2a006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb2b8086cb0 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fb2a0071e10 0x7fb2a00742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb2b800be50 con 0x7fb2a0071e10 2024-04-23T10:24:42.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb2b80893b0 con 0x7fb2bc0c5fa0 2024-04-23T10:24:42.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c21f3640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fb2a0071e10 0x7fb2a00742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb2a0068380 0x7fb2a006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.461+0000 7fb2c21f3640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fb2a0071e10 0x7fb2a00742b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.465+0000 7fb2c11f1640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb2a0068380 0x7fb2a006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0ad000 tx=0x7fb2ac0a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.465+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== osd.0 v2:172.21.15.26:6817/1116322657 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb2b800be50 con 0x7fb2a0071e10 2024-04-23T10:24:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 --> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb2bc075e60 con 0x7fb2a0071e10 2024-04-23T10:24:42.476 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2b27fc640 1 -- 172.21.15.26:0/445678220 <== osd.0 v2:172.21.15.26:6817/1116322657 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb2bc075e60 con 0x7fb2a0071e10 2024-04-23T10:24:42.476 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:42.476 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:42.476 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fb2a0071e10 msgr2=0x7fb2a00742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.477 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:6817/1116322657,v1:172.21.15.26:6819/1116322657] conn(0x7fb2a0071e10 0x7fb2a00742b0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb2a0068380 msgr2=0x7fb2a006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb2a0068380 0x7fb2a006a840 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7fb2ac0ad000 tx=0x7fb2ac0a6000 comp rx=0 tx=0).stop 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 msgr2=0x7fb2bc161b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 --2- 172.21.15.26:0/445678220 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb2bc0c5fa0 0x7fb2bc161b30 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7fb2b800e870 tx=0x7fb2b800ec70 comp rx=0 tx=0).stop 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c21f3640 1 -- 172.21.15.26:0/445678220 reap_dead start 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 shutdown_connections 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 >> 172.21.15.26:0/445678220 conn(0x7fb2bc0c9130 msgr2=0x7fb2bc0cbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 shutdown_connections 2024-04-23T10:24:42.478 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.477+0000 7fb2c3c56640 1 -- 172.21.15.26:0/445678220 wait complete. 2024-04-23T10:24:42.493 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-23T10:24:42.610 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 Processor -- start 2024-04-23T10:24:42.611 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 -- start start 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7006c750 0x7f0f70143e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f700cdc80 0x7f0f701443d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0f7015e740 con 0x7f0f700cd8a0 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f0f700c9e90 con 0x7f0f700cdc80 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f77b21640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0f7015e9e0 con 0x7f0f7006c750 2024-04-23T10:24:42.612 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f700cdc80 0x7f0f701443d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f0f700cdc80 0x7f0f701443d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53050/0 (socket says 172.21.15.26:53050) 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 -- 172.21.15.26:0/524012851 learned_addr learned my addr 172.21.15.26:0/524012851 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f750bc640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7006c750 0x7f0f70143e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 -- 172.21.15.26:0/524012851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7006c750 msgr2=0x7f0f70143e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7006c750 0x7f0f70143e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 -- 172.21.15.26:0/524012851 >> v1:172.21.15.190:6789/0 conn(0x7f0f700cd8a0 legacy=0x7f0f700720d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:42.613 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.613+0000 7f0f760be640 1 -- 172.21.15.26:0/524012851 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f7015ecc0 con 0x7f0f700cdc80 2024-04-23T10:24:42.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f760be640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cdc80 0x7f0f701443d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009870 tx=0x7f0f6801ed10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a70ecedede26605d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.614 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f748bb640 1 -- 172.21.15.26:0/524012851 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680b5070 con 0x7f0f700cdc80 2024-04-23T10:24:42.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f748bb640 1 -- 172.21.15.26:0/524012851 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f680a89d0 con 0x7f0f700cdc80 2024-04-23T10:24:42.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f748bb640 1 -- 172.21.15.26:0/524012851 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f680a8da0 con 0x7f0f700cdc80 2024-04-23T10:24:42.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- 172.21.15.26:0/524012851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cdc80 msgr2=0x7f0f701443d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.615 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cdc80 0x7f0f701443d0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f0f68009870 tx=0x7f0f6801ed10 comp rx=0 tx=0).stop 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- 172.21.15.26:0/524012851 shutdown_connections 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cdc80 0x7f0f701443d0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- 172.21.15.26:0/524012851 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f7006c750 0x7f0f70143e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- 172.21.15.26:0/524012851 >> 172.21.15.26:0/524012851 conn(0x7f0f7006fca0 msgr2=0x7f0f700700b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- 172.21.15.26:0/524012851 shutdown_connections 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- 172.21.15.26:0/524012851 wait complete. 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 Processor -- start 2024-04-23T10:24:42.616 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- start start 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7006c750 0x7f0f70156f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700cdc80 0x7f0f70141130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f0f700c9930 con 0x7f0f700cd8a0 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f0f7015f280 con 0x7f0f7006c750 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f77b21640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0f700c9ab0 con 0x7f0f700cdc80 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53064/0 (socket says 172.21.15.26:53064) 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 -- 172.21.15.26:0/1675280146 learned_addr learned my addr 172.21.15.26:0/1675280146 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f758bd640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7006c750 0x7f0f70156f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f760be640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700cdc80 0x7f0f70141130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 -- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700cdc80 msgr2=0x7f0f70141130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.619 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700cdc80 0x7f0f70141130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 -- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7006c750 msgr2=0x7f0f70156f60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7006c750 0x7f0f70156f60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.617+0000 7f0f750bc640 1 -- 172.21.15.26:0/1675280146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0f701565d0 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f750bc640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d800 tx=0x7f0f6000dcc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000b6c0 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f60019070 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0f70158fc0 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0f6000ba60 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0f70155d00 con 0x7f0f700cd8a0 2024-04-23T10:24:42.620 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0f70075df0 con 0x7f0f700cd8a0 2024-04-23T10:24:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f0f6000bc00 con 0x7f0f700cd8a0 2024-04-23T10:24:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 0x7f0f5406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0f60087250 con 0x7f0f700cd8a0 2024-04-23T10:24:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f758bd640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 0x7f0f5406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.621 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.621+0000 7f0f758bd640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 0x7f0f5406a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c005530 tx=0x7f0f6c009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.625 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.625+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0f600573e0 con 0x7f0f700cd8a0 2024-04-23T10:24:42.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.785+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7f0f700cc0f0 con 0x7f0f540683b0 2024-04-23T10:24:42.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.785+0000 7f0f667fc640 1 -- 172.21.15.26:0/1675280146 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0f700cc0f0 con 0x7f0f540683b0 2024-04-23T10:24:42.784 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 0 to deep-scrub 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 msgr2=0x7f0f5406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 0x7f0f5406a870 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0f6c005530 tx=0x7f0f6c009040 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 msgr2=0x7f0f70159df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f0f6000d800 tx=0x7f0f6000dcc0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 shutdown_connections 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0f540683b0 0x7f0f5406a870 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0f700cdc80 0x7f0f70141130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0f700cd8a0 0x7f0f70159df0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 --2- 172.21.15.26:0/1675280146 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f0f7006c750 0x7f0f70156f60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 >> 172.21.15.26:0/1675280146 conn(0x7f0f7006fca0 msgr2=0x7f0f700ccd70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 shutdown_connections 2024-04-23T10:24:42.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.789+0000 7f0f77b21640 1 -- 172.21.15.26:0/1675280146 wait complete. 2024-04-23T10:24:42.803 INFO:tasks.ceph:Scrubbing osd.1 2024-04-23T10:24:42.803 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:42.924 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.925+0000 7fa122cce640 1 Processor -- start 2024-04-23T10:24:42.925 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.925+0000 7fa122cce640 1 -- start start 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c155350 0x7fa11c0cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa11c0cc950 0x7fa11c0cb5a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa11c155730 con 0x7fa11c0cceb0 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fa11c15e670 con 0x7fa11c0cc950 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c15e950 con 0x7fa11c155350 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa11c0cc950 0x7fa11c0cb5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fa11c0cc950 0x7fa11c0cb5a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53074/0 (socket says 172.21.15.26:53074) 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 -- 172.21.15.26:0/2904095936 learned_addr learned my addr 172.21.15.26:0/2904095936 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa120a6a640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c155350 0x7fa11c0cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 -- 172.21.15.26:0/2904095936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c155350 msgr2=0x7fa11c0cc370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c155350 0x7fa11c0cc370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 -- 172.21.15.26:0/2904095936 >> v1:172.21.15.190:6789/0 conn(0x7fa11c0cceb0 legacy=0x7fa11c06d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.927 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 -- 172.21.15.26:0/2904095936 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c15ec30 con 0x7fa11c0cc950 2024-04-23T10:24:42.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11bfff640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0cc950 0x7fa11c0cb5a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa110009870 tx=0x7fa11001c560 comp rx=0 tx=0).ready entity=mon.0 client_cookie=77ce531436294490 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11b7fe640 1 -- 172.21.15.26:0/2904095936 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100a7070 con 0x7fa11c0cc950 2024-04-23T10:24:42.929 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11b7fe640 1 -- 172.21.15.26:0/2904095936 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa1100b0070 con 0x7fa11c0cc950 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa11b7fe640 1 -- 172.21.15.26:0/2904095936 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa1100ab890 con 0x7fa11c0cc950 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- 172.21.15.26:0/2904095936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0cc950 msgr2=0x7fa11c0cb5a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0cc950 0x7fa11c0cb5a0 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7fa110009870 tx=0x7fa11001c560 comp rx=0 tx=0).stop 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- 172.21.15.26:0/2904095936 shutdown_connections 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c0cc950 0x7fa11c0cb5a0 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 --2- 172.21.15.26:0/2904095936 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c155350 0x7fa11c0cc370 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- 172.21.15.26:0/2904095936 >> 172.21.15.26:0/2904095936 conn(0x7fa11c06bf00 msgr2=0x7fa11c073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- 172.21.15.26:0/2904095936 shutdown_connections 2024-04-23T10:24:42.930 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.929+0000 7fa122cce640 1 -- 172.21.15.26:0/2904095936 wait complete. 2024-04-23T10:24:42.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 Processor -- start 2024-04-23T10:24:42.931 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- start start 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa11c0cc950 0x7fa11c15d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c0cceb0 0x7fa11c0cf940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 0x7fa11c0cfe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c168510 con 0x7fa11c155350 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fa11c168390 con 0x7fa11c0cc950 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fa11c168690 con 0x7fa11c0cceb0 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 0x7fa11c0cfe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 0x7fa11c0cfe80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53086/0 (socket says 172.21.15.26:53086) 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 -- 172.21.15.26:0/300112193 learned_addr learned my addr 172.21.15.26:0/300112193 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa120a6a640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa11c0cc950 0x7fa11c15d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa11bfff640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c0cceb0 0x7fa11c0cf940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 -- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c0cceb0 msgr2=0x7fa11c0cf940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.933 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c0cceb0 0x7fa11c0cf940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 -- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa11c0cc950 msgr2=0x7fa11c15d660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fa11c0cc950 0x7fa11c15d660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa11c0c8d10 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa11bfff640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fa11c0cceb0 0x7fa11c0cf940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa12126b640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 0x7fa11c0cfe80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c770 tx=0x7fa11400cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa114003b80 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa114003d20 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa11c1f3a50 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fa11400aa90 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa11c1f3d10 con 0x7fa11c155350 2024-04-23T10:24:42.934 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.933+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fa11c075e60 con 0x7fa11c155350 2024-04-23T10:24:42.935 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fa11400ac30 con 0x7fa11c155350 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa108068380 0x7fa10806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fa1140877d0 con 0x7fa11c155350 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7fa108071e20 0x7fa1080742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fa114015ec0 con 0x7fa108071e20 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fa114087c60 con 0x7fa11c155350 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa120a6a640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa108068380 0x7fa10806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa11bfff640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7fa108071e20 0x7fa1080742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa11bfff640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7fa108071e20 0x7fa1080742c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa120a6a640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa108068380 0x7fa10806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00b9d0 tx=0x7fa10c008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:42.936 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.937+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== osd.1 v2:172.21.15.26:6816/1500743666 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fa114015ec0 con 0x7fa108071e20 2024-04-23T10:24:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 --> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fa11c0cc150 con 0x7fa108071e20 2024-04-23T10:24:42.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa1197fa640 1 -- 172.21.15.26:0/300112193 <== osd.1 v2:172.21.15.26:6816/1500743666 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fa11c0cc150 con 0x7fa108071e20 2024-04-23T10:24:42.949 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:42.949 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:42.949 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7fa108071e20 msgr2=0x7fa1080742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:6816/1500743666,v1:172.21.15.26:6818/1500743666] conn(0x7fa108071e20 0x7fa1080742c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa108068380 msgr2=0x7fa10806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fa108068380 0x7fa10806a840 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x7fa10c00b9d0 tx=0x7fa10c008040 comp rx=0 tx=0).stop 2024-04-23T10:24:42.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 msgr2=0x7fa11c0cfe80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 --2- 172.21.15.26:0/300112193 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fa11c155350 0x7fa11c0cfe80 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 crypto rx=0x7fa11400c770 tx=0x7fa11400cc30 comp rx=0 tx=0).stop 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa12126b640 1 -- 172.21.15.26:0/300112193 reap_dead start 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 shutdown_connections 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 >> 172.21.15.26:0/300112193 conn(0x7fa11c06bf00 msgr2=0x7fa11c073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 shutdown_connections 2024-04-23T10:24:42.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:42.949+0000 7fa122cce640 1 -- 172.21.15.26:0/300112193 wait complete. 2024-04-23T10:24:42.965 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-23T10:24:43.077 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.077+0000 7f198aae3640 1 Processor -- start 2024-04-23T10:24:43.078 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.077+0000 7f198aae3640 1 -- start start 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198aae3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f19840c8250 0x7f19840c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198aae3640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f198415b740 con 0x7f19840c8630 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198aae3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f19840c58c0 con 0x7f19840c8a70 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198aae3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f19840c6490 con 0x7f19840c8250 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f19840c8630 0x7f1984151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48362/0 (socket says 172.21.15.26:48362) 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 -- 172.21.15.26:0/1385175601 learned_addr learned my addr 172.21.15.26:0/1385175601 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198887f640 1 --2- 172.21.15.26:0/1385175601 >> v2:172.21.15.190:3300/0 conn(0x7f19840c8250 0x7f19840c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3717111891 0 0) 0x7f198415b740 con 0x7f19840c8630 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f196c003530 con 0x7f19840c8630 2024-04-23T10:24:43.081 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3528910121 0 0) 0x7f196c003530 con 0x7f19840c8630 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 >> v2:172.21.15.190:3300/0 conn(0x7f19840c8250 msgr2=0x7f19840c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 --2- 172.21.15.26:0/1385175601 >> v2:172.21.15.190:3300/0 conn(0x7f19840c8250 0x7f19840c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 >> v1:172.21.15.190:6789/0 conn(0x7f19840c8a70 legacy=0x7f1984162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19840c5b60 con 0x7f19840c8630 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f1978001680 con 0x7f19840c8630 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 >> v1:172.21.15.26:6789/0 conn(0x7f19840c8630 legacy=0x7f1984151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c0039c0 0x7f196c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 0x7f196c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f196c0051d0 0x7f196c00b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19840c6490 con 0x7f196c004810 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f196c00c170 con 0x7f196c0039c0 2024-04-23T10:24:43.082 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f196c00c370 con 0x7f196c0051d0 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 0x7f196c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f198887f640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c0039c0 0x7f196c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1989080640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f196c0051d0 0x7f196c00b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 -- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f196c0051d0 msgr2=0x7f196c00b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f196c0051d0 0x7f196c00b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 -- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c0039c0 msgr2=0x7f196c003de0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c0039c0 0x7f196c003de0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1983fff640 1 -- 172.21.15.26:0/1385175601 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f196c003530 con 0x7f196c004810 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1989080640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f196c0051d0 0x7f196c00b9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:43.083 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.081+0000 7f1989080640 1 -- 172.21.15.26:0/1385175601 reap_dead start 2024-04-23T10:24:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 0x7f196c004c90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f197800c1c0 tx=0x7f197801cc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68d8c90cbd8d36e7 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.084 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978007d00 con 0x7f196c004810 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19780a9020 con 0x7f196c004810 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f19837fe640 1 -- 172.21.15.26:0/1385175601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978005ae0 con 0x7f196c004810 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 msgr2=0x7f196c004c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 0x7f196c004c90 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f197800c1c0 tx=0x7f197801cc60 comp rx=0 tx=0).stop 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- 172.21.15.26:0/1385175601 shutdown_connections 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 --2- 172.21.15.26:0/1385175601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f196c004810 0x7f196c004c90 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- 172.21.15.26:0/1385175601 >> 172.21.15.26:0/1385175601 conn(0x7f198406b9d0 msgr2=0x7f198406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- 172.21.15.26:0/1385175601 shutdown_connections 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- 172.21.15.26:0/1385175601 wait complete. 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 Processor -- start 2024-04-23T10:24:43.085 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- start start 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 0x7f1984146350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19841560c0 0x7f1984073c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f19840c6900 con 0x7f1984155ca0 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f198415b400 con 0x7f196c004810 2024-04-23T10:24:43.087 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198aae3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f19840681d0 con 0x7f19841560c0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53108/0 (socket says 172.21.15.26:53108) 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 -- 172.21.15.26:0/4200958964 learned_addr learned my addr 172.21.15.26:0/4200958964 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198887f640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 0x7f1984146350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1989080640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19841560c0 0x7f1984073c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 -- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19841560c0 msgr2=0x7f1984073c60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19841560c0 0x7f1984073c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 -- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 msgr2=0x7f1984146350 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 0x7f1984146350 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f1983fff640 1 -- 172.21.15.26:0/4200958964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f19841e8d20 con 0x7f1984155ca0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.085+0000 7f198887f640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 0x7f1984146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f1983fff640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19780ab040 tx=0x7f196c005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f19780b4070 con 0x7f1984155ca0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19780070d0 con 0x7f1984155ca0 2024-04-23T10:24:43.088 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1978007d00 con 0x7f1984155ca0 2024-04-23T10:24:43.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1984159430 con 0x7f1984155ca0 2024-04-23T10:24:43.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f19841f6f80 con 0x7f1984155ca0 2024-04-23T10:24:43.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1984075df0 con 0x7f1984155ca0 2024-04-23T10:24:43.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f19780bf060 con 0x7f1984155ca0 2024-04-23T10:24:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 0x7f197006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f197811faa0 con 0x7f1984155ca0 2024-04-23T10:24:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f198887f640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 0x7f197006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.089+0000 7f198887f640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 0x7f197006a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1974009b50 tx=0x7f1974008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.093+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1978016970 con 0x7f1984155ca0 2024-04-23T10:24:43.252 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.253+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f19841591e0 con 0x7f1970068380 2024-04-23T10:24:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.253+0000 7f19817fa640 1 -- 172.21.15.26:0/4200958964 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f19841591e0 con 0x7f1970068380 2024-04-23T10:24:43.253 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 1 to deep-scrub 2024-04-23T10:24:43.255 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 msgr2=0x7f197006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 0x7f197006a840 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f1974009b50 tx=0x7f1974008040 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 msgr2=0x7f1984073720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x7f19780ab040 tx=0x7f196c005840 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 shutdown_connections 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1970068380 0x7f197006a840 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f19841560c0 0x7f1984073c60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1984155ca0 0x7f1984073720 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 --2- 172.21.15.26:0/4200958964 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f196c004810 0x7f1984146350 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 >> 172.21.15.26:0/4200958964 conn(0x7f198406b9d0 msgr2=0x7f19841474c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 shutdown_connections 2024-04-23T10:24:43.256 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.257+0000 7f198aae3640 1 -- 172.21.15.26:0/4200958964 wait complete. 2024-04-23T10:24:43.272 INFO:tasks.ceph:Scrubbing osd.2 2024-04-23T10:24:43.272 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:43.391 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 Processor -- start 2024-04-23T10:24:43.392 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 -- start start 2024-04-23T10:24:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fd764155350 0x7fd76406ca60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.393 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76415bc40 0x7fd76406b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd7640bef20 con 0x7fd7640bffc0 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd7640bf200 con 0x7fd76415bc40 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd76a9c4640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fd7640bf4e0 con 0x7fd764155350 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76415bc40 0x7fd76406b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd76415bc40 0x7fd76406b9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53122/0 (socket says 172.21.15.26:53122) 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 -- 172.21.15.26:0/3857637050 learned_addr learned my addr 172.21.15.26:0/3857637050 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd763fff640 1 --2- 172.21.15.26:0/3857637050 >> v2:172.21.15.190:3300/0 conn(0x7fd764155350 0x7fd76406ca60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 -- 172.21.15.26:0/3857637050 >> v2:172.21.15.190:3300/0 conn(0x7fd764155350 msgr2=0x7fd76406ca60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 --2- 172.21.15.26:0/3857637050 >> v2:172.21.15.190:3300/0 conn(0x7fd764155350 0x7fd76406ca60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 -- 172.21.15.26:0/3857637050 >> v1:172.21.15.190:6789/0 conn(0x7fd7640bffc0 legacy=0x7fd7640c6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.394 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.393+0000 7fd768f61640 1 -- 172.21.15.26:0/3857637050 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd7640bf7c0 con 0x7fd76415bc40 2024-04-23T10:24:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd768f61640 1 --2- 172.21.15.26:0/3857637050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76415bc40 0x7fd76406b9d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd764070b20 tx=0x7fd75c01f1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=64a7c059efed5782 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd762ffd640 1 -- 172.21.15.26:0/3857637050 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0b4070 con 0x7fd76415bc40 2024-04-23T10:24:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd762ffd640 1 -- 172.21.15.26:0/3857637050 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd75c0af400 con 0x7fd76415bc40 2024-04-23T10:24:43.397 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd762ffd640 1 -- 172.21.15.26:0/3857637050 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd75c0af7d0 con 0x7fd76415bc40 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 -- 172.21.15.26:0/3857637050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76415bc40 msgr2=0x7fd76406b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/3857637050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76415bc40 0x7fd76406b9d0 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7fd764070b20 tx=0x7fd75c01f1a0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 -- 172.21.15.26:0/3857637050 shutdown_connections 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/3857637050 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd76415bc40 0x7fd76406b9d0 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/3857637050 >> v2:172.21.15.190:3300/0 conn(0x7fd764155350 0x7fd76406ca60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 -- 172.21.15.26:0/3857637050 >> 172.21.15.26:0/3857637050 conn(0x7fd7640c9130 msgr2=0x7fd7640c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 -- 172.21.15.26:0/3857637050 shutdown_connections 2024-04-23T10:24:43.398 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.397+0000 7fd76a9c4640 1 -- 172.21.15.26:0/3857637050 wait complete. 2024-04-23T10:24:43.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 Processor -- start 2024-04-23T10:24:43.399 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- start start 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7640bffc0 0x7fd7641f4940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 0x7fd764158530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd76415bc40 0x7fd76415aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd76415c050 con 0x7fd764155350 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd7640be880 con 0x7fd7640bffc0 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd76415c1d0 con 0x7fd76415bc40 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 0x7fd764158530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 0x7fd764158530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53132/0 (socket says 172.21.15.26:53132) 2024-04-23T10:24:43.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 -- 172.21.15.26:0/2167849605 learned_addr learned my addr 172.21.15.26:0/2167849605 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd763fff640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7640bffc0 0x7fd7641f4940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd768f61640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd76415bc40 0x7fd76415aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 -- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd76415bc40 msgr2=0x7fd76415aec0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd76415bc40 0x7fd76415aec0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 -- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7640bffc0 msgr2=0x7fd7641f4940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd7640bffc0 0x7fd7641f4940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd764151cc0 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd768f61640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd76415bc40 0x7fd76415aec0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd7637fe640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 0x7fd764158530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c450 tx=0x7fd75800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758012830 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd758017070 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd76415cca0 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd758012c30 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd764151420 con 0x7fd764155350 2024-04-23T10:24:43.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.401+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fd764075e60 con 0x7fd764155350 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd75801c460 con 0x7fd764155350 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd750068380 0x7fd75006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fd758086b50 con 0x7fd764155350 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7fd750071e20 0x7fd7500742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fd750074990 con 0x7fd750071e20 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fd75808b2c0 con 0x7fd764155350 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd763fff640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd750068380 0x7fd75006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd768f61640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7fd750071e20 0x7fd7500742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd768f61640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7fd750071e20 0x7fd7500742c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd763fff640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd750068380 0x7fd75006a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd75400a970 tx=0x7fd754008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.404 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.405+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== osd.2 v2:172.21.15.26:6808/3344984401 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fd750074990 con 0x7fd750071e20 2024-04-23T10:24:43.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 --> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fd764151700 con 0x7fd750071e20 2024-04-23T10:24:43.417 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd760ff9640 1 -- 172.21.15.26:0/2167849605 <== osd.2 v2:172.21.15.26:6808/3344984401 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fd764151700 con 0x7fd750071e20 2024-04-23T10:24:43.417 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:43.417 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:43.417 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7fd750071e20 msgr2=0x7fd7500742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:6808/3344984401,v1:172.21.15.26:6809/3344984401] conn(0x7fd750071e20 0x7fd7500742c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.418 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd750068380 msgr2=0x7fd75006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd750068380 0x7fd75006a840 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fd75400a970 tx=0x7fd754008040 comp rx=0 tx=0).stop 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 msgr2=0x7fd764158530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 --2- 172.21.15.26:0/2167849605 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd764155350 0x7fd764158530 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7fd75800c450 tx=0x7fd75800c910 comp rx=0 tx=0).stop 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd768f61640 1 -- 172.21.15.26:0/2167849605 reap_dead start 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 shutdown_connections 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 >> 172.21.15.26:0/2167849605 conn(0x7fd7640c9130 msgr2=0x7fd76406b9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 shutdown_connections 2024-04-23T10:24:43.419 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.417+0000 7fd76a9c4640 1 -- 172.21.15.26:0/2167849605 wait complete. 2024-04-23T10:24:43.433 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-23T10:24:43.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 Processor -- start 2024-04-23T10:24:43.548 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 -- start start 2024-04-23T10:24:43.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 0x7f04280c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f042815beb0 con 0x7f04280cda50 2024-04-23T10:24:43.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f04280ccc90 con 0x7f042815b0b0 2024-04-23T10:24:43.550 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042f82a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f04280cca40 con 0x7f0428155350 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042cdc5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f04280cda50 0x7f04280cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48372/0 (socket says 172.21.15.26:48372) 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042cdc5640 1 -- 172.21.15.26:0/2236530962 learned_addr learned my addr 172.21.15.26:0/2236530962 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f042d5c6640 1 --2- 172.21.15.26:0/2236530962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 0x7f04280c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3263223768 0 0) 0x7f042815beb0 con 0x7f04280cda50 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.549+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0414003530 con 0x7f04280cda50 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2372039927 0 0) 0x7f0414003530 con 0x7f04280cda50 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042d5c6640 1 -- 172.21.15.26:0/2236530962 >> v1:172.21.15.190:6789/0 conn(0x7f042815b0b0 legacy=0x7f042815b540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042d5c6640 1 -- 172.21.15.26:0/2236530962 >> v1:172.21.15.26:6789/0 conn(0x7f04280cda50 legacy=0x7f04280cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.551 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042d5c6640 1 -- 172.21.15.26:0/2236530962 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04280ccf70 con 0x7f0428155350 2024-04-23T10:24:43.552 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042d5c6640 1 --2- 172.21.15.26:0/2236530962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 0x7f04280c59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f04240097f0 tx=0x7f042401c340 comp rx=0 tx=0).ready entity=mon.2 client_cookie=25c4807cf88dc52c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f04240b0070 con 0x7f0428155350 2024-04-23T10:24:43.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04240ab400 con 0x7f0428155350 2024-04-23T10:24:43.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f041ffff640 1 -- 172.21.15.26:0/2236530962 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418001680 con 0x7f0428155350 2024-04-23T10:24:43.553 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 -- 172.21.15.26:0/2236530962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 msgr2=0x7f04280c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 --2- 172.21.15.26:0/2236530962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 0x7f04280c59c0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f04240097f0 tx=0x7f042401c340 comp rx=0 tx=0).stop 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 -- 172.21.15.26:0/2236530962 shutdown_connections 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 --2- 172.21.15.26:0/2236530962 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f0428155350 0x7f04280c59c0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 -- 172.21.15.26:0/2236530962 >> 172.21.15.26:0/2236530962 conn(0x7f042806cc30 msgr2=0x7f042806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 -- 172.21.15.26:0/2236530962 shutdown_connections 2024-04-23T10:24:43.554 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.553+0000 7f042f82a640 1 -- 172.21.15.26:0/2236530962 wait complete. 2024-04-23T10:24:43.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 Processor -- start 2024-04-23T10:24:43.555 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- start start 2024-04-23T10:24:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04280cda50 0x7f042815d600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.557 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 0x7f04280b6490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f04280cd530 con 0x7f0428155350 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f042815bc50 con 0x7f04280cda50 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f0428155730 con 0x7f042815b0b0 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53142/0 (socket says 172.21.15.26:53142) 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 -- 172.21.15.26:0/42976862 learned_addr learned my addr 172.21.15.26:0/42976862 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042d5c6640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04280cda50 0x7f042815d600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042ddc7640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 0x7f04280b6490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 -- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 msgr2=0x7f04280b6490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 0x7f04280b6490 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 -- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04280cda50 msgr2=0x7f042815d600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04280cda50 0x7f042815d600 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.558 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 -- 172.21.15.26:0/42976862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f04281f1c10 con 0x7f0428155350 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042ddc7640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 0x7f04280b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042cdc5640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f041800c500 tx=0x7f041800c9c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418018070 con 0x7f0428155350 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0418007560 con 0x7f0428155350 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f04281f1eb0 con 0x7f0428155350 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0418004a30 con 0x7f0428155350 2024-04-23T10:24:43.559 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.557+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f042815e580 con 0x7f0428155350 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0428075df0 con 0x7f0428155350 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f041801b070 con 0x7f0428155350 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f041dffb640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 0x7f040c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f04180860f0 con 0x7f0428155350 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f042d5c6640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 0x7f040c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.560 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.561+0000 7f042d5c6640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 0x7f040c06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f04240ad000 tx=0x7f04240a6000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.564 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.565+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f0418056320 con 0x7f0428155350 2024-04-23T10:24:43.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.729+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7f04280cc610 con 0x7f040c068380 2024-04-23T10:24:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f041dffb640 1 -- 172.21.15.26:0/42976862 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f04280cc610 con 0x7f040c068380 2024-04-23T10:24:43.730 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 2 to deep-scrub 2024-04-23T10:24:43.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 msgr2=0x7f040c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 0x7f040c06a840 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f04240ad000 tx=0x7f04240a6000 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 msgr2=0x7f04280b5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 crypto rx=0x7f041800c500 tx=0x7f041800c9c0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 shutdown_connections 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f040c068380 0x7f040c06a840 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f042815b0b0 0x7f04280b6490 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f0428155350 0x7f04280b5f50 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 --2- 172.21.15.26:0/42976862 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f04280cda50 0x7f042815d600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 >> 172.21.15.26:0/42976862 conn(0x7f042806cc30 msgr2=0x7f04280cb770 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 shutdown_connections 2024-04-23T10:24:43.733 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.733+0000 7f042f82a640 1 -- 172.21.15.26:0/42976862 wait complete. 2024-04-23T10:24:43.750 INFO:tasks.ceph:Scrubbing osd.3 2024-04-23T10:24:43.750 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 Processor -- start 2024-04-23T10:24:43.873 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 -- start start 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f005c1525d0 0x7f005c158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c158ca0 0x7f005c0c4f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f005c15ba00 con 0x7f005c1521f0 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f005c0c4240 con 0x7f005c1525d0 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0063549640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f005c15bce0 con 0x7f005c158ca0 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0060ae4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f005c1525d0 0x7f005c158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.874 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0060ae4640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f005c1525d0 0x7f005c158760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53158/0 (socket says 172.21.15.26:53158) 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f00612e5640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f005c1521f0 0x7f005c0c3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48386/0 (socket says 172.21.15.26:48386) 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.873+0000 7f0060ae4640 1 -- 172.21.15.26:0/1804639514 learned_addr learned my addr 172.21.15.26:0/1804639514 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0061ae6640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c158ca0 0x7f005c0c4f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0060ae4640 1 -- 172.21.15.26:0/1804639514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c158ca0 msgr2=0x7f005c0c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0060ae4640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c158ca0 0x7f005c0c4f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0060ae4640 1 -- 172.21.15.26:0/1804639514 >> v1:172.21.15.26:6789/0 conn(0x7f005c1521f0 legacy=0x7f005c0c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0060ae4640 1 -- 172.21.15.26:0/1804639514 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c15bfc0 con 0x7f005c1525d0 2024-04-23T10:24:43.875 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0053fff640 1 -- 172.21.15.26:0/1804639514 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2769187946 0 0) 0x7f005c15ba00 con 0x7f005c1521f0 2024-04-23T10:24:43.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0060ae4640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c1525d0 0x7f005c158760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bb10 tx=0x7f004c01ec30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=818e4617c10099ba server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0053fff640 1 -- 172.21.15.26:0/1804639514 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0b4070 con 0x7f005c1525d0 2024-04-23T10:24:43.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0053fff640 1 -- 172.21.15.26:0/1804639514 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f004c0a7a00 con 0x7f005c1525d0 2024-04-23T10:24:43.877 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0053fff640 1 -- 172.21.15.26:0/1804639514 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f004c0a7dd0 con 0x7f005c1525d0 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 -- 172.21.15.26:0/1804639514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c1525d0 msgr2=0x7f005c158760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c1525d0 0x7f005c158760 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f004c00bb10 tx=0x7f004c01ec30 comp rx=0 tx=0).stop 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 -- 172.21.15.26:0/1804639514 shutdown_connections 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c158ca0 0x7f005c0c4f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 --2- 172.21.15.26:0/1804639514 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c1525d0 0x7f005c158760 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 -- 172.21.15.26:0/1804639514 >> 172.21.15.26:0/1804639514 conn(0x7f005c0c9130 msgr2=0x7f005c0c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 -- 172.21.15.26:0/1804639514 shutdown_connections 2024-04-23T10:24:43.878 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.877+0000 7f0063549640 1 -- 172.21.15.26:0/1804639514 wait complete. 2024-04-23T10:24:43.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 Processor -- start 2024-04-23T10:24:43.879 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- start start 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c1521f0 0x7f005c154280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c158ca0 0x7f005c157b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 0x7f005c1536a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f005c15b5c0 con 0x7f005c161750 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f005c06ce60 con 0x7f005c158ca0 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f005c15b740 con 0x7f005c1521f0 2024-04-23T10:24:43.881 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 0x7f005c1536a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 0x7f005c1536a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53168/0 (socket says 172.21.15.26:53168) 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 -- 172.21.15.26:0/2335986214 learned_addr learned my addr 172.21.15.26:0/2335986214 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0060ae4640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c158ca0 0x7f005c157b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f00612e5640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c1521f0 0x7f005c154280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 -- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c1521f0 msgr2=0x7f005c154280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c1521f0 0x7f005c154280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 -- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c158ca0 msgr2=0x7f005c157b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f005c158ca0 0x7f005c157b30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f005c153be0 con 0x7f005c161750 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f00612e5640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f005c1521f0 0x7f005c154280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0061ae6640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 0x7f005c1536a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0054007e60 tx=0x7f005400e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054014420 con 0x7f005c161750 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0054019070 con 0x7f005c161750 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f005c156110 con 0x7f005c161750 2024-04-23T10:24:43.882 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f0054014820 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.881+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f005c1566d0 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f005c155ec0 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f00540149c0 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0040068380 0x7f004006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f0054088420 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f0040071e10 0x7f00400742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f0054014e50 con 0x7f0040071e10 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f00540888b0 con 0x7f005c161750 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f00612e5640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0040068380 0x7f004006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.884 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0060ae4640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f0040071e10 0x7f00400742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0060ae4640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f0040071e10 0x7f00400742b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f00612e5640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0040068380 0x7f004006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f70 tx=0x7f0058009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:43.885 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.885+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== osd.3 v2:172.21.15.26:6800/451500618 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f0054014e50 con 0x7f0040071e10 2024-04-23T10:24:43.898 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 --> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f005c075e60 con 0x7f0040071e10 2024-04-23T10:24:43.899 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0051ffb640 1 -- 172.21.15.26:0/2335986214 <== osd.3 v2:172.21.15.26:6800/451500618 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f005c075e60 con 0x7f0040071e10 2024-04-23T10:24:43.899 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:43.899 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:43.899 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f0040071e10 msgr2=0x7f00400742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:6800/451500618,v1:172.21.15.26:6801/451500618] conn(0x7f0040071e10 0x7f00400742b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0040068380 msgr2=0x7f004006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f0040068380 0x7f004006a840 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f0058000f70 tx=0x7f0058009040 comp rx=0 tx=0).stop 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 msgr2=0x7f005c1536a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 --2- 172.21.15.26:0/2335986214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f005c161750 0x7f005c1536a0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x7f0054007e60 tx=0x7f005400e4b0 comp rx=0 tx=0).stop 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0061ae6640 1 -- 172.21.15.26:0/2335986214 reap_dead start 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 shutdown_connections 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 >> 172.21.15.26:0/2335986214 conn(0x7f005c0c9130 msgr2=0x7f005c0c5a60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 shutdown_connections 2024-04-23T10:24:43.900 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:43.901+0000 7f0063549640 1 -- 172.21.15.26:0/2335986214 wait complete. 2024-04-23T10:24:43.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-23T10:24:44.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 Processor -- start 2024-04-23T10:24:44.022 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 -- start start 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5cc0074100 0x7f5cc006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc00c5d70 con 0x7f5cc014ffa0 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cc00c6050 con 0x7f5cc014fbc0 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc6a55640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f5cc00c6330 con 0x7f5cc0074100 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cbf7fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f5cc014ffa0 0x7f5cc00c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48390/0 (socket says 172.21.15.26:48390) 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc4ff2640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f5cc0074100 0x7f5cc006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.023 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cbf7fe640 1 -- 172.21.15.26:0/658004687 learned_addr learned my addr 172.21.15.26:0/658004687 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cbeffd640 1 -- 172.21.15.26:0/658004687 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1280399848 0 0) 0x7f5cc00c5d70 con 0x7f5cc014ffa0 2024-04-23T10:24:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cbeffd640 1 -- 172.21.15.26:0/658004687 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f5cac003530 con 0x7f5cc014ffa0 2024-04-23T10:24:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc4ff2640 1 -- 172.21.15.26:0/658004687 >> v1:172.21.15.190:6789/0 conn(0x7f5cc014fbc0 legacy=0x7f5cc00c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc4ff2640 1 -- 172.21.15.26:0/658004687 >> v1:172.21.15.26:6789/0 conn(0x7f5cc014ffa0 legacy=0x7f5cc00c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.024 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.025+0000 7f5cc4ff2640 1 -- 172.21.15.26:0/658004687 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc00c6610 con 0x7f5cc0074100 2024-04-23T10:24:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc4ff2640 1 --2- 172.21.15.26:0/658004687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc0074100 0x7f5cc006f700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80097f0 tx=0x7f5cb801c4a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b3b881455da3e4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbeffd640 1 -- 172.21.15.26:0/658004687 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80aa620 con 0x7f5cc0074100 2024-04-23T10:24:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbeffd640 1 -- 172.21.15.26:0/658004687 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cb80af070 con 0x7f5cc0074100 2024-04-23T10:24:44.026 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbeffd640 1 -- 172.21.15.26:0/658004687 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5cb80aa9e0 con 0x7f5cc0074100 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/658004687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc0074100 msgr2=0x7f5cc006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/658004687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc0074100 0x7f5cc006f700 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f5cb80097f0 tx=0x7f5cb801c4a0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/658004687 shutdown_connections 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/658004687 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc0074100 0x7f5cc006f700 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/658004687 >> 172.21.15.26:0/658004687 conn(0x7f5cc006b9d0 msgr2=0x7f5cc006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/658004687 shutdown_connections 2024-04-23T10:24:44.027 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/658004687 wait complete. 2024-04-23T10:24:44.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 Processor -- start 2024-04-23T10:24:44.028 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- start start 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cc0074100 0x7f5cc0148600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cc014ffa0 0x7f5cc01f42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc0167630 con 0x7f5cc014fbc0 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f5cc01674b0 con 0x7f5cc014ffa0 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f5cc01677b0 con 0x7f5cc0074100 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53198/0 (socket says 172.21.15.26:53198) 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 -- 172.21.15.26:0/3948165395 learned_addr learned my addr 172.21.15.26:0/3948165395 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 -- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cc0074100 msgr2=0x7f5cc0148600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cc0074100 0x7f5cc0148600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.030 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 -- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cc014ffa0 msgr2=0x7f5cc01f42c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cc014ffa0 0x7f5cc01f42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 -- 172.21.15.26:0/3948165395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cc01f8170 con 0x7f5cc014fbc0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbf7fe640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c450 tx=0x7f5ca800c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8017070 con 0x7f5cc014fbc0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5ca8005cf0 con 0x7f5cc014fbc0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cc01f8450 con 0x7f5cc014fbc0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f5ca8007270 con 0x7f5cc014fbc0 2024-04-23T10:24:44.031 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.029+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cc01531d0 con 0x7f5cc014fbc0 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cc0075df0 con 0x7f5cc014fbc0 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f5ca801a070 con 0x7f5cc014fbc0 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cbcff9640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 0x7f5ca006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f5ca8085ff0 con 0x7f5cc014fbc0 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cbffff640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 0x7f5ca006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.032 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.033+0000 7f5cbffff640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 0x7f5ca006a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0007fd0 tx=0x7f5cb0007d60 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.036 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.037+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f5ca8055b40 con 0x7f5cc014fbc0 2024-04-23T10:24:44.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.197+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f5cc00c5a30 con 0x7f5ca00683b0 2024-04-23T10:24:44.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.197+0000 7f5cbcff9640 1 -- 172.21.15.26:0/3948165395 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f5cb0003980 con 0x7f5ca00683b0 2024-04-23T10:24:44.197 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 3 to deep-scrub 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 msgr2=0x7f5ca006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 0x7f5ca006a870 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f5cb0007fd0 tx=0x7f5cb0007d60 comp rx=0 tx=0).stop 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 msgr2=0x7f5cc00c5110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f5ca800c450 tx=0x7f5ca800c910 comp rx=0 tx=0).stop 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 shutdown_connections 2024-04-23T10:24:44.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f5ca00683b0 0x7f5ca006a870 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f5cc014ffa0 0x7f5cc01f42c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f5cc014fbc0 0x7f5cc00c5110 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 --2- 172.21.15.26:0/3948165395 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f5cc0074100 0x7f5cc0148600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 >> 172.21.15.26:0/3948165395 conn(0x7f5cc006b9d0 msgr2=0x7f5cc00cbde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 shutdown_connections 2024-04-23T10:24:44.200 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.201+0000 7f5cc6a55640 1 -- 172.21.15.26:0/3948165395 wait complete. 2024-04-23T10:24:44.215 INFO:tasks.ceph:Scrubbing osd.4 2024-04-23T10:24:44.215 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:44.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 Processor -- start 2024-04-23T10:24:44.347 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 -- start start 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66d80cc950 0x7f66d80cc370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f66d80cceb0 0x7f66d806d570 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f66d8155730 con 0x7f66d8155350 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f66d815e670 con 0x7f66d80cc950 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66dd169640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f66d815e950 con 0x7f66d80cceb0 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66d80cc950 0x7f66d80cc370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f66d80cc950 0x7f66d80cc370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53200/0 (socket says 172.21.15.26:53200) 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 -- 172.21.15.26:0/337405693 learned_addr learned my addr 172.21.15.26:0/337405693 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d759e640 1 --2- 172.21.15.26:0/337405693 >> v2:172.21.15.190:3300/0 conn(0x7f66d80cceb0 0x7f66d806d570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 -- 172.21.15.26:0/337405693 >> v2:172.21.15.190:3300/0 conn(0x7f66d80cceb0 msgr2=0x7f66d806d570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 --2- 172.21.15.26:0/337405693 >> v2:172.21.15.190:3300/0 conn(0x7f66d80cceb0 0x7f66d806d570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 -- 172.21.15.26:0/337405693 >> v1:172.21.15.190:6789/0 conn(0x7f66d8155350 legacy=0x7f66d80cb5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.349 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.349+0000 7f66d659c640 1 -- 172.21.15.26:0/337405693 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d815ec30 con 0x7f66d80cc950 2024-04-23T10:24:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d659c640 1 --2- 172.21.15.26:0/337405693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cc950 0x7f66d80cc370 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66d80d19f0 tx=0x7f66cc01c4e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7fa5c3af390f2a69 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d5d9b640 1 -- 172.21.15.26:0/337405693 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0ab5f0 con 0x7f66d80cc950 2024-04-23T10:24:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d5d9b640 1 -- 172.21.15.26:0/337405693 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc0b0070 con 0x7f66d80cc950 2024-04-23T10:24:44.351 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d5d9b640 1 -- 172.21.15.26:0/337405693 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0ab9b0 con 0x7f66d80cc950 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- 172.21.15.26:0/337405693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cc950 msgr2=0x7f66d80cc370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- 172.21.15.26:0/337405693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cc950 0x7f66d80cc370 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 crypto rx=0x7f66d80d19f0 tx=0x7f66cc01c4e0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- 172.21.15.26:0/337405693 shutdown_connections 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- 172.21.15.26:0/337405693 >> v2:172.21.15.190:3300/0 conn(0x7f66d80cceb0 0x7f66d806d570 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- 172.21.15.26:0/337405693 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cc950 0x7f66d80cc370 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- 172.21.15.26:0/337405693 >> 172.21.15.26:0/337405693 conn(0x7f66d806bf00 msgr2=0x7f66d8073100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- 172.21.15.26:0/337405693 shutdown_connections 2024-04-23T10:24:44.352 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- 172.21.15.26:0/337405693 wait complete. 2024-04-23T10:24:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 Processor -- start 2024-04-23T10:24:44.354 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- start start 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d80cc950 0x7f66d81f52a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 0x7f66d815d660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66d8155350 0x7f66d81f7330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80cbe30 con 0x7f66d80cceb0 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f66d80cbcb0 con 0x7f66d80cc950 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66dd169640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f66d8168180 con 0x7f66d8155350 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 0x7f66d815d660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d659c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 0x7f66d815d660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53202/0 (socket says 172.21.15.26:53202) 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.353+0000 7f66d659c640 1 -- 172.21.15.26:0/3846634908 learned_addr learned my addr 172.21.15.26:0/3846634908 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d759e640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66d8155350 0x7f66d81f7330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 -- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66d8155350 msgr2=0x7f66d81f7330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d6d9d640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d80cc950 0x7f66d81f52a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f66d8155350 0x7f66d81f7330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 -- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d80cc950 msgr2=0x7f66d81f52a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f66d80cc950 0x7f66d81f52a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f66d81f57e0 con 0x7f66d80cceb0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d659c640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 0x7f66d815d660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a110 tx=0x7f66cc01ad20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0be5f0 con 0x7f66d80cceb0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc0be790 con 0x7f66d80cceb0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f66cc0beb80 con 0x7f66d80cceb0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f66d80b6490 con 0x7f66d80cceb0 2024-04-23T10:24:44.356 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f66d815c170 con 0x7f66d80cceb0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f66d814e680 con 0x7f66d80cceb0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f66cc0b43f0 con 0x7f66d80cceb0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f66c4068380 0x7f66c406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f66cc121910 con 0x7f66d80cceb0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f66c4071e20 0x7f66c40742c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f66cc0c7e50 con 0x7f66c4071e20 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f66cc1262c0 con 0x7f66d80cceb0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d6d9d640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f66c4068380 0x7f66c406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.358 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d759e640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f66c4071e20 0x7f66c40742c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d6d9d640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f66c4068380 0x7f66c406a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f66c800a750 tx=0x7f66c8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.357+0000 7f66d759e640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f66c4071e20 0x7f66c40742c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.359 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.361+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== osd.4 v2:172.21.15.190:6817/3258213114 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f66cc0c7e50 con 0x7f66c4071e20 2024-04-23T10:24:44.372 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.373+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 --> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f66d8069180 con 0x7f66c4071e20 2024-04-23T10:24:44.373 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.373+0000 7f66bf7fe640 1 -- 172.21.15.26:0/3846634908 <== osd.4 v2:172.21.15.190:6817/3258213114 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f66d8069180 con 0x7f66c4071e20 2024-04-23T10:24:44.374 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:44.374 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:44.374 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.373+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f66c4071e20 msgr2=0x7f66c40742c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.373+0000 7f66dd169640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6817/3258213114,v1:172.21.15.190:6819/3258213114] conn(0x7f66c4071e20 0x7f66c40742c0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f66c4068380 msgr2=0x7f66c406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f66c4068380 0x7f66c406a840 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f66c800a750 tx=0x7f66c8008040 comp rx=0 tx=0).stop 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 msgr2=0x7f66d815d660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 --2- 172.21.15.26:0/3846634908 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f66d80cceb0 0x7f66d815d660 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7f66cc01a110 tx=0x7f66cc01ad20 comp rx=0 tx=0).stop 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66d759e640 1 -- 172.21.15.26:0/3846634908 reap_dead start 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 shutdown_connections 2024-04-23T10:24:44.375 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 >> 172.21.15.26:0/3846634908 conn(0x7f66d806bf00 msgr2=0x7f66d80c59e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 shutdown_connections 2024-04-23T10:24:44.376 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.377+0000 7f66dd169640 1 -- 172.21.15.26:0/3846634908 wait complete. 2024-04-23T10:24:44.390 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-23T10:24:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 Processor -- start 2024-04-23T10:24:44.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 -- start start 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7faf8414ffa0 0x7faf8406f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf840c7250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7faf840c5d70 con 0x7faf8414fbc0 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7faf840c6050 con 0x7faf8414ffa0 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf8ad3f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faf840c6330 con 0x7faf84074100 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7faf8414fbc0 0x7faf840c8220 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48394/0 (socket says 172.21.15.26:48394) 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 -- 172.21.15.26:0/330461616 learned_addr learned my addr 172.21.15.26:0/330461616 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf83fff640 1 --2- 172.21.15.26:0/330461616 >> v2:172.21.15.190:3300/0 conn(0x7faf8414ffa0 0x7faf8406f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf892dc640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf840c7250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3125307059 0 0) 0x7faf840c5d70 con 0x7faf8414fbc0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7faf6c003530 con 0x7faf8414fbc0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 615380212 0 0) 0x7faf6c003530 con 0x7faf8414fbc0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 msgr2=0x7faf840c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf840c7250 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 >> v2:172.21.15.190:3300/0 conn(0x7faf8414ffa0 msgr2=0x7faf8406f700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 --2- 172.21.15.26:0/330461616 >> v2:172.21.15.190:3300/0 conn(0x7faf8414ffa0 0x7faf8406f700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf840c6610 con 0x7faf8414fbc0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7faf74001680 con 0x7faf8414fbc0 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 >> v1:172.21.15.26:6789/0 conn(0x7faf8414fbc0 legacy=0x7faf840c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf6c0039c0 0x7faf6c003de0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf6c004810 0x7faf6c004c90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.502 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf6c0051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faf840c6050 con 0x7faf6c0039c0 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faf840c6330 con 0x7faf6c004810 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faf6c00b9d0 con 0x7faf84074100 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf6c0039c0 0x7faf6c003de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf892dc640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf6c0051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf83fff640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf6c004810 0x7faf6c004c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 -- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 msgr2=0x7faf6c0051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf6c0051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 -- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf6c004810 msgr2=0x7faf6c004c90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf6c004810 0x7faf6c004c90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf88adb640 1 -- 172.21.15.26:0/330461616 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf6c003530 con 0x7faf6c0039c0 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf892dc640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf84074100 0x7faf6c0051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:44.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.501+0000 7faf83fff640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf6c004810 0x7faf6c004c90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:44.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf88adb640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf6c0039c0 0x7faf6c003de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c240 tx=0x7faf7401cca0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8da4089561d1588c server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74007d40 con 0x7faf6c0039c0 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf740a9020 con 0x7faf6c0039c0 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf837fe640 1 -- 172.21.15.26:0/330461616 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf74005b00 con 0x7faf6c0039c0 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- 172.21.15.26:0/330461616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf6c0039c0 msgr2=0x7faf6c003de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/330461616 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf6c0039c0 0x7faf6c003de0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7faf7400c240 tx=0x7faf7401cca0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf892dc640 1 -- 172.21.15.26:0/330461616 reap_dead start 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- 172.21.15.26:0/330461616 shutdown_connections 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- 172.21.15.26:0/330461616 >> 172.21.15.26:0/330461616 conn(0x7faf8406b9d0 msgr2=0x7faf8406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- 172.21.15.26:0/330461616 shutdown_connections 2024-04-23T10:24:44.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- 172.21.15.26:0/330461616 wait complete. 2024-04-23T10:24:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 Processor -- start 2024-04-23T10:24:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.505+0000 7faf8ad3f640 1 -- start start 2024-04-23T10:24:44.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf6c0039c0 0x7faf841612f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf841492b0 0x7faf84148910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7faf841639f0 con 0x7faf8414ebf0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7faf84163870 con 0x7faf841492b0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7faf84163b70 con 0x7faf6c0039c0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53220/0 (socket says 172.21.15.26:53220) 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 -- 172.21.15.26:0/686251390 learned_addr learned my addr 172.21.15.26:0/686251390 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf892dc640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf841492b0 0x7faf84148910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf88adb640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf6c0039c0 0x7faf841612f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 -- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf6c0039c0 msgr2=0x7faf841612f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf6c0039c0 0x7faf841612f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 -- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf841492b0 msgr2=0x7faf84148910 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf841492b0 0x7faf84148910 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 -- 172.21.15.26:0/686251390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7faf841f5b80 con 0x7faf8414ebf0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf83fff640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf78010980 tx=0x7faf78010e40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7800f040 con 0x7faf8414ebf0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7faf78004220 con 0x7faf8414ebf0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7faf84151bd0 con 0x7faf8414ebf0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7faf7800e9a0 con 0x7faf8414ebf0 2024-04-23T10:24:44.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7faf841f5e20 con 0x7faf8414ebf0 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7faf7800eb40 con 0x7faf8414ebf0 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7faf84075df0 con 0x7faf8414ebf0 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 0x7faf7006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7faf78086e20 con 0x7faf8414ebf0 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.509+0000 7faf88adb640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 0x7faf7006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.513+0000 7faf88adb640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 0x7faf7006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf740aa000 tx=0x7faf840735f0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.513+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7faf78018030 con 0x7faf8414ebf0 2024-04-23T10:24:44.677 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.677+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "4", "target": ["mon-mgr", ""]}) -- 0x7faf84149d50 con 0x7faf70068380 2024-04-23T10:24:44.679 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf817fa640 1 -- 172.21.15.26:0/686251390 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 4 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7faf84149d50 con 0x7faf70068380 2024-04-23T10:24:44.679 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 4 to deep-scrub 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 msgr2=0x7faf7006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 0x7faf7006a840 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7faf740aa000 tx=0x7faf840735f0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 msgr2=0x7faf841513d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7faf78010980 tx=0x7faf78010e40 comp rx=0 tx=0).stop 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 shutdown_connections 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7faf70068380 0x7faf7006a840 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7faf841492b0 0x7faf84148910 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.681 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7faf8414ebf0 0x7faf841513d0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 --2- 172.21.15.26:0/686251390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7faf6c0039c0 0x7faf841612f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 >> 172.21.15.26:0/686251390 conn(0x7faf8406b9d0 msgr2=0x7faf8406bf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 shutdown_connections 2024-04-23T10:24:44.682 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.681+0000 7faf8ad3f640 1 -- 172.21.15.26:0/686251390 wait complete. 2024-04-23T10:24:44.696 INFO:tasks.ceph:Scrubbing osd.5 2024-04-23T10:24:44.697 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 Processor -- start 2024-04-23T10:24:44.823 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 -- start start 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fb7300c6380 0x7fb730152cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c73a0 0x7fb730153230 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb73006ce60 con 0x7fb7300c5fa0 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fb730153770 con 0x7fb7300c6380 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb7358de640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb7300c8890 con 0x7fb7300c73a0 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72effd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb7300c5fa0 0x7fb73015ce00 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48410/0 (socket says 172.21.15.26:48410) 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72effd640 1 -- 172.21.15.26:0/1845573866 learned_addr learned my addr 172.21.15.26:0/1845573866 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/1845573866 >> v2:172.21.15.26:3300/0 conn(0x7fb7300c6380 0x7fb730152cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c73a0 0x7fb730153230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72e7fc640 1 -- 172.21.15.26:0/1845573866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c73a0 msgr2=0x7fb730153230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c73a0 0x7fb730153230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.825 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72e7fc640 1 -- 172.21.15.26:0/1845573866 >> v1:172.21.15.26:6789/0 conn(0x7fb7300c5fa0 legacy=0x7fb73015ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72dffb640 1 -- 172.21.15.26:0/1845573866 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2320654346 0 0) 0x7fb73006ce60 con 0x7fb7300c5fa0 2024-04-23T10:24:44.826 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.825+0000 7fb72e7fc640 1 -- 172.21.15.26:0/1845573866 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb7300c8ae0 con 0x7fb7300c6380 2024-04-23T10:24:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c6380 0x7fb730152cf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28e6a13557296592 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb72dffb640 1 -- 172.21.15.26:0/1845573866 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240b0070 con 0x7fb7300c6380 2024-04-23T10:24:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb72dffb640 1 -- 172.21.15.26:0/1845573866 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7240ab600 con 0x7fb7300c6380 2024-04-23T10:24:44.827 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb72dffb640 1 -- 172.21.15.26:0/1845573866 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb7240ab9d0 con 0x7fb7300c6380 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- 172.21.15.26:0/1845573866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c6380 msgr2=0x7fb730152cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c6380 0x7fb730152cf0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7fb7240097c0 tx=0x7fb72401c380 comp rx=0 tx=0).stop 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- 172.21.15.26:0/1845573866 shutdown_connections 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c73a0 0x7fb730153230 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 --2- 172.21.15.26:0/1845573866 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c6380 0x7fb730152cf0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- 172.21.15.26:0/1845573866 >> 172.21.15.26:0/1845573866 conn(0x7fb7300c9130 msgr2=0x7fb7300c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.828 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- 172.21.15.26:0/1845573866 shutdown_connections 2024-04-23T10:24:44.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- 172.21.15.26:0/1845573866 wait complete. 2024-04-23T10:24:44.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 Processor -- start 2024-04-23T10:24:44.829 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 -- start start 2024-04-23T10:24:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.829+0000 7fb7358de640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 0x7fb730153900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c6380 0x7fb73015b690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7300c73a0 0x7fb730155890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.831 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb73006ca90 con 0x7fb7300c5fa0 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb730159010 con 0x7fb7300c73a0 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb73006cc10 con 0x7fb7300c6380 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 0x7fb730153900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 0x7fb730153900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53238/0 (socket says 172.21.15.26:53238) 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 -- 172.21.15.26:0/161466226 learned_addr learned my addr 172.21.15.26:0/161466226 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c6380 0x7fb73015b690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 -- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c6380 msgr2=0x7fb73015b690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb7300c6380 0x7fb73015b690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7300c73a0 0x7fb730155890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 -- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7300c73a0 msgr2=0x7fb730155890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb7300c73a0 0x7fb730155890 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.832 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb730151410 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72effd640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 0x7fb730153900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c4b0 tx=0x7fb72000c970 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720018070 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb720007500 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb720004a30 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb730152440 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb730152a00 con 0x7fb7300c5fa0 2024-04-23T10:24:44.833 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb730075e60 con 0x7fb7300c5fa0 2024-04-23T10:24:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb72001b070 con 0x7fb7300c5fa0 2024-04-23T10:24:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb71c068380 0x7fb71c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb720086680 con 0x7fb7300c5fa0 2024-04-23T10:24:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7fb71c071e10 0x7fb71c0742b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.834 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb71c074980 con 0x7fb71c071e10 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fb720086b10 con 0x7fb7300c5fa0 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb71c068380 0x7fb71c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.833+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7fb71c071e10 0x7fb71c0742b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.837+0000 7fb72e7fc640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb71c068380 0x7fb71c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7240ad000 tx=0x7fb724008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.837+0000 7fb72f7fe640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7fb71c071e10 0x7fb71c0742b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.835 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.837+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== osd.5 v2:172.21.15.190:6800/228505156 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb71c074980 con 0x7fb71c071e10 2024-04-23T10:24:44.848 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.849+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 --> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fb73006e0e0 con 0x7fb71c071e10 2024-04-23T10:24:44.849 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.849+0000 7fb717fff640 1 -- 172.21.15.26:0/161466226 <== osd.5 v2:172.21.15.190:6800/228505156 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fb73006e0e0 con 0x7fb71c071e10 2024-04-23T10:24:44.850 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:44.850 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:44.850 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:44.850 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.849+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7fb71c071e10 msgr2=0x7fb71c0742b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.849+0000 7fb7358de640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6800/228505156,v1:172.21.15.190:6801/228505156] conn(0x7fb71c071e10 0x7fb71c0742b0 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb71c068380 msgr2=0x7fb71c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb71c068380 0x7fb71c06a840 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7fb7240ad000 tx=0x7fb724008040 comp rx=0 tx=0).stop 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 msgr2=0x7fb730153900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 --2- 172.21.15.26:0/161466226 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb7300c5fa0 0x7fb730153900 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 crypto rx=0x7fb72000c4b0 tx=0x7fb72000c970 comp rx=0 tx=0).stop 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb72f7fe640 1 -- 172.21.15.26:0/161466226 reap_dead start 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 shutdown_connections 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 >> 172.21.15.26:0/161466226 conn(0x7fb7300c9130 msgr2=0x7fb73015ce00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 shutdown_connections 2024-04-23T10:24:44.851 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.853+0000 7fb7358de640 1 -- 172.21.15.26:0/161466226 wait complete. 2024-04-23T10:24:44.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-23T10:24:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 Processor -- start 2024-04-23T10:24:44.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 -- start start 2024-04-23T10:24:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 0x7fb85c0c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c15b740 con 0x7fb85c0c8630 2024-04-23T10:24:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb85c0c58c0 con 0x7fb85c0c8a70 2024-04-23T10:24:44.978 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb862de4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c0c6490 con 0x7fb85c0c8250 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85bfff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fb85c0c8630 0x7fb85c151b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48422/0 (socket says 172.21.15.26:48422) 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85bfff640 1 -- 172.21.15.26:0/4046809664 learned_addr learned my addr 172.21.15.26:0/4046809664 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 552832790 0 0) 0x7fb85c15b740 con 0x7fb85c0c8630 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb844005740 con 0x7fb85c0c8630 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 0x7fb85c0c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1793641160 0 0) 0x7fb844005740 con 0x7fb85c0c8630 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 msgr2=0x7fb85c0c39e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 0x7fb85c0c39e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 >> v1:172.21.15.190:6789/0 conn(0x7fb85c0c8a70 legacy=0x7fb85c162790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c0c5b60 con 0x7fb85c0c8630 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fb850001680 con 0x7fb85c0c8630 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 >> v1:172.21.15.26:6789/0 conn(0x7fb85c0c8630 legacy=0x7fb85c151b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb844005c00 0x7fb844006020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 0x7fb844006a20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844006f60 0x7fb8440073e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0c6490 con 0x7fb844005c00 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb84400ddc0 con 0x7fb844006f60 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb84400dfc0 con 0x7fb85c0c8250 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb844005c00 0x7fb844006020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 -- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 msgr2=0x7fb844006a20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c0c8250 0x7fb844006a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 -- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844006f60 msgr2=0x7fb8440073e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844006f60 0x7fb8440073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.977+0000 7fb860b80640 1 -- 172.21.15.26:0/4046809664 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb844005740 con 0x7fb844005c00 2024-04-23T10:24:44.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb860b80640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb844005c00 0x7fb844006020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00ba30 tx=0x7fb84c01c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7388d01c680c7c7e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c0b3070 con 0x7fb844005c00 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb84c0ae670 con 0x7fb844005c00 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb85b7fe640 1 -- 172.21.15.26:0/4046809664 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb84c00b600 con 0x7fb844005c00 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- 172.21.15.26:0/4046809664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb844005c00 msgr2=0x7fb844006020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 --2- 172.21.15.26:0/4046809664 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb844005c00 0x7fb844006020 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7fb84c00ba30 tx=0x7fb84c01c6e0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb861381640 1 -- 172.21.15.26:0/4046809664 reap_dead start 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- 172.21.15.26:0/4046809664 shutdown_connections 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- 172.21.15.26:0/4046809664 >> 172.21.15.26:0/4046809664 conn(0x7fb85c06b9d0 msgr2=0x7fb85c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:44.982 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- 172.21.15.26:0/4046809664 shutdown_connections 2024-04-23T10:24:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- 172.21.15.26:0/4046809664 wait complete. 2024-04-23T10:24:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 Processor -- start 2024-04-23T10:24:44.983 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.981+0000 7fb862de4640 1 -- start start 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 0x7fb85c15a140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 0x7fb85c14e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c0c6900 con 0x7fb85c158ae0 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fb85c15b400 con 0x7fb844005c00 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fb85c0681d0 con 0x7fb85c1f0d00 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53254/0 (socket says 172.21.15.26:53254) 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 -- 172.21.15.26:0/1539822255 learned_addr learned my addr 172.21.15.26:0/1539822255 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb860b80640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 0x7fb85c15a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.985 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb861381640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 0x7fb85c14e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 -- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 msgr2=0x7fb85c14e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 0x7fb85c14e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 -- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 msgr2=0x7fb85c15a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 0x7fb85c15a140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 -- 172.21.15.26:0/1539822255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb85c15a680 con 0x7fb85c158ae0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb860b80640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 0x7fb85c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb861381640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 0x7fb85c14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb85bfff640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c770 tx=0x7fb85000cc30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850018070 con 0x7fb85c158ae0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb850007500 con 0x7fb85c158ae0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fb850004a30 con 0x7fb85c158ae0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb85c1f44f0 con 0x7fb85c158ae0 2024-04-23T10:24:44.986 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb85c1e7310 con 0x7fb85c158ae0 2024-04-23T10:24:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fb85c075df0 con 0x7fb85c158ae0 2024-04-23T10:24:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fb850004bd0 con 0x7fb85c158ae0 2024-04-23T10:24:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 0x7fb84806a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fb850086440 con 0x7fb85c158ae0 2024-04-23T10:24:44.987 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.985+0000 7fb860b80640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 0x7fb84806a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:44.988 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.989+0000 7fb860b80640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 0x7fb84806a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0b0000 tx=0x7fb84c0046d0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:44.990 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:44.993+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fb8500565e0 con 0x7fb85c158ae0 2024-04-23T10:24:45.148 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.149+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "5", "target": ["mon-mgr", ""]}) -- 0x7fb85c1e75f0 con 0x7fb848068380 2024-04-23T10:24:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.149+0000 7fb8597fa640 1 -- 172.21.15.26:0/1539822255 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 5 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fb84c0ae570 con 0x7fb848068380 2024-04-23T10:24:45.149 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 5 to deep-scrub 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 msgr2=0x7fb84806a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 0x7fb84806a840 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7fb84c0b0000 tx=0x7fb84c0046d0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 msgr2=0x7fb85c1f3fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7fb85000c770 tx=0x7fb85000cc30 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 shutdown_connections 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fb848068380 0x7fb84806a840 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fb85c1f0d00 0x7fb85c14e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fb85c158ae0 0x7fb85c1f3fb0 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 --2- 172.21.15.26:0/1539822255 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fb844005c00 0x7fb85c15a140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 >> 172.21.15.26:0/1539822255 conn(0x7fb85c06b9d0 msgr2=0x7fb85c0c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.152 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 shutdown_connections 2024-04-23T10:24:45.153 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.153+0000 7fb862de4640 1 -- 172.21.15.26:0/1539822255 wait complete. 2024-04-23T10:24:45.167 INFO:tasks.ceph:Scrubbing osd.6 2024-04-23T10:24:45.168 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 Processor -- start 2024-04-23T10:24:45.292 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 -- start start 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4c806d920 0x7fc4c8151a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fc4c806d120 0x7fc4c8151f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fc4c8152490 con 0x7fc4c806cd40 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c8073210 con 0x7fc4c806d920 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.293+0000 7fc4ce529640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fc4c8073db0 con 0x7fc4c806d120 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fc4c806d920 0x7fc4c8151a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c7fff640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fc4c806cd40 0x7fc4c80736a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48434/0 (socket says 172.21.15.26:48434) 2024-04-23T10:24:45.294 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c7fff640 1 -- 172.21.15.26:0/1751048549 learned_addr learned my addr 172.21.15.26:0/1751048549 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/1751048549 >> v2:172.21.15.26:3300/0 conn(0x7fc4c806d920 0x7fc4c8151a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53268/0 (socket says 172.21.15.26:53268) 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ccac6640 1 --2- 172.21.15.26:0/1751048549 >> v2:172.21.15.190:3300/0 conn(0x7fc4c806d120 0x7fc4c8151f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 -- 172.21.15.26:0/1751048549 >> v2:172.21.15.190:3300/0 conn(0x7fc4c806d120 msgr2=0x7fc4c8151f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/1751048549 >> v2:172.21.15.190:3300/0 conn(0x7fc4c806d120 0x7fc4c8151f50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 -- 172.21.15.26:0/1751048549 >> v1:172.21.15.26:6789/0 conn(0x7fc4c806cd40 legacy=0x7fc4c80736a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c6ffd640 1 -- 172.21.15.26:0/1751048549 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2459781783 0 0) 0x7fc4c8152490 con 0x7fc4c806cd40 2024-04-23T10:24:45.295 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 -- 172.21.15.26:0/1751048549 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c8072620 con 0x7fc4c806d920 2024-04-23T10:24:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/1751048549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d920 0x7fc4c8151a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00097c0 tx=0x7fc4b001c460 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dd7cec2972f8f42d server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c6ffd640 1 -- 172.21.15.26:0/1751048549 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00b0070 con 0x7fc4c806d920 2024-04-23T10:24:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c6ffd640 1 -- 172.21.15.26:0/1751048549 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b0004230 con 0x7fc4c806d920 2024-04-23T10:24:45.296 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4c6ffd640 1 -- 172.21.15.26:0/1751048549 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0003620 con 0x7fc4c806d920 2024-04-23T10:24:45.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 -- 172.21.15.26:0/1751048549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d920 msgr2=0x7fc4c8151a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 --2- 172.21.15.26:0/1751048549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d920 0x7fc4c8151a10 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7fc4b00097c0 tx=0x7fc4b001c460 comp rx=0 tx=0).stop 2024-04-23T10:24:45.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 -- 172.21.15.26:0/1751048549 shutdown_connections 2024-04-23T10:24:45.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 --2- 172.21.15.26:0/1751048549 >> v2:172.21.15.190:3300/0 conn(0x7fc4c806d120 0x7fc4c8151f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.297 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 --2- 172.21.15.26:0/1751048549 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d920 0x7fc4c8151a10 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 -- 172.21.15.26:0/1751048549 >> 172.21.15.26:0/1751048549 conn(0x7fc4c80ca0d0 msgr2=0x7fc4c80ca4e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 -- 172.21.15.26:0/1751048549 shutdown_connections 2024-04-23T10:24:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.297+0000 7fc4ce529640 1 -- 172.21.15.26:0/1751048549 wait complete. 2024-04-23T10:24:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 Processor -- start 2024-04-23T10:24:45.298 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- start start 2024-04-23T10:24:45.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4c806cd40 0x7fc4c8146e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 0x7fc4c80cc690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.300 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4c806d920 0x7fc4c80ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c80c7fd0 con 0x7fc4c806d120 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fc4c8072ea0 con 0x7fc4c806d920 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fc4c80c8150 con 0x7fc4c806cd40 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 0x7fc4c80cc690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 0x7fc4c80cc690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53274/0 (socket says 172.21.15.26:53274) 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 -- 172.21.15.26:0/72604004 learned_addr learned my addr 172.21.15.26:0/72604004 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ccac6640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4c806d920 0x7fc4c80ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c7fff640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4c806cd40 0x7fc4c8146e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 -- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4c806cd40 msgr2=0x7fc4c8146e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fc4c806cd40 0x7fc4c8146e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 -- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4c806d920 msgr2=0x7fc4c80ccbd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fc4c806d920 0x7fc4c80ccbd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fc4c8158900 con 0x7fc4c806d120 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c77fe640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 0x7fc4c80cc690 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0019070 tx=0x7fc4b0019200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b00b0040 con 0x7fc4c806d120 2024-04-23T10:24:45.301 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4b00bb070 con 0x7fc4c806d120 2024-04-23T10:24:45.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fc4c8154190 con 0x7fc4c806d120 2024-04-23T10:24:45.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fc4b0006e20 con 0x7fc4c806d120 2024-04-23T10:24:45.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fc4c8154750 con 0x7fc4c806d120 2024-04-23T10:24:45.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fc4c8075e60 con 0x7fc4c806d120 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.301+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fc4b00b3070 con 0x7fc4c806d120 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc4a80683b0 0x7fc4a806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fc4b0121630 con 0x7fc4c806d120 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fc4a8071e40 0x7fc4a80742e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fc4b00ade90 con 0x7fc4a8071e40 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7fc4b0121a90 con 0x7fc4c806d120 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c7fff640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc4a80683b0 0x7fc4a806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4ccac6640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fc4a8071e40 0x7fc4a80742e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c7fff640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc4a80683b0 0x7fc4a806a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000f70 tx=0x7fc4b8009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.304 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4ccac6640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fc4a8071e40 0x7fc4a80742e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.6 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.305 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.305+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== osd.6 v2:172.21.15.190:6808/2710988300 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fc4b00ade90 con 0x7fc4a8071e40 2024-04-23T10:24:45.318 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 --> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fc4c81557c0 con 0x7fc4a8071e40 2024-04-23T10:24:45.319 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4c4ff9640 1 -- 172.21.15.26:0/72604004 <== osd.6 v2:172.21.15.190:6808/2710988300 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fc4c81557c0 con 0x7fc4a8071e40 2024-04-23T10:24:45.319 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:45.319 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:45.319 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:45.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fc4a8071e40 msgr2=0x7fc4a80742e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6808/2710988300,v1:172.21.15.190:6809/2710988300] conn(0x7fc4a8071e40 0x7fc4a80742e0 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.320 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc4a80683b0 msgr2=0x7fc4a806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fc4a80683b0 0x7fc4a806a870 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7fc4b8000f70 tx=0x7fc4b8009040 comp rx=0 tx=0).stop 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 msgr2=0x7fc4c80cc690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 --2- 172.21.15.26:0/72604004 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fc4c806d120 0x7fc4c80cc690 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7fc4b0019070 tx=0x7fc4b0019200 comp rx=0 tx=0).stop 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ccac6640 1 -- 172.21.15.26:0/72604004 reap_dead start 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 shutdown_connections 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 >> 172.21.15.26:0/72604004 conn(0x7fc4c80ca0d0 msgr2=0x7fc4c81581f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 shutdown_connections 2024-04-23T10:24:45.321 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.321+0000 7fc4ce529640 1 -- 172.21.15.26:0/72604004 wait complete. 2024-04-23T10:24:45.335 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-23T10:24:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 Processor -- start 2024-04-23T10:24:45.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 -- start start 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 0x7fcd9015b9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd900703c0 0x7fcd900c9010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fcd900c8570 con 0x7fcd900c9550 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fcd9015f420 con 0x7fcd900703c0 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd96605640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fcd900c8040 con 0x7fcd90144580 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd900703c0 0x7fcd900c9010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fcd900703c0 0x7fcd900c9010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53276/0 (socket says 172.21.15.26:53276) 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 -- 172.21.15.26:0/2296437397 learned_addr learned my addr 172.21.15.26:0/2296437397 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:45.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8ffff640 1 --2- 172.21.15.26:0/2296437397 >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 0x7fcd9015b9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 -- 172.21.15.26:0/2296437397 >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 msgr2=0x7fcd9015b9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 --2- 172.21.15.26:0/2296437397 >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 0x7fcd9015b9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 -- 172.21.15.26:0/2296437397 >> v1:172.21.15.190:6789/0 conn(0x7fcd900c9550 legacy=0x7fcd9006cee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8f7fe640 1 -- 172.21.15.26:0/2296437397 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd900c8290 con 0x7fcd900703c0 2024-04-23T10:24:45.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.453+0000 7fcd8ffff640 1 --2- 172.21.15.26:0/2296437397 >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 0x7fcd9015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:24:45.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd8f7fe640 1 --2- 172.21.15.26:0/2296437397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900c9010 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd9006ca00 tx=0x7fcd8401c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb06dc6c12c9c840 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd8effd640 1 -- 172.21.15.26:0/2296437397 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840aa680 con 0x7fcd900703c0 2024-04-23T10:24:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd8effd640 1 -- 172.21.15.26:0/2296437397 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd840af070 con 0x7fcd900703c0 2024-04-23T10:24:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd8effd640 1 -- 172.21.15.26:0/2296437397 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd840aaa40 con 0x7fcd900703c0 2024-04-23T10:24:45.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- 172.21.15.26:0/2296437397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 msgr2=0x7fcd900c9010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 --2- 172.21.15.26:0/2296437397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900c9010 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 crypto rx=0x7fcd9006ca00 tx=0x7fcd8401c520 comp rx=0 tx=0).stop 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- 172.21.15.26:0/2296437397 shutdown_connections 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 --2- 172.21.15.26:0/2296437397 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900c9010 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 --2- 172.21.15.26:0/2296437397 >> v2:172.21.15.190:3300/0 conn(0x7fcd90144580 0x7fcd9015b9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- 172.21.15.26:0/2296437397 >> 172.21.15.26:0/2296437397 conn(0x7fcd900ca540 msgr2=0x7fcd900ca950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- 172.21.15.26:0/2296437397 shutdown_connections 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- 172.21.15.26:0/2296437397 wait complete. 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 Processor -- start 2024-04-23T10:24:45.457 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.457+0000 7fcd96605640 1 -- start start 2024-04-23T10:24:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd900c9550 0x7fcd90156730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd90144580 0x7fcd90156c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fcd900c8cb0 con 0x7fcd900703c0 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fcd9015ef00 con 0x7fcd900c9550 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fcd9006d5f0 con 0x7fcd90144580 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53292/0 (socket says 172.21.15.26:53292) 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 -- 172.21.15.26:0/3757447390 learned_addr learned my addr 172.21.15.26:0/3757447390 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8f7fe640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd900c9550 0x7fcd90156730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd94ba2640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd90144580 0x7fcd90156c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 -- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd90144580 msgr2=0x7fcd90156c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd90144580 0x7fcd90156c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 -- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd900c9550 msgr2=0x7fcd90156730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd900c9550 0x7fcd90156730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 -- 172.21.15.26:0/3757447390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fcd90140850 con 0x7fcd900703c0 2024-04-23T10:24:45.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8ffff640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e840 tx=0x7fcd8000ed00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd80017070 con 0x7fcd900703c0 2024-04-23T10:24:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fcd8000c8d0 con 0x7fcd900703c0 2024-04-23T10:24:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fcd90155940 con 0x7fcd900703c0 2024-04-23T10:24:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fcd8000f040 con 0x7fcd900703c0 2024-04-23T10:24:45.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fcd90155f00 con 0x7fcd900703c0 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fcd90075df0 con 0x7fcd900703c0 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fcd8001a070 con 0x7fcd900703c0 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.461+0000 7fcd8cff9640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 0x7fcd7c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.465+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fcd80086990 con 0x7fcd900703c0 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.465+0000 7fcd8f7fe640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 0x7fcd7c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.462 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.465+0000 7fcd8f7fe640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 0x7fcd7c06a870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd840ae000 tx=0x7fcd840a7000 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.469+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fcd80056b30 con 0x7fcd900703c0 2024-04-23T10:24:45.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.633+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "6", "target": ["mon-mgr", ""]}) -- 0x7fcd90073530 con 0x7fcd7c0683b0 2024-04-23T10:24:45.632 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.633+0000 7fcd8cff9640 1 -- 172.21.15.26:0/3757447390 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 6 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fcd90073530 con 0x7fcd7c0683b0 2024-04-23T10:24:45.632 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 6 to deep-scrub 2024-04-23T10:24:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 msgr2=0x7fcd7c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.634 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 0x7fcd7c06a870 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7fcd840ae000 tx=0x7fcd840a7000 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 msgr2=0x7fcd900cca50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7fcd8000e840 tx=0x7fcd8000ed00 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 shutdown_connections 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fcd7c0683b0 0x7fcd7c06a870 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fcd90144580 0x7fcd90156c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fcd900c9550 0x7fcd90156730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 --2- 172.21.15.26:0/3757447390 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fcd900703c0 0x7fcd900cca50 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 >> 172.21.15.26:0/3757447390 conn(0x7fcd900ca540 msgr2=0x7fcd9006ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 shutdown_connections 2024-04-23T10:24:45.635 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.637+0000 7fcd96605640 1 -- 172.21.15.26:0/3757447390 wait complete. 2024-04-23T10:24:45.651 INFO:tasks.ceph:Scrubbing osd.7 2024-04-23T10:24:45.651 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-23T10:24:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 Processor -- start 2024-04-23T10:24:45.782 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 -- start start 2024-04-23T10:24:45.783 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74e80c5fa0 0x7f74e815ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f74e80c6380 0x7f74e8163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f74e806ce60 con 0x7f74e815d340 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f74e80c8890 con 0x7f74e80c5fa0 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74ecaeb640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f74e815c970 con 0x7f74e80c6380 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74e80c5fa0 0x7f74e815ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e5d9b640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f74e815d340 0x7f74e8152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48444/0 (socket says 172.21.15.26:48444) 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e5d9b640 1 -- 172.21.15.26:0/1857982148 learned_addr learned my addr 172.21.15.26:0/1857982148 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f74e80c5fa0 0x7f74e815ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53302/0 (socket says 172.21.15.26:53302) 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e6d9d640 1 --2- 172.21.15.26:0/1857982148 >> v2:172.21.15.190:3300/0 conn(0x7f74e80c6380 0x7f74e8163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 -- 172.21.15.26:0/1857982148 >> v2:172.21.15.190:3300/0 conn(0x7f74e80c6380 msgr2=0x7f74e8163990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 --2- 172.21.15.26:0/1857982148 >> v2:172.21.15.190:3300/0 conn(0x7f74e80c6380 0x7f74e8163990 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 -- 172.21.15.26:0/1857982148 >> v1:172.21.15.26:6789/0 conn(0x7f74e815d340 legacy=0x7f74e8152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.784 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.785+0000 7f74e659c640 1 -- 172.21.15.26:0/1857982148 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e80c8ae0 con 0x7f74e80c5fa0 2024-04-23T10:24:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e659c640 1 --2- 172.21.15.26:0/1857982148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e80c5fa0 0x7f74e815ce00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f74e8156c00 tx=0x7f74d801c330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f01787997145742 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e559a640 1 -- 172.21.15.26:0/1857982148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d80b0070 con 0x7f74e80c5fa0 2024-04-23T10:24:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e559a640 1 -- 172.21.15.26:0/1857982148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74d80ab600 con 0x7f74e80c5fa0 2024-04-23T10:24:45.786 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e559a640 1 -- 172.21.15.26:0/1857982148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74d80ab9d0 con 0x7f74e80c5fa0 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- 172.21.15.26:0/1857982148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e80c5fa0 msgr2=0x7f74e815ce00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/1857982148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e80c5fa0 0x7f74e815ce00 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f74e8156c00 tx=0x7f74d801c330 comp rx=0 tx=0).stop 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- 172.21.15.26:0/1857982148 shutdown_connections 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/1857982148 >> v2:172.21.15.190:3300/0 conn(0x7f74e80c6380 0x7f74e8163990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/1857982148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e80c5fa0 0x7f74e815ce00 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- 172.21.15.26:0/1857982148 >> 172.21.15.26:0/1857982148 conn(0x7f74e80c9130 msgr2=0x7f74e80c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- 172.21.15.26:0/1857982148 shutdown_connections 2024-04-23T10:24:45.787 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- 172.21.15.26:0/1857982148 wait complete. 2024-04-23T10:24:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 Processor -- start 2024-04-23T10:24:45.788 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- start start 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74e80c5fa0 0x7f74e8073990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e80c6380 0x7f74e81f3ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 0x7f74e80c3b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f74e806cc10 con 0x7f74e815d340 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f74e806ca90 con 0x7f74e80c6380 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74ecaeb640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f74e80c6fa0 con 0x7f74e80c5fa0 2024-04-23T10:24:45.790 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 0x7f74e80c3b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 0x7f74e80c3b30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53314/0 (socket says 172.21.15.26:53314) 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 -- 172.21.15.26:0/2230221854 learned_addr learned my addr 172.21.15.26:0/2230221854 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 -- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74e80c5fa0 msgr2=0x7f74e8073990 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e659c640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74e80c5fa0 0x7f74e8073990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f74e80c5fa0 0x7f74e8073990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e5d9b640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e80c6380 0x7f74e81f3ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 -- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e80c6380 msgr2=0x7f74e81f3ac0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f74e80c6380 0x7f74e81f3ac0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f74e8072680 con 0x7f74e815d340 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.789+0000 7f74e6d9d640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 0x7f74e80c3b30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f74e0007e40 tx=0x7f74e000e4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0014620 con 0x7f74e815d340 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f74e0019070 con 0x7f74e815d340 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f74e80728f0 con 0x7f74e815d340 2024-04-23T10:24:45.791 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f74e0014a20 con 0x7f74e815d340 2024-04-23T10:24:45.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f74e8072eb0 con 0x7f74e815d340 2024-04-23T10:24:45.792 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f74e8075e60 con 0x7f74e815d340 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f74e0014bc0 con 0x7f74e815d340 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f74c80683b0 0x7f74c806a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f74e0088570 con 0x7f74e815d340 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f74c8071e50 0x7f74c80742f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f74e000df30 con 0x7f74c8071e50 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_get_version_reply(handle=1 version=26) ==== 24+0+0 (secure 0 0 0) 0x7f74e0088920 con 0x7f74e815d340 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74e659c640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f74c80683b0 0x7f74c806a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.794 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74e5d9b640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f74c8071e50 0x7f74c80742f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74e659c640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f74c80683b0 0x7f74c806a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f74d80ad000 tx=0x7f74d8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.793+0000 7f74e5d9b640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f74c8071e50 0x7f74c80742f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.7 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.795 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.797+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== osd.7 v2:172.21.15.190:6816/2532942072 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f74e000df30 con 0x7f74c8071e50 2024-04-23T10:24:45.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 --> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f74e80ca5d0 con 0x7f74c8071e50 2024-04-23T10:24:45.808 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74d6ffd640 1 -- 172.21.15.26:0/2230221854 <== osd.7 v2:172.21.15.190:6816/2532942072 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f74e80ca5d0 con 0x7f74c8071e50 2024-04-23T10:24:45.809 INFO:teuthology.orchestra.run.smithi026.stdout:{ 2024-04-23T10:24:45.809 INFO:teuthology.orchestra.run.smithi026.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-23T10:24:45.809 INFO:teuthology.orchestra.run.smithi026.stdout:} 2024-04-23T10:24:45.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f74c8071e50 msgr2=0x7f74c80742f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6816/2532942072,v1:172.21.15.190:6818/2532942072] conn(0x7f74c8071e50 0x7f74c80742f0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.810 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f74c80683b0 msgr2=0x7f74c806a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f74c80683b0 0x7f74c806a870 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f74d80ad000 tx=0x7f74d8008040 comp rx=0 tx=0).stop 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 msgr2=0x7f74e80c3b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 --2- 172.21.15.26:0/2230221854 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f74e815d340 0x7f74e80c3b30 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f74e0007e40 tx=0x7f74e000e4b0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74e6d9d640 1 -- 172.21.15.26:0/2230221854 reap_dead start 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 shutdown_connections 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 >> 172.21.15.26:0/2230221854 conn(0x7f74e80c9130 msgr2=0x7f74e80cbea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 shutdown_connections 2024-04-23T10:24:45.811 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.809+0000 7f74ecaeb640 1 -- 172.21.15.26:0/2230221854 wait complete. 2024-04-23T10:24:45.826 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-23T10:24:45.943 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 Processor -- start 2024-04-23T10:24:45.944 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 -- start start 2024-04-23T10:24:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69680ca290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.946 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f696806d980 con 0x7f69680ca7d0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f69680c4b90 con 0x7f6968153160 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f6970601640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f69680c54c0 con 0x7f69680ccc60 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696eb9e640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f69680ca7d0 0x7f69680c6d30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:48452/0 (socket says 172.21.15.26:48452) 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696eb9e640 1 -- 172.21.15.26:0/1536758194 learned_addr learned my addr 172.21.15.26:0/1536758194 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696db9c640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69680ca290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1779993742 0 0) 0x7f696806d980 con 0x7f69680ca7d0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f6954003530 con 0x7f69680ca7d0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 4072982294 0 0) 0x7f6954003530 con 0x7f69680ca7d0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 msgr2=0x7f69680ca290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69680ca290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 >> v1:172.21.15.190:6789/0 conn(0x7f6968153160 legacy=0x7f696806b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69680c4e70 con 0x7f69680ca7d0 2024-04-23T10:24:45.947 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f6960001a00 con 0x7f69680ca7d0 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 >> v1:172.21.15.26:6789/0 conn(0x7f69680ca7d0 legacy=0x7f69680c6d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69540039f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6954004020 0x7f6954004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004d50 0x7f69540051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f695400bb60 con 0x7f6954004020 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f695400bd10 con 0x7f6954004d50 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.945+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f695400bf10 con 0x7f69680ccc60 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6954004020 0x7f6954004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696e39d640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69540039f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696eb9e640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004d50 0x7f69540051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 -- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 msgr2=0x7f69540039f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69680ccc60 0x7f69540039f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 -- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004d50 msgr2=0x7f69540051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:45.948 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004d50 0x7f69540051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 -- 172.21.15.26:0/1536758194 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6954003530 con 0x7f6954004020 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696db9c640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6954004020 0x7f6954004810 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f695800ba30 tx=0x7f695801c6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b758a3c55b8b1df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f695800b600 con 0x7f6954004020 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69580b1070 con 0x7f6954004020 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696d39b640 1 -- 172.21.15.26:0/1536758194 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580ac680 con 0x7f6954004020 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 -- 172.21.15.26:0/1536758194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6954004020 msgr2=0x7f6954004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 --2- 172.21.15.26:0/1536758194 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f6954004020 0x7f6954004810 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f695800ba30 tx=0x7f695801c6a0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f696eb9e640 1 -- 172.21.15.26:0/1536758194 reap_dead start 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 -- 172.21.15.26:0/1536758194 shutdown_connections 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 -- 172.21.15.26:0/1536758194 >> 172.21.15.26:0/1536758194 conn(0x7f696806fde0 msgr2=0x7f69680701f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:45.950 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 -- 172.21.15.26:0/1536758194 shutdown_connections 2024-04-23T10:24:45.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.949+0000 7f6970601640 1 -- 172.21.15.26:0/1536758194 wait complete. 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 Processor -- start 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- start start 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004020 0x7f69681f52d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69681f1b90 0x7f6968072380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f696806d5f0 con 0x7f696814b710 2024-04-23T10:24:45.953 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f696806dc60 con 0x7f6954004020 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f6968153540 con 0x7f69681f1b90 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53328/0 (socket says 172.21.15.26:53328) 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 -- 172.21.15.26:0/1674168470 learned_addr learned my addr 172.21.15.26:0/1674168470 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696e39d640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004020 0x7f69681f52d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696eb9e640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69681f1b90 0x7f6968072380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 -- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69681f1b90 msgr2=0x7f6968072380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69681f1b90 0x7f6968072380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 -- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004020 msgr2=0x7f69681f52d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004020 0x7f69681f52d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 -- 172.21.15.26:0/1674168470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69681e56c0 con 0x7f696814b710 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f696db9c640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f695801c4d0 tx=0x7f6954005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f69580bb070 con 0x7f696814b710 2024-04-23T10:24:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69580acc80 con 0x7f696814b710 2024-04-23T10:24:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69681e59a0 con 0x7f696814b710 2024-04-23T10:24:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f6958004240 con 0x7f696814b710 2024-04-23T10:24:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69681f4ad0 con 0x7f696814b710 2024-04-23T10:24:45.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6968075df0 con 0x7f696814b710 2024-04-23T10:24:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.953+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f6958003620 con 0x7f696814b710 2024-04-23T10:24:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.957+0000 7f695effd640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 0x7f694c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.957+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f6958121190 con 0x7f696814b710 2024-04-23T10:24:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.957+0000 7f696e39d640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 0x7f694c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:45.956 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.957+0000 7f696e39d640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 0x7f694c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6964000c10 tx=0x7f6964009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:45.958 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:45.961+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f69580c5060 con 0x7f696814b710 2024-04-23T10:24:46.128 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.129+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "7", "target": ["mon-mgr", ""]}) -- 0x7f69681e5c80 con 0x7f694c068380 2024-04-23T10:24:46.129 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.129+0000 7f695effd640 1 -- 172.21.15.26:0/1674168470 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 7 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f69681e5c80 con 0x7f694c068380 2024-04-23T10:24:46.129 INFO:teuthology.orchestra.run.smithi026.stderr:instructed osd(s) 7 to deep-scrub 2024-04-23T10:24:46.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 msgr2=0x7f694c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.131 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 0x7f694c06a840 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f6964000c10 tx=0x7f6964009040 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 msgr2=0x7f6968072c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 crypto rx=0x7f695801c4d0 tx=0x7f6954005840 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 shutdown_connections 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f694c068380 0x7f694c06a840 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f69681f1b90 0x7f6968072380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f696814b710 0x7f6968072c30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 --2- 172.21.15.26:0/1674168470 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f6954004020 0x7f69681f52d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 >> 172.21.15.26:0/1674168470 conn(0x7f696806fde0 msgr2=0x7f696806c240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 shutdown_connections 2024-04-23T10:24:46.132 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.133+0000 7f6970601640 1 -- 172.21.15.26:0/1674168470 wait complete. 2024-04-23T10:24:46.147 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:24:46.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.257+0000 7feb9367f640 1 Processor -- start 2024-04-23T10:24:46.258 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.257+0000 7feb9367f640 1 -- start start 2024-04-23T10:24:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9367f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9367f640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9367f640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7feb8c0c4e80 con 0x7feb8c155300 2024-04-23T10:24:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9367f640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7feb8c0c4230 con 0x7feb8c06f700 2024-04-23T10:24:46.259 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9367f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c0c5770 con 0x7feb8c15ee20 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb91c1c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:46344/0 (socket says 172.21.15.26:46344) 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb9141b640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7feb8c155300 0x7feb8c15e710 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:46566/0 (socket says 172.21.15.26:46566) 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb91c1c640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:43166/0 (socket says 172.21.15.26:43166) 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 -- 172.21.15.26:0/855125179 learned_addr learned my addr 172.21.15.26:0/855125179 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 -- 172.21.15.26:0/855125179 >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 msgr2=0x7feb8c0c6f70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 --2- 172.21.15.26:0/855125179 >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.260 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 -- 172.21.15.26:0/855125179 >> v1:172.21.15.190:6789/0 conn(0x7feb8c155300 legacy=0x7feb8c15e710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb90c1a640 1 -- 172.21.15.26:0/855125179 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c15f320 con 0x7feb8c15ee20 2024-04-23T10:24:46.261 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.261+0000 7feb91c1c640 1 --2- 172.21.15.26:0/855125179 >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:24:46.262 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- 172.21.15.26:0/855125179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009870 tx=0x7feb7c01c560 comp rx=0 tx=0).ready entity=mon.2 client_cookie=bf2b41f46543ff75 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb83fff640 1 -- 172.21.15.26:0/855125179 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0ab650 con 0x7feb8c15ee20 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb83fff640 1 -- 172.21.15.26:0/855125179 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0b0070 con 0x7feb8c15ee20 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb83fff640 1 -- 172.21.15.26:0/855125179 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0aba10 con 0x7feb8c15ee20 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/855125179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 msgr2=0x7feb8c0c3cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- 172.21.15.26:0/855125179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7feb7c009870 tx=0x7feb7c01c560 comp rx=0 tx=0).stop 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/855125179 shutdown_connections 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- 172.21.15.26:0/855125179 >> v2:172.21.15.190:3300/0 conn(0x7feb8c06f700 0x7feb8c0c6f70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- 172.21.15.26:0/855125179 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c15ee20 0x7feb8c0c3cf0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/855125179 >> 172.21.15.26:0/855125179 conn(0x7feb8c06b9d0 msgr2=0x7feb8c06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:46.263 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/855125179 shutdown_connections 2024-04-23T10:24:46.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/855125179 wait complete. 2024-04-23T10:24:46.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 Processor -- start 2024-04-23T10:24:46.264 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- start start 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c06f700 0x7feb8c1567f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb8c15ee20 0x7feb8c15c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c0681d0 con 0x7feb8c155300 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7feb8c15f600 con 0x7feb8c15ee20 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7feb8c068350 con 0x7feb8c06f700 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.266 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:53330/0 (socket says 172.21.15.26:53330) 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 -- 172.21.15.26:0/2375424448 learned_addr learned my addr 172.21.15.26:0/2375424448 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9141b640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c06f700 0x7feb8c1567f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb91c1c640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb8c15ee20 0x7feb8c15c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 -- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c06f700 msgr2=0x7feb8c1567f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c06f700 0x7feb8c1567f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 -- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb8c15ee20 msgr2=0x7feb8c15c540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb8c15ee20 0x7feb8c15c540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 -- 172.21.15.26:0/2375424448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7feb8c1475d0 con 0x7feb8c155300 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb90c1a640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb7c01ac10 tx=0x7feb7c01ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0be5f0 con 0x7feb8c155300 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feb7c0be7b0 con 0x7feb8c155300 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7feb8c1478b0 con 0x7feb8c155300 2024-04-23T10:24:46.267 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7feb7c0beba0 con 0x7feb8c155300 2024-04-23T10:24:46.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.265+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7feb8c147e70 con 0x7feb8c155300 2024-04-23T10:24:46.268 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7feb8c075df0 con 0x7feb8c155300 2024-04-23T10:24:46.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7feb7c0b43f0 con 0x7feb8c155300 2024-04-23T10:24:46.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb81ffb640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 0x7feb7006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:24:46.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7feb7c1210d0 con 0x7feb8c155300 2024-04-23T10:24:46.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb9141b640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 0x7feb7006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:24:46.269 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.269+0000 7feb9141b640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 0x7feb7006a870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f70 tx=0x7feb88007cd0 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:24:46.271 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.273+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7feb7c016150 con 0x7feb8c155300 2024-04-23T10:24:46.428 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.429+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7feb8c06c4f0 con 0x7feb700683b0 2024-04-23T10:24:46.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.457+0000 7feb81ffb640 1 -- 172.21.15.26:0/2375424448 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+334424 (secure 0 0 0) 0x7feb8c06c4f0 con 0x7feb700683b0 2024-04-23T10:24:46.460 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:24:46.462 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:24:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.461+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 msgr2=0x7feb7006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.461+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 0x7feb7006a870 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7feb88000f70 tx=0x7feb88007cd0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.463 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.461+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 msgr2=0x7feb8c148950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.461+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7feb7c01ac10 tx=0x7feb7c01ada0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.461+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 shutdown_connections 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7feb700683b0 0x7feb7006a870 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7feb8c15ee20 0x7feb8c15c540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7feb8c155300 0x7feb8c148950 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 --2- 172.21.15.26:0/2375424448 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7feb8c06f700 0x7feb8c1567f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 >> 172.21.15.26:0/2375424448 conn(0x7feb8c06b9d0 msgr2=0x7feb8c1536b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 shutdown_connections 2024-04-23T10:24:46.464 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:24:46.465+0000 7feb9367f640 1 -- 172.21.15.26:0/2375424448 wait complete. 2024-04-23T10:24:46.478 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":391,"stamp":"2024-04-23T10:24:45.211953+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":48930,"ondisk_log_size":48930,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":57666,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":13,"num_write_kb":66,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005214"},"pg_stats":[{"pgid":"2.1f","version":"26'118","reported_seq":148,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.924273+0000","last_change":"2024-04-23T10:12:34.048074+0000","last_active":"2024-04-23T10:24:27.924273+0000","last_peered":"2024-04-23T10:24:27.924273+0000","last_clean":"2024-04-23T10:24:27.924273+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:27.924273+0000","last_undegraded":"2024-04-23T10:24:27.924273+0000","last_fullsized":"2024-04-23T10:24:27.924273+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":118,"log_dups_size":0,"ondisk_log_size":118,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:09:13.432196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544970+0000","last_change":"2024-04-23T10:12:35.047731+0000","last_active":"2024-04-23T10:24:33.544970+0000","last_peered":"2024-04-23T10:24:33.544970+0000","last_clean":"2024-04-23T10:24:33.544970+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:33.544970+0000","last_undegraded":"2024-04-23T10:24:33.544970+0000","last_fullsized":"2024-04-23T10:24:33.544970+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:41:30.750807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":878,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.015013+0000","last_change":"2024-04-23T10:12:39.147718+0000","last_active":"2024-04-23T10:24:30.015013+0000","last_peered":"2024-04-23T10:24:30.015013+0000","last_clean":"2024-04-23T10:24:30.015013+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:24:30.015013+0000","last_undegraded":"2024-04-23T10:24:30.015013+0000","last_fullsized":"2024-04-23T10:24:30.015013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:33.196231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'473","reported_seq":504,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.079668+0000","last_change":"2024-04-23T10:12:34.042441+0000","last_active":"2024-04-23T10:24:25.079668+0000","last_peered":"2024-04-23T10:24:25.079668+0000","last_clean":"2024-04-23T10:24:25.079668+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:25.079668+0000","last_undegraded":"2024-04-23T10:24:25.079668+0000","last_fullsized":"2024-04-23T10:24:25.079668+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":473,"log_dups_size":0,"ondisk_log_size":473,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:50.978162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.548547+0000","last_change":"2024-04-23T10:12:35.028938+0000","last_active":"2024-04-23T10:24:33.548547+0000","last_peered":"2024-04-23T10:24:33.548547+0000","last_clean":"2024-04-23T10:24:33.548547+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:33.548547+0000","last_undegraded":"2024-04-23T10:24:33.548547+0000","last_fullsized":"2024-04-23T10:24:33.548547+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:54.781296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":913,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.010030+0000","last_change":"2024-04-23T10:12:39.100704+0000","last_active":"2024-04-23T10:24:30.010030+0000","last_peered":"2024-04-23T10:24:30.010030+0000","last_clean":"2024-04-23T10:24:30.010030+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:30.010030+0000","last_undegraded":"2024-04-23T10:24:30.010030+0000","last_fullsized":"2024-04-23T10:24:30.010030+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:59:14.947542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'340","reported_seq":370,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.049614+0000","last_change":"2024-04-23T10:12:34.051435+0000","last_active":"2024-04-23T10:24:29.049614+0000","last_peered":"2024-04-23T10:24:29.049614+0000","last_clean":"2024-04-23T10:24:29.049614+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:29.049614+0000","last_undegraded":"2024-04-23T10:24:29.049614+0000","last_fullsized":"2024-04-23T10:24:29.049614+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":340,"log_dups_size":0,"ondisk_log_size":340,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:54:56.313690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":218,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484064+0000","last_change":"2024-04-23T10:12:35.020848+0000","last_active":"2024-04-23T10:24:33.484064+0000","last_peered":"2024-04-23T10:24:33.484064+0000","last_clean":"2024-04-23T10:24:33.484064+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:33.484064+0000","last_undegraded":"2024-04-23T10:24:33.484064+0000","last_fullsized":"2024-04-23T10:24:33.484064+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:47.907255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":861,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.979936+0000","last_change":"2024-04-23T10:12:39.101184+0000","last_active":"2024-04-23T10:24:29.979936+0000","last_peered":"2024-04-23T10:24:29.979936+0000","last_clean":"2024-04-23T10:24:29.979936+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:29.979936+0000","last_undegraded":"2024-04-23T10:24:29.979936+0000","last_fullsized":"2024-04-23T10:24:29.979936+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:10.087949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'280","reported_seq":310,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.005526+0000","last_change":"2024-04-23T10:12:34.047704+0000","last_active":"2024-04-23T10:24:28.005526+0000","last_peered":"2024-04-23T10:24:28.005526+0000","last_clean":"2024-04-23T10:24:28.005526+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:28.005526+0000","last_undegraded":"2024-04-23T10:24:28.005526+0000","last_fullsized":"2024-04-23T10:24:28.005526+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":280,"log_dups_size":0,"ondisk_log_size":280,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:42.145966+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.484949+0000","last_change":"2024-04-23T10:12:35.033719+0000","last_active":"2024-04-23T10:24:33.484949+0000","last_peered":"2024-04-23T10:24:33.484949+0000","last_clean":"2024-04-23T10:24:33.484949+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:24:33.484949+0000","last_undegraded":"2024-04-23T10:24:33.484949+0000","last_fullsized":"2024-04-23T10:24:33.484949+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:16.033080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":846,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.936877+0000","last_change":"2024-04-23T10:12:39.083391+0000","last_active":"2024-04-23T10:24:29.936877+0000","last_peered":"2024-04-23T10:24:29.936877+0000","last_clean":"2024-04-23T10:24:29.936877+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:29.936877+0000","last_undegraded":"2024-04-23T10:24:29.936877+0000","last_fullsized":"2024-04-23T10:24:29.936877+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:41.295781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.472721+0000","last_change":"2024-04-23T10:12:35.037010+0000","last_active":"2024-04-23T10:24:33.472721+0000","last_peered":"2024-04-23T10:24:33.472721+0000","last_clean":"2024-04-23T10:24:33.472721+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:33.472721+0000","last_undegraded":"2024-04-23T10:24:33.472721+0000","last_fullsized":"2024-04-23T10:24:33.472721+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:55:26.140636+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'179","reported_seq":210,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.873263+0000","last_change":"2024-04-23T10:12:34.046179+0000","last_active":"2024-04-23T10:24:25.873263+0000","last_peered":"2024-04-23T10:24:25.873263+0000","last_clean":"2024-04-23T10:24:25.873263+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:25.873263+0000","last_undegraded":"2024-04-23T10:24:25.873263+0000","last_fullsized":"2024-04-23T10:24:25.873263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":179,"log_dups_size":0,"ondisk_log_size":179,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:33:01.709624+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":917,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060435+0000","last_change":"2024-04-23T10:13:16.029363+0000","last_active":"2024-04-23T10:24:29.060435+0000","last_peered":"2024-04-23T10:24:29.060435+0000","last_clean":"2024-04-23T10:24:29.060435+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:29.060435+0000","last_undegraded":"2024-04-23T10:24:29.060435+0000","last_fullsized":"2024-04-23T10:24:29.060435+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:18:32.314654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560764+0000","last_change":"2024-04-23T10:12:35.031098+0000","last_active":"2024-04-23T10:24:33.560764+0000","last_peered":"2024-04-23T10:24:33.560764+0000","last_clean":"2024-04-23T10:24:33.560764+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:33.560764+0000","last_undegraded":"2024-04-23T10:24:33.560764+0000","last_fullsized":"2024-04-23T10:24:33.560764+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:37:38.423881+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'218","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.053169+0000","last_change":"2024-04-23T10:12:34.036649+0000","last_active":"2024-04-23T10:24:25.053169+0000","last_peered":"2024-04-23T10:24:25.053169+0000","last_clean":"2024-04-23T10:24:25.053169+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:25.053169+0000","last_undegraded":"2024-04-23T10:24:25.053169+0000","last_fullsized":"2024-04-23T10:24:25.053169+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:36:18.373061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":864,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917527+0000","last_change":"2024-04-23T10:12:39.101144+0000","last_active":"2024-04-23T10:24:29.917527+0000","last_peered":"2024-04-23T10:24:29.917527+0000","last_clean":"2024-04-23T10:24:29.917527+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:29.917527+0000","last_undegraded":"2024-04-23T10:24:29.917527+0000","last_fullsized":"2024-04-23T10:24:29.917527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:08.575915+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564275+0000","last_change":"2024-04-23T10:12:35.024609+0000","last_active":"2024-04-23T10:24:33.564275+0000","last_peered":"2024-04-23T10:24:33.564275+0000","last_clean":"2024-04-23T10:24:33.564275+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:33.564275+0000","last_undegraded":"2024-04-23T10:24:33.564275+0000","last_fullsized":"2024-04-23T10:24:33.564275+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:01:26.750679+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'67","reported_seq":98,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.882235+0000","last_change":"2024-04-23T10:12:34.044890+0000","last_active":"2024-04-23T10:24:23.882235+0000","last_peered":"2024-04-23T10:24:23.882235+0000","last_clean":"2024-04-23T10:24:23.882235+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:23.882235+0000","last_undegraded":"2024-04-23T10:24:23.882235+0000","last_fullsized":"2024-04-23T10:24:23.882235+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":67,"log_dups_size":0,"ondisk_log_size":67,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:11:48.500724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":833,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.004676+0000","last_change":"2024-04-23T10:12:39.141082+0000","last_active":"2024-04-23T10:24:30.004676+0000","last_peered":"2024-04-23T10:24:30.004676+0000","last_clean":"2024-04-23T10:24:30.004676+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:30.004676+0000","last_undegraded":"2024-04-23T10:24:30.004676+0000","last_fullsized":"2024-04-23T10:24:30.004676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:26:35.654417+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.469317+0000","last_change":"2024-04-23T10:12:35.021996+0000","last_active":"2024-04-23T10:24:33.469317+0000","last_peered":"2024-04-23T10:24:33.469317+0000","last_clean":"2024-04-23T10:24:33.469317+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:33.469317+0000","last_undegraded":"2024-04-23T10:24:33.469317+0000","last_fullsized":"2024-04-23T10:24:33.469317+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:04:58.572616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'475","reported_seq":506,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875874+0000","last_change":"2024-04-23T10:12:34.047229+0000","last_active":"2024-04-23T10:24:25.875874+0000","last_peered":"2024-04-23T10:24:25.875874+0000","last_clean":"2024-04-23T10:24:25.875874+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:25.875874+0000","last_undegraded":"2024-04-23T10:24:25.875874+0000","last_fullsized":"2024-04-23T10:24:25.875874+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":475,"log_dups_size":0,"ondisk_log_size":475,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:14:19.005721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":841,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.018213+0000","last_change":"2024-04-23T10:12:39.089936+0000","last_active":"2024-04-23T10:24:30.018213+0000","last_peered":"2024-04-23T10:24:30.018213+0000","last_clean":"2024-04-23T10:24:30.018213+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:30.018213+0000","last_undegraded":"2024-04-23T10:24:30.018213+0000","last_fullsized":"2024-04-23T10:24:30.018213+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:47:29.475715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560778+0000","last_change":"2024-04-23T10:12:35.028544+0000","last_active":"2024-04-23T10:24:33.560778+0000","last_peered":"2024-04-23T10:24:33.560778+0000","last_clean":"2024-04-23T10:24:33.560778+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:33.560778+0000","last_undegraded":"2024-04-23T10:24:33.560778+0000","last_fullsized":"2024-04-23T10:24:33.560778+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:12:35.419054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'80","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:27.943277+0000","last_change":"2024-04-23T10:12:34.049066+0000","last_active":"2024-04-23T10:24:27.943277+0000","last_peered":"2024-04-23T10:24:27.943277+0000","last_clean":"2024-04-23T10:24:27.943277+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:27.943277+0000","last_undegraded":"2024-04-23T10:24:27.943277+0000","last_fullsized":"2024-04-23T10:24:27.943277+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":80,"log_dups_size":0,"ondisk_log_size":80,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:57:07.542594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":960,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.945497+0000","last_change":"2024-04-23T10:12:39.141101+0000","last_active":"2024-04-23T10:24:29.945497+0000","last_peered":"2024-04-23T10:24:29.945497+0000","last_clean":"2024-04-23T10:24:29.945497+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:29.945497+0000","last_undegraded":"2024-04-23T10:24:29.945497+0000","last_fullsized":"2024-04-23T10:24:29.945497+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:15:34.394746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":190,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541259+0000","last_change":"2024-04-23T10:13:16.572546+0000","last_active":"2024-04-23T10:24:33.541259+0000","last_peered":"2024-04-23T10:24:33.541259+0000","last_clean":"2024-04-23T10:24:33.541259+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:33.541259+0000","last_undegraded":"2024-04-23T10:24:33.541259+0000","last_fullsized":"2024-04-23T10:24:33.541259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:21:43.770054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'476","reported_seq":507,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.750104+0000","last_change":"2024-04-23T10:12:34.051765+0000","last_active":"2024-04-23T10:24:30.750104+0000","last_peered":"2024-04-23T10:24:30.750104+0000","last_clean":"2024-04-23T10:24:30.750104+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:30.750104+0000","last_undegraded":"2024-04-23T10:24:30.750104+0000","last_fullsized":"2024-04-23T10:24:30.750104+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":476,"log_dups_size":0,"ondisk_log_size":476,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:46:58.763955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.105305+0000","last_change":"2024-04-23T10:13:16.891510+0000","last_active":"2024-04-23T10:24:29.105305+0000","last_peered":"2024-04-23T10:24:29.105305+0000","last_clean":"2024-04-23T10:24:29.105305+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:29.105305+0000","last_undegraded":"2024-04-23T10:24:29.105305+0000","last_fullsized":"2024-04-23T10:24:29.105305+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:49:32.803809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.435786+0000","last_change":"2024-04-23T10:12:35.024849+0000","last_active":"2024-04-23T10:24:33.435786+0000","last_peered":"2024-04-23T10:24:33.435786+0000","last_clean":"2024-04-23T10:24:33.435786+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:33.435786+0000","last_undegraded":"2024-04-23T10:24:33.435786+0000","last_fullsized":"2024-04-23T10:24:33.435786+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:57:06.992715+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'228","reported_seq":259,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.015506+0000","last_change":"2024-04-23T10:12:34.048733+0000","last_active":"2024-04-23T10:24:25.015506+0000","last_peered":"2024-04-23T10:24:25.015506+0000","last_clean":"2024-04-23T10:24:25.015506+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:25.015506+0000","last_undegraded":"2024-04-23T10:24:25.015506+0000","last_fullsized":"2024-04-23T10:24:25.015506+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":228,"log_dups_size":0,"ondisk_log_size":228,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:02.783698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":783,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.009539+0000","last_change":"2024-04-23T10:12:39.136827+0000","last_active":"2024-04-23T10:24:30.009539+0000","last_peered":"2024-04-23T10:24:30.009539+0000","last_clean":"2024-04-23T10:24:30.009539+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:30.009539+0000","last_undegraded":"2024-04-23T10:24:30.009539+0000","last_fullsized":"2024-04-23T10:24:30.009539+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:43:38.436474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549700+0000","last_change":"2024-04-23T10:12:35.031635+0000","last_active":"2024-04-23T10:24:33.549700+0000","last_peered":"2024-04-23T10:24:33.549700+0000","last_clean":"2024-04-23T10:24:33.549700+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:33.549700+0000","last_undegraded":"2024-04-23T10:24:33.549700+0000","last_fullsized":"2024-04-23T10:24:33.549700+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:43.875593+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":96,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:25.875263+0000","last_change":"2024-04-23T10:12:34.034528+0000","last_active":"2024-04-23T10:24:25.875263+0000","last_peered":"2024-04-23T10:24:25.875263+0000","last_clean":"2024-04-23T10:24:25.875263+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:25.875263+0000","last_undegraded":"2024-04-23T10:24:25.875263+0000","last_fullsized":"2024-04-23T10:24:25.875263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:28:09.296690+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":892,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.949787+0000","last_change":"2024-04-23T10:12:39.090479+0000","last_active":"2024-04-23T10:24:29.949787+0000","last_peered":"2024-04-23T10:24:29.949787+0000","last_clean":"2024-04-23T10:24:29.949787+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:29.949787+0000","last_undegraded":"2024-04-23T10:24:29.949787+0000","last_fullsized":"2024-04-23T10:24:29.949787+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:24:40.769556+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560629+0000","last_change":"2024-04-23T10:12:35.030491+0000","last_active":"2024-04-23T10:24:33.560629+0000","last_peered":"2024-04-23T10:24:33.560629+0000","last_clean":"2024-04-23T10:24:33.560629+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:33.560629+0000","last_undegraded":"2024-04-23T10:24:33.560629+0000","last_fullsized":"2024-04-23T10:24:33.560629+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:43:32.009311+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1260","reported_seq":1291,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:15.892836+0000","last_change":"2024-04-23T10:12:34.040545+0000","last_active":"2024-04-23T10:24:15.892836+0000","last_peered":"2024-04-23T10:24:15.892836+0000","last_clean":"2024-04-23T10:24:15.892836+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:15.892836+0000","last_undegraded":"2024-04-23T10:24:15.892836+0000","last_fullsized":"2024-04-23T10:24:15.892836+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1260,"log_dups_size":0,"ondisk_log_size":1260,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:36:35.729565+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.038327+0000","last_change":"2024-04-23T10:12:39.090430+0000","last_active":"2024-04-23T10:24:30.038327+0000","last_peered":"2024-04-23T10:24:30.038327+0000","last_clean":"2024-04-23T10:24:30.038327+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:30.038327+0000","last_undegraded":"2024-04-23T10:24:30.038327+0000","last_fullsized":"2024-04-23T10:24:30.038327+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:25:18.883799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.439036+0000","last_change":"2024-04-23T10:12:35.024777+0000","last_active":"2024-04-23T10:24:33.439036+0000","last_peered":"2024-04-23T10:24:33.439036+0000","last_clean":"2024-04-23T10:24:33.439036+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:33.439036+0000","last_undegraded":"2024-04-23T10:24:33.439036+0000","last_fullsized":"2024-04-23T10:24:33.439036+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:15.109613+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'678","reported_seq":1305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:31.909387+0000","last_change":"2024-04-23T10:12:34.029262+0000","last_active":"2024-04-23T10:24:31.909387+0000","last_peered":"2024-04-23T10:24:31.909387+0000","last_clean":"2024-04-23T10:24:31.909387+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:31.909387+0000","last_undegraded":"2024-04-23T10:24:31.909387+0000","last_fullsized":"2024-04-23T10:24:31.909387+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":678,"log_dups_size":0,"ondisk_log_size":678,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:40:53.545320+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":880,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.961324+0000","last_change":"2024-04-23T10:12:39.084451+0000","last_active":"2024-04-23T10:24:29.961324+0000","last_peered":"2024-04-23T10:24:29.961324+0000","last_clean":"2024-04-23T10:24:29.961324+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:29.961324+0000","last_undegraded":"2024-04-23T10:24:29.961324+0000","last_fullsized":"2024-04-23T10:24:29.961324+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:28:28.683843+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551035+0000","last_change":"2024-04-23T10:12:35.039385+0000","last_active":"2024-04-23T10:24:33.551035+0000","last_peered":"2024-04-23T10:24:33.551035+0000","last_clean":"2024-04-23T10:24:33.551035+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:33.551035+0000","last_undegraded":"2024-04-23T10:24:33.551035+0000","last_fullsized":"2024-04-23T10:24:33.551035+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:27:31.323883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'821","reported_seq":853,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.130128+0000","last_change":"2024-04-23T10:12:34.047396+0000","last_active":"2024-04-23T10:24:28.130128+0000","last_peered":"2024-04-23T10:24:28.130128+0000","last_clean":"2024-04-23T10:24:28.130128+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:28.130128+0000","last_undegraded":"2024-04-23T10:24:28.130128+0000","last_fullsized":"2024-04-23T10:24:28.130128+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":821,"log_dups_size":0,"ondisk_log_size":821,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.879616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":985,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.968924+0000","last_change":"2024-04-23T10:13:16.574008+0000","last_active":"2024-04-23T10:24:29.968924+0000","last_peered":"2024-04-23T10:24:29.968924+0000","last_clean":"2024-04-23T10:24:29.968924+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:29.968924+0000","last_undegraded":"2024-04-23T10:24:29.968924+0000","last_fullsized":"2024-04-23T10:24:29.968924+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:57:57.257058+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.543989+0000","last_change":"2024-04-23T10:12:35.025278+0000","last_active":"2024-04-23T10:24:33.543989+0000","last_peered":"2024-04-23T10:24:33.543989+0000","last_clean":"2024-04-23T10:24:33.543989+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:33.543989+0000","last_undegraded":"2024-04-23T10:24:33.543989+0000","last_fullsized":"2024-04-23T10:24:33.543989+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:42:13.400028+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'74","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.060231+0000","last_change":"2024-04-23T10:12:34.027132+0000","last_active":"2024-04-23T10:24:29.060231+0000","last_peered":"2024-04-23T10:24:29.060231+0000","last_clean":"2024-04-23T10:24:29.060231+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:29.060231+0000","last_undegraded":"2024-04-23T10:24:29.060231+0000","last_fullsized":"2024-04-23T10:24:29.060231+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:58:54.117110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"16'117","reported_seq":188,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:22:26.305857+0000","last_change":"2024-04-23T10:12:23.220636+0000","last_active":"2024-04-23T10:22:26.305857+0000","last_peered":"2024-04-23T10:22:26.305857+0000","last_clean":"2024-04-23T10:22:26.305857+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:22:26.305857+0000","last_undegraded":"2024-04-23T10:22:26.305857+0000","last_fullsized":"2024-04-23T10:22:26.305857+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:21.816533+0000","last_clean_scrub_stamp":"2024-04-23T10:12:21.816533+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:33:02.095877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":912,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.984831+0000","last_change":"2024-04-23T10:12:39.147231+0000","last_active":"2024-04-23T10:24:29.984831+0000","last_peered":"2024-04-23T10:24:29.984831+0000","last_clean":"2024-04-23T10:24:29.984831+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:29.984831+0000","last_undegraded":"2024-04-23T10:24:29.984831+0000","last_fullsized":"2024-04-23T10:24:29.984831+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:31:11.337150+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502905+0000","last_change":"2024-04-23T10:12:35.034818+0000","last_active":"2024-04-23T10:24:33.502905+0000","last_peered":"2024-04-23T10:24:33.502905+0000","last_clean":"2024-04-23T10:24:33.502905+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:33.502905+0000","last_undegraded":"2024-04-23T10:24:33.502905+0000","last_fullsized":"2024-04-23T10:24:33.502905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:52:33.104722+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'69","reported_seq":99,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.940375+0000","last_change":"2024-04-23T10:12:34.031427+0000","last_active":"2024-04-23T10:24:29.940375+0000","last_peered":"2024-04-23T10:24:29.940375+0000","last_clean":"2024-04-23T10:24:29.940375+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:29.940375+0000","last_undegraded":"2024-04-23T10:24:29.940375+0000","last_fullsized":"2024-04-23T10:24:29.940375+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:59:51.072578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.922885+0000","last_change":"2024-04-23T10:12:39.141477+0000","last_active":"2024-04-23T10:24:29.922885+0000","last_peered":"2024-04-23T10:24:29.922885+0000","last_clean":"2024-04-23T10:24:29.922885+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:29.922885+0000","last_undegraded":"2024-04-23T10:24:29.922885+0000","last_fullsized":"2024-04-23T10:24:29.922885+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:29:18.286583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.553149+0000","last_change":"2024-04-23T10:12:35.029890+0000","last_active":"2024-04-23T10:24:33.553149+0000","last_peered":"2024-04-23T10:24:33.553149+0000","last_clean":"2024-04-23T10:24:33.553149+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:33.553149+0000","last_undegraded":"2024-04-23T10:24:33.553149+0000","last_fullsized":"2024-04-23T10:24:33.553149+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:52.666819+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'596","reported_seq":627,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.987525+0000","last_change":"2024-04-23T10:12:34.043407+0000","last_active":"2024-04-23T10:24:24.987525+0000","last_peered":"2024-04-23T10:24:24.987525+0000","last_clean":"2024-04-23T10:24:24.987525+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:24.987525+0000","last_undegraded":"2024-04-23T10:24:24.987525+0000","last_fullsized":"2024-04-23T10:24:24.987525+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":596,"log_dups_size":0,"ondisk_log_size":596,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:45:20.357651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1010,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.136676+0000","last_change":"2024-04-23T10:12:39.094214+0000","last_active":"2024-04-23T10:24:29.136676+0000","last_peered":"2024-04-23T10:24:29.136676+0000","last_clean":"2024-04-23T10:24:29.136676+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:29.136676+0000","last_undegraded":"2024-04-23T10:24:29.136676+0000","last_fullsized":"2024-04-23T10:24:29.136676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:35:43.105637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.507457+0000","last_change":"2024-04-23T10:12:35.040753+0000","last_active":"2024-04-23T10:24:33.507457+0000","last_peered":"2024-04-23T10:24:33.507457+0000","last_clean":"2024-04-23T10:24:33.507457+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:33.507457+0000","last_undegraded":"2024-04-23T10:24:33.507457+0000","last_fullsized":"2024-04-23T10:24:33.507457+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:37:14.791167+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'411","reported_seq":441,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:18.824761+0000","last_change":"2024-04-23T10:12:34.029683+0000","last_active":"2024-04-23T10:24:18.824761+0000","last_peered":"2024-04-23T10:24:18.824761+0000","last_clean":"2024-04-23T10:24:18.824761+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:18.824761+0000","last_undegraded":"2024-04-23T10:24:18.824761+0000","last_fullsized":"2024-04-23T10:24:18.824761+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":411,"log_dups_size":0,"ondisk_log_size":411,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:16:24.683253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":920,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.019063+0000","last_change":"2024-04-23T10:12:39.137520+0000","last_active":"2024-04-23T10:24:30.019063+0000","last_peered":"2024-04-23T10:24:30.019063+0000","last_clean":"2024-04-23T10:24:30.019063+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:24:30.019063+0000","last_undegraded":"2024-04-23T10:24:30.019063+0000","last_fullsized":"2024-04-23T10:24:30.019063+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:24:04.401888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":212,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502372+0000","last_change":"2024-04-23T10:12:35.040959+0000","last_active":"2024-04-23T10:24:33.502372+0000","last_peered":"2024-04-23T10:24:33.502372+0000","last_clean":"2024-04-23T10:24:33.502372+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:24:33.502372+0000","last_undegraded":"2024-04-23T10:24:33.502372+0000","last_fullsized":"2024-04-23T10:24:33.502372+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:23:14.735371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'184","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.124538+0000","last_change":"2024-04-23T10:12:34.030575+0000","last_active":"2024-04-23T10:24:29.124538+0000","last_peered":"2024-04-23T10:24:29.124538+0000","last_clean":"2024-04-23T10:24:29.124538+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:29.124538+0000","last_undegraded":"2024-04-23T10:24:29.124538+0000","last_fullsized":"2024-04-23T10:24:29.124538+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":184,"log_dups_size":0,"ondisk_log_size":184,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:24:27.708358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.022137+0000","last_change":"2024-04-23T10:12:39.102360+0000","last_active":"2024-04-23T10:24:30.022137+0000","last_peered":"2024-04-23T10:24:30.022137+0000","last_clean":"2024-04-23T10:24:30.022137+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:30.022137+0000","last_undegraded":"2024-04-23T10:24:30.022137+0000","last_fullsized":"2024-04-23T10:24:30.022137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:34.895438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":264,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.498935+0000","last_change":"2024-04-23T10:12:35.041313+0000","last_active":"2024-04-23T10:24:33.498935+0000","last_peered":"2024-04-23T10:24:33.498935+0000","last_clean":"2024-04-23T10:24:33.498935+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:33.498935+0000","last_undegraded":"2024-04-23T10:24:33.498935+0000","last_fullsized":"2024-04-23T10:24:33.498935+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:09.335522+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'235","reported_seq":265,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:34.310965+0000","last_change":"2024-04-23T10:12:34.023082+0000","last_active":"2024-04-23T10:24:34.310965+0000","last_peered":"2024-04-23T10:24:34.310965+0000","last_clean":"2024-04-23T10:24:34.310965+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:34.310965+0000","last_undegraded":"2024-04-23T10:24:34.310965+0000","last_fullsized":"2024-04-23T10:24:34.310965+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:48.716292+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":891,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.976890+0000","last_change":"2024-04-23T10:12:39.094627+0000","last_active":"2024-04-23T10:24:29.976890+0000","last_peered":"2024-04-23T10:24:29.976890+0000","last_clean":"2024-04-23T10:24:29.976890+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:29.976890+0000","last_undegraded":"2024-04-23T10:24:29.976890+0000","last_fullsized":"2024-04-23T10:24:29.976890+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:46:40.742433+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559222+0000","last_change":"2024-04-23T10:12:35.031423+0000","last_active":"2024-04-23T10:24:33.559222+0000","last_peered":"2024-04-23T10:24:33.559222+0000","last_clean":"2024-04-23T10:24:33.559222+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:33.559222+0000","last_undegraded":"2024-04-23T10:24:33.559222+0000","last_fullsized":"2024-04-23T10:24:33.559222+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:19:19.638735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'75","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:21.921579+0000","last_change":"2024-04-23T10:12:34.054940+0000","last_active":"2024-04-23T10:24:21.921579+0000","last_peered":"2024-04-23T10:24:21.921579+0000","last_clean":"2024-04-23T10:24:21.921579+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:21.921579+0000","last_undegraded":"2024-04-23T10:24:21.921579+0000","last_fullsized":"2024-04-23T10:24:21.921579+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:16:26.567078+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.138272+0000","last_change":"2024-04-23T10:12:39.140743+0000","last_active":"2024-04-23T10:24:29.138272+0000","last_peered":"2024-04-23T10:24:29.138272+0000","last_clean":"2024-04-23T10:24:29.138272+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:29.138272+0000","last_undegraded":"2024-04-23T10:24:29.138272+0000","last_fullsized":"2024-04-23T10:24:29.138272+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:21:24.788408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":231,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504309+0000","last_change":"2024-04-23T10:12:35.040926+0000","last_active":"2024-04-23T10:24:33.504309+0000","last_peered":"2024-04-23T10:24:33.504309+0000","last_clean":"2024-04-23T10:24:33.504309+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:33.504309+0000","last_undegraded":"2024-04-23T10:24:33.504309+0000","last_fullsized":"2024-04-23T10:24:33.504309+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.628467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'72","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.905924+0000","last_change":"2024-04-23T10:12:34.032332+0000","last_active":"2024-04-23T10:24:29.905924+0000","last_peered":"2024-04-23T10:24:29.905924+0000","last_clean":"2024-04-23T10:24:29.905924+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:29.905924+0000","last_undegraded":"2024-04-23T10:24:29.905924+0000","last_fullsized":"2024-04-23T10:24:29.905924+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:07:41.349208+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":817,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.954554+0000","last_change":"2024-04-23T10:12:39.137312+0000","last_active":"2024-04-23T10:24:29.954554+0000","last_peered":"2024-04-23T10:24:29.954554+0000","last_clean":"2024-04-23T10:24:29.954554+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:29.954554+0000","last_undegraded":"2024-04-23T10:24:29.954554+0000","last_fullsized":"2024-04-23T10:24:29.954554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:02:01.370956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.558092+0000","last_change":"2024-04-23T10:12:35.046110+0000","last_active":"2024-04-23T10:24:33.558092+0000","last_peered":"2024-04-23T10:24:33.558092+0000","last_clean":"2024-04-23T10:24:33.558092+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:33.558092+0000","last_undegraded":"2024-04-23T10:24:33.558092+0000","last_fullsized":"2024-04-23T10:24:33.558092+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:44:07.691043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'560","reported_seq":590,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:16.384742+0000","last_change":"2024-04-23T10:12:34.036933+0000","last_active":"2024-04-23T10:24:16.384742+0000","last_peered":"2024-04-23T10:24:16.384742+0000","last_clean":"2024-04-23T10:24:16.384742+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:16.384742+0000","last_undegraded":"2024-04-23T10:24:16.384742+0000","last_fullsized":"2024-04-23T10:24:16.384742+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":560,"log_dups_size":0,"ondisk_log_size":560,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:16:59.860711+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":849,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.035161+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:24:30.035161+0000","last_peered":"2024-04-23T10:24:30.035161+0000","last_clean":"2024-04-23T10:24:30.035161+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:24:30.035161+0000","last_undegraded":"2024-04-23T10:24:30.035161+0000","last_fullsized":"2024-04-23T10:24:30.035161+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:46:27.861358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554954+0000","last_change":"2024-04-23T10:12:35.044724+0000","last_active":"2024-04-23T10:24:33.554954+0000","last_peered":"2024-04-23T10:24:33.554954+0000","last_clean":"2024-04-23T10:24:33.554954+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:24:33.554954+0000","last_undegraded":"2024-04-23T10:24:33.554954+0000","last_fullsized":"2024-04-23T10:24:33.554954+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:00:18.880671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'413","reported_seq":444,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:23.015396+0000","last_change":"2024-04-23T10:12:34.048988+0000","last_active":"2024-04-23T10:24:23.015396+0000","last_peered":"2024-04-23T10:24:23.015396+0000","last_clean":"2024-04-23T10:24:23.015396+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:23.015396+0000","last_undegraded":"2024-04-23T10:24:23.015396+0000","last_fullsized":"2024-04-23T10:24:23.015396+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":413,"log_dups_size":0,"ondisk_log_size":413,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:34:59.259326+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":839,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.935827+0000","last_change":"2024-04-23T10:12:39.102067+0000","last_active":"2024-04-23T10:24:29.935827+0000","last_peered":"2024-04-23T10:24:29.935827+0000","last_clean":"2024-04-23T10:24:29.935827+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:29.935827+0000","last_undegraded":"2024-04-23T10:24:29.935827+0000","last_fullsized":"2024-04-23T10:24:29.935827+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:27.529813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503506+0000","last_change":"2024-04-23T10:12:35.027896+0000","last_active":"2024-04-23T10:24:33.503506+0000","last_peered":"2024-04-23T10:24:33.503506+0000","last_clean":"2024-04-23T10:24:33.503506+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:33.503506+0000","last_undegraded":"2024-04-23T10:24:33.503506+0000","last_fullsized":"2024-04-23T10:24:33.503506+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:33:32.760952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'298","reported_seq":329,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:31.915295+0000","last_change":"2024-04-23T10:12:34.030291+0000","last_active":"2024-04-23T10:24:31.915295+0000","last_peered":"2024-04-23T10:24:31.915295+0000","last_clean":"2024-04-23T10:24:31.915295+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:31.915295+0000","last_undegraded":"2024-04-23T10:24:31.915295+0000","last_fullsized":"2024-04-23T10:24:31.915295+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":298,"log_dups_size":0,"ondisk_log_size":298,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:47:38.224160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":829,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.978436+0000","last_change":"2024-04-23T10:12:39.091624+0000","last_active":"2024-04-23T10:24:29.978436+0000","last_peered":"2024-04-23T10:24:29.978436+0000","last_clean":"2024-04-23T10:24:29.978436+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:29.978436+0000","last_undegraded":"2024-04-23T10:24:29.978436+0000","last_fullsized":"2024-04-23T10:24:29.978436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:01:25.136414+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551606+0000","last_change":"2024-04-23T10:13:16.891269+0000","last_active":"2024-04-23T10:24:33.551606+0000","last_peered":"2024-04-23T10:24:33.551606+0000","last_clean":"2024-04-23T10:24:33.551606+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:33.551606+0000","last_undegraded":"2024-04-23T10:24:33.551606+0000","last_fullsized":"2024-04-23T10:24:33.551606+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:16:31.365499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'274","reported_seq":305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.087224+0000","last_change":"2024-04-23T10:12:34.051736+0000","last_active":"2024-04-23T10:24:29.087224+0000","last_peered":"2024-04-23T10:24:29.087224+0000","last_clean":"2024-04-23T10:24:29.087224+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:29.087224+0000","last_undegraded":"2024-04-23T10:24:29.087224+0000","last_fullsized":"2024-04-23T10:24:29.087224+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":274,"log_dups_size":0,"ondisk_log_size":274,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:33:57.663281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":914,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.029718+0000","last_change":"2024-04-23T10:12:39.097105+0000","last_active":"2024-04-23T10:24:30.029718+0000","last_peered":"2024-04-23T10:24:30.029718+0000","last_clean":"2024-04-23T10:24:30.029718+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:30.029718+0000","last_undegraded":"2024-04-23T10:24:30.029718+0000","last_fullsized":"2024-04-23T10:24:30.029718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:09:37.822000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.503295+0000","last_change":"2024-04-23T10:12:35.029298+0000","last_active":"2024-04-23T10:24:33.503295+0000","last_peered":"2024-04-23T10:24:33.503295+0000","last_clean":"2024-04-23T10:24:33.503295+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:33.503295+0000","last_undegraded":"2024-04-23T10:24:33.503295+0000","last_fullsized":"2024-04-23T10:24:33.503295+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:35:16.538604+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'72","reported_seq":103,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.397964+0000","last_change":"2024-04-23T10:12:34.054361+0000","last_active":"2024-04-23T10:24:33.397964+0000","last_peered":"2024-04-23T10:24:33.397964+0000","last_clean":"2024-04-23T10:24:33.397964+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:33.397964+0000","last_undegraded":"2024-04-23T10:24:33.397964+0000","last_fullsized":"2024-04-23T10:24:33.397964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:31:45.371684+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":931,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.026126+0000","last_change":"2024-04-23T10:12:39.147411+0000","last_active":"2024-04-23T10:24:30.026126+0000","last_peered":"2024-04-23T10:24:30.026126+0000","last_clean":"2024-04-23T10:24:30.026126+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:30.026126+0000","last_undegraded":"2024-04-23T10:24:30.026126+0000","last_fullsized":"2024-04-23T10:24:30.026126+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:07:57.948767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:30.019528+0000","last_change":"2024-04-23T10:12:39.146346+0000","last_active":"2024-04-23T10:24:30.019528+0000","last_peered":"2024-04-23T10:24:30.019528+0000","last_clean":"2024-04-23T10:24:30.019528+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:30.019528+0000","last_undegraded":"2024-04-23T10:24:30.019528+0000","last_fullsized":"2024-04-23T10:24:30.019528+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:47:43.805555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.562436+0000","last_change":"2024-04-23T10:12:35.027396+0000","last_active":"2024-04-23T10:24:33.562436+0000","last_peered":"2024-04-23T10:24:33.562436+0000","last_clean":"2024-04-23T10:24:33.562436+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:33.562436+0000","last_undegraded":"2024-04-23T10:24:33.562436+0000","last_fullsized":"2024-04-23T10:24:33.562436+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:48.087768+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1046","reported_seq":1077,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917241+0000","last_change":"2024-04-23T10:12:34.031232+0000","last_active":"2024-04-23T10:24:29.917241+0000","last_peered":"2024-04-23T10:24:29.917241+0000","last_clean":"2024-04-23T10:24:29.917241+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:29.917241+0000","last_undegraded":"2024-04-23T10:24:29.917241+0000","last_fullsized":"2024-04-23T10:24:29.917241+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":1046,"log_dups_size":0,"ondisk_log_size":1046,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:32:20.185964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":797,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:28.993724+0000","last_change":"2024-04-23T10:12:39.105535+0000","last_active":"2024-04-23T10:24:28.993724+0000","last_peered":"2024-04-23T10:24:28.993724+0000","last_clean":"2024-04-23T10:24:28.993724+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:28.993724+0000","last_undegraded":"2024-04-23T10:24:28.993724+0000","last_fullsized":"2024-04-23T10:24:28.993724+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:16.880377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554764+0000","last_change":"2024-04-23T10:13:16.027915+0000","last_active":"2024-04-23T10:24:33.554764+0000","last_peered":"2024-04-23T10:24:33.554764+0000","last_clean":"2024-04-23T10:24:33.554764+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:33.554764+0000","last_undegraded":"2024-04-23T10:24:33.554764+0000","last_fullsized":"2024-04-23T10:24:33.554764+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:22.650156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'152","reported_seq":182,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.917562+0000","last_change":"2024-04-23T10:12:34.038067+0000","last_active":"2024-04-23T10:24:29.917562+0000","last_peered":"2024-04-23T10:24:29.917562+0000","last_clean":"2024-04-23T10:24:29.917562+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:29.917562+0000","last_undegraded":"2024-04-23T10:24:29.917562+0000","last_fullsized":"2024-04-23T10:24:29.917562+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":152,"log_dups_size":0,"ondisk_log_size":152,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:48.648511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'373","reported_seq":403,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:22.944498+0000","last_change":"2024-04-23T10:12:34.055284+0000","last_active":"2024-04-23T10:24:22.944498+0000","last_peered":"2024-04-23T10:24:22.944498+0000","last_clean":"2024-04-23T10:24:22.944498+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:22.944498+0000","last_undegraded":"2024-04-23T10:24:22.944498+0000","last_fullsized":"2024-04-23T10:24:22.944498+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":373,"log_dups_size":0,"ondisk_log_size":373,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:40.524202+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":215,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564241+0000","last_change":"2024-04-23T10:12:35.037750+0000","last_active":"2024-04-23T10:24:33.564241+0000","last_peered":"2024-04-23T10:24:33.564241+0000","last_clean":"2024-04-23T10:24:33.564241+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:33.564241+0000","last_undegraded":"2024-04-23T10:24:33.564241+0000","last_fullsized":"2024-04-23T10:24:33.564241+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:39:00.529692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":801,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.960197+0000","last_change":"2024-04-23T10:12:39.080857+0000","last_active":"2024-04-23T10:24:29.960197+0000","last_peered":"2024-04-23T10:24:29.960197+0000","last_clean":"2024-04-23T10:24:29.960197+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:29.960197+0000","last_undegraded":"2024-04-23T10:24:29.960197+0000","last_fullsized":"2024-04-23T10:24:29.960197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:16:52.079440+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'112","reported_seq":141,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:24.927138+0000","last_change":"2024-04-23T10:12:34.032401+0000","last_active":"2024-04-23T10:24:24.927138+0000","last_peered":"2024-04-23T10:24:24.927138+0000","last_clean":"2024-04-23T10:24:24.927138+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:24.927138+0000","last_undegraded":"2024-04-23T10:24:24.927138+0000","last_fullsized":"2024-04-23T10:24:24.927138+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:32.983156+0000","last_clean_scrub_stamp":"2024-04-23T10:12:32.983156+0000","objects_scrubbed":0,"log_size":112,"log_dups_size":0,"ondisk_log_size":112,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:56:03.913974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":229,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473116+0000","last_change":"2024-04-23T10:12:35.019063+0000","last_active":"2024-04-23T10:24:33.473116+0000","last_peered":"2024-04-23T10:24:33.473116+0000","last_clean":"2024-04-23T10:24:33.473116+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:33.473116+0000","last_undegraded":"2024-04-23T10:24:33.473116+0000","last_fullsized":"2024-04-23T10:24:33.473116+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:51.848989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":874,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.131318+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:24:29.131318+0000","last_peered":"2024-04-23T10:24:29.131318+0000","last_clean":"2024-04-23T10:24:29.131318+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:24:29.131318+0000","last_undegraded":"2024-04-23T10:24:29.131318+0000","last_fullsized":"2024-04-23T10:24:29.131318+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:36.923567+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559932+0000","last_change":"2024-04-23T10:12:35.033084+0000","last_active":"2024-04-23T10:24:33.559932+0000","last_peered":"2024-04-23T10:24:33.559932+0000","last_clean":"2024-04-23T10:24:33.559932+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:33.559932+0000","last_undegraded":"2024-04-23T10:24:33.559932+0000","last_fullsized":"2024-04-23T10:24:33.559932+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:56:43.209295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.541987+0000","last_change":"2024-04-23T10:12:35.029336+0000","last_active":"2024-04-23T10:24:33.541987+0000","last_peered":"2024-04-23T10:24:33.541987+0000","last_clean":"2024-04-23T10:24:33.541987+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:33.541987+0000","last_undegraded":"2024-04-23T10:24:33.541987+0000","last_fullsized":"2024-04-23T10:24:33.541987+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:56.140758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":267,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549732+0000","last_change":"2024-04-23T10:12:35.026961+0000","last_active":"2024-04-23T10:24:33.549732+0000","last_peered":"2024-04-23T10:24:33.549732+0000","last_clean":"2024-04-23T10:24:33.549732+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:33.549732+0000","last_undegraded":"2024-04-23T10:24:33.549732+0000","last_fullsized":"2024-04-23T10:24:33.549732+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:19:24.107766+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.562847+0000","last_change":"2024-04-23T10:12:35.029617+0000","last_active":"2024-04-23T10:24:33.562847+0000","last_peered":"2024-04-23T10:24:33.562847+0000","last_clean":"2024-04-23T10:24:33.562847+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:33.562847+0000","last_undegraded":"2024-04-23T10:24:33.562847+0000","last_fullsized":"2024-04-23T10:24:33.562847+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:18:01.680362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":219,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.552147+0000","last_change":"2024-04-23T10:12:35.037049+0000","last_active":"2024-04-23T10:24:33.552147+0000","last_peered":"2024-04-23T10:24:33.552147+0000","last_clean":"2024-04-23T10:24:33.552147+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:33.552147+0000","last_undegraded":"2024-04-23T10:24:33.552147+0000","last_fullsized":"2024-04-23T10:24:33.552147+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:29:31.910914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560580+0000","last_change":"2024-04-23T10:12:35.026225+0000","last_active":"2024-04-23T10:24:33.560580+0000","last_peered":"2024-04-23T10:24:33.560580+0000","last_clean":"2024-04-23T10:24:33.560580+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:33.560580+0000","last_undegraded":"2024-04-23T10:24:33.560580+0000","last_fullsized":"2024-04-23T10:24:33.560580+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:21:05.692185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":275,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.502105+0000","last_change":"2024-04-23T10:12:35.045626+0000","last_active":"2024-04-23T10:24:33.502105+0000","last_peered":"2024-04-23T10:24:33.502105+0000","last_clean":"2024-04-23T10:24:33.502105+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:33.502105+0000","last_undegraded":"2024-04-23T10:24:33.502105+0000","last_fullsized":"2024-04-23T10:24:33.502105+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:59:53.363296+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.544972+0000","last_change":"2024-04-23T10:12:35.043827+0000","last_active":"2024-04-23T10:24:33.544972+0000","last_peered":"2024-04-23T10:24:33.544972+0000","last_clean":"2024-04-23T10:24:33.544972+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:33.544972+0000","last_undegraded":"2024-04-23T10:24:33.544972+0000","last_fullsized":"2024-04-23T10:24:33.544972+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:02:25.529712+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.549783+0000","last_change":"2024-04-23T10:12:35.026457+0000","last_active":"2024-04-23T10:24:33.549783+0000","last_peered":"2024-04-23T10:24:33.549783+0000","last_clean":"2024-04-23T10:24:33.549783+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:33.549783+0000","last_undegraded":"2024-04-23T10:24:33.549783+0000","last_fullsized":"2024-04-23T10:24:33.549783+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:50.621127+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.545594+0000","last_change":"2024-04-23T10:12:35.036915+0000","last_active":"2024-04-23T10:24:33.545594+0000","last_peered":"2024-04-23T10:24:33.545594+0000","last_clean":"2024-04-23T10:24:33.545594+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:33.545594+0000","last_undegraded":"2024-04-23T10:24:33.545594+0000","last_fullsized":"2024-04-23T10:24:33.545594+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:32:33.985352+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501556+0000","last_change":"2024-04-23T10:12:35.028799+0000","last_active":"2024-04-23T10:24:33.501556+0000","last_peered":"2024-04-23T10:24:33.501556+0000","last_clean":"2024-04-23T10:24:33.501556+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:33.501556+0000","last_undegraded":"2024-04-23T10:24:33.501556+0000","last_fullsized":"2024-04-23T10:24:33.501556+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:33:46.492754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.564160+0000","last_change":"2024-04-23T10:12:35.046352+0000","last_active":"2024-04-23T10:24:33.564160+0000","last_peered":"2024-04-23T10:24:33.564160+0000","last_clean":"2024-04-23T10:24:33.564160+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:33.564160+0000","last_undegraded":"2024-04-23T10:24:33.564160+0000","last_fullsized":"2024-04-23T10:24:33.564160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:09:05.712553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.473964+0000","last_change":"2024-04-23T10:12:35.038235+0000","last_active":"2024-04-23T10:24:33.473964+0000","last_peered":"2024-04-23T10:24:33.473964+0000","last_clean":"2024-04-23T10:24:33.473964+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:33.473964+0000","last_undegraded":"2024-04-23T10:24:33.473964+0000","last_fullsized":"2024-04-23T10:24:33.473964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:17.822831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554626+0000","last_change":"2024-04-23T10:12:35.041532+0000","last_active":"2024-04-23T10:24:33.554626+0000","last_peered":"2024-04-23T10:24:33.554626+0000","last_clean":"2024-04-23T10:24:33.554626+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:33.554626+0000","last_undegraded":"2024-04-23T10:24:33.554626+0000","last_fullsized":"2024-04-23T10:24:33.554626+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:14:04.917301+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.546876+0000","last_change":"2024-04-23T10:12:35.042230+0000","last_active":"2024-04-23T10:24:33.546876+0000","last_peered":"2024-04-23T10:24:33.546876+0000","last_clean":"2024-04-23T10:24:33.546876+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:33.546876+0000","last_undegraded":"2024-04-23T10:24:33.546876+0000","last_fullsized":"2024-04-23T10:24:33.546876+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:40:25.009170+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.501448+0000","last_change":"2024-04-23T10:12:35.029759+0000","last_active":"2024-04-23T10:24:33.501448+0000","last_peered":"2024-04-23T10:24:33.501448+0000","last_clean":"2024-04-23T10:24:33.501448+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:33.501448+0000","last_undegraded":"2024-04-23T10:24:33.501448+0000","last_fullsized":"2024-04-23T10:24:33.501448+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:51.564943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555566+0000","last_change":"2024-04-23T10:13:16.027649+0000","last_active":"2024-04-23T10:24:33.555566+0000","last_peered":"2024-04-23T10:24:33.555566+0000","last_clean":"2024-04-23T10:24:33.555566+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:33.555566+0000","last_undegraded":"2024-04-23T10:24:33.555566+0000","last_fullsized":"2024-04-23T10:24:33.555566+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:48:54.503318+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.467678+0000","last_change":"2024-04-23T10:12:35.019314+0000","last_active":"2024-04-23T10:24:33.467678+0000","last_peered":"2024-04-23T10:24:33.467678+0000","last_clean":"2024-04-23T10:24:33.467678+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:33.467678+0000","last_undegraded":"2024-04-23T10:24:33.467678+0000","last_fullsized":"2024-04-23T10:24:33.467678+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:49.658969+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.560655+0000","last_change":"2024-04-23T10:12:35.028547+0000","last_active":"2024-04-23T10:24:33.560655+0000","last_peered":"2024-04-23T10:24:33.560655+0000","last_clean":"2024-04-23T10:24:33.560655+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:33.560655+0000","last_undegraded":"2024-04-23T10:24:33.560655+0000","last_fullsized":"2024-04-23T10:24:33.560655+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:20:32.169434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.556848+0000","last_change":"2024-04-23T10:12:35.031477+0000","last_active":"2024-04-23T10:24:33.556848+0000","last_peered":"2024-04-23T10:24:33.556848+0000","last_clean":"2024-04-23T10:24:33.556848+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:33.556848+0000","last_undegraded":"2024-04-23T10:24:33.556848+0000","last_fullsized":"2024-04-23T10:24:33.556848+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:30.729476+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":216,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.478347+0000","last_change":"2024-04-23T10:12:35.035122+0000","last_active":"2024-04-23T10:24:33.478347+0000","last_peered":"2024-04-23T10:24:33.478347+0000","last_clean":"2024-04-23T10:24:33.478347+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:33.478347+0000","last_undegraded":"2024-04-23T10:24:33.478347+0000","last_fullsized":"2024-04-23T10:24:33.478347+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:20:21.556667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.483401+0000","last_change":"2024-04-23T10:12:35.039081+0000","last_active":"2024-04-23T10:24:33.483401+0000","last_peered":"2024-04-23T10:24:33.483401+0000","last_clean":"2024-04-23T10:24:33.483401+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:33.483401+0000","last_undegraded":"2024-04-23T10:24:33.483401+0000","last_fullsized":"2024-04-23T10:24:33.483401+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:35:49.305883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":236,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.489162+0000","last_change":"2024-04-23T10:12:35.040893+0000","last_active":"2024-04-23T10:24:33.489162+0000","last_peered":"2024-04-23T10:24:33.489162+0000","last_clean":"2024-04-23T10:24:33.489162+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:33.489162+0000","last_undegraded":"2024-04-23T10:24:33.489162+0000","last_fullsized":"2024-04-23T10:24:33.489162+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:11:10.972955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.508070+0000","last_change":"2024-04-23T10:12:35.039924+0000","last_active":"2024-04-23T10:24:33.508070+0000","last_peered":"2024-04-23T10:24:33.508070+0000","last_clean":"2024-04-23T10:24:33.508070+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:33.508070+0000","last_undegraded":"2024-04-23T10:24:33.508070+0000","last_fullsized":"2024-04-23T10:24:33.508070+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:33:53.609157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":217,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.551211+0000","last_change":"2024-04-23T10:12:35.026071+0000","last_active":"2024-04-23T10:24:33.551211+0000","last_peered":"2024-04-23T10:24:33.551211+0000","last_clean":"2024-04-23T10:24:33.551211+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:33.551211+0000","last_undegraded":"2024-04-23T10:24:33.551211+0000","last_fullsized":"2024-04-23T10:24:33.551211+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:54:57.273344+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559120+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:24:33.559120+0000","last_peered":"2024-04-23T10:24:33.559120+0000","last_clean":"2024-04-23T10:24:33.559120+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:24:33.559120+0000","last_undegraded":"2024-04-23T10:24:33.559120+0000","last_fullsized":"2024-04-23T10:24:33.559120+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:15:08.753822+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559225+0000","last_change":"2024-04-23T10:12:35.031826+0000","last_active":"2024-04-23T10:24:33.559225+0000","last_peered":"2024-04-23T10:24:33.559225+0000","last_clean":"2024-04-23T10:24:33.559225+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:33.559225+0000","last_undegraded":"2024-04-23T10:24:33.559225+0000","last_fullsized":"2024-04-23T10:24:33.559225+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:10:10.577484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.554394+0000","last_change":"2024-04-23T10:12:35.034854+0000","last_active":"2024-04-23T10:24:33.554394+0000","last_peered":"2024-04-23T10:24:33.554394+0000","last_clean":"2024-04-23T10:24:33.554394+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:33.554394+0000","last_undegraded":"2024-04-23T10:24:33.554394+0000","last_fullsized":"2024-04-23T10:24:33.554394+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:46:58.903805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559435+0000","last_change":"2024-04-23T10:12:35.032985+0000","last_active":"2024-04-23T10:24:33.559435+0000","last_peered":"2024-04-23T10:24:33.559435+0000","last_clean":"2024-04-23T10:24:33.559435+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:33.559435+0000","last_undegraded":"2024-04-23T10:24:33.559435+0000","last_fullsized":"2024-04-23T10:24:33.559435+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.068295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.555603+0000","last_change":"2024-04-23T10:12:35.028911+0000","last_active":"2024-04-23T10:24:33.555603+0000","last_peered":"2024-04-23T10:24:33.555603+0000","last_clean":"2024-04-23T10:24:33.555603+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:33.555603+0000","last_undegraded":"2024-04-23T10:24:33.555603+0000","last_fullsized":"2024-04-23T10:24:33.555603+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:46:33.670745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.431229+0000","last_change":"2024-04-23T10:12:35.031068+0000","last_active":"2024-04-23T10:24:33.431229+0000","last_peered":"2024-04-23T10:24:33.431229+0000","last_clean":"2024-04-23T10:24:33.431229+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:33.431229+0000","last_undegraded":"2024-04-23T10:24:33.431229+0000","last_fullsized":"2024-04-23T10:24:33.431229+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:54:05.086618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504628+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:24:33.504628+0000","last_peered":"2024-04-23T10:24:33.504628+0000","last_clean":"2024-04-23T10:24:33.504628+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:24:33.504628+0000","last_undegraded":"2024-04-23T10:24:33.504628+0000","last_fullsized":"2024-04-23T10:24:33.504628+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:02:41.380510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10774,"ondisk_log_size":10774,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575000,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574998,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574998,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575000,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575000,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575000,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574999,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575000,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:24:46.485 INFO:tasks.ceph:pgid 2.1f last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.485 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.485 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 2.1e last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 2.1d last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 2.1c last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.486 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 2.b last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 2.a last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 2.9 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 2.8 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.487 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.488 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.489 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-23T10:12:21.816533+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=21, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 2.c last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.490 INFO:tasks.ceph:pgid 2.d last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 2.e last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 2.f last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 2.10 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.491 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 2.11 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 2.12 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.492 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 2.13 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 2.14 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 2.15 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.493 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 2.16 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 2.17 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 2.18 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.494 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 2.19 last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 2.1a last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 2.1b last_scrub_stamp 2024-04-23T10:12:32.983156+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=32, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.495 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.496 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.497 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:24:46.498 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T10:25:06.499 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:25:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 Processor -- start 2024-04-23T10:25:06.638 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 -- start start 2024-04-23T10:25:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46080cda50 0x7f46080c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f460815beb0 con 0x7f4608155350 2024-04-23T10:25:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f46080cca40 con 0x7f46080cda50 2024-04-23T10:25:06.639 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460efc3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f46080ccc90 con 0x7f460815b0b0 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f4607fff640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f46080cda50 0x7f46080c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:57534/0 (socket says 172.21.15.26:57534) 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 -- 172.21.15.26:0/4077820249 learned_addr learned my addr 172.21.15.26:0/4077820249 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460cd5f640 1 --1- 172.21.15.26:0/4077820249 >> v1:172.21.15.190:6789/0 conn(0x7f4608155350 0x7f46080cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:43994/0 (socket says 172.21.15.26:43994) 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 -- 172.21.15.26:0/4077820249 >> v2:172.21.15.190:3300/0 conn(0x7f46080cda50 msgr2=0x7f46080c59c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 --2- 172.21.15.26:0/4077820249 >> v2:172.21.15.190:3300/0 conn(0x7f46080cda50 0x7f46080c59c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 -- 172.21.15.26:0/4077820249 >> v1:172.21.15.190:6789/0 conn(0x7f4608155350 legacy=0x7f46080cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.640 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.641+0000 7f460d560640 1 -- 172.21.15.26:0/4077820249 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46080ccf70 con 0x7f460815b0b0 2024-04-23T10:25:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460d560640 1 --2- 172.21.15.26:0/4077820249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460001f210 comp rx=0 tx=0).ready entity=mon.2 client_cookie=ef48096f07ac1a4 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:06.642 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f46077fe640 1 -- 172.21.15.26:0/4077820249 <== mon.2 v2:172.21.15.190:3301/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000b4070 con 0x7f460815b0b0 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f46077fe640 1 -- 172.21.15.26:0/4077820249 <== mon.2 v2:172.21.15.190:3301/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46000af400 con 0x7f460815b0b0 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f46077fe640 1 -- 172.21.15.26:0/4077820249 <== mon.2 v2:172.21.15.190:3301/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f46000af7d0 con 0x7f460815b0b0 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- 172.21.15.26:0/4077820249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 msgr2=0x7f460815b540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 --2- 172.21.15.26:0/4077820249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f4600009e50 tx=0x7f460001f210 comp rx=0 tx=0).stop 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- 172.21.15.26:0/4077820249 shutdown_connections 2024-04-23T10:25:06.643 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 --2- 172.21.15.26:0/4077820249 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f460815b0b0 0x7f460815b540 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 --2- 172.21.15.26:0/4077820249 >> v2:172.21.15.190:3300/0 conn(0x7f46080cda50 0x7f46080c59c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- 172.21.15.26:0/4077820249 >> 172.21.15.26:0/4077820249 conn(0x7f460806cc30 msgr2=0x7f460806d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- 172.21.15.26:0/4077820249 shutdown_connections 2024-04-23T10:25:06.644 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- 172.21.15.26:0/4077820249 wait complete. 2024-04-23T10:25:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 Processor -- start 2024-04-23T10:25:06.645 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.645+0000 7f460efc3640 1 -- start start 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46080cda50 0x7f46081486f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f460815b0b0 0x7f46080b5bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4608155730 con 0x7f4608155350 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f46080cd530 con 0x7f460815b0b0 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f460815e860 con 0x7f46080cda50 2024-04-23T10:25:06.647 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:55316/0 (socket says 172.21.15.26:55316) 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 -- 172.21.15.26:0/4000105761 learned_addr learned my addr 172.21.15.26:0/4000105761 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460cd5f640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46080cda50 0x7f46081486f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460d560640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f460815b0b0 0x7f46080b5bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 -- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46080cda50 msgr2=0x7f46081486f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46080cda50 0x7f46081486f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 -- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f460815b0b0 msgr2=0x7f46080b5bc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f460815b0b0 0x7f46080b5bc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 -- 172.21.15.26:0/4000105761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4608154bd0 con 0x7f4608155350 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f4607fff640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e960 tx=0x7f45f400ee20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f4017070 con 0x7f4608155350 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45f400ca00 con 0x7f4608155350 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46081548f0 con 0x7f4608155350 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f45f400cdb0 con 0x7f4608155350 2024-04-23T10:25:06.648 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f460815e280 con 0x7f4608155350 2024-04-23T10:25:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f45f401a070 con 0x7f4608155350 2024-04-23T10:25:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4608075df0 con 0x7f4608155350 2024-04-23T10:25:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 0x7f45ec06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f45f40871b0 con 0x7f4608155350 2024-04-23T10:25:06.649 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.649+0000 7f460cd5f640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 0x7f45ec06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:06.650 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.653+0000 7f460cd5f640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 0x7f45ec06a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000f70 tx=0x7f45fc007e50 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:06.654 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.657+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f45f4056c70 con 0x7f4608155350 2024-04-23T10:25:06.813 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.813+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f460814f600 con 0x7f45ec068380 2024-04-23T10:25:06.837 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.837+0000 7f46057fa640 1 -- 172.21.15.26:0/4000105761 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335058 (secure 0 0 0) 0x7f460814f600 con 0x7f45ec068380 2024-04-23T10:25:06.840 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:25:06.842 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:25:06.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 msgr2=0x7f45ec06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 0x7f45ec06a840 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7f45fc000f70 tx=0x7f45fc007e50 comp rx=0 tx=0).stop 2024-04-23T10:25:06.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 msgr2=0x7f460814f9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:06.843 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e960 tx=0x7f45f400ee20 comp rx=0 tx=0).stop 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 shutdown_connections 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f45ec068380 0x7f45ec06a840 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f460815b0b0 0x7f46080b5bc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4608155350 0x7f460814f9a0 secure :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7f45f400e960 tx=0x7f45f400ee20 comp rx=0 tx=0).stop 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 --2- 172.21.15.26:0/4000105761 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f46080cda50 0x7f46081486f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 >> 172.21.15.26:0/4000105761 conn(0x7f460806cc30 msgr2=0x7f46081596a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 shutdown_connections 2024-04-23T10:25:06.844 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:06.841+0000 7f460efc3640 1 -- 172.21.15.26:0/4000105761 wait complete. 2024-04-23T10:25:06.858 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":401,"stamp":"2024-04-23T10:25:05.220393+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49050,"ondisk_log_size":49050,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005340"},"pg_stats":[{"pgid":"2.1f","version":"26'125","reported_seq":164,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.918234+0000","last_change":"2024-04-23T10:24:44.918266+0000","last_active":"2024-04-23T10:24:44.918234+0000","last_peered":"2024-04-23T10:24:44.918234+0000","last_clean":"2024-04-23T10:24:44.918234+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:44.918234+0000","last_undegraded":"2024-04-23T10:24:44.918234+0000","last_fullsized":"2024-04-23T10:24:44.918234+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2024-04-23T10:24:44.918168+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2024-04-23T10:24:44.918168+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.918168+0000","objects_scrubbed":7,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:56.729277+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.524249+0000","last_change":"2024-04-23T10:24:55.524310+0000","last_active":"2024-04-23T10:24:55.524249+0000","last_peered":"2024-04-23T10:24:55.524249+0000","last_clean":"2024-04-23T10:24:55.524249+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:55.524249+0000","last_undegraded":"2024-04-23T10:24:55.524249+0000","last_fullsized":"2024-04-23T10:24:55.524249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:55.524068+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:55.524068+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.524068+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:32.293851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":888,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.724682+0000","last_change":"2024-04-23T10:25:00.724747+0000","last_active":"2024-04-23T10:25:00.724682+0000","last_peered":"2024-04-23T10:25:00.724682+0000","last_clean":"2024-04-23T10:25:00.724682+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:25:00.724682+0000","last_undegraded":"2024-04-23T10:25:00.724682+0000","last_fullsized":"2024-04-23T10:25:00.724682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'784","last_scrub_stamp":"2024-04-23T10:25:00.724486+0000","last_deep_scrub":"26'784","last_deep_scrub_stamp":"2024-04-23T10:25:00.724486+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.724486+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:56.024378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'474","reported_seq":514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.458311+0000","last_change":"2024-04-23T10:24:48.458479+0000","last_active":"2024-04-23T10:24:48.458311+0000","last_peered":"2024-04-23T10:24:48.458311+0000","last_clean":"2024-04-23T10:24:48.458311+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:48.458311+0000","last_undegraded":"2024-04-23T10:24:48.458311+0000","last_fullsized":"2024-04-23T10:24:48.458311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'474","last_scrub_stamp":"2024-04-23T10:24:48.458095+0000","last_deep_scrub":"26'474","last_deep_scrub_stamp":"2024-04-23T10:24:48.458095+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.458095+0000","objects_scrubbed":1,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:20.917017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.920608+0000","last_change":"2024-04-23T10:24:47.920687+0000","last_active":"2024-04-23T10:24:47.920608+0000","last_peered":"2024-04-23T10:24:47.920608+0000","last_clean":"2024-04-23T10:24:47.920608+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:47.920608+0000","last_undegraded":"2024-04-23T10:24:47.920608+0000","last_fullsized":"2024-04-23T10:24:47.920608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:47.920433+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:47.920433+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.920433+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:54:56.844175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.186564+0000","last_change":"2024-04-23T10:24:54.186631+0000","last_active":"2024-04-23T10:24:54.186564+0000","last_peered":"2024-04-23T10:24:54.186564+0000","last_clean":"2024-04-23T10:24:54.186564+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:54.186564+0000","last_undegraded":"2024-04-23T10:24:54.186564+0000","last_fullsized":"2024-04-23T10:24:54.186564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'778","last_scrub_stamp":"2024-04-23T10:24:54.186374+0000","last_deep_scrub":"26'778","last_deep_scrub_stamp":"2024-04-23T10:24:54.186374+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.186374+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:40.947727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'350","reported_seq":389,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.311774+0000","last_change":"2024-04-23T10:24:54.311869+0000","last_active":"2024-04-23T10:24:54.311774+0000","last_peered":"2024-04-23T10:24:54.311774+0000","last_clean":"2024-04-23T10:24:54.311774+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:54.311774+0000","last_undegraded":"2024-04-23T10:24:54.311774+0000","last_fullsized":"2024-04-23T10:24:54.311774+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'350","last_scrub_stamp":"2024-04-23T10:24:54.311583+0000","last_deep_scrub":"26'350","last_deep_scrub_stamp":"2024-04-23T10:24:54.311583+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.311583+0000","objects_scrubbed":10,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:20.107854+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.239414+0000","last_change":"2024-04-23T10:24:52.239474+0000","last_active":"2024-04-23T10:24:52.239414+0000","last_peered":"2024-04-23T10:24:52.239414+0000","last_clean":"2024-04-23T10:24:52.239414+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:52.239414+0000","last_undegraded":"2024-04-23T10:24:52.239414+0000","last_fullsized":"2024-04-23T10:24:52.239414+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:24:52.239244+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:24:52.239244+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.239244+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:52:58.486490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":870,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.151741+0000","last_change":"2024-04-23T10:24:56.151814+0000","last_active":"2024-04-23T10:24:56.151741+0000","last_peered":"2024-04-23T10:24:56.151741+0000","last_clean":"2024-04-23T10:24:56.151741+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:56.151741+0000","last_undegraded":"2024-04-23T10:24:56.151741+0000","last_fullsized":"2024-04-23T10:24:56.151741+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'776","last_scrub_stamp":"2024-04-23T10:24:56.151538+0000","last_deep_scrub":"26'776","last_deep_scrub_stamp":"2024-04-23T10:24:56.151538+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.151538+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:19.524342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'284","reported_seq":323,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.323393+0000","last_change":"2024-04-23T10:24:52.323469+0000","last_active":"2024-04-23T10:24:52.323393+0000","last_peered":"2024-04-23T10:24:52.323393+0000","last_clean":"2024-04-23T10:24:52.323393+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:52.323393+0000","last_undegraded":"2024-04-23T10:24:52.323393+0000","last_fullsized":"2024-04-23T10:24:52.323393+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'284","last_scrub_stamp":"2024-04-23T10:24:52.323224+0000","last_deep_scrub":"26'284","last_deep_scrub_stamp":"2024-04-23T10:24:52.323224+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.323224+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:18.013565+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.356248+0000","last_change":"2024-04-23T10:25:00.356307+0000","last_active":"2024-04-23T10:25:00.356248+0000","last_peered":"2024-04-23T10:25:00.356248+0000","last_clean":"2024-04-23T10:25:00.356248+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:25:00.356248+0000","last_undegraded":"2024-04-23T10:25:00.356248+0000","last_fullsized":"2024-04-23T10:25:00.356248+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:25:00.356066+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:25:00.356066+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.356066+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:43.744638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":855,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.221975+0000","last_change":"2024-04-23T10:24:51.222040+0000","last_active":"2024-04-23T10:24:51.221975+0000","last_peered":"2024-04-23T10:24:51.221975+0000","last_clean":"2024-04-23T10:24:51.221975+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:51.221975+0000","last_undegraded":"2024-04-23T10:24:51.221975+0000","last_fullsized":"2024-04-23T10:24:51.221975+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'757","last_scrub_stamp":"2024-04-23T10:24:51.221755+0000","last_deep_scrub":"26'757","last_deep_scrub_stamp":"2024-04-23T10:24:51.221755+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.221755+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:34:39.851691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.033493+0000","last_change":"2024-04-23T10:24:53.033551+0000","last_active":"2024-04-23T10:24:53.033493+0000","last_peered":"2024-04-23T10:24:53.033493+0000","last_clean":"2024-04-23T10:24:53.033493+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:53.033493+0000","last_undegraded":"2024-04-23T10:24:53.033493+0000","last_fullsized":"2024-04-23T10:24:53.033493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:24:53.033320+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:24:53.033320+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.033320+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:33.955914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'183","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.367512+0000","last_change":"2024-04-23T10:24:49.367625+0000","last_active":"2024-04-23T10:24:49.367512+0000","last_peered":"2024-04-23T10:24:49.367512+0000","last_clean":"2024-04-23T10:24:49.367512+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:49.367512+0000","last_undegraded":"2024-04-23T10:24:49.367512+0000","last_fullsized":"2024-04-23T10:24:49.367512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:24:49.367303+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:24:49.367303+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.367303+0000","objects_scrubbed":4,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:29.623495+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.260097+0000","last_change":"2024-04-23T10:24:59.260164+0000","last_active":"2024-04-23T10:24:59.260097+0000","last_peered":"2024-04-23T10:24:59.260097+0000","last_clean":"2024-04-23T10:24:59.260097+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:59.260097+0000","last_undegraded":"2024-04-23T10:24:59.260097+0000","last_fullsized":"2024-04-23T10:24:59.260097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'817","last_scrub_stamp":"2024-04-23T10:24:59.259806+0000","last_deep_scrub":"26'817","last_deep_scrub_stamp":"2024-04-23T10:24:59.259806+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.259806+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:54.233170+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.525865+0000","last_change":"2024-04-23T10:24:52.525928+0000","last_active":"2024-04-23T10:24:52.525865+0000","last_peered":"2024-04-23T10:24:52.525865+0000","last_clean":"2024-04-23T10:24:52.525865+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:52.525865+0000","last_undegraded":"2024-04-23T10:24:52.525865+0000","last_fullsized":"2024-04-23T10:24:52.525865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:24:52.525686+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:24:52.525686+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.525686+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:23:19.550754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'220","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.808834+0000","last_change":"2024-04-23T10:24:46.808904+0000","last_active":"2024-04-23T10:24:46.808834+0000","last_peered":"2024-04-23T10:24:46.808834+0000","last_clean":"2024-04-23T10:24:46.808834+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:46.808834+0000","last_undegraded":"2024-04-23T10:24:46.808834+0000","last_fullsized":"2024-04-23T10:24:46.808834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:24:46.808662+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:24:46.808662+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.808662+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:45:45.268825+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.184475+0000","last_change":"2024-04-23T10:24:55.184600+0000","last_active":"2024-04-23T10:24:55.184475+0000","last_peered":"2024-04-23T10:24:55.184475+0000","last_clean":"2024-04-23T10:24:55.184475+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:55.184475+0000","last_undegraded":"2024-04-23T10:24:55.184475+0000","last_fullsized":"2024-04-23T10:24:55.184475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'802","last_scrub_stamp":"2024-04-23T10:24:55.184174+0000","last_deep_scrub":"26'802","last_deep_scrub_stamp":"2024-04-23T10:24:55.184174+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.184174+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:14.802714+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.432156+0000","last_change":"2024-04-23T10:24:49.432272+0000","last_active":"2024-04-23T10:24:49.432156+0000","last_peered":"2024-04-23T10:24:49.432156+0000","last_clean":"2024-04-23T10:24:49.432156+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:49.432156+0000","last_undegraded":"2024-04-23T10:24:49.432156+0000","last_fullsized":"2024-04-23T10:24:49.432156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:49.431923+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:49.431923+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.431923+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:56:18.341636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'71","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.737460+0000","last_change":"2024-04-23T10:24:48.737535+0000","last_active":"2024-04-23T10:24:48.737460+0000","last_peered":"2024-04-23T10:24:48.737460+0000","last_clean":"2024-04-23T10:24:48.737460+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:48.737460+0000","last_undegraded":"2024-04-23T10:24:48.737460+0000","last_fullsized":"2024-04-23T10:24:48.737460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'71","last_scrub_stamp":"2024-04-23T10:24:48.737294+0000","last_deep_scrub":"26'71","last_deep_scrub_stamp":"2024-04-23T10:24:48.737294+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.737294+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:17:52.081824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.746778+0000","last_change":"2024-04-23T10:24:59.746844+0000","last_active":"2024-04-23T10:24:59.746778+0000","last_peered":"2024-04-23T10:24:59.746778+0000","last_clean":"2024-04-23T10:24:59.746778+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:59.746778+0000","last_undegraded":"2024-04-23T10:24:59.746778+0000","last_fullsized":"2024-04-23T10:24:59.746778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-23T10:24:59.746581+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-23T10:24:59.746581+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.746581+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:15.067264+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.241183+0000","last_change":"2024-04-23T10:24:47.241242+0000","last_active":"2024-04-23T10:24:47.241183+0000","last_peered":"2024-04-23T10:24:47.241183+0000","last_clean":"2024-04-23T10:24:47.241183+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:47.241183+0000","last_undegraded":"2024-04-23T10:24:47.241183+0000","last_fullsized":"2024-04-23T10:24:47.241183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:47.241009+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:47.241009+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.241009+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:42:56.883341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'477","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.386747+0000","last_change":"2024-04-23T10:24:50.386840+0000","last_active":"2024-04-23T10:24:50.386747+0000","last_peered":"2024-04-23T10:24:50.386747+0000","last_clean":"2024-04-23T10:24:50.386747+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:50.386747+0000","last_undegraded":"2024-04-23T10:24:50.386747+0000","last_fullsized":"2024-04-23T10:24:50.386747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'477","last_scrub_stamp":"2024-04-23T10:24:50.386533+0000","last_deep_scrub":"26'477","last_deep_scrub_stamp":"2024-04-23T10:24:50.386533+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.386533+0000","objects_scrubbed":2,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:28:47.335230+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.190035+0000","last_change":"2024-04-23T10:24:52.190170+0000","last_active":"2024-04-23T10:24:52.190035+0000","last_peered":"2024-04-23T10:24:52.190035+0000","last_clean":"2024-04-23T10:24:52.190035+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:52.190035+0000","last_undegraded":"2024-04-23T10:24:52.190035+0000","last_fullsized":"2024-04-23T10:24:52.190035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'721","last_scrub_stamp":"2024-04-23T10:24:52.189732+0000","last_deep_scrub":"26'721","last_deep_scrub_stamp":"2024-04-23T10:24:52.189732+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.189732+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:13.106560+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.893835+0000","last_change":"2024-04-23T10:24:49.893900+0000","last_active":"2024-04-23T10:24:49.893835+0000","last_peered":"2024-04-23T10:24:49.893835+0000","last_clean":"2024-04-23T10:24:49.893835+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:49.893835+0000","last_undegraded":"2024-04-23T10:24:49.893835+0000","last_fullsized":"2024-04-23T10:24:49.893835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-23T10:24:49.893656+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-23T10:24:49.893656+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.893656+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:52:03.508582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'84","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.057978+0000","last_change":"2024-04-23T10:24:47.058056+0000","last_active":"2024-04-23T10:24:47.057978+0000","last_peered":"2024-04-23T10:24:47.057978+0000","last_clean":"2024-04-23T10:24:47.057978+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:47.057978+0000","last_undegraded":"2024-04-23T10:24:47.057978+0000","last_fullsized":"2024-04-23T10:24:47.057978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'84","last_scrub_stamp":"2024-04-23T10:24:47.057809+0000","last_deep_scrub":"26'84","last_deep_scrub_stamp":"2024-04-23T10:24:47.057809+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.057809+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:04:39.109858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":969,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.211534+0000","last_change":"2024-04-23T10:24:58.211597+0000","last_active":"2024-04-23T10:24:58.211534+0000","last_peered":"2024-04-23T10:24:58.211534+0000","last_clean":"2024-04-23T10:24:58.211534+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:58.211534+0000","last_undegraded":"2024-04-23T10:24:58.211534+0000","last_fullsized":"2024-04-23T10:24:58.211534+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'826","last_scrub_stamp":"2024-04-23T10:24:58.211336+0000","last_deep_scrub":"26'826","last_deep_scrub_stamp":"2024-04-23T10:24:58.211336+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.211336+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:09:32.538604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.696835+0000","last_change":"2024-04-23T10:24:53.696976+0000","last_active":"2024-04-23T10:24:53.696835+0000","last_peered":"2024-04-23T10:24:53.696835+0000","last_clean":"2024-04-23T10:24:53.696835+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:53.696835+0000","last_undegraded":"2024-04-23T10:24:53.696835+0000","last_fullsized":"2024-04-23T10:24:53.696835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'175","last_scrub_stamp":"2024-04-23T10:24:53.696602+0000","last_deep_scrub":"26'175","last_deep_scrub_stamp":"2024-04-23T10:24:53.696602+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.696602+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:39.184196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'479","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.761459+0000","last_change":"2024-04-23T10:24:49.761532+0000","last_active":"2024-04-23T10:24:49.761459+0000","last_peered":"2024-04-23T10:24:49.761459+0000","last_clean":"2024-04-23T10:24:49.761459+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:49.761459+0000","last_undegraded":"2024-04-23T10:24:49.761459+0000","last_fullsized":"2024-04-23T10:24:49.761459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'479","last_scrub_stamp":"2024-04-23T10:24:49.761281+0000","last_deep_scrub":"26'479","last_deep_scrub_stamp":"2024-04-23T10:24:49.761281+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.761281+0000","objects_scrubbed":4,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:41:17.289999+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.750132+0000","last_change":"2024-04-23T10:24:54.750196+0000","last_active":"2024-04-23T10:24:54.750132+0000","last_peered":"2024-04-23T10:24:54.750132+0000","last_clean":"2024-04-23T10:24:54.750132+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:54.750132+0000","last_undegraded":"2024-04-23T10:24:54.750132+0000","last_fullsized":"2024-04-23T10:24:54.750132+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'806","last_scrub_stamp":"2024-04-23T10:24:54.749941+0000","last_deep_scrub":"26'806","last_deep_scrub_stamp":"2024-04-23T10:24:54.749941+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.749941+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:30.322357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:43.846581+0000","last_change":"2024-04-23T10:24:43.846640+0000","last_active":"2024-04-23T10:24:43.846581+0000","last_peered":"2024-04-23T10:24:43.846581+0000","last_clean":"2024-04-23T10:24:43.846581+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:43.846581+0000","last_undegraded":"2024-04-23T10:24:43.846581+0000","last_fullsized":"2024-04-23T10:24:43.846581+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:43.846409+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:43.846409+0000","last_clean_scrub_stamp":"2024-04-23T10:24:43.846409+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:27.549621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'232","reported_seq":272,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.276504+0000","last_change":"2024-04-23T10:24:53.276575+0000","last_active":"2024-04-23T10:24:53.276504+0000","last_peered":"2024-04-23T10:24:53.276504+0000","last_clean":"2024-04-23T10:24:53.276504+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:53.276504+0000","last_undegraded":"2024-04-23T10:24:53.276504+0000","last_fullsized":"2024-04-23T10:24:53.276504+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'232","last_scrub_stamp":"2024-04-23T10:24:53.276344+0000","last_deep_scrub":"26'232","last_deep_scrub_stamp":"2024-04-23T10:24:53.276344+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.276344+0000","objects_scrubbed":4,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:43.521082+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":792,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.784009+0000","last_change":"2024-04-23T10:24:55.784075+0000","last_active":"2024-04-23T10:24:55.784009+0000","last_peered":"2024-04-23T10:24:55.784009+0000","last_clean":"2024-04-23T10:24:55.784009+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:55.784009+0000","last_undegraded":"2024-04-23T10:24:55.784009+0000","last_fullsized":"2024-04-23T10:24:55.784009+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'736","last_scrub_stamp":"2024-04-23T10:24:55.783832+0000","last_deep_scrub":"26'736","last_deep_scrub_stamp":"2024-04-23T10:24:55.783832+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.783832+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:47:52.752821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.263019+0000","last_change":"2024-04-23T10:24:57.263076+0000","last_active":"2024-04-23T10:24:57.263019+0000","last_peered":"2024-04-23T10:24:57.263019+0000","last_clean":"2024-04-23T10:24:57.263019+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:57.263019+0000","last_undegraded":"2024-04-23T10:24:57.263019+0000","last_fullsized":"2024-04-23T10:24:57.263019+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:24:57.262853+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:24:57.262853+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.262853+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:29.182107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":105,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.769757+0000","last_change":"2024-04-23T10:24:45.769797+0000","last_active":"2024-04-23T10:24:45.769757+0000","last_peered":"2024-04-23T10:24:45.769757+0000","last_clean":"2024-04-23T10:24:45.769757+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:45.769757+0000","last_undegraded":"2024-04-23T10:24:45.769757+0000","last_fullsized":"2024-04-23T10:24:45.769757+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-04-23T10:24:45.769677+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-04-23T10:24:45.769677+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.769677+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:48.860772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.739084+0000","last_change":"2024-04-23T10:24:57.739148+0000","last_active":"2024-04-23T10:24:57.739084+0000","last_peered":"2024-04-23T10:24:57.739084+0000","last_clean":"2024-04-23T10:24:57.739084+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:57.739084+0000","last_undegraded":"2024-04-23T10:24:57.739084+0000","last_fullsized":"2024-04-23T10:24:57.739084+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'769","last_scrub_stamp":"2024-04-23T10:24:57.738895+0000","last_deep_scrub":"26'769","last_deep_scrub_stamp":"2024-04-23T10:24:57.738895+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.738895+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:54:26.612952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.232301+0000","last_change":"2024-04-23T10:24:49.232452+0000","last_active":"2024-04-23T10:24:49.232301+0000","last_peered":"2024-04-23T10:24:49.232301+0000","last_clean":"2024-04-23T10:24:49.232301+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:49.232301+0000","last_undegraded":"2024-04-23T10:24:49.232301+0000","last_fullsized":"2024-04-23T10:24:49.232301+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:49.231988+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:49.231988+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.231988+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:50:09.199923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1264","reported_seq":1304,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.280714+0000","last_change":"2024-04-23T10:24:50.280797+0000","last_active":"2024-04-23T10:24:50.280714+0000","last_peered":"2024-04-23T10:24:50.280714+0000","last_clean":"2024-04-23T10:24:50.280714+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:50.280714+0000","last_undegraded":"2024-04-23T10:24:50.280714+0000","last_fullsized":"2024-04-23T10:24:50.280714+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1264","last_scrub_stamp":"2024-04-23T10:24:50.280531+0000","last_deep_scrub":"26'1264","last_deep_scrub_stamp":"2024-04-23T10:24:50.280531+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.280531+0000","objects_scrubbed":4,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.326472+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":819,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.703233+0000","last_change":"2024-04-23T10:24:56.703299+0000","last_active":"2024-04-23T10:24:56.703233+0000","last_peered":"2024-04-23T10:24:56.703233+0000","last_clean":"2024-04-23T10:24:56.703233+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:56.703233+0000","last_undegraded":"2024-04-23T10:24:56.703233+0000","last_fullsized":"2024-04-23T10:24:56.703233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'715","last_scrub_stamp":"2024-04-23T10:24:56.703055+0000","last_deep_scrub":"26'715","last_deep_scrub_stamp":"2024-04-23T10:24:56.703055+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.703055+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:27:46.626550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.665151+0000","last_change":"2024-04-23T10:24:51.665269+0000","last_active":"2024-04-23T10:24:51.665151+0000","last_peered":"2024-04-23T10:24:51.665151+0000","last_clean":"2024-04-23T10:24:51.665151+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:51.665151+0000","last_undegraded":"2024-04-23T10:24:51.665151+0000","last_fullsized":"2024-04-23T10:24:51.665151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:51.664876+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:51.664876+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.664876+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:31:44.502662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'680","reported_seq":1316,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.627229+0000","last_change":"2024-04-23T10:24:45.627302+0000","last_active":"2024-04-23T10:24:45.627229+0000","last_peered":"2024-04-23T10:24:45.627229+0000","last_clean":"2024-04-23T10:24:45.627229+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:45.627229+0000","last_undegraded":"2024-04-23T10:24:45.627229+0000","last_fullsized":"2024-04-23T10:24:45.627229+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'680","last_scrub_stamp":"2024-04-23T10:24:45.627062+0000","last_deep_scrub":"26'680","last_deep_scrub_stamp":"2024-04-23T10:24:45.627062+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.627062+0000","objects_scrubbed":4,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:46.840528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.728397+0000","last_change":"2024-04-23T10:24:55.728458+0000","last_active":"2024-04-23T10:24:55.728397+0000","last_peered":"2024-04-23T10:24:55.728397+0000","last_clean":"2024-04-23T10:24:55.728397+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:55.728397+0000","last_undegraded":"2024-04-23T10:24:55.728397+0000","last_fullsized":"2024-04-23T10:24:55.728397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-23T10:24:55.728217+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-23T10:24:55.728217+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.728217+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:30:38.630850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:42.858434+0000","last_change":"2024-04-23T10:24:42.858465+0000","last_active":"2024-04-23T10:24:42.858434+0000","last_peered":"2024-04-23T10:24:42.858434+0000","last_clean":"2024-04-23T10:24:42.858434+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:42.858434+0000","last_undegraded":"2024-04-23T10:24:42.858434+0000","last_fullsized":"2024-04-23T10:24:42.858434+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'196","last_scrub_stamp":"2024-04-23T10:24:42.858345+0000","last_deep_scrub":"26'196","last_deep_scrub_stamp":"2024-04-23T10:24:42.858345+0000","last_clean_scrub_stamp":"2024-04-23T10:24:42.858345+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:57:43.388736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'824","reported_seq":866,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.347823+0000","last_change":"2024-04-23T10:24:51.347896+0000","last_active":"2024-04-23T10:24:51.347823+0000","last_peered":"2024-04-23T10:24:51.347823+0000","last_clean":"2024-04-23T10:24:51.347823+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:51.347823+0000","last_undegraded":"2024-04-23T10:24:51.347823+0000","last_fullsized":"2024-04-23T10:24:51.347823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'824","last_scrub_stamp":"2024-04-23T10:24:51.347654+0000","last_deep_scrub":"26'824","last_deep_scrub_stamp":"2024-04-23T10:24:51.347654+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.347654+0000","objects_scrubbed":3,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.819014+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":994,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.819778+0000","last_change":"2024-04-23T10:24:57.819840+0000","last_active":"2024-04-23T10:24:57.819778+0000","last_peered":"2024-04-23T10:24:57.819778+0000","last_clean":"2024-04-23T10:24:57.819778+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:57.819778+0000","last_undegraded":"2024-04-23T10:24:57.819778+0000","last_fullsized":"2024-04-23T10:24:57.819778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'869","last_scrub_stamp":"2024-04-23T10:24:57.819599+0000","last_deep_scrub":"26'869","last_deep_scrub_stamp":"2024-04-23T10:24:57.819599+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.819599+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:35:09.865060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.474199+0000","last_change":"2024-04-23T10:24:50.474351+0000","last_active":"2024-04-23T10:24:50.474199+0000","last_peered":"2024-04-23T10:24:50.474199+0000","last_clean":"2024-04-23T10:24:50.474199+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:50.474199+0000","last_undegraded":"2024-04-23T10:24:50.474199+0000","last_fullsized":"2024-04-23T10:24:50.474199+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:50.473989+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:50.473989+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.473989+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:43:56.373260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'79","reported_seq":119,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.210427+0000","last_change":"2024-04-23T10:24:47.210500+0000","last_active":"2024-04-23T10:24:47.210427+0000","last_peered":"2024-04-23T10:24:47.210427+0000","last_clean":"2024-04-23T10:24:47.210427+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:47.210427+0000","last_undegraded":"2024-04-23T10:24:47.210427+0000","last_fullsized":"2024-04-23T10:24:47.210427+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-23T10:24:47.210252+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-23T10:24:47.210252+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.210252+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:56.780582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.365841+0000","last_change":"2024-04-23T10:24:48.365913+0000","last_active":"2024-04-23T10:24:48.365841+0000","last_peered":"2024-04-23T10:24:48.365841+0000","last_clean":"2024-04-23T10:24:48.365841+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:24:48.365841+0000","last_undegraded":"2024-04-23T10:24:48.365841+0000","last_fullsized":"2024-04-23T10:24:48.365841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-23T10:24:48.365673+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-23T10:24:48.365673+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.365673+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:38.924156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":921,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.995464+0000","last_change":"2024-04-23T10:24:59.995619+0000","last_active":"2024-04-23T10:24:59.995464+0000","last_peered":"2024-04-23T10:24:59.995464+0000","last_clean":"2024-04-23T10:24:59.995464+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:59.995464+0000","last_undegraded":"2024-04-23T10:24:59.995464+0000","last_fullsized":"2024-04-23T10:24:59.995464+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'785","last_scrub_stamp":"2024-04-23T10:24:59.995238+0000","last_deep_scrub":"26'785","last_deep_scrub_stamp":"2024-04-23T10:24:59.995238+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.995238+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:19.821751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.303608+0000","last_change":"2024-04-23T10:24:55.303666+0000","last_active":"2024-04-23T10:24:55.303608+0000","last_peered":"2024-04-23T10:24:55.303608+0000","last_clean":"2024-04-23T10:24:55.303608+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:55.303608+0000","last_undegraded":"2024-04-23T10:24:55.303608+0000","last_fullsized":"2024-04-23T10:24:55.303608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:55.303426+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:55.303426+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.303426+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:43:21.863457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'71","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.675293+0000","last_change":"2024-04-23T10:24:47.675363+0000","last_active":"2024-04-23T10:24:47.675293+0000","last_peered":"2024-04-23T10:24:47.675293+0000","last_clean":"2024-04-23T10:24:47.675293+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:47.675293+0000","last_undegraded":"2024-04-23T10:24:47.675293+0000","last_fullsized":"2024-04-23T10:24:47.675293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'71","last_scrub_stamp":"2024-04-23T10:24:47.675126+0000","last_deep_scrub":"26'71","last_deep_scrub_stamp":"2024-04-23T10:24:47.675126+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.675126+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:57.781077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.963303+0000","last_change":"2024-04-23T10:24:58.963367+0000","last_active":"2024-04-23T10:24:58.963303+0000","last_peered":"2024-04-23T10:24:58.963303+0000","last_clean":"2024-04-23T10:24:58.963303+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:58.963303+0000","last_undegraded":"2024-04-23T10:24:58.963303+0000","last_fullsized":"2024-04-23T10:24:58.963303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'798","last_scrub_stamp":"2024-04-23T10:24:58.963109+0000","last_deep_scrub":"26'798","last_deep_scrub_stamp":"2024-04-23T10:24:58.963109+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.963109+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:54:24.617015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.309110+0000","last_change":"2024-04-23T10:24:56.309173+0000","last_active":"2024-04-23T10:24:56.309110+0000","last_peered":"2024-04-23T10:24:56.309110+0000","last_clean":"2024-04-23T10:24:56.309110+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:56.309110+0000","last_undegraded":"2024-04-23T10:24:56.309110+0000","last_fullsized":"2024-04-23T10:24:56.309110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:56.308875+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:56.308875+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.308875+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:42.814654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'598","reported_seq":638,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.795726+0000","last_change":"2024-04-23T10:24:47.795797+0000","last_active":"2024-04-23T10:24:47.795726+0000","last_peered":"2024-04-23T10:24:47.795726+0000","last_clean":"2024-04-23T10:24:47.795726+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:47.795726+0000","last_undegraded":"2024-04-23T10:24:47.795726+0000","last_fullsized":"2024-04-23T10:24:47.795726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'598","last_scrub_stamp":"2024-04-23T10:24:47.795538+0000","last_deep_scrub":"26'598","last_deep_scrub_stamp":"2024-04-23T10:24:47.795538+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.795538+0000","objects_scrubbed":2,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:45:02.548842+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1019,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.845053+0000","last_change":"2024-04-23T10:24:53.845114+0000","last_active":"2024-04-23T10:24:53.845053+0000","last_peered":"2024-04-23T10:24:53.845053+0000","last_clean":"2024-04-23T10:24:53.845053+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:53.845053+0000","last_undegraded":"2024-04-23T10:24:53.845053+0000","last_fullsized":"2024-04-23T10:24:53.845053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'841","last_scrub_stamp":"2024-04-23T10:24:53.844877+0000","last_deep_scrub":"26'841","last_deep_scrub_stamp":"2024-04-23T10:24:53.844877+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.844877+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:00.975799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.285350+0000","last_change":"2024-04-23T10:24:56.285409+0000","last_active":"2024-04-23T10:24:56.285350+0000","last_peered":"2024-04-23T10:24:56.285350+0000","last_clean":"2024-04-23T10:24:56.285350+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:56.285350+0000","last_undegraded":"2024-04-23T10:24:56.285350+0000","last_fullsized":"2024-04-23T10:24:56.285350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:56.285171+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:56.285171+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.285171+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:32.034108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'414","reported_seq":453,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.685462+0000","last_change":"2024-04-23T10:24:46.685545+0000","last_active":"2024-04-23T10:24:46.685462+0000","last_peered":"2024-04-23T10:24:46.685462+0000","last_clean":"2024-04-23T10:24:46.685462+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:46.685462+0000","last_undegraded":"2024-04-23T10:24:46.685462+0000","last_fullsized":"2024-04-23T10:24:46.685462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'414","last_scrub_stamp":"2024-04-23T10:24:46.685281+0000","last_deep_scrub":"26'414","last_deep_scrub_stamp":"2024-04-23T10:24:46.685281+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.685281+0000","objects_scrubbed":3,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:22.493073+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":925,"reported_epoch":26,"state":"active+clean+scrubbing+deep","last_fresh":"2024-04-23T10:25:01.319550+0000","last_change":"2024-04-23T10:25:01.319072+0000","last_active":"2024-04-23T10:25:01.319550+0000","last_peered":"2024-04-23T10:25:01.319550+0000","last_clean":"2024-04-23T10:25:01.319550+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:25:01.319550+0000","last_undegraded":"2024-04-23T10:25:01.319550+0000","last_fullsized":"2024-04-23T10:25:01.319550+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"deep scrubbing for 0s","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.303090+0000","last_change":"2024-04-23T10:25:00.303238+0000","last_active":"2024-04-23T10:25:00.303090+0000","last_peered":"2024-04-23T10:25:00.303090+0000","last_clean":"2024-04-23T10:25:00.303090+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:25:00.303090+0000","last_undegraded":"2024-04-23T10:25:00.303090+0000","last_fullsized":"2024-04-23T10:25:00.303090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:25:00.302863+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:25:00.302863+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.302863+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:25:23.443469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.294125+0000","last_change":"2024-04-23T10:24:45.294220+0000","last_active":"2024-04-23T10:24:45.294125+0000","last_peered":"2024-04-23T10:24:45.294125+0000","last_clean":"2024-04-23T10:24:45.294125+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:45.294125+0000","last_undegraded":"2024-04-23T10:24:45.294125+0000","last_fullsized":"2024-04-23T10:24:45.294125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:45.293942+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:45.293942+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.293942+0000","objects_scrubbed":3,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:11.020007+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.172900+0000","last_change":"2024-04-23T10:24:57.172961+0000","last_active":"2024-04-23T10:24:57.172900+0000","last_peered":"2024-04-23T10:24:57.172900+0000","last_clean":"2024-04-23T10:24:57.172900+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:57.172900+0000","last_undegraded":"2024-04-23T10:24:57.172900+0000","last_fullsized":"2024-04-23T10:24:57.172900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'790","last_scrub_stamp":"2024-04-23T10:24:57.172732+0000","last_deep_scrub":"26'790","last_deep_scrub_stamp":"2024-04-23T10:24:57.172732+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.172732+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:09.014343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.330806+0000","last_change":"2024-04-23T10:24:58.330938+0000","last_active":"2024-04-23T10:24:58.330806+0000","last_peered":"2024-04-23T10:24:58.330806+0000","last_clean":"2024-04-23T10:24:58.330806+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:58.330806+0000","last_undegraded":"2024-04-23T10:24:58.330806+0000","last_fullsized":"2024-04-23T10:24:58.330806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-23T10:24:58.330596+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-23T10:24:58.330596+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.330596+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:01.362542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'243","reported_seq":282,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.681086+0000","last_change":"2024-04-23T10:24:44.681147+0000","last_active":"2024-04-23T10:24:44.681086+0000","last_peered":"2024-04-23T10:24:44.681086+0000","last_clean":"2024-04-23T10:24:44.681086+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:44.681086+0000","last_undegraded":"2024-04-23T10:24:44.681086+0000","last_fullsized":"2024-04-23T10:24:44.681086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'243","last_scrub_stamp":"2024-04-23T10:24:44.680989+0000","last_deep_scrub":"26'243","last_deep_scrub_stamp":"2024-04-23T10:24:44.680989+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.680989+0000","objects_scrubbed":9,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:49:49.902343+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.799467+0000","last_change":"2024-04-23T10:24:54.799543+0000","last_active":"2024-04-23T10:24:54.799467+0000","last_peered":"2024-04-23T10:24:54.799467+0000","last_clean":"2024-04-23T10:24:54.799467+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:54.799467+0000","last_undegraded":"2024-04-23T10:24:54.799467+0000","last_fullsized":"2024-04-23T10:24:54.799467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'794","last_scrub_stamp":"2024-04-23T10:24:54.799261+0000","last_deep_scrub":"26'794","last_deep_scrub_stamp":"2024-04-23T10:24:54.799261+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.799261+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:59:56.445356+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.062427+0000","last_change":"2024-04-23T10:24:51.062486+0000","last_active":"2024-04-23T10:24:51.062427+0000","last_peered":"2024-04-23T10:24:51.062427+0000","last_clean":"2024-04-23T10:24:51.062427+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:51.062427+0000","last_undegraded":"2024-04-23T10:24:51.062427+0000","last_fullsized":"2024-04-23T10:24:51.062427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:51.062250+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:51.062250+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.062250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:52:47.262688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'77","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.084629+0000","last_change":"2024-04-23T10:24:49.084753+0000","last_active":"2024-04-23T10:24:49.084629+0000","last_peered":"2024-04-23T10:24:49.084629+0000","last_clean":"2024-04-23T10:24:49.084629+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:49.084629+0000","last_undegraded":"2024-04-23T10:24:49.084629+0000","last_fullsized":"2024-04-23T10:24:49.084629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-23T10:24:49.084411+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-23T10:24:49.084411+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.084411+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:24:18.817656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":860,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.629248+0000","last_change":"2024-04-23T10:24:58.629379+0000","last_active":"2024-04-23T10:24:58.629248+0000","last_peered":"2024-04-23T10:24:58.629248+0000","last_clean":"2024-04-23T10:24:58.629248+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:58.629248+0000","last_undegraded":"2024-04-23T10:24:58.629248+0000","last_fullsized":"2024-04-23T10:24:58.629248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'743","last_scrub_stamp":"2024-04-23T10:24:58.629021+0000","last_deep_scrub":"26'743","last_deep_scrub_stamp":"2024-04-23T10:24:58.629021+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.629021+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:52.752315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.322421+0000","last_change":"2024-04-23T10:24:57.322480+0000","last_active":"2024-04-23T10:24:57.322421+0000","last_peered":"2024-04-23T10:24:57.322421+0000","last_clean":"2024-04-23T10:24:57.322421+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:57.322421+0000","last_undegraded":"2024-04-23T10:24:57.322421+0000","last_fullsized":"2024-04-23T10:24:57.322421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:24:57.322246+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:24:57.322246+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.322246+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:32.287860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'75","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.236100+0000","last_change":"2024-04-23T10:24:49.236170+0000","last_active":"2024-04-23T10:24:49.236100+0000","last_peered":"2024-04-23T10:24:49.236100+0000","last_clean":"2024-04-23T10:24:49.236100+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:49.236100+0000","last_undegraded":"2024-04-23T10:24:49.236100+0000","last_fullsized":"2024-04-23T10:24:49.236100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2024-04-23T10:24:49.235928+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2024-04-23T10:24:49.235928+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.235928+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:32:21.167463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":826,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.620317+0000","last_change":"2024-04-23T10:24:57.620383+0000","last_active":"2024-04-23T10:24:57.620317+0000","last_peered":"2024-04-23T10:24:57.620317+0000","last_clean":"2024-04-23T10:24:57.620317+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:57.620317+0000","last_undegraded":"2024-04-23T10:24:57.620317+0000","last_fullsized":"2024-04-23T10:24:57.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'715","last_scrub_stamp":"2024-04-23T10:24:57.620132+0000","last_deep_scrub":"26'715","last_deep_scrub_stamp":"2024-04-23T10:24:57.620132+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.620132+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:34.592598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.845337+0000","last_change":"2024-04-23T10:24:51.845457+0000","last_active":"2024-04-23T10:24:51.845337+0000","last_peered":"2024-04-23T10:24:51.845337+0000","last_clean":"2024-04-23T10:24:51.845337+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:51.845337+0000","last_undegraded":"2024-04-23T10:24:51.845337+0000","last_fullsized":"2024-04-23T10:24:51.845337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:51.845131+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:51.845131+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.845131+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:06.018254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'568","reported_seq":607,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:43.920642+0000","last_change":"2024-04-23T10:24:43.920703+0000","last_active":"2024-04-23T10:24:43.920642+0000","last_peered":"2024-04-23T10:24:43.920642+0000","last_clean":"2024-04-23T10:24:43.920642+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:43.920642+0000","last_undegraded":"2024-04-23T10:24:43.920642+0000","last_fullsized":"2024-04-23T10:24:43.920642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'568","last_scrub_stamp":"2024-04-23T10:24:43.920564+0000","last_deep_scrub":"26'568","last_deep_scrub_stamp":"2024-04-23T10:24:43.920564+0000","last_clean_scrub_stamp":"2024-04-23T10:24:43.920564+0000","objects_scrubbed":8,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:01:43.125188+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":851,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.153706+0000","last_change":"2024-04-23T10:12:39.146761+0000","last_active":"2024-04-23T10:24:45.153706+0000","last_peered":"2024-04-23T10:24:45.153706+0000","last_clean":"2024-04-23T10:24:45.153706+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:24:45.153706+0000","last_undegraded":"2024-04-23T10:24:45.153706+0000","last_fullsized":"2024-04-23T10:24:45.153706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:01.337159+0000","last_change":"2024-04-23T10:25:01.337269+0000","last_active":"2024-04-23T10:25:01.337159+0000","last_peered":"2024-04-23T10:25:01.337159+0000","last_clean":"2024-04-23T10:25:01.337159+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:25:01.337159+0000","last_undegraded":"2024-04-23T10:25:01.337159+0000","last_fullsized":"2024-04-23T10:25:01.337159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:25:01.336963+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:25:01.336963+0000","last_clean_scrub_stamp":"2024-04-23T10:25:01.336963+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:45.925754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'420","reported_seq":460,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.053457+0000","last_change":"2024-04-23T10:24:46.053570+0000","last_active":"2024-04-23T10:24:46.053457+0000","last_peered":"2024-04-23T10:24:46.053457+0000","last_clean":"2024-04-23T10:24:46.053457+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:46.053457+0000","last_undegraded":"2024-04-23T10:24:46.053457+0000","last_fullsized":"2024-04-23T10:24:46.053457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'420","last_scrub_stamp":"2024-04-23T10:24:46.053289+0000","last_deep_scrub":"26'420","last_deep_scrub_stamp":"2024-04-23T10:24:46.053289+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.053289+0000","objects_scrubbed":8,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:32:20.204743+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.709746+0000","last_change":"2024-04-23T10:24:58.709825+0000","last_active":"2024-04-23T10:24:58.709746+0000","last_peered":"2024-04-23T10:24:58.709746+0000","last_clean":"2024-04-23T10:24:58.709746+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:58.709746+0000","last_undegraded":"2024-04-23T10:24:58.709746+0000","last_fullsized":"2024-04-23T10:24:58.709746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'768","last_scrub_stamp":"2024-04-23T10:24:58.709568+0000","last_deep_scrub":"26'768","last_deep_scrub_stamp":"2024-04-23T10:24:58.709568+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.709568+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:50.544966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.196114+0000","last_change":"2024-04-23T10:24:48.196172+0000","last_active":"2024-04-23T10:24:48.196114+0000","last_peered":"2024-04-23T10:24:48.196114+0000","last_clean":"2024-04-23T10:24:48.196114+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:48.196114+0000","last_undegraded":"2024-04-23T10:24:48.196114+0000","last_fullsized":"2024-04-23T10:24:48.196114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:48.195936+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:48.195936+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.195936+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:52.991155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'301","reported_seq":341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.808457+0000","last_change":"2024-04-23T10:24:44.808626+0000","last_active":"2024-04-23T10:24:44.808457+0000","last_peered":"2024-04-23T10:24:44.808457+0000","last_clean":"2024-04-23T10:24:44.808457+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:44.808457+0000","last_undegraded":"2024-04-23T10:24:44.808457+0000","last_fullsized":"2024-04-23T10:24:44.808457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'301","last_scrub_stamp":"2024-04-23T10:24:44.808248+0000","last_deep_scrub":"26'301","last_deep_scrub_stamp":"2024-04-23T10:24:44.808248+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.808248+0000","objects_scrubbed":4,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:44:25.431258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.224864+0000","last_change":"2024-04-23T10:24:53.224926+0000","last_active":"2024-04-23T10:24:53.224864+0000","last_peered":"2024-04-23T10:24:53.224864+0000","last_clean":"2024-04-23T10:24:53.224864+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:53.224864+0000","last_undegraded":"2024-04-23T10:24:53.224864+0000","last_fullsized":"2024-04-23T10:24:53.224864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'729","last_scrub_stamp":"2024-04-23T10:24:53.224686+0000","last_deep_scrub":"26'729","last_deep_scrub_stamp":"2024-04-23T10:24:53.224686+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.224686+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.053963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.833125+0000","last_change":"2024-04-23T10:24:58.833274+0000","last_active":"2024-04-23T10:24:58.833125+0000","last_peered":"2024-04-23T10:24:58.833125+0000","last_clean":"2024-04-23T10:24:58.833125+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:58.833125+0000","last_undegraded":"2024-04-23T10:24:58.833125+0000","last_fullsized":"2024-04-23T10:24:58.833125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-23T10:24:58.832918+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-23T10:24:58.832918+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.832918+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:22:40.310017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'277","reported_seq":317,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.240892+0000","last_change":"2024-04-23T10:24:51.241028+0000","last_active":"2024-04-23T10:24:51.240892+0000","last_peered":"2024-04-23T10:24:51.240892+0000","last_clean":"2024-04-23T10:24:51.240892+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:51.240892+0000","last_undegraded":"2024-04-23T10:24:51.240892+0000","last_fullsized":"2024-04-23T10:24:51.240892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-04-23T10:24:51.240639+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-04-23T10:24:51.240639+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.240639+0000","objects_scrubbed":3,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:06:18.947292+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.574898+0000","last_change":"2024-04-23T10:24:56.574970+0000","last_active":"2024-04-23T10:24:56.574898+0000","last_peered":"2024-04-23T10:24:56.574898+0000","last_clean":"2024-04-23T10:24:56.574898+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:56.574898+0000","last_undegraded":"2024-04-23T10:24:56.574898+0000","last_fullsized":"2024-04-23T10:24:56.574898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'809","last_scrub_stamp":"2024-04-23T10:24:56.574701+0000","last_deep_scrub":"26'809","last_deep_scrub_stamp":"2024-04-23T10:24:56.574701+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.574701+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:10.456635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.222744+0000","last_change":"2024-04-23T10:24:45.222821+0000","last_active":"2024-04-23T10:24:45.222744+0000","last_peered":"2024-04-23T10:24:45.222744+0000","last_clean":"2024-04-23T10:24:45.222744+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:45.222744+0000","last_undegraded":"2024-04-23T10:24:45.222744+0000","last_fullsized":"2024-04-23T10:24:45.222744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'222","last_scrub_stamp":"2024-04-23T10:24:45.222519+0000","last_deep_scrub":"26'222","last_deep_scrub_stamp":"2024-04-23T10:24:45.222519+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.222519+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:52.711185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'73","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.068044+0000","last_change":"2024-04-23T10:24:48.068112+0000","last_active":"2024-04-23T10:24:48.068044+0000","last_peered":"2024-04-23T10:24:48.068044+0000","last_clean":"2024-04-23T10:24:48.068044+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:48.068044+0000","last_undegraded":"2024-04-23T10:24:48.068044+0000","last_fullsized":"2024-04-23T10:24:48.068044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-04-23T10:24:48.067879+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-04-23T10:24:48.067879+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.067879+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:13:49.428070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.678633+0000","last_change":"2024-04-23T10:24:59.678733+0000","last_active":"2024-04-23T10:24:59.678633+0000","last_peered":"2024-04-23T10:24:59.678633+0000","last_clean":"2024-04-23T10:24:59.678633+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:59.678633+0000","last_undegraded":"2024-04-23T10:24:59.678633+0000","last_fullsized":"2024-04-23T10:24:59.678633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'832","last_scrub_stamp":"2024-04-23T10:24:59.678439+0000","last_deep_scrub":"26'832","last_deep_scrub_stamp":"2024-04-23T10:24:59.678439+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.678439+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:37:16.988603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.819726+0000","last_change":"2024-04-23T10:24:56.819788+0000","last_active":"2024-04-23T10:24:56.819726+0000","last_peered":"2024-04-23T10:24:56.819726+0000","last_clean":"2024-04-23T10:24:56.819726+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:56.819726+0000","last_undegraded":"2024-04-23T10:24:56.819726+0000","last_fullsized":"2024-04-23T10:24:56.819726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'810","last_scrub_stamp":"2024-04-23T10:24:56.819540+0000","last_deep_scrub":"26'810","last_deep_scrub_stamp":"2024-04-23T10:24:56.819540+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.819540+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:27:37.138846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.680478+0000","last_change":"2024-04-23T10:24:53.680538+0000","last_active":"2024-04-23T10:24:53.680478+0000","last_peered":"2024-04-23T10:24:53.680478+0000","last_clean":"2024-04-23T10:24:53.680478+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:53.680478+0000","last_undegraded":"2024-04-23T10:24:53.680478+0000","last_fullsized":"2024-04-23T10:24:53.680478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:24:53.680300+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:24:53.680300+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.680300+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:07.467468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1049","reported_seq":1089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.247814+0000","last_change":"2024-04-23T10:24:48.247889+0000","last_active":"2024-04-23T10:24:48.247814+0000","last_peered":"2024-04-23T10:24:48.247814+0000","last_clean":"2024-04-23T10:24:48.247814+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:48.247814+0000","last_undegraded":"2024-04-23T10:24:48.247814+0000","last_fullsized":"2024-04-23T10:24:48.247814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1049","last_scrub_stamp":"2024-04-23T10:24:48.247636+0000","last_deep_scrub":"26'1049","last_deep_scrub_stamp":"2024-04-23T10:24:48.247636+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.247636+0000","objects_scrubbed":3,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:23:30.261658+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":806,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.996271+0000","last_change":"2024-04-23T10:24:57.996336+0000","last_active":"2024-04-23T10:24:57.996271+0000","last_peered":"2024-04-23T10:24:57.996271+0000","last_clean":"2024-04-23T10:24:57.996271+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:57.996271+0000","last_undegraded":"2024-04-23T10:24:57.996271+0000","last_fullsized":"2024-04-23T10:24:57.996271+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'723","last_scrub_stamp":"2024-04-23T10:24:57.996086+0000","last_deep_scrub":"26'723","last_deep_scrub_stamp":"2024-04-23T10:24:57.996086+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.996086+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:34:25.064752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.734447+0000","last_change":"2024-04-23T10:24:52.734510+0000","last_active":"2024-04-23T10:24:52.734447+0000","last_peered":"2024-04-23T10:24:52.734447+0000","last_clean":"2024-04-23T10:24:52.734447+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:52.734447+0000","last_undegraded":"2024-04-23T10:24:52.734447+0000","last_fullsized":"2024-04-23T10:24:52.734447+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:24:52.734278+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:24:52.734278+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.734278+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:24:17.990136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'155","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.463753+0000","last_change":"2024-04-23T10:24:47.463824+0000","last_active":"2024-04-23T10:24:47.463753+0000","last_peered":"2024-04-23T10:24:47.463753+0000","last_clean":"2024-04-23T10:24:47.463753+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:47.463753+0000","last_undegraded":"2024-04-23T10:24:47.463753+0000","last_fullsized":"2024-04-23T10:24:47.463753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'155","last_scrub_stamp":"2024-04-23T10:24:47.463584+0000","last_deep_scrub":"26'155","last_deep_scrub_stamp":"2024-04-23T10:24:47.463584+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.463584+0000","objects_scrubbed":3,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:48:41.822513+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'379","reported_seq":418,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.087930+0000","last_change":"2024-04-23T10:24:50.088020+0000","last_active":"2024-04-23T10:24:50.087930+0000","last_peered":"2024-04-23T10:24:50.087930+0000","last_clean":"2024-04-23T10:24:50.087930+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:50.087930+0000","last_undegraded":"2024-04-23T10:24:50.087930+0000","last_fullsized":"2024-04-23T10:24:50.087930+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'379","last_scrub_stamp":"2024-04-23T10:24:50.087751+0000","last_deep_scrub":"26'379","last_deep_scrub_stamp":"2024-04-23T10:24:50.087751+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.087751+0000","objects_scrubbed":6,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:14.416736+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":224,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.847312+0000","last_change":"2024-04-23T10:24:50.847377+0000","last_active":"2024-04-23T10:24:50.847312+0000","last_peered":"2024-04-23T10:24:50.847312+0000","last_clean":"2024-04-23T10:24:50.847312+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:50.847312+0000","last_undegraded":"2024-04-23T10:24:50.847312+0000","last_fullsized":"2024-04-23T10:24:50.847312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:24:50.847129+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:24:50.847129+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.847129+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:19.995948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":810,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.673447+0000","last_change":"2024-04-23T10:24:50.673510+0000","last_active":"2024-04-23T10:24:50.673447+0000","last_peered":"2024-04-23T10:24:50.673447+0000","last_clean":"2024-04-23T10:24:50.673447+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:50.673447+0000","last_undegraded":"2024-04-23T10:24:50.673447+0000","last_fullsized":"2024-04-23T10:24:50.673447+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'716","last_scrub_stamp":"2024-04-23T10:24:50.673258+0000","last_deep_scrub":"26'716","last_deep_scrub_stamp":"2024-04-23T10:24:50.673258+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.673258+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:12:17.512931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'114","reported_seq":152,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.452893+0000","last_change":"2024-04-23T10:24:46.452959+0000","last_active":"2024-04-23T10:24:46.452893+0000","last_peered":"2024-04-23T10:24:46.452893+0000","last_clean":"2024-04-23T10:24:46.452893+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:46.452893+0000","last_undegraded":"2024-04-23T10:24:46.452893+0000","last_fullsized":"2024-04-23T10:24:46.452893+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'114","last_scrub_stamp":"2024-04-23T10:24:46.452818+0000","last_deep_scrub":"26'114","last_deep_scrub_stamp":"2024-04-23T10:24:46.452818+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.452818+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:27.133608+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":238,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.246501+0000","last_change":"2024-04-23T10:24:46.246559+0000","last_active":"2024-04-23T10:24:46.246501+0000","last_peered":"2024-04-23T10:24:46.246501+0000","last_clean":"2024-04-23T10:24:46.246501+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:46.246501+0000","last_undegraded":"2024-04-23T10:24:46.246501+0000","last_fullsized":"2024-04-23T10:24:46.246501+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:24:46.246333+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:24:46.246333+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.246333+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:57:41.487852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":875,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:29.994454+0000","last_change":"2024-04-23T10:13:16.027505+0000","last_active":"2024-04-23T10:24:29.994454+0000","last_peered":"2024-04-23T10:24:29.994454+0000","last_clean":"2024-04-23T10:24:29.994454+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:24:29.994454+0000","last_undegraded":"2024-04-23T10:24:29.994454+0000","last_fullsized":"2024-04-23T10:24:29.994454+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:38.046140+0000","last_clean_scrub_stamp":"2024-04-23T10:12:38.046140+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":256,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.082160+0000","last_change":"2024-04-23T10:24:52.082218+0000","last_active":"2024-04-23T10:24:52.082160+0000","last_peered":"2024-04-23T10:24:52.082160+0000","last_clean":"2024-04-23T10:24:52.082160+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:52.082160+0000","last_undegraded":"2024-04-23T10:24:52.082160+0000","last_fullsized":"2024-04-23T10:24:52.082160+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:24:52.081988+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:24:52.081988+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.081988+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:26.167286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.666505+0000","last_change":"2024-04-23T10:24:48.666563+0000","last_active":"2024-04-23T10:24:48.666505+0000","last_peered":"2024-04-23T10:24:48.666505+0000","last_clean":"2024-04-23T10:24:48.666505+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:48.666505+0000","last_undegraded":"2024-04-23T10:24:48.666505+0000","last_fullsized":"2024-04-23T10:24:48.666505+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'217","last_scrub_stamp":"2024-04-23T10:24:48.666339+0000","last_deep_scrub":"26'217","last_deep_scrub_stamp":"2024-04-23T10:24:48.666339+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.666339+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:39.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":276,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.287905+0000","last_change":"2024-04-23T10:24:54.287964+0000","last_active":"2024-04-23T10:24:54.287905+0000","last_peered":"2024-04-23T10:24:54.287905+0000","last_clean":"2024-04-23T10:24:54.287905+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:54.287905+0000","last_undegraded":"2024-04-23T10:24:54.287905+0000","last_fullsized":"2024-04-23T10:24:54.287905+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'238","last_scrub_stamp":"2024-04-23T10:24:54.287735+0000","last_deep_scrub":"26'238","last_deep_scrub_stamp":"2024-04-23T10:24:54.287735+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.287735+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:11:58.112894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.897965+0000","last_change":"2024-04-23T10:24:48.898094+0000","last_active":"2024-04-23T10:24:48.897965+0000","last_peered":"2024-04-23T10:24:48.897965+0000","last_clean":"2024-04-23T10:24:48.897965+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:48.897965+0000","last_undegraded":"2024-04-23T10:24:48.897965+0000","last_fullsized":"2024-04-23T10:24:48.897965+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:48.897766+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:48.897766+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.897766+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:55.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.457617+0000","last_change":"2024-04-23T10:24:44.457650+0000","last_active":"2024-04-23T10:24:44.457617+0000","last_peered":"2024-04-23T10:24:44.457617+0000","last_clean":"2024-04-23T10:24:44.457617+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:44.457617+0000","last_undegraded":"2024-04-23T10:24:44.457617+0000","last_fullsized":"2024-04-23T10:24:44.457617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-23T10:24:44.457540+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-23T10:24:44.457540+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.457540+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:59.205029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.634807+0000","last_change":"2024-04-23T10:24:52.634971+0000","last_active":"2024-04-23T10:24:52.634807+0000","last_peered":"2024-04-23T10:24:52.634807+0000","last_clean":"2024-04-23T10:24:52.634807+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:52.634807+0000","last_undegraded":"2024-04-23T10:24:52.634807+0000","last_fullsized":"2024-04-23T10:24:52.634807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-23T10:24:52.634574+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-23T10:24:52.634574+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.634574+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:41.604368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.976053+0000","last_change":"2024-04-23T10:24:56.976111+0000","last_active":"2024-04-23T10:24:56.976053+0000","last_peered":"2024-04-23T10:24:56.976053+0000","last_clean":"2024-04-23T10:24:56.976053+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:56.976053+0000","last_undegraded":"2024-04-23T10:24:56.976053+0000","last_fullsized":"2024-04-23T10:24:56.976053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'246","last_scrub_stamp":"2024-04-23T10:24:56.975881+0000","last_deep_scrub":"26'246","last_deep_scrub_stamp":"2024-04-23T10:24:56.975881+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.975881+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:54.652261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.535825+0000","last_change":"2024-04-23T10:24:54.535891+0000","last_active":"2024-04-23T10:24:54.535825+0000","last_peered":"2024-04-23T10:24:54.535825+0000","last_clean":"2024-04-23T10:24:54.535825+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:54.535825+0000","last_undegraded":"2024-04-23T10:24:54.535825+0000","last_fullsized":"2024-04-23T10:24:54.535825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:54.535638+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:54.535638+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.535638+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:41:42.206146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":258,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.251179+0000","last_change":"2024-04-23T10:24:53.251238+0000","last_active":"2024-04-23T10:24:53.251179+0000","last_peered":"2024-04-23T10:24:53.251179+0000","last_clean":"2024-04-23T10:24:53.251179+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:53.251179+0000","last_undegraded":"2024-04-23T10:24:53.251179+0000","last_fullsized":"2024-04-23T10:24:53.251179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:24:53.251000+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:24:53.251000+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.251000+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:58.005176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.464773+0000","last_change":"2024-04-23T10:24:45.464815+0000","last_active":"2024-04-23T10:24:45.464773+0000","last_peered":"2024-04-23T10:24:45.464773+0000","last_clean":"2024-04-23T10:24:45.464773+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:45.464773+0000","last_undegraded":"2024-04-23T10:24:45.464773+0000","last_fullsized":"2024-04-23T10:24:45.464773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:45.464685+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:45.464685+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.464685+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:45.209853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.241224+0000","last_change":"2024-04-23T10:24:46.241334+0000","last_active":"2024-04-23T10:24:46.241224+0000","last_peered":"2024-04-23T10:24:46.241224+0000","last_clean":"2024-04-23T10:24:46.241224+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:46.241224+0000","last_undegraded":"2024-04-23T10:24:46.241224+0000","last_fullsized":"2024-04-23T10:24:46.241224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:46.241011+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:46.241011+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.241011+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:30.655755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.817746+0000","last_change":"2024-04-23T10:24:52.817805+0000","last_active":"2024-04-23T10:24:52.817746+0000","last_peered":"2024-04-23T10:24:52.817746+0000","last_clean":"2024-04-23T10:24:52.817746+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:52.817746+0000","last_undegraded":"2024-04-23T10:24:52.817746+0000","last_fullsized":"2024-04-23T10:24:52.817746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:52.817577+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:52.817577+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.817577+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:35.035158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.014458+0000","last_change":"2024-04-23T10:24:54.014524+0000","last_active":"2024-04-23T10:24:54.014458+0000","last_peered":"2024-04-23T10:24:54.014458+0000","last_clean":"2024-04-23T10:24:54.014458+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:54.014458+0000","last_undegraded":"2024-04-23T10:24:54.014458+0000","last_fullsized":"2024-04-23T10:24:54.014458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:54.014249+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:54.014249+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.014249+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:24.566106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.295201+0000","last_change":"2024-04-23T10:24:59.295259+0000","last_active":"2024-04-23T10:24:59.295201+0000","last_peered":"2024-04-23T10:24:59.295201+0000","last_clean":"2024-04-23T10:24:59.295201+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:59.295201+0000","last_undegraded":"2024-04-23T10:24:59.295201+0000","last_fullsized":"2024-04-23T10:24:59.295201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:59.295024+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:59.295024+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.295024+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:22.108853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.618597+0000","last_change":"2024-04-23T10:24:49.618662+0000","last_active":"2024-04-23T10:24:49.618597+0000","last_peered":"2024-04-23T10:24:49.618597+0000","last_clean":"2024-04-23T10:24:49.618597+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:49.618597+0000","last_undegraded":"2024-04-23T10:24:49.618597+0000","last_fullsized":"2024-04-23T10:24:49.618597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:24:49.618420+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:24:49.618420+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.618420+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:15:34.746958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.299045+0000","last_change":"2024-04-23T10:24:55.299110+0000","last_active":"2024-04-23T10:24:55.299045+0000","last_peered":"2024-04-23T10:24:55.299045+0000","last_clean":"2024-04-23T10:24:55.299045+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:55.299045+0000","last_undegraded":"2024-04-23T10:24:55.299045+0000","last_fullsized":"2024-04-23T10:24:55.299045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:55.298873+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:55.298873+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.298873+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:43:53.074724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.700482+0000","last_change":"2024-04-23T10:24:51.700482+0000","last_active":"2024-04-23T10:24:51.700482+0000","last_peered":"2024-04-23T10:24:51.700482+0000","last_clean":"2024-04-23T10:24:51.700482+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:51.700482+0000","last_undegraded":"2024-04-23T10:24:51.700482+0000","last_fullsized":"2024-04-23T10:24:51.700482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-23T10:24:51.700128+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-23T10:24:51.700128+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.700128+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:57:44.414875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.691144+0000","last_change":"2024-04-23T10:24:50.691202+0000","last_active":"2024-04-23T10:24:50.691144+0000","last_peered":"2024-04-23T10:24:50.691144+0000","last_clean":"2024-04-23T10:24:50.691144+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:50.691144+0000","last_undegraded":"2024-04-23T10:24:50.691144+0000","last_fullsized":"2024-04-23T10:24:50.691144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-23T10:24:50.690970+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-23T10:24:50.690970+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.690970+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:06.736145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.921246+0000","last_change":"2024-04-23T10:24:45.921306+0000","last_active":"2024-04-23T10:24:45.921246+0000","last_peered":"2024-04-23T10:24:45.921246+0000","last_clean":"2024-04-23T10:24:45.921246+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:45.921246+0000","last_undegraded":"2024-04-23T10:24:45.921246+0000","last_fullsized":"2024-04-23T10:24:45.921246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:24:45.921082+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:24:45.921082+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.921082+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:21.459304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.504422+0000","last_change":"2024-04-23T10:24:53.504544+0000","last_active":"2024-04-23T10:24:53.504422+0000","last_peered":"2024-04-23T10:24:53.504422+0000","last_clean":"2024-04-23T10:24:53.504422+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:53.504422+0000","last_undegraded":"2024-04-23T10:24:53.504422+0000","last_fullsized":"2024-04-23T10:24:53.504422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:53.504198+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:53.504198+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.504198+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:01.149241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.192982+0000","last_change":"2024-04-23T10:24:50.193044+0000","last_active":"2024-04-23T10:24:50.192982+0000","last_peered":"2024-04-23T10:24:50.192982+0000","last_clean":"2024-04-23T10:24:50.192982+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:50.192982+0000","last_undegraded":"2024-04-23T10:24:50.192982+0000","last_fullsized":"2024-04-23T10:24:50.192982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:50.192807+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:50.192807+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.192807+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:18.792192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.061635+0000","last_change":"2024-04-23T10:24:55.061760+0000","last_active":"2024-04-23T10:24:55.061635+0000","last_peered":"2024-04-23T10:24:55.061635+0000","last_clean":"2024-04-23T10:24:55.061635+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:55.061635+0000","last_undegraded":"2024-04-23T10:24:55.061635+0000","last_fullsized":"2024-04-23T10:24:55.061635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:24:55.061421+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:24:55.061421+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.061421+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:27.015385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.016991+0000","last_change":"2024-04-23T10:24:56.017053+0000","last_active":"2024-04-23T10:24:56.016991+0000","last_peered":"2024-04-23T10:24:56.016991+0000","last_clean":"2024-04-23T10:24:56.016991+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:56.016991+0000","last_undegraded":"2024-04-23T10:24:56.016991+0000","last_fullsized":"2024-04-23T10:24:56.016991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:24:56.016819+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:24:56.016819+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.016819+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:32:20.695135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.347792+0000","last_change":"2024-04-23T10:24:46.347852+0000","last_active":"2024-04-23T10:24:46.347792+0000","last_peered":"2024-04-23T10:24:46.347792+0000","last_clean":"2024-04-23T10:24:46.347792+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:46.347792+0000","last_undegraded":"2024-04-23T10:24:46.347792+0000","last_fullsized":"2024-04-23T10:24:46.347792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-23T10:24:46.347620+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-23T10:24:46.347620+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.347620+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:28.360220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.481668+0000","last_change":"2024-04-23T10:24:51.481730+0000","last_active":"2024-04-23T10:24:51.481668+0000","last_peered":"2024-04-23T10:24:51.481668+0000","last_clean":"2024-04-23T10:24:51.481668+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:51.481668+0000","last_undegraded":"2024-04-23T10:24:51.481668+0000","last_fullsized":"2024-04-23T10:24:51.481668+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:24:51.481492+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:24:51.481492+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.481492+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.889258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":235,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.559369+0000","last_change":"2024-04-23T10:12:35.044869+0000","last_active":"2024-04-23T10:24:33.559369+0000","last_peered":"2024-04-23T10:24:33.559369+0000","last_clean":"2024-04-23T10:24:33.559369+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:24:33.559369+0000","last_undegraded":"2024-04-23T10:24:33.559369+0000","last_fullsized":"2024-04-23T10:24:33.559369+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.292122+0000","last_change":"2024-04-23T10:24:58.292183+0000","last_active":"2024-04-23T10:24:58.292122+0000","last_peered":"2024-04-23T10:24:58.292122+0000","last_clean":"2024-04-23T10:24:58.292122+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:58.292122+0000","last_undegraded":"2024-04-23T10:24:58.292122+0000","last_fullsized":"2024-04-23T10:24:58.292122+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'196","last_scrub_stamp":"2024-04-23T10:24:58.291942+0000","last_deep_scrub":"26'196","last_deep_scrub_stamp":"2024-04-23T10:24:58.291942+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.291942+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:42.505724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.340634+0000","last_change":"2024-04-23T10:24:47.340718+0000","last_active":"2024-04-23T10:24:47.340634+0000","last_peered":"2024-04-23T10:24:47.340634+0000","last_clean":"2024-04-23T10:24:47.340634+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:47.340634+0000","last_undegraded":"2024-04-23T10:24:47.340634+0000","last_fullsized":"2024-04-23T10:24:47.340634+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:24:47.340397+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:24:47.340397+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.340397+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:34.025341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.323274+0000","last_change":"2024-04-23T10:24:59.323336+0000","last_active":"2024-04-23T10:24:59.323274+0000","last_peered":"2024-04-23T10:24:59.323274+0000","last_clean":"2024-04-23T10:24:59.323274+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:59.323274+0000","last_undegraded":"2024-04-23T10:24:59.323274+0000","last_fullsized":"2024-04-23T10:24:59.323274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:59.323099+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:59.323099+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.323099+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:21.810345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.879819+0000","last_change":"2024-04-23T10:24:46.879957+0000","last_active":"2024-04-23T10:24:46.879819+0000","last_peered":"2024-04-23T10:24:46.879819+0000","last_clean":"2024-04-23T10:24:46.879819+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:46.879819+0000","last_undegraded":"2024-04-23T10:24:46.879819+0000","last_fullsized":"2024-04-23T10:24:46.879819+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:46.879609+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:46.879609+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.879609+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:21.088050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.675186+0000","last_change":"2024-04-23T10:24:54.675246+0000","last_active":"2024-04-23T10:24:54.675186+0000","last_peered":"2024-04-23T10:24:54.675186+0000","last_clean":"2024-04-23T10:24:54.675186+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:54.675186+0000","last_undegraded":"2024-04-23T10:24:54.675186+0000","last_fullsized":"2024-04-23T10:24:54.675186+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-23T10:24:54.675005+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-23T10:24:54.675005+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.675005+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:50.690888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:33.504880+0000","last_change":"2024-04-23T10:12:35.047249+0000","last_active":"2024-04-23T10:24:33.504880+0000","last_peered":"2024-04-23T10:24:33.504880+0000","last_clean":"2024-04-23T10:24:33.504880+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:24:33.504880+0000","last_undegraded":"2024-04-23T10:24:33.504880+0000","last_fullsized":"2024-04-23T10:24:33.504880+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-23T10:12:33.993614+0000","last_clean_scrub_stamp":"2024-04-23T10:12:33.993614+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10892,"ondisk_log_size":10892,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575004,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575002,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575002,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575004,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575004,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575004,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575003,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575004,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:25:06.863 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:25:06.864 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:25:06.864 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-23T10:12:38.046140+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=38, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:25:06.864 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:25:06.864 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-23T10:12:33.993614+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=12, tm_sec=33, tm_wday=1, tm_yday=114, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=23, tm_hour=10, tm_min=24, tm_sec=41, tm_wday=1, tm_yday=114, tm_isdst=0) 2024-04-23T10:25:06.864 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-23T10:25:08.073 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:08.076 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:26.865 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-23T10:25:26.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 Processor -- start 2024-04-23T10:25:26.998 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 -- start start 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1fb40c6690 0x7f1fb41593b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb41598f0 0x7f1fb40c6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1fb40c4800 con 0x7f1fb415f800 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f1fb40c4ac0 con 0x7f1fb40c6690 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb9792640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb40c4da0 con 0x7f1fb41598f0 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1fb40c6690 0x7f1fb41593b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.000 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f1fb40c6690 0x7f1fb41593b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40240/0 (socket says 172.21.15.26:40240) 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 -- 172.21.15.26:0/2229909214 learned_addr learned my addr 172.21.15.26:0/2229909214 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb37fe640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb41598f0 0x7f1fb40c6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 -- 172.21.15.26:0/2229909214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb41598f0 msgr2=0x7f1fb40c6ee0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb41598f0 0x7f1fb40c6ee0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 -- 172.21.15.26:0/2229909214 >> v1:172.21.15.190:6789/0 conn(0x7f1fb415f800 legacy=0x7f1fb415fbe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.001 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.001+0000 7f1fb27fc640 1 -- 172.21.15.26:0/2229909214 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb40c5080 con 0x7f1fb40c6690 2024-04-23T10:25:27.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb27fc640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb40c6690 0x7f1fb41593b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009870 tx=0x7f1fa801c530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d315ad211bf0c7b server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.002 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb1ffb640 1 -- 172.21.15.26:0/2229909214 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80ab640 con 0x7f1fb40c6690 2024-04-23T10:25:27.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb1ffb640 1 -- 172.21.15.26:0/2229909214 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fa80b0070 con 0x7f1fb40c6690 2024-04-23T10:25:27.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb1ffb640 1 -- 172.21.15.26:0/2229909214 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fa80aba00 con 0x7f1fb40c6690 2024-04-23T10:25:27.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- 172.21.15.26:0/2229909214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb40c6690 msgr2=0x7f1fb41593b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.003 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb40c6690 0x7f1fb41593b0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7f1fa8009870 tx=0x7f1fa801c530 comp rx=0 tx=0).stop 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- 172.21.15.26:0/2229909214 shutdown_connections 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb41598f0 0x7f1fb40c6ee0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- 172.21.15.26:0/2229909214 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb40c6690 0x7f1fb41593b0 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- 172.21.15.26:0/2229909214 >> 172.21.15.26:0/2229909214 conn(0x7f1fb406b9d0 msgr2=0x7f1fb406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- 172.21.15.26:0/2229909214 shutdown_connections 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- 172.21.15.26:0/2229909214 wait complete. 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 Processor -- start 2024-04-23T10:25:27.004 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- start start 2024-04-23T10:25:27.006 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb40c6690 0x7f1fb4157ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb41598f0 0x7f1fb4147e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb40c7830 con 0x7f1fb415f800 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f1fb41602f0 con 0x7f1fb41598f0 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb9792640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f1fb406f700 con 0x7f1fb40c6690 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb37fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40248/0 (socket says 172.21.15.26:40248) 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.005+0000 7f1fb37fe640 1 -- 172.21.15.26:0/3337383036 learned_addr learned my addr 172.21.15.26:0/3337383036 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb27fc640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb41598f0 0x7f1fb4147e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb2ffd640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb40c6690 0x7f1fb4157ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 -- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb40c6690 msgr2=0x7f1fb4157ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb40c6690 0x7f1fb4157ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 -- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb41598f0 msgr2=0x7f1fb4147e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.007 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb41598f0 0x7f1fb4147e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 -- 172.21.15.26:0/3337383036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1fb41fc3d0 con 0x7f1fb415f800 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb37fe640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009dd0 tx=0x7f1fac00c490 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac018020 con 0x7f1fb415f800 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1fac014480 con 0x7f1fb415f800 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1fb415efc0 con 0x7f1fb415f800 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f1fac014870 con 0x7f1fb415f800 2024-04-23T10:25:27.008 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1fb415f260 con 0x7f1fb415f800 2024-04-23T10:25:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1fb414f700 con 0x7f1fb415f800 2024-04-23T10:25:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f1fac01b020 con 0x7f1fb415f800 2024-04-23T10:25:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 0x7f1fa006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f1fac087840 con 0x7f1fb415f800 2024-04-23T10:25:27.009 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.009+0000 7f1fb2ffd640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 0x7f1fa006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.010 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.013+0000 7f1fb2ffd640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 0x7f1fa006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40015b0 tx=0x7f1fa4009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.013 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.013+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f1fac022070 con 0x7f1fb415f800 2024-04-23T10:25:27.177 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.177+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 --> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1fb4075df0 con 0x7f1fa0068380 2024-04-23T10:25:27.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.201+0000 7f1f9b7fe640 1 -- 172.21.15.26:0/3337383036 <== mgr.4105 v2:172.21.15.190:6832/2066447761 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+335256 (secure 0 0 0) 0x7f1fb4075df0 con 0x7f1fa0068380 2024-04-23T10:25:27.205 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:25:27.207 INFO:teuthology.orchestra.run.smithi026.stderr:dumped all 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 msgr2=0x7f1fa006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 0x7f1fa006a840 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f1fa40015b0 tx=0x7f1fa4009040 comp rx=0 tx=0).stop 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 msgr2=0x7f1fb414d610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7f1fac009dd0 tx=0x7f1fac00c490 comp rx=0 tx=0).stop 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 shutdown_connections 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f1fa0068380 0x7f1fa006a840 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f1fb415f800 0x7f1fb414d610 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f1fb41598f0 0x7f1fb4147e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.208 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 --2- 172.21.15.26:0/3337383036 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f1fb40c6690 0x7f1fb4157ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 >> 172.21.15.26:0/3337383036 conn(0x7f1fb406b9d0 msgr2=0x7f1fb40c6bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 shutdown_connections 2024-04-23T10:25:27.209 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.209+0000 7f1fb9792640 1 -- 172.21.15.26:0/3337383036 wait complete. 2024-04-23T10:25:27.225 INFO:teuthology.orchestra.run.smithi026.stdout:{"pg_ready":true,"pg_map":{"version":411,"stamp":"2024-04-23T10:25:25.228288+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":136147029,"num_objects":132,"num_object_clones":0,"num_object_copies":264,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":132,"num_whiteouts":0,"num_read":3269,"num_read_kb":1384152,"num_write":34250,"num_write_kb":4408836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":49050,"ondisk_log_size":49050,"up":322,"acting":322,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":322,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":909104,"kb_used_data":268336,"kb_used_omap":12,"kb_used_meta":640691,"kb_avail":754065616,"statfs":{"total":773094113280,"available":772163190784,"internally_reserved":0,"allocated":274776064,"data_stored":273209642,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12752,"internal_metadata":656068144},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005040"},"pg_stats":[{"pgid":"2.1f","version":"26'125","reported_seq":165,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.918266+0000","last_change":"2024-04-23T10:24:44.918266+0000","last_active":"2024-04-23T10:24:44.918266+0000","last_peered":"2024-04-23T10:24:44.918266+0000","last_clean":"2024-04-23T10:24:44.918266+0000","last_became_active":"2024-04-23T10:12:34.047489+0000","last_became_peered":"2024-04-23T10:12:34.047489+0000","last_unstale":"2024-04-23T10:24:44.918266+0000","last_undegraded":"2024-04-23T10:24:44.918266+0000","last_fullsized":"2024-04-23T10:24:44.918266+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'125","last_scrub_stamp":"2024-04-23T10:24:44.918168+0000","last_deep_scrub":"26'125","last_deep_scrub_stamp":"2024-04-23T10:24:44.918168+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.918168+0000","objects_scrubbed":7,"log_size":125,"log_dups_size":0,"ondisk_log_size":125,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:51:56.729277+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194976,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":83,"num_write_kb":4144,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1e","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.524249+0000","last_change":"2024-04-23T10:24:55.524310+0000","last_active":"2024-04-23T10:24:55.524249+0000","last_peered":"2024-04-23T10:24:55.524249+0000","last_clean":"2024-04-23T10:24:55.524249+0000","last_became_active":"2024-04-23T10:12:35.047408+0000","last_became_peered":"2024-04-23T10:12:35.047408+0000","last_unstale":"2024-04-23T10:24:55.524249+0000","last_undegraded":"2024-04-23T10:24:55.524249+0000","last_fullsized":"2024-04-23T10:24:55.524249+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:55.524068+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:55.524068+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.524068+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:32.293851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"26'784","reported_seq":888,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.724682+0000","last_change":"2024-04-23T10:25:00.724747+0000","last_active":"2024-04-23T10:25:00.724682+0000","last_peered":"2024-04-23T10:25:00.724682+0000","last_clean":"2024-04-23T10:25:00.724682+0000","last_became_active":"2024-04-23T10:12:39.146378+0000","last_became_peered":"2024-04-23T10:12:39.146378+0000","last_unstale":"2024-04-23T10:25:00.724682+0000","last_undegraded":"2024-04-23T10:25:00.724682+0000","last_fullsized":"2024-04-23T10:25:00.724682+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'784","last_scrub_stamp":"2024-04-23T10:25:00.724486+0000","last_deep_scrub":"26'784","last_deep_scrub_stamp":"2024-04-23T10:25:00.724486+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.724486+0000","objects_scrubbed":0,"log_size":784,"log_dups_size":0,"ondisk_log_size":784,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:48:56.024378+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":28693,"num_write":772,"num_write_kb":103365,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,7,0],"acting":[3,2,7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1e","version":"26'474","reported_seq":514,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.458311+0000","last_change":"2024-04-23T10:24:48.458479+0000","last_active":"2024-04-23T10:24:48.458311+0000","last_peered":"2024-04-23T10:24:48.458311+0000","last_clean":"2024-04-23T10:24:48.458311+0000","last_became_active":"2024-04-23T10:12:34.041746+0000","last_became_peered":"2024-04-23T10:12:34.041746+0000","last_unstale":"2024-04-23T10:24:48.458311+0000","last_undegraded":"2024-04-23T10:24:48.458311+0000","last_fullsized":"2024-04-23T10:24:48.458311+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'474","last_scrub_stamp":"2024-04-23T10:24:48.458095+0000","last_deep_scrub":"26'474","last_deep_scrub_stamp":"2024-04-23T10:24:48.458095+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.458095+0000","objects_scrubbed":1,"log_size":474,"log_dups_size":0,"ondisk_log_size":474,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:37:20.917017+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":429,"num_write_kb":4221,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1f","version":"26'187","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.920687+0000","last_change":"2024-04-23T10:24:47.920687+0000","last_active":"2024-04-23T10:24:47.920687+0000","last_peered":"2024-04-23T10:24:47.920687+0000","last_clean":"2024-04-23T10:24:47.920687+0000","last_became_active":"2024-04-23T10:12:35.028297+0000","last_became_peered":"2024-04-23T10:12:35.028297+0000","last_unstale":"2024-04-23T10:24:47.920687+0000","last_undegraded":"2024-04-23T10:24:47.920687+0000","last_fullsized":"2024-04-23T10:24:47.920687+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:47.920433+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:47.920433+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.920433+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:54:56.844175+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.18","version":"26'778","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.186564+0000","last_change":"2024-04-23T10:24:54.186631+0000","last_active":"2024-04-23T10:24:54.186564+0000","last_peered":"2024-04-23T10:24:54.186564+0000","last_clean":"2024-04-23T10:24:54.186564+0000","last_became_active":"2024-04-23T10:12:39.099310+0000","last_became_peered":"2024-04-23T10:12:39.099310+0000","last_unstale":"2024-04-23T10:24:54.186564+0000","last_undegraded":"2024-04-23T10:24:54.186564+0000","last_fullsized":"2024-04-23T10:24:54.186564+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'778","last_scrub_stamp":"2024-04-23T10:24:54.186374+0000","last_deep_scrub":"26'778","last_deep_scrub_stamp":"2024-04-23T10:24:54.186374+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.186374+0000","objects_scrubbed":0,"log_size":778,"log_dups_size":0,"ondisk_log_size":778,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:00:40.947727+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":113,"num_read_kb":66748,"num_write":759,"num_write_kb":155630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6,1,3],"acting":[4,6,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1d","version":"26'350","reported_seq":390,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.311869+0000","last_change":"2024-04-23T10:24:54.311869+0000","last_active":"2024-04-23T10:24:54.311869+0000","last_peered":"2024-04-23T10:24:54.311869+0000","last_clean":"2024-04-23T10:24:54.311869+0000","last_became_active":"2024-04-23T10:12:34.051028+0000","last_became_peered":"2024-04-23T10:12:34.051028+0000","last_unstale":"2024-04-23T10:24:54.311869+0000","last_undegraded":"2024-04-23T10:24:54.311869+0000","last_fullsized":"2024-04-23T10:24:54.311869+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'350","last_scrub_stamp":"2024-04-23T10:24:54.311583+0000","last_deep_scrub":"26'350","last_deep_scrub_stamp":"2024-04-23T10:24:54.311583+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.311583+0000","objects_scrubbed":10,"log_size":350,"log_dups_size":0,"ondisk_log_size":350,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:52:20.107854+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":283,"num_write_kb":12459,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":7,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1c","version":"26'190","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.239474+0000","last_change":"2024-04-23T10:24:52.239474+0000","last_active":"2024-04-23T10:24:52.239474+0000","last_peered":"2024-04-23T10:24:52.239474+0000","last_clean":"2024-04-23T10:24:52.239474+0000","last_became_active":"2024-04-23T10:12:35.018158+0000","last_became_peered":"2024-04-23T10:12:35.018158+0000","last_unstale":"2024-04-23T10:24:52.239474+0000","last_undegraded":"2024-04-23T10:24:52.239474+0000","last_fullsized":"2024-04-23T10:24:52.239474+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:24:52.239244+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:24:52.239244+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.239244+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:52:58.486490+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"26'776","reported_seq":871,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.151814+0000","last_change":"2024-04-23T10:24:56.151814+0000","last_active":"2024-04-23T10:24:56.151814+0000","last_peered":"2024-04-23T10:24:56.151814+0000","last_clean":"2024-04-23T10:24:56.151814+0000","last_became_active":"2024-04-23T10:12:39.099168+0000","last_became_peered":"2024-04-23T10:12:39.099168+0000","last_unstale":"2024-04-23T10:24:56.151814+0000","last_undegraded":"2024-04-23T10:24:56.151814+0000","last_fullsized":"2024-04-23T10:24:56.151814+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'776","last_scrub_stamp":"2024-04-23T10:24:56.151538+0000","last_deep_scrub":"26'776","last_deep_scrub_stamp":"2024-04-23T10:24:56.151538+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.151538+0000","objects_scrubbed":0,"log_size":776,"log_dups_size":0,"ondisk_log_size":776,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:19.524342+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":22230,"num_write":765,"num_write_kb":140073,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.1c","version":"26'284","reported_seq":324,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.323469+0000","last_change":"2024-04-23T10:24:52.323469+0000","last_active":"2024-04-23T10:24:52.323469+0000","last_peered":"2024-04-23T10:24:52.323469+0000","last_clean":"2024-04-23T10:24:52.323469+0000","last_became_active":"2024-04-23T10:12:34.047108+0000","last_became_peered":"2024-04-23T10:12:34.047108+0000","last_unstale":"2024-04-23T10:24:52.323469+0000","last_undegraded":"2024-04-23T10:24:52.323469+0000","last_fullsized":"2024-04-23T10:24:52.323469+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'284","last_scrub_stamp":"2024-04-23T10:24:52.323224+0000","last_deep_scrub":"26'284","last_deep_scrub_stamp":"2024-04-23T10:24:52.323224+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.323224+0000","objects_scrubbed":4,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:07:18.013565+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194886,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":224,"num_write_kb":4220,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1d","version":"26'204","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.356307+0000","last_change":"2024-04-23T10:25:00.356307+0000","last_active":"2024-04-23T10:25:00.356307+0000","last_peered":"2024-04-23T10:25:00.356307+0000","last_clean":"2024-04-23T10:25:00.356307+0000","last_became_active":"2024-04-23T10:12:35.033318+0000","last_became_peered":"2024-04-23T10:12:35.033318+0000","last_unstale":"2024-04-23T10:25:00.356307+0000","last_undegraded":"2024-04-23T10:25:00.356307+0000","last_fullsized":"2024-04-23T10:25:00.356307+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:25:00.356066+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:25:00.356066+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.356066+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:43.744638+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1a","version":"26'757","reported_seq":856,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.222040+0000","last_change":"2024-04-23T10:24:51.222040+0000","last_active":"2024-04-23T10:24:51.222040+0000","last_peered":"2024-04-23T10:24:51.222040+0000","last_clean":"2024-04-23T10:24:51.222040+0000","last_became_active":"2024-04-23T10:12:39.082243+0000","last_became_peered":"2024-04-23T10:12:39.082243+0000","last_unstale":"2024-04-23T10:24:51.222040+0000","last_undegraded":"2024-04-23T10:24:51.222040+0000","last_fullsized":"2024-04-23T10:24:51.222040+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'757","last_scrub_stamp":"2024-04-23T10:24:51.221755+0000","last_deep_scrub":"26'757","last_deep_scrub_stamp":"2024-04-23T10:24:51.221755+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.221755+0000","objects_scrubbed":0,"log_size":757,"log_dups_size":0,"ondisk_log_size":757,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:34:39.851691+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":67,"num_read_kb":29826,"num_write":737,"num_write_kb":97607,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,0,5],"acting":[4,3,0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"26'208","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.033493+0000","last_change":"2024-04-23T10:24:53.033551+0000","last_active":"2024-04-23T10:24:53.033493+0000","last_peered":"2024-04-23T10:24:53.033493+0000","last_clean":"2024-04-23T10:24:53.033493+0000","last_became_active":"2024-04-23T10:12:35.036695+0000","last_became_peered":"2024-04-23T10:12:35.036695+0000","last_unstale":"2024-04-23T10:24:53.033493+0000","last_undegraded":"2024-04-23T10:24:53.033493+0000","last_fullsized":"2024-04-23T10:24:53.033493+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'208","last_scrub_stamp":"2024-04-23T10:24:53.033320+0000","last_deep_scrub":"26'208","last_deep_scrub_stamp":"2024-04-23T10:24:53.033320+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.033320+0000","objects_scrubbed":0,"log_size":208,"log_dups_size":0,"ondisk_log_size":208,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:45:33.955914+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.b","version":"26'183","reported_seq":223,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.367512+0000","last_change":"2024-04-23T10:24:49.367625+0000","last_active":"2024-04-23T10:24:49.367512+0000","last_peered":"2024-04-23T10:24:49.367512+0000","last_clean":"2024-04-23T10:24:49.367512+0000","last_became_active":"2024-04-23T10:12:34.045668+0000","last_became_peered":"2024-04-23T10:12:34.045668+0000","last_unstale":"2024-04-23T10:24:49.367512+0000","last_undegraded":"2024-04-23T10:24:49.367512+0000","last_fullsized":"2024-04-23T10:24:49.367512+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:24:49.367303+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:24:49.367303+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.367303+0000","objects_scrubbed":4,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:34:29.623495+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":127,"num_write_kb":8254,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.d","version":"26'817","reported_seq":926,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.260097+0000","last_change":"2024-04-23T10:24:59.260164+0000","last_active":"2024-04-23T10:24:59.260097+0000","last_peered":"2024-04-23T10:24:59.260097+0000","last_clean":"2024-04-23T10:24:59.260097+0000","last_became_active":"2024-04-23T10:13:16.028746+0000","last_became_peered":"2024-04-23T10:13:16.028746+0000","last_unstale":"2024-04-23T10:24:59.260097+0000","last_undegraded":"2024-04-23T10:24:59.260097+0000","last_fullsized":"2024-04-23T10:24:59.260097+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'817","last_scrub_stamp":"2024-04-23T10:24:59.259806+0000","last_deep_scrub":"26'817","last_deep_scrub_stamp":"2024-04-23T10:24:59.259806+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.259806+0000","objects_scrubbed":0,"log_size":817,"log_dups_size":0,"ondisk_log_size":817,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:51:54.233170+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":70,"num_read_kb":42103,"num_write":798,"num_write_kb":164741,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0,2,5],"acting":[4,0,2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"26'216","reported_seq":253,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.525865+0000","last_change":"2024-04-23T10:24:52.525928+0000","last_active":"2024-04-23T10:24:52.525865+0000","last_peered":"2024-04-23T10:24:52.525865+0000","last_clean":"2024-04-23T10:24:52.525865+0000","last_became_active":"2024-04-23T10:12:35.030805+0000","last_became_peered":"2024-04-23T10:12:35.030805+0000","last_unstale":"2024-04-23T10:24:52.525865+0000","last_undegraded":"2024-04-23T10:24:52.525865+0000","last_fullsized":"2024-04-23T10:24:52.525865+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'216","last_scrub_stamp":"2024-04-23T10:24:52.525686+0000","last_deep_scrub":"26'216","last_deep_scrub_stamp":"2024-04-23T10:24:52.525686+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.525686+0000","objects_scrubbed":0,"log_size":216,"log_dups_size":0,"ondisk_log_size":216,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:23:19.550754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.a","version":"26'220","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.808834+0000","last_change":"2024-04-23T10:24:46.808904+0000","last_active":"2024-04-23T10:24:46.808834+0000","last_peered":"2024-04-23T10:24:46.808834+0000","last_clean":"2024-04-23T10:24:46.808834+0000","last_became_active":"2024-04-23T10:12:34.035800+0000","last_became_peered":"2024-04-23T10:12:34.035800+0000","last_unstale":"2024-04-23T10:24:46.808834+0000","last_undegraded":"2024-04-23T10:24:46.808834+0000","last_fullsized":"2024-04-23T10:24:46.808834+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:24:46.808662+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:24:46.808662+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.808662+0000","objects_scrubbed":3,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:45:45.268825+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":154,"num_write_kb":4200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"26'802","reported_seq":873,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.184475+0000","last_change":"2024-04-23T10:24:55.184600+0000","last_active":"2024-04-23T10:24:55.184475+0000","last_peered":"2024-04-23T10:24:55.184475+0000","last_clean":"2024-04-23T10:24:55.184475+0000","last_became_active":"2024-04-23T10:12:39.099983+0000","last_became_peered":"2024-04-23T10:12:39.099983+0000","last_unstale":"2024-04-23T10:24:55.184475+0000","last_undegraded":"2024-04-23T10:24:55.184475+0000","last_fullsized":"2024-04-23T10:24:55.184475+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'802","last_scrub_stamp":"2024-04-23T10:24:55.184174+0000","last_deep_scrub":"26'802","last_deep_scrub_stamp":"2024-04-23T10:24:55.184174+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.184174+0000","objects_scrubbed":0,"log_size":802,"log_dups_size":0,"ondisk_log_size":802,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:09:14.802714+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":39,"num_read_kb":20582,"num_write":786,"num_write_kb":72388,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.8","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.432156+0000","last_change":"2024-04-23T10:24:49.432272+0000","last_active":"2024-04-23T10:24:49.432156+0000","last_peered":"2024-04-23T10:24:49.432156+0000","last_clean":"2024-04-23T10:24:49.432156+0000","last_became_active":"2024-04-23T10:12:35.024277+0000","last_became_peered":"2024-04-23T10:12:35.024277+0000","last_unstale":"2024-04-23T10:24:49.432156+0000","last_undegraded":"2024-04-23T10:24:49.432156+0000","last_fullsized":"2024-04-23T10:24:49.432156+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:49.431923+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:49.431923+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.431923+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:56:18.341636+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.9","version":"26'71","reported_seq":111,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.737460+0000","last_change":"2024-04-23T10:24:48.737535+0000","last_active":"2024-04-23T10:24:48.737460+0000","last_peered":"2024-04-23T10:24:48.737460+0000","last_clean":"2024-04-23T10:24:48.737460+0000","last_became_active":"2024-04-23T10:12:34.044515+0000","last_became_peered":"2024-04-23T10:12:34.044515+0000","last_unstale":"2024-04-23T10:24:48.737460+0000","last_undegraded":"2024-04-23T10:24:48.737460+0000","last_fullsized":"2024-04-23T10:24:48.737460+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'71","last_scrub_stamp":"2024-04-23T10:24:48.737294+0000","last_deep_scrub":"26'71","last_deep_scrub_stamp":"2024-04-23T10:24:48.737294+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.737294+0000","objects_scrubbed":4,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:17:52.081824+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.f","version":"26'747","reported_seq":842,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.746778+0000","last_change":"2024-04-23T10:24:59.746844+0000","last_active":"2024-04-23T10:24:59.746778+0000","last_peered":"2024-04-23T10:24:59.746778+0000","last_clean":"2024-04-23T10:24:59.746778+0000","last_became_active":"2024-04-23T10:12:39.140471+0000","last_became_peered":"2024-04-23T10:12:39.140471+0000","last_unstale":"2024-04-23T10:24:59.746778+0000","last_undegraded":"2024-04-23T10:24:59.746778+0000","last_fullsized":"2024-04-23T10:24:59.746778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-23T10:24:59.746581+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-23T10:24:59.746581+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.746581+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:45:15.067264+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":30652,"num_write":729,"num_write_kb":117690,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,4,7],"acting":[1,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.9","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.241183+0000","last_change":"2024-04-23T10:24:47.241242+0000","last_active":"2024-04-23T10:24:47.241183+0000","last_peered":"2024-04-23T10:24:47.241183+0000","last_clean":"2024-04-23T10:24:47.241183+0000","last_became_active":"2024-04-23T10:12:35.021146+0000","last_became_peered":"2024-04-23T10:12:35.021146+0000","last_unstale":"2024-04-23T10:24:47.241183+0000","last_undegraded":"2024-04-23T10:24:47.241183+0000","last_fullsized":"2024-04-23T10:24:47.241183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:47.241009+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:47.241009+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.241009+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:42:56.883341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.8","version":"26'477","reported_seq":517,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.386747+0000","last_change":"2024-04-23T10:24:50.386840+0000","last_active":"2024-04-23T10:24:50.386747+0000","last_peered":"2024-04-23T10:24:50.386747+0000","last_clean":"2024-04-23T10:24:50.386747+0000","last_became_active":"2024-04-23T10:12:34.045862+0000","last_became_peered":"2024-04-23T10:12:34.045862+0000","last_unstale":"2024-04-23T10:24:50.386747+0000","last_undegraded":"2024-04-23T10:24:50.386747+0000","last_fullsized":"2024-04-23T10:24:50.386747+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'477","last_scrub_stamp":"2024-04-23T10:24:50.386533+0000","last_deep_scrub":"26'477","last_deep_scrub_stamp":"2024-04-23T10:24:50.386533+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.386533+0000","objects_scrubbed":2,"log_size":477,"log_dups_size":0,"ondisk_log_size":477,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:28:47.335230+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":416,"num_write_kb":4354,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.e","version":"26'721","reported_seq":850,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.190035+0000","last_change":"2024-04-23T10:24:52.190170+0000","last_active":"2024-04-23T10:24:52.190035+0000","last_peered":"2024-04-23T10:24:52.190035+0000","last_clean":"2024-04-23T10:24:52.190035+0000","last_became_active":"2024-04-23T10:12:39.088929+0000","last_became_peered":"2024-04-23T10:12:39.088929+0000","last_unstale":"2024-04-23T10:24:52.190035+0000","last_undegraded":"2024-04-23T10:24:52.190035+0000","last_fullsized":"2024-04-23T10:24:52.190035+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'721","last_scrub_stamp":"2024-04-23T10:24:52.189732+0000","last_deep_scrub":"26'721","last_deep_scrub_stamp":"2024-04-23T10:24:52.189732+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.189732+0000","objects_scrubbed":0,"log_size":721,"log_dups_size":0,"ondisk_log_size":721,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:07:13.106560+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":53711,"num_write":710,"num_write_kb":118359,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3,6,1],"acting":[4,3,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"26'224","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.893835+0000","last_change":"2024-04-23T10:24:49.893900+0000","last_active":"2024-04-23T10:24:49.893835+0000","last_peered":"2024-04-23T10:24:49.893835+0000","last_clean":"2024-04-23T10:24:49.893835+0000","last_became_active":"2024-04-23T10:12:35.028050+0000","last_became_peered":"2024-04-23T10:12:35.028050+0000","last_unstale":"2024-04-23T10:24:49.893835+0000","last_undegraded":"2024-04-23T10:24:49.893835+0000","last_fullsized":"2024-04-23T10:24:49.893835+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'224","last_scrub_stamp":"2024-04-23T10:24:49.893656+0000","last_deep_scrub":"26'224","last_deep_scrub_stamp":"2024-04-23T10:24:49.893656+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.893656+0000","objects_scrubbed":0,"log_size":224,"log_dups_size":0,"ondisk_log_size":224,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:52:03.508582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"26'84","reported_seq":124,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.057978+0000","last_change":"2024-04-23T10:24:47.058056+0000","last_active":"2024-04-23T10:24:47.057978+0000","last_peered":"2024-04-23T10:24:47.057978+0000","last_clean":"2024-04-23T10:24:47.057978+0000","last_became_active":"2024-04-23T10:12:34.048295+0000","last_became_peered":"2024-04-23T10:12:34.048295+0000","last_unstale":"2024-04-23T10:24:47.057978+0000","last_undegraded":"2024-04-23T10:24:47.057978+0000","last_fullsized":"2024-04-23T10:24:47.057978+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'84","last_scrub_stamp":"2024-04-23T10:24:47.057809+0000","last_deep_scrub":"26'84","last_deep_scrub_stamp":"2024-04-23T10:24:47.057809+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.057809+0000","objects_scrubbed":4,"log_size":84,"log_dups_size":0,"ondisk_log_size":84,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:04:39.109858+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":22,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1","version":"26'826","reported_seq":970,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.211597+0000","last_change":"2024-04-23T10:24:58.211597+0000","last_active":"2024-04-23T10:24:58.211597+0000","last_peered":"2024-04-23T10:24:58.211597+0000","last_clean":"2024-04-23T10:24:58.211597+0000","last_became_active":"2024-04-23T10:12:39.140333+0000","last_became_peered":"2024-04-23T10:12:39.140333+0000","last_unstale":"2024-04-23T10:24:58.211597+0000","last_undegraded":"2024-04-23T10:24:58.211597+0000","last_fullsized":"2024-04-23T10:24:58.211597+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'826","last_scrub_stamp":"2024-04-23T10:24:58.211336+0000","last_deep_scrub":"26'826","last_deep_scrub_stamp":"2024-04-23T10:24:58.211336+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.211336+0000","objects_scrubbed":0,"log_size":826,"log_dups_size":0,"ondisk_log_size":826,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:09:32.538604+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":111,"num_read_kb":59689,"num_write":816,"num_write_kb":234107,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,7],"acting":[4,5,6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.7","version":"26'175","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.696835+0000","last_change":"2024-04-23T10:24:53.696976+0000","last_active":"2024-04-23T10:24:53.696835+0000","last_peered":"2024-04-23T10:24:53.696835+0000","last_clean":"2024-04-23T10:24:53.696835+0000","last_became_active":"2024-04-23T10:13:16.571495+0000","last_became_peered":"2024-04-23T10:13:16.571495+0000","last_unstale":"2024-04-23T10:24:53.696835+0000","last_undegraded":"2024-04-23T10:24:53.696835+0000","last_fullsized":"2024-04-23T10:24:53.696835+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'175","last_scrub_stamp":"2024-04-23T10:24:53.696602+0000","last_deep_scrub":"26'175","last_deep_scrub_stamp":"2024-04-23T10:24:53.696602+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.696602+0000","objects_scrubbed":0,"log_size":175,"log_dups_size":0,"ondisk_log_size":175,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:29:39.184196+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.6","version":"26'479","reported_seq":519,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.761459+0000","last_change":"2024-04-23T10:24:49.761532+0000","last_active":"2024-04-23T10:24:49.761459+0000","last_peered":"2024-04-23T10:24:49.761459+0000","last_clean":"2024-04-23T10:24:49.761459+0000","last_became_active":"2024-04-23T10:12:34.051313+0000","last_became_peered":"2024-04-23T10:12:34.051313+0000","last_unstale":"2024-04-23T10:24:49.761459+0000","last_undegraded":"2024-04-23T10:24:49.761459+0000","last_fullsized":"2024-04-23T10:24:49.761459+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'479","last_scrub_stamp":"2024-04-23T10:24:49.761281+0000","last_deep_scrub":"26'479","last_deep_scrub_stamp":"2024-04-23T10:24:49.761281+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.761281+0000","objects_scrubbed":4,"log_size":479,"log_dups_size":0,"ondisk_log_size":479,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:41:17.289999+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1179,"num_write_kb":1778,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.0","version":"26'806","reported_seq":885,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.750196+0000","last_change":"2024-04-23T10:24:54.750196+0000","last_active":"2024-04-23T10:24:54.750196+0000","last_peered":"2024-04-23T10:24:54.750196+0000","last_clean":"2024-04-23T10:24:54.750196+0000","last_became_active":"2024-04-23T10:13:16.888713+0000","last_became_peered":"2024-04-23T10:13:16.888713+0000","last_unstale":"2024-04-23T10:24:54.750196+0000","last_undegraded":"2024-04-23T10:24:54.750196+0000","last_fullsized":"2024-04-23T10:24:54.750196+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'806","last_scrub_stamp":"2024-04-23T10:24:54.749941+0000","last_deep_scrub":"26'806","last_deep_scrub_stamp":"2024-04-23T10:24:54.749941+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.749941+0000","objects_scrubbed":0,"log_size":806,"log_dups_size":0,"ondisk_log_size":806,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:53:30.322357+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":32561,"num_write":796,"num_write_kb":127084,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7,0,1],"acting":[2,7,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.4","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:43.846640+0000","last_change":"2024-04-23T10:24:43.846640+0000","last_active":"2024-04-23T10:24:43.846640+0000","last_peered":"2024-04-23T10:24:43.846640+0000","last_clean":"2024-04-23T10:24:43.846640+0000","last_became_active":"2024-04-23T10:12:35.024458+0000","last_became_peered":"2024-04-23T10:12:35.024458+0000","last_unstale":"2024-04-23T10:24:43.846640+0000","last_undegraded":"2024-04-23T10:24:43.846640+0000","last_fullsized":"2024-04-23T10:24:43.846640+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:43.846409+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:43.846409+0000","last_clean_scrub_stamp":"2024-04-23T10:24:43.846409+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:12:27.549621+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"26'232","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.276575+0000","last_change":"2024-04-23T10:24:53.276575+0000","last_active":"2024-04-23T10:24:53.276575+0000","last_peered":"2024-04-23T10:24:53.276575+0000","last_clean":"2024-04-23T10:24:53.276575+0000","last_became_active":"2024-04-23T10:12:34.046270+0000","last_became_peered":"2024-04-23T10:12:34.046270+0000","last_unstale":"2024-04-23T10:24:53.276575+0000","last_undegraded":"2024-04-23T10:24:53.276575+0000","last_fullsized":"2024-04-23T10:24:53.276575+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'232","last_scrub_stamp":"2024-04-23T10:24:53.276344+0000","last_deep_scrub":"26'232","last_deep_scrub_stamp":"2024-04-23T10:24:53.276344+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.276344+0000","objects_scrubbed":4,"log_size":232,"log_dups_size":0,"ondisk_log_size":232,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:27:43.521082+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194416,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":177,"num_write_kb":4186,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3","version":"26'736","reported_seq":793,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.784075+0000","last_change":"2024-04-23T10:24:55.784075+0000","last_active":"2024-04-23T10:24:55.784075+0000","last_peered":"2024-04-23T10:24:55.784075+0000","last_clean":"2024-04-23T10:24:55.784075+0000","last_became_active":"2024-04-23T10:12:39.136362+0000","last_became_peered":"2024-04-23T10:12:39.136362+0000","last_unstale":"2024-04-23T10:24:55.784075+0000","last_undegraded":"2024-04-23T10:24:55.784075+0000","last_fullsized":"2024-04-23T10:24:55.784075+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'736","last_scrub_stamp":"2024-04-23T10:24:55.783832+0000","last_deep_scrub":"26'736","last_deep_scrub_stamp":"2024-04-23T10:24:55.783832+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.783832+0000","objects_scrubbed":0,"log_size":736,"log_dups_size":0,"ondisk_log_size":736,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:47:52.752821+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10149,"num_write":716,"num_write_kb":72944,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,7,1],"acting":[0,5,7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.5","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.263076+0000","last_change":"2024-04-23T10:24:57.263076+0000","last_active":"2024-04-23T10:24:57.263076+0000","last_peered":"2024-04-23T10:24:57.263076+0000","last_clean":"2024-04-23T10:24:57.263076+0000","last_became_active":"2024-04-23T10:12:35.025961+0000","last_became_peered":"2024-04-23T10:12:35.025961+0000","last_unstale":"2024-04-23T10:24:57.263076+0000","last_undegraded":"2024-04-23T10:24:57.263076+0000","last_fullsized":"2024-04-23T10:24:57.263076+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:24:57.262853+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:24:57.262853+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.262853+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:43:29.182107+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"26'65","reported_seq":106,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.769797+0000","last_change":"2024-04-23T10:24:45.769797+0000","last_active":"2024-04-23T10:24:45.769797+0000","last_peered":"2024-04-23T10:24:45.769797+0000","last_clean":"2024-04-23T10:24:45.769797+0000","last_became_active":"2024-04-23T10:12:34.033985+0000","last_became_peered":"2024-04-23T10:12:34.033985+0000","last_unstale":"2024-04-23T10:24:45.769797+0000","last_undegraded":"2024-04-23T10:24:45.769797+0000","last_fullsized":"2024-04-23T10:24:45.769797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'65","last_scrub_stamp":"2024-04-23T10:24:45.769677+0000","last_deep_scrub":"26'65","last_deep_scrub_stamp":"2024-04-23T10:24:45.769677+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.769677+0000","objects_scrubbed":0,"log_size":65,"log_dups_size":0,"ondisk_log_size":65,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:41:48.860772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"26'769","reported_seq":902,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.739148+0000","last_change":"2024-04-23T10:24:57.739148+0000","last_active":"2024-04-23T10:24:57.739148+0000","last_peered":"2024-04-23T10:24:57.739148+0000","last_clean":"2024-04-23T10:24:57.739148+0000","last_became_active":"2024-04-23T10:12:39.089516+0000","last_became_peered":"2024-04-23T10:12:39.089516+0000","last_unstale":"2024-04-23T10:24:57.739148+0000","last_undegraded":"2024-04-23T10:24:57.739148+0000","last_fullsized":"2024-04-23T10:24:57.739148+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'769","last_scrub_stamp":"2024-04-23T10:24:57.738895+0000","last_deep_scrub":"26'769","last_deep_scrub_stamp":"2024-04-23T10:24:57.738895+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.738895+0000","objects_scrubbed":0,"log_size":769,"log_dups_size":0,"ondisk_log_size":769,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:54:26.612952+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":100,"num_read_kb":47274,"num_write":751,"num_write_kb":105696,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,4,0],"acting":[1,5,4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"26'200","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.232452+0000","last_change":"2024-04-23T10:24:49.232452+0000","last_active":"2024-04-23T10:24:49.232452+0000","last_peered":"2024-04-23T10:24:49.232452+0000","last_clean":"2024-04-23T10:24:49.232452+0000","last_became_active":"2024-04-23T10:12:35.030171+0000","last_became_peered":"2024-04-23T10:12:35.030171+0000","last_unstale":"2024-04-23T10:24:49.232452+0000","last_undegraded":"2024-04-23T10:24:49.232452+0000","last_fullsized":"2024-04-23T10:24:49.232452+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:49.231988+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:49.231988+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.231988+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:50:09.199923+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.2","version":"26'1264","reported_seq":1305,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.280797+0000","last_change":"2024-04-23T10:24:50.280797+0000","last_active":"2024-04-23T10:24:50.280797+0000","last_peered":"2024-04-23T10:24:50.280797+0000","last_clean":"2024-04-23T10:24:50.280797+0000","last_became_active":"2024-04-23T10:12:34.039916+0000","last_became_peered":"2024-04-23T10:12:34.039916+0000","last_unstale":"2024-04-23T10:24:50.280797+0000","last_undegraded":"2024-04-23T10:24:50.280797+0000","last_fullsized":"2024-04-23T10:24:50.280797+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1264","last_scrub_stamp":"2024-04-23T10:24:50.280531+0000","last_deep_scrub":"26'1264","last_deep_scrub_stamp":"2024-04-23T10:24:50.280531+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.280531+0000","objects_scrubbed":4,"log_size":1264,"log_dups_size":0,"ondisk_log_size":1264,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:49:11.326472+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389196,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1199,"num_write_kb":8751,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.4","version":"26'715","reported_seq":820,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.703299+0000","last_change":"2024-04-23T10:24:56.703299+0000","last_active":"2024-04-23T10:24:56.703299+0000","last_peered":"2024-04-23T10:24:56.703299+0000","last_clean":"2024-04-23T10:24:56.703299+0000","last_became_active":"2024-04-23T10:12:39.089909+0000","last_became_peered":"2024-04-23T10:12:39.089909+0000","last_unstale":"2024-04-23T10:24:56.703299+0000","last_undegraded":"2024-04-23T10:24:56.703299+0000","last_fullsized":"2024-04-23T10:24:56.703299+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'715","last_scrub_stamp":"2024-04-23T10:24:56.703055+0000","last_deep_scrub":"26'715","last_deep_scrub_stamp":"2024-04-23T10:24:56.703055+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.703055+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:27:46.626550+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":72,"num_read_kb":35238,"num_write":695,"num_write_kb":146305,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,6],"acting":[1,2,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.0","version":"26'206","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.665151+0000","last_change":"2024-04-23T10:24:51.665269+0000","last_active":"2024-04-23T10:24:51.665151+0000","last_peered":"2024-04-23T10:24:51.665151+0000","last_clean":"2024-04-23T10:24:51.665151+0000","last_became_active":"2024-04-23T10:12:35.024468+0000","last_became_peered":"2024-04-23T10:12:35.024468+0000","last_unstale":"2024-04-23T10:24:51.665151+0000","last_undegraded":"2024-04-23T10:24:51.665151+0000","last_fullsized":"2024-04-23T10:24:51.665151+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:51.664876+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:51.664876+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.664876+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:31:44.502662+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"26'680","reported_seq":1317,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.627302+0000","last_change":"2024-04-23T10:24:45.627302+0000","last_active":"2024-04-23T10:24:45.627302+0000","last_peered":"2024-04-23T10:24:45.627302+0000","last_clean":"2024-04-23T10:24:45.627302+0000","last_became_active":"2024-04-23T10:12:34.028768+0000","last_became_peered":"2024-04-23T10:12:34.028768+0000","last_unstale":"2024-04-23T10:24:45.627302+0000","last_undegraded":"2024-04-23T10:24:45.627302+0000","last_fullsized":"2024-04-23T10:24:45.627302+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'680","last_scrub_stamp":"2024-04-23T10:24:45.627062+0000","last_deep_scrub":"26'680","last_deep_scrub_stamp":"2024-04-23T10:24:45.627062+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.627062+0000","objects_scrubbed":4,"log_size":680,"log_dups_size":0,"ondisk_log_size":680,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:30:46.840528+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1565163,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":614,"num_write_kb":1938,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.7","version":"26'747","reported_seq":889,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.728397+0000","last_change":"2024-04-23T10:24:55.728458+0000","last_active":"2024-04-23T10:24:55.728397+0000","last_peered":"2024-04-23T10:24:55.728397+0000","last_clean":"2024-04-23T10:24:55.728397+0000","last_became_active":"2024-04-23T10:12:39.083681+0000","last_became_peered":"2024-04-23T10:12:39.083681+0000","last_unstale":"2024-04-23T10:24:55.728397+0000","last_undegraded":"2024-04-23T10:24:55.728397+0000","last_fullsized":"2024-04-23T10:24:55.728397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'747","last_scrub_stamp":"2024-04-23T10:24:55.728217+0000","last_deep_scrub":"26'747","last_deep_scrub_stamp":"2024-04-23T10:24:55.728217+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.728217+0000","objects_scrubbed":0,"log_size":747,"log_dups_size":0,"ondisk_log_size":747,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:30:38.630850+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":110,"num_read_kb":64670,"num_write":730,"num_write_kb":150836,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5,0,3],"acting":[1,5,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"26'196","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:42.858465+0000","last_change":"2024-04-23T10:24:42.858465+0000","last_active":"2024-04-23T10:24:42.858465+0000","last_peered":"2024-04-23T10:24:42.858465+0000","last_clean":"2024-04-23T10:24:42.858465+0000","last_became_active":"2024-04-23T10:12:35.039174+0000","last_became_peered":"2024-04-23T10:12:35.039174+0000","last_unstale":"2024-04-23T10:24:42.858465+0000","last_undegraded":"2024-04-23T10:24:42.858465+0000","last_fullsized":"2024-04-23T10:24:42.858465+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'196","last_scrub_stamp":"2024-04-23T10:24:42.858345+0000","last_deep_scrub":"26'196","last_deep_scrub_stamp":"2024-04-23T10:24:42.858345+0000","last_clean_scrub_stamp":"2024-04-23T10:24:42.858345+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:57:43.388736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"26'824","reported_seq":866,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.347823+0000","last_change":"2024-04-23T10:24:51.347896+0000","last_active":"2024-04-23T10:24:51.347823+0000","last_peered":"2024-04-23T10:24:51.347823+0000","last_clean":"2024-04-23T10:24:51.347823+0000","last_became_active":"2024-04-23T10:12:34.046793+0000","last_became_peered":"2024-04-23T10:12:34.046793+0000","last_unstale":"2024-04-23T10:24:51.347823+0000","last_undegraded":"2024-04-23T10:24:51.347823+0000","last_fullsized":"2024-04-23T10:24:51.347823+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'824","last_scrub_stamp":"2024-04-23T10:24:51.347654+0000","last_deep_scrub":"26'824","last_deep_scrub_stamp":"2024-04-23T10:24:51.347654+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.347654+0000","objects_scrubbed":3,"log_size":824,"log_dups_size":0,"ondisk_log_size":824,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:08:45.819014+0000","scrub_duration":35,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388608,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":760,"num_write_kb":8415,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.6","version":"26'869","reported_seq":994,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.819778+0000","last_change":"2024-04-23T10:24:57.819840+0000","last_active":"2024-04-23T10:24:57.819778+0000","last_peered":"2024-04-23T10:24:57.819778+0000","last_clean":"2024-04-23T10:24:57.819778+0000","last_became_active":"2024-04-23T10:13:16.572255+0000","last_became_peered":"2024-04-23T10:13:16.572255+0000","last_unstale":"2024-04-23T10:24:57.819778+0000","last_undegraded":"2024-04-23T10:24:57.819778+0000","last_fullsized":"2024-04-23T10:24:57.819778+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'869","last_scrub_stamp":"2024-04-23T10:24:57.819599+0000","last_deep_scrub":"26'869","last_deep_scrub_stamp":"2024-04-23T10:24:57.819599+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.819599+0000","objects_scrubbed":0,"log_size":869,"log_dups_size":0,"ondisk_log_size":869,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:35:09.865060+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":38545,"num_write":855,"num_write_kb":144399,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5,2,7],"acting":[0,5,2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2","version":"26'187","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.474351+0000","last_change":"2024-04-23T10:24:50.474351+0000","last_active":"2024-04-23T10:24:50.474351+0000","last_peered":"2024-04-23T10:24:50.474351+0000","last_clean":"2024-04-23T10:24:50.474351+0000","last_became_active":"2024-04-23T10:12:35.024990+0000","last_became_peered":"2024-04-23T10:12:35.024990+0000","last_unstale":"2024-04-23T10:24:50.474351+0000","last_undegraded":"2024-04-23T10:24:50.474351+0000","last_fullsized":"2024-04-23T10:24:50.474351+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:50.473989+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:50.473989+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.473989+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:43:56.373260+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.3","version":"26'79","reported_seq":120,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.210500+0000","last_change":"2024-04-23T10:24:47.210500+0000","last_active":"2024-04-23T10:24:47.210500+0000","last_peered":"2024-04-23T10:24:47.210500+0000","last_clean":"2024-04-23T10:24:47.210500+0000","last_became_active":"2024-04-23T10:12:34.026810+0000","last_became_peered":"2024-04-23T10:12:34.026810+0000","last_unstale":"2024-04-23T10:24:47.210500+0000","last_undegraded":"2024-04-23T10:24:47.210500+0000","last_fullsized":"2024-04-23T10:24:47.210500+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'79","last_scrub_stamp":"2024-04-23T10:24:47.210252+0000","last_deep_scrub":"26'79","last_deep_scrub_stamp":"2024-04-23T10:24:47.210252+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.210252+0000","objects_scrubbed":5,"log_size":79,"log_dups_size":0,"ondisk_log_size":79,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:56.780582+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":68,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"26'119","reported_seq":199,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.365841+0000","last_change":"2024-04-23T10:24:48.365913+0000","last_active":"2024-04-23T10:24:48.365841+0000","last_peered":"2024-04-23T10:24:48.365841+0000","last_clean":"2024-04-23T10:24:48.365841+0000","last_became_active":"2024-04-23T10:12:23.218865+0000","last_became_peered":"2024-04-23T10:12:23.218865+0000","last_unstale":"2024-04-23T10:24:48.365841+0000","last_undegraded":"2024-04-23T10:24:48.365841+0000","last_fullsized":"2024-04-23T10:24:48.365841+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'119","last_scrub_stamp":"2024-04-23T10:24:48.365673+0000","last_deep_scrub":"26'119","last_deep_scrub_stamp":"2024-04-23T10:24:48.365673+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.365673+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:27:38.924156+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.5","version":"26'785","reported_seq":922,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.995619+0000","last_change":"2024-04-23T10:24:59.995619+0000","last_active":"2024-04-23T10:24:59.995619+0000","last_peered":"2024-04-23T10:24:59.995619+0000","last_clean":"2024-04-23T10:24:59.995619+0000","last_became_active":"2024-04-23T10:12:39.146062+0000","last_became_peered":"2024-04-23T10:12:39.146062+0000","last_unstale":"2024-04-23T10:24:59.995619+0000","last_undegraded":"2024-04-23T10:24:59.995619+0000","last_fullsized":"2024-04-23T10:24:59.995619+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'785","last_scrub_stamp":"2024-04-23T10:24:59.995238+0000","last_deep_scrub":"26'785","last_deep_scrub_stamp":"2024-04-23T10:24:59.995238+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.995238+0000","objects_scrubbed":0,"log_size":785,"log_dups_size":0,"ondisk_log_size":785,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:51:19.821751+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":104,"num_read_kb":48306,"num_write":767,"num_write_kb":118152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3,4,7],"acting":[6,3,4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.303608+0000","last_change":"2024-04-23T10:24:55.303666+0000","last_active":"2024-04-23T10:24:55.303608+0000","last_peered":"2024-04-23T10:24:55.303608+0000","last_clean":"2024-04-23T10:24:55.303608+0000","last_became_active":"2024-04-23T10:12:35.034275+0000","last_became_peered":"2024-04-23T10:12:35.034275+0000","last_unstale":"2024-04-23T10:24:55.303608+0000","last_undegraded":"2024-04-23T10:24:55.303608+0000","last_fullsized":"2024-04-23T10:24:55.303608+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:55.303426+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:55.303426+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.303426+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:43:21.863457+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.c","version":"26'71","reported_seq":110,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.675293+0000","last_change":"2024-04-23T10:24:47.675363+0000","last_active":"2024-04-23T10:24:47.675293+0000","last_peered":"2024-04-23T10:24:47.675293+0000","last_clean":"2024-04-23T10:24:47.675293+0000","last_became_active":"2024-04-23T10:12:34.031131+0000","last_became_peered":"2024-04-23T10:12:34.031131+0000","last_unstale":"2024-04-23T10:24:47.675293+0000","last_undegraded":"2024-04-23T10:24:47.675293+0000","last_fullsized":"2024-04-23T10:24:47.675293+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'71","last_scrub_stamp":"2024-04-23T10:24:47.675126+0000","last_deep_scrub":"26'71","last_deep_scrub_stamp":"2024-04-23T10:24:47.675126+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.675126+0000","objects_scrubbed":3,"log_size":71,"log_dups_size":0,"ondisk_log_size":71,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:24:57.781077+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1752,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.a","version":"26'798","reported_seq":932,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.963303+0000","last_change":"2024-04-23T10:24:58.963367+0000","last_active":"2024-04-23T10:24:58.963303+0000","last_peered":"2024-04-23T10:24:58.963303+0000","last_clean":"2024-04-23T10:24:58.963303+0000","last_became_active":"2024-04-23T10:12:39.140630+0000","last_became_peered":"2024-04-23T10:12:39.140630+0000","last_unstale":"2024-04-23T10:24:58.963303+0000","last_undegraded":"2024-04-23T10:24:58.963303+0000","last_fullsized":"2024-04-23T10:24:58.963303+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'798","last_scrub_stamp":"2024-04-23T10:24:58.963109+0000","last_deep_scrub":"26'798","last_deep_scrub_stamp":"2024-04-23T10:24:58.963109+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.963109+0000","objects_scrubbed":0,"log_size":798,"log_dups_size":0,"ondisk_log_size":798,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:54:24.617015+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":102,"num_read_kb":57246,"num_write":786,"num_write_kb":130467,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7,1,0],"acting":[6,7,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.c","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.309110+0000","last_change":"2024-04-23T10:24:56.309173+0000","last_active":"2024-04-23T10:24:56.309110+0000","last_peered":"2024-04-23T10:24:56.309110+0000","last_clean":"2024-04-23T10:24:56.309110+0000","last_became_active":"2024-04-23T10:12:35.028887+0000","last_became_peered":"2024-04-23T10:12:35.028887+0000","last_unstale":"2024-04-23T10:24:56.309110+0000","last_undegraded":"2024-04-23T10:24:56.309110+0000","last_fullsized":"2024-04-23T10:24:56.309110+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:56.308875+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:56.308875+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.308875+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:04:42.814654+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.d","version":"26'598","reported_seq":638,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.795726+0000","last_change":"2024-04-23T10:24:47.795797+0000","last_active":"2024-04-23T10:24:47.795726+0000","last_peered":"2024-04-23T10:24:47.795726+0000","last_clean":"2024-04-23T10:24:47.795726+0000","last_became_active":"2024-04-23T10:12:34.043097+0000","last_became_peered":"2024-04-23T10:12:34.043097+0000","last_unstale":"2024-04-23T10:24:47.795726+0000","last_undegraded":"2024-04-23T10:24:47.795726+0000","last_fullsized":"2024-04-23T10:24:47.795726+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'598","last_scrub_stamp":"2024-04-23T10:24:47.795538+0000","last_deep_scrub":"26'598","last_deep_scrub_stamp":"2024-04-23T10:24:47.795538+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.795538+0000","objects_scrubbed":2,"log_size":598,"log_dups_size":0,"ondisk_log_size":598,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:45:02.548842+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194374,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":537,"num_write_kb":4378,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.b","version":"26'841","reported_seq":1019,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.845053+0000","last_change":"2024-04-23T10:24:53.845114+0000","last_active":"2024-04-23T10:24:53.845053+0000","last_peered":"2024-04-23T10:24:53.845053+0000","last_clean":"2024-04-23T10:24:53.845053+0000","last_became_active":"2024-04-23T10:12:39.093546+0000","last_became_peered":"2024-04-23T10:12:39.093546+0000","last_unstale":"2024-04-23T10:24:53.845053+0000","last_undegraded":"2024-04-23T10:24:53.845053+0000","last_fullsized":"2024-04-23T10:24:53.845053+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'841","last_scrub_stamp":"2024-04-23T10:24:53.844877+0000","last_deep_scrub":"26'841","last_deep_scrub_stamp":"2024-04-23T10:24:53.844877+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.844877+0000","objects_scrubbed":0,"log_size":841,"log_dups_size":0,"ondisk_log_size":841,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:50:00.975799+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":146,"num_read_kb":73740,"num_write":839,"num_write_kb":234176,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,4,5],"acting":[0,1,4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.f","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.285350+0000","last_change":"2024-04-23T10:24:56.285409+0000","last_active":"2024-04-23T10:24:56.285350+0000","last_peered":"2024-04-23T10:24:56.285350+0000","last_clean":"2024-04-23T10:24:56.285350+0000","last_became_active":"2024-04-23T10:12:35.040438+0000","last_became_peered":"2024-04-23T10:12:35.040438+0000","last_unstale":"2024-04-23T10:24:56.285350+0000","last_undegraded":"2024-04-23T10:24:56.285350+0000","last_fullsized":"2024-04-23T10:24:56.285350+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:56.285171+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:56.285171+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.285171+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:23:32.034108+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.e","version":"26'414","reported_seq":453,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.685462+0000","last_change":"2024-04-23T10:24:46.685545+0000","last_active":"2024-04-23T10:24:46.685462+0000","last_peered":"2024-04-23T10:24:46.685462+0000","last_clean":"2024-04-23T10:24:46.685462+0000","last_became_active":"2024-04-23T10:12:34.029009+0000","last_became_peered":"2024-04-23T10:12:34.029009+0000","last_unstale":"2024-04-23T10:24:46.685462+0000","last_undegraded":"2024-04-23T10:24:46.685462+0000","last_fullsized":"2024-04-23T10:24:46.685462+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'414","last_scrub_stamp":"2024-04-23T10:24:46.685281+0000","last_deep_scrub":"26'414","last_deep_scrub_stamp":"2024-04-23T10:24:46.685281+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.685281+0000","objects_scrubbed":3,"log_size":414,"log_dups_size":0,"ondisk_log_size":414,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:22.493073+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":354,"num_write_kb":4289,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.8","version":"26'811","reported_seq":930,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:01.329554+0000","last_change":"2024-04-23T10:25:01.329628+0000","last_active":"2024-04-23T10:25:01.329554+0000","last_peered":"2024-04-23T10:25:01.329554+0000","last_clean":"2024-04-23T10:25:01.329554+0000","last_became_active":"2024-04-23T10:12:39.136710+0000","last_became_peered":"2024-04-23T10:12:39.136710+0000","last_unstale":"2024-04-23T10:25:01.329554+0000","last_undegraded":"2024-04-23T10:25:01.329554+0000","last_fullsized":"2024-04-23T10:25:01.329554+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'811","last_scrub_stamp":"2024-04-23T10:25:01.329338+0000","last_deep_scrub":"26'811","last_deep_scrub_stamp":"2024-04-23T10:25:01.329338+0000","last_clean_scrub_stamp":"2024-04-23T10:25:01.329338+0000","objects_scrubbed":0,"log_size":811,"log_dups_size":0,"ondisk_log_size":811,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:37:00.414625+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":86,"num_read_kb":46792,"num_write":793,"num_write_kb":138987,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4,7,6],"acting":[5,4,7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.e","version":"26'183","reported_seq":221,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:00.303090+0000","last_change":"2024-04-23T10:25:00.303238+0000","last_active":"2024-04-23T10:25:00.303090+0000","last_peered":"2024-04-23T10:25:00.303090+0000","last_clean":"2024-04-23T10:25:00.303090+0000","last_became_active":"2024-04-23T10:12:35.040339+0000","last_became_peered":"2024-04-23T10:12:35.040339+0000","last_unstale":"2024-04-23T10:25:00.303090+0000","last_undegraded":"2024-04-23T10:25:00.303090+0000","last_fullsized":"2024-04-23T10:25:00.303090+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'183","last_scrub_stamp":"2024-04-23T10:25:00.302863+0000","last_deep_scrub":"26'183","last_deep_scrub_stamp":"2024-04-23T10:25:00.302863+0000","last_clean_scrub_stamp":"2024-04-23T10:25:00.302863+0000","objects_scrubbed":0,"log_size":183,"log_dups_size":0,"ondisk_log_size":183,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:25:23.443469+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.f","version":"26'187","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.294125+0000","last_change":"2024-04-23T10:24:45.294220+0000","last_active":"2024-04-23T10:24:45.294125+0000","last_peered":"2024-04-23T10:24:45.294125+0000","last_clean":"2024-04-23T10:24:45.294125+0000","last_became_active":"2024-04-23T10:12:34.029796+0000","last_became_peered":"2024-04-23T10:12:34.029796+0000","last_unstale":"2024-04-23T10:24:45.294125+0000","last_undegraded":"2024-04-23T10:24:45.294125+0000","last_fullsized":"2024-04-23T10:24:45.294125+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:45.293942+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:45.293942+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.293942+0000","objects_scrubbed":3,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:28:11.020007+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194326,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":130,"num_write_kb":4243,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.9","version":"26'790","reported_seq":893,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.172900+0000","last_change":"2024-04-23T10:24:57.172961+0000","last_active":"2024-04-23T10:24:57.172900+0000","last_peered":"2024-04-23T10:24:57.172900+0000","last_clean":"2024-04-23T10:24:57.172900+0000","last_became_active":"2024-04-23T10:12:39.100948+0000","last_became_peered":"2024-04-23T10:12:39.100948+0000","last_unstale":"2024-04-23T10:24:57.172900+0000","last_undegraded":"2024-04-23T10:24:57.172900+0000","last_fullsized":"2024-04-23T10:24:57.172900+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'790","last_scrub_stamp":"2024-04-23T10:24:57.172732+0000","last_deep_scrub":"26'790","last_deep_scrub_stamp":"2024-04-23T10:24:57.172732+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.172732+0000","objects_scrubbed":0,"log_size":790,"log_dups_size":0,"ondisk_log_size":790,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:22:09.014343+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":35817,"num_write":778,"num_write_kb":100795,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1,3,6],"acting":[4,1,3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.11","version":"26'235","reported_seq":273,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.330806+0000","last_change":"2024-04-23T10:24:58.330938+0000","last_active":"2024-04-23T10:24:58.330806+0000","last_peered":"2024-04-23T10:24:58.330806+0000","last_clean":"2024-04-23T10:24:58.330806+0000","last_became_active":"2024-04-23T10:12:35.040356+0000","last_became_peered":"2024-04-23T10:12:35.040356+0000","last_unstale":"2024-04-23T10:24:58.330806+0000","last_undegraded":"2024-04-23T10:24:58.330806+0000","last_fullsized":"2024-04-23T10:24:58.330806+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'235","last_scrub_stamp":"2024-04-23T10:24:58.330596+0000","last_deep_scrub":"26'235","last_deep_scrub_stamp":"2024-04-23T10:24:58.330596+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.330596+0000","objects_scrubbed":0,"log_size":235,"log_dups_size":0,"ondisk_log_size":235,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:32:01.362542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.10","version":"26'243","reported_seq":282,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.681086+0000","last_change":"2024-04-23T10:24:44.681147+0000","last_active":"2024-04-23T10:24:44.681086+0000","last_peered":"2024-04-23T10:24:44.681086+0000","last_clean":"2024-04-23T10:24:44.681086+0000","last_became_active":"2024-04-23T10:12:34.022101+0000","last_became_peered":"2024-04-23T10:12:34.022101+0000","last_unstale":"2024-04-23T10:24:44.681086+0000","last_undegraded":"2024-04-23T10:24:44.681086+0000","last_fullsized":"2024-04-23T10:24:44.681086+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'243","last_scrub_stamp":"2024-04-23T10:24:44.680989+0000","last_deep_scrub":"26'243","last_deep_scrub_stamp":"2024-04-23T10:24:44.680989+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.680989+0000","objects_scrubbed":9,"log_size":243,"log_dups_size":0,"ondisk_log_size":243,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:49:49.902343+0000","scrub_duration":27,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":3959458,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":176,"num_write_kb":3977,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":6,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.16","version":"26'794","reported_seq":901,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.799467+0000","last_change":"2024-04-23T10:24:54.799543+0000","last_active":"2024-04-23T10:24:54.799467+0000","last_peered":"2024-04-23T10:24:54.799467+0000","last_clean":"2024-04-23T10:24:54.799467+0000","last_became_active":"2024-04-23T10:12:39.093873+0000","last_became_peered":"2024-04-23T10:12:39.093873+0000","last_unstale":"2024-04-23T10:24:54.799467+0000","last_undegraded":"2024-04-23T10:24:54.799467+0000","last_fullsized":"2024-04-23T10:24:54.799467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'794","last_scrub_stamp":"2024-04-23T10:24:54.799261+0000","last_deep_scrub":"26'794","last_deep_scrub_stamp":"2024-04-23T10:24:54.799261+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.799261+0000","objects_scrubbed":0,"log_size":794,"log_dups_size":0,"ondisk_log_size":794,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:59:56.445356+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":75,"num_read_kb":45827,"num_write":777,"num_write_kb":167744,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,6],"acting":[0,3,2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"26'214","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.062427+0000","last_change":"2024-04-23T10:24:51.062486+0000","last_active":"2024-04-23T10:24:51.062427+0000","last_peered":"2024-04-23T10:24:51.062427+0000","last_clean":"2024-04-23T10:24:51.062427+0000","last_became_active":"2024-04-23T10:12:35.030676+0000","last_became_peered":"2024-04-23T10:12:35.030676+0000","last_unstale":"2024-04-23T10:24:51.062427+0000","last_undegraded":"2024-04-23T10:24:51.062427+0000","last_fullsized":"2024-04-23T10:24:51.062427+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:51.062250+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:51.062250+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.062250+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:52:47.262688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.11","version":"26'77","reported_seq":117,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.084629+0000","last_change":"2024-04-23T10:24:49.084753+0000","last_active":"2024-04-23T10:24:49.084629+0000","last_peered":"2024-04-23T10:24:49.084629+0000","last_clean":"2024-04-23T10:24:49.084629+0000","last_became_active":"2024-04-23T10:12:34.054500+0000","last_became_peered":"2024-04-23T10:12:34.054500+0000","last_unstale":"2024-04-23T10:24:49.084629+0000","last_undegraded":"2024-04-23T10:24:49.084629+0000","last_fullsized":"2024-04-23T10:24:49.084629+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'77","last_scrub_stamp":"2024-04-23T10:24:49.084411+0000","last_deep_scrub":"26'77","last_deep_scrub_stamp":"2024-04-23T10:24:49.084411+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.084411+0000","objects_scrubbed":3,"log_size":77,"log_dups_size":0,"ondisk_log_size":77,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:24:18.817656+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":1170,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":84,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.17","version":"26'743","reported_seq":860,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.629248+0000","last_change":"2024-04-23T10:24:58.629379+0000","last_active":"2024-04-23T10:24:58.629248+0000","last_peered":"2024-04-23T10:24:58.629248+0000","last_clean":"2024-04-23T10:24:58.629248+0000","last_became_active":"2024-04-23T10:12:39.140398+0000","last_became_peered":"2024-04-23T10:12:39.140398+0000","last_unstale":"2024-04-23T10:24:58.629248+0000","last_undegraded":"2024-04-23T10:24:58.629248+0000","last_fullsized":"2024-04-23T10:24:58.629248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'743","last_scrub_stamp":"2024-04-23T10:24:58.629021+0000","last_deep_scrub":"26'743","last_deep_scrub_stamp":"2024-04-23T10:24:58.629021+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.629021+0000","objects_scrubbed":0,"log_size":743,"log_dups_size":0,"ondisk_log_size":743,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:21:52.752315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":85,"num_read_kb":51193,"num_write":729,"num_write_kb":110728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,1,6],"acting":[3,7,1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"26'202","reported_seq":240,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.322421+0000","last_change":"2024-04-23T10:24:57.322480+0000","last_active":"2024-04-23T10:24:57.322421+0000","last_peered":"2024-04-23T10:24:57.322421+0000","last_clean":"2024-04-23T10:24:57.322421+0000","last_became_active":"2024-04-23T10:12:35.040232+0000","last_became_peered":"2024-04-23T10:12:35.040232+0000","last_unstale":"2024-04-23T10:24:57.322421+0000","last_undegraded":"2024-04-23T10:24:57.322421+0000","last_fullsized":"2024-04-23T10:24:57.322421+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'202","last_scrub_stamp":"2024-04-23T10:24:57.322246+0000","last_deep_scrub":"26'202","last_deep_scrub_stamp":"2024-04-23T10:24:57.322246+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.322246+0000","objects_scrubbed":0,"log_size":202,"log_dups_size":0,"ondisk_log_size":202,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:06:32.287860+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.12","version":"26'75","reported_seq":115,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.236100+0000","last_change":"2024-04-23T10:24:49.236170+0000","last_active":"2024-04-23T10:24:49.236100+0000","last_peered":"2024-04-23T10:24:49.236100+0000","last_clean":"2024-04-23T10:24:49.236100+0000","last_became_active":"2024-04-23T10:12:34.028734+0000","last_became_peered":"2024-04-23T10:12:34.028734+0000","last_unstale":"2024-04-23T10:24:49.236100+0000","last_undegraded":"2024-04-23T10:24:49.236100+0000","last_fullsized":"2024-04-23T10:24:49.236100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'75","last_scrub_stamp":"2024-04-23T10:24:49.235928+0000","last_deep_scrub":"26'75","last_deep_scrub_stamp":"2024-04-23T10:24:49.235928+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.235928+0000","objects_scrubbed":3,"log_size":75,"log_dups_size":0,"ondisk_log_size":75,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:32:21.167463+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":90,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":42,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.14","version":"26'715","reported_seq":826,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.620317+0000","last_change":"2024-04-23T10:24:57.620383+0000","last_active":"2024-04-23T10:24:57.620317+0000","last_peered":"2024-04-23T10:24:57.620317+0000","last_clean":"2024-04-23T10:24:57.620317+0000","last_became_active":"2024-04-23T10:12:39.136575+0000","last_became_peered":"2024-04-23T10:12:39.136575+0000","last_unstale":"2024-04-23T10:24:57.620317+0000","last_undegraded":"2024-04-23T10:24:57.620317+0000","last_fullsized":"2024-04-23T10:24:57.620317+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'715","last_scrub_stamp":"2024-04-23T10:24:57.620132+0000","last_deep_scrub":"26'715","last_deep_scrub_stamp":"2024-04-23T10:24:57.620132+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.620132+0000","objects_scrubbed":0,"log_size":715,"log_dups_size":0,"ondisk_log_size":715,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:48:34.592598+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":79,"num_read_kb":41494,"num_write":696,"num_write_kb":114108,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,7,2],"acting":[3,1,7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.845337+0000","last_change":"2024-04-23T10:24:51.845457+0000","last_active":"2024-04-23T10:24:51.845337+0000","last_peered":"2024-04-23T10:24:51.845337+0000","last_clean":"2024-04-23T10:24:51.845337+0000","last_became_active":"2024-04-23T10:12:35.045793+0000","last_became_peered":"2024-04-23T10:12:35.045793+0000","last_unstale":"2024-04-23T10:24:51.845337+0000","last_undegraded":"2024-04-23T10:24:51.845337+0000","last_fullsized":"2024-04-23T10:24:51.845337+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:51.845131+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:51.845131+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.845131+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:53:06.018254+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.13","version":"26'568","reported_seq":607,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:43.920642+0000","last_change":"2024-04-23T10:24:43.920703+0000","last_active":"2024-04-23T10:24:43.920642+0000","last_peered":"2024-04-23T10:24:43.920642+0000","last_clean":"2024-04-23T10:24:43.920642+0000","last_became_active":"2024-04-23T10:12:34.035893+0000","last_became_peered":"2024-04-23T10:12:34.035893+0000","last_unstale":"2024-04-23T10:24:43.920642+0000","last_undegraded":"2024-04-23T10:24:43.920642+0000","last_fullsized":"2024-04-23T10:24:43.920642+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'568","last_scrub_stamp":"2024-04-23T10:24:43.920564+0000","last_deep_scrub":"26'568","last_deep_scrub_stamp":"2024-04-23T10:24:43.920564+0000","last_clean_scrub_stamp":"2024-04-23T10:24:43.920564+0000","objects_scrubbed":8,"log_size":568,"log_dups_size":0,"ondisk_log_size":568,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T21:01:43.125188+0000","scrub_duration":39,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8388676,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":503,"num_write_kb":8449,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":4,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.15","version":"26'744","reported_seq":859,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:02.371221+0000","last_change":"2024-04-23T10:25:02.371282+0000","last_active":"2024-04-23T10:25:02.371221+0000","last_peered":"2024-04-23T10:25:02.371221+0000","last_clean":"2024-04-23T10:25:02.371221+0000","last_became_active":"2024-04-23T10:12:39.145567+0000","last_became_peered":"2024-04-23T10:12:39.145567+0000","last_unstale":"2024-04-23T10:25:02.371221+0000","last_undegraded":"2024-04-23T10:25:02.371221+0000","last_fullsized":"2024-04-23T10:25:02.371221+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'744","last_scrub_stamp":"2024-04-23T10:25:02.371055+0000","last_deep_scrub":"26'744","last_deep_scrub_stamp":"2024-04-23T10:25:02.371055+0000","last_clean_scrub_stamp":"2024-04-23T10:25:02.371055+0000","objects_scrubbed":0,"log_size":744,"log_dups_size":0,"ondisk_log_size":744,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:09:59.919579+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":83,"num_read_kb":49248,"num_write":726,"num_write_kb":125931,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7,3,2],"acting":[5,7,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.15","version":"26'204","reported_seq":242,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:01.337159+0000","last_change":"2024-04-23T10:25:01.337269+0000","last_active":"2024-04-23T10:25:01.337159+0000","last_peered":"2024-04-23T10:25:01.337159+0000","last_clean":"2024-04-23T10:25:01.337159+0000","last_became_active":"2024-04-23T10:12:35.044451+0000","last_became_peered":"2024-04-23T10:12:35.044451+0000","last_unstale":"2024-04-23T10:25:01.337159+0000","last_undegraded":"2024-04-23T10:25:01.337159+0000","last_fullsized":"2024-04-23T10:25:01.337159+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'204","last_scrub_stamp":"2024-04-23T10:25:01.336963+0000","last_deep_scrub":"26'204","last_deep_scrub_stamp":"2024-04-23T10:25:01.336963+0000","last_clean_scrub_stamp":"2024-04-23T10:25:01.336963+0000","objects_scrubbed":0,"log_size":204,"log_dups_size":0,"ondisk_log_size":204,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:29:45.925754+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.14","version":"26'420","reported_seq":460,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.053457+0000","last_change":"2024-04-23T10:24:46.053570+0000","last_active":"2024-04-23T10:24:46.053457+0000","last_peered":"2024-04-23T10:24:46.053457+0000","last_clean":"2024-04-23T10:24:46.053457+0000","last_became_active":"2024-04-23T10:12:34.048422+0000","last_became_peered":"2024-04-23T10:12:34.048422+0000","last_unstale":"2024-04-23T10:24:46.053457+0000","last_undegraded":"2024-04-23T10:24:46.053457+0000","last_fullsized":"2024-04-23T10:24:46.053457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'420","last_scrub_stamp":"2024-04-23T10:24:46.053289+0000","last_deep_scrub":"26'420","last_deep_scrub_stamp":"2024-04-23T10:24:46.053289+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.053289+0000","objects_scrubbed":8,"log_size":420,"log_dups_size":0,"ondisk_log_size":420,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:32:20.204743+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12583584,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":375,"num_write_kb":12491,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.12","version":"26'768","reported_seq":848,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.709746+0000","last_change":"2024-04-23T10:24:58.709825+0000","last_active":"2024-04-23T10:24:58.709746+0000","last_peered":"2024-04-23T10:24:58.709746+0000","last_clean":"2024-04-23T10:24:58.709746+0000","last_became_active":"2024-04-23T10:12:39.101268+0000","last_became_peered":"2024-04-23T10:12:39.101268+0000","last_unstale":"2024-04-23T10:24:58.709746+0000","last_undegraded":"2024-04-23T10:24:58.709746+0000","last_fullsized":"2024-04-23T10:24:58.709746+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'768","last_scrub_stamp":"2024-04-23T10:24:58.709568+0000","last_deep_scrub":"26'768","last_deep_scrub_stamp":"2024-04-23T10:24:58.709568+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.709568+0000","objects_scrubbed":0,"log_size":768,"log_dups_size":0,"ondisk_log_size":768,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:10:50.544966+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":48,"num_read_kb":36828,"num_write":745,"num_write_kb":93335,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6,2,0],"acting":[1,6,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.14","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.196114+0000","last_change":"2024-04-23T10:24:48.196172+0000","last_active":"2024-04-23T10:24:48.196114+0000","last_peered":"2024-04-23T10:24:48.196114+0000","last_clean":"2024-04-23T10:24:48.196114+0000","last_became_active":"2024-04-23T10:12:35.027089+0000","last_became_peered":"2024-04-23T10:12:35.027089+0000","last_unstale":"2024-04-23T10:24:48.196114+0000","last_undegraded":"2024-04-23T10:24:48.196114+0000","last_fullsized":"2024-04-23T10:24:48.196114+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:48.195936+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:48.195936+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.195936+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:25:52.991155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"2.15","version":"26'301","reported_seq":341,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.808457+0000","last_change":"2024-04-23T10:24:44.808626+0000","last_active":"2024-04-23T10:24:44.808457+0000","last_peered":"2024-04-23T10:24:44.808457+0000","last_clean":"2024-04-23T10:24:44.808457+0000","last_became_active":"2024-04-23T10:12:34.029567+0000","last_became_peered":"2024-04-23T10:12:34.029567+0000","last_unstale":"2024-04-23T10:24:44.808457+0000","last_undegraded":"2024-04-23T10:24:44.808457+0000","last_fullsized":"2024-04-23T10:24:44.808457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'301","last_scrub_stamp":"2024-04-23T10:24:44.808248+0000","last_deep_scrub":"26'301","last_deep_scrub_stamp":"2024-04-23T10:24:44.808248+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.808248+0000","objects_scrubbed":4,"log_size":301,"log_dups_size":0,"ondisk_log_size":301,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:44:25.431258+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":672,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":254,"num_write_kb":286,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.13","version":"26'729","reported_seq":838,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.224864+0000","last_change":"2024-04-23T10:24:53.224926+0000","last_active":"2024-04-23T10:24:53.224864+0000","last_peered":"2024-04-23T10:24:53.224864+0000","last_clean":"2024-04-23T10:24:53.224864+0000","last_became_active":"2024-04-23T10:12:39.090532+0000","last_became_peered":"2024-04-23T10:12:39.090532+0000","last_unstale":"2024-04-23T10:24:53.224864+0000","last_undegraded":"2024-04-23T10:24:53.224864+0000","last_fullsized":"2024-04-23T10:24:53.224864+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'729","last_scrub_stamp":"2024-04-23T10:24:53.224686+0000","last_deep_scrub":"26'729","last_deep_scrub_stamp":"2024-04-23T10:24:53.224686+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.224686+0000","objects_scrubbed":0,"log_size":729,"log_dups_size":0,"ondisk_log_size":729,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:35:55.053963+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":77,"num_read_kb":43978,"num_write":716,"num_write_kb":155737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5,6,1],"acting":[4,5,6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.17","version":"26'199","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.833125+0000","last_change":"2024-04-23T10:24:58.833274+0000","last_active":"2024-04-23T10:24:58.833125+0000","last_peered":"2024-04-23T10:24:58.833125+0000","last_clean":"2024-04-23T10:24:58.833125+0000","last_became_active":"2024-04-23T10:13:16.890357+0000","last_became_peered":"2024-04-23T10:13:16.890357+0000","last_unstale":"2024-04-23T10:24:58.833125+0000","last_undegraded":"2024-04-23T10:24:58.833125+0000","last_fullsized":"2024-04-23T10:24:58.833125+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'199","last_scrub_stamp":"2024-04-23T10:24:58.832918+0000","last_deep_scrub":"26'199","last_deep_scrub_stamp":"2024-04-23T10:24:58.832918+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.832918+0000","objects_scrubbed":0,"log_size":199,"log_dups_size":0,"ondisk_log_size":199,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:22:40.310017+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.16","version":"26'277","reported_seq":317,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.240892+0000","last_change":"2024-04-23T10:24:51.241028+0000","last_active":"2024-04-23T10:24:51.240892+0000","last_peered":"2024-04-23T10:24:51.240892+0000","last_clean":"2024-04-23T10:24:51.240892+0000","last_became_active":"2024-04-23T10:12:34.051247+0000","last_became_peered":"2024-04-23T10:12:34.051247+0000","last_unstale":"2024-04-23T10:24:51.240892+0000","last_undegraded":"2024-04-23T10:24:51.240892+0000","last_fullsized":"2024-04-23T10:24:51.240892+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'277","last_scrub_stamp":"2024-04-23T10:24:51.240639+0000","last_deep_scrub":"26'277","last_deep_scrub_stamp":"2024-04-23T10:24:51.240639+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.240639+0000","objects_scrubbed":3,"log_size":277,"log_dups_size":0,"ondisk_log_size":277,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:06:18.947292+0000","scrub_duration":23,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":219,"num_write_kb":4216,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"26'809","reported_seq":923,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.574898+0000","last_change":"2024-04-23T10:24:56.574970+0000","last_active":"2024-04-23T10:24:56.574898+0000","last_peered":"2024-04-23T10:24:56.574898+0000","last_clean":"2024-04-23T10:24:56.574898+0000","last_became_active":"2024-04-23T10:12:39.096577+0000","last_became_peered":"2024-04-23T10:12:39.096577+0000","last_unstale":"2024-04-23T10:24:56.574898+0000","last_undegraded":"2024-04-23T10:24:56.574898+0000","last_fullsized":"2024-04-23T10:24:56.574898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'809","last_scrub_stamp":"2024-04-23T10:24:56.574701+0000","last_deep_scrub":"26'809","last_deep_scrub_stamp":"2024-04-23T10:24:56.574701+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.574701+0000","objects_scrubbed":0,"log_size":809,"log_dups_size":0,"ondisk_log_size":809,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:10.456635+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":82,"num_read_kb":50792,"num_write":792,"num_write_kb":109247,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,6,4],"acting":[3,1,6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"26'222","reported_seq":260,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.222744+0000","last_change":"2024-04-23T10:24:45.222821+0000","last_active":"2024-04-23T10:24:45.222744+0000","last_peered":"2024-04-23T10:24:45.222744+0000","last_clean":"2024-04-23T10:24:45.222744+0000","last_became_active":"2024-04-23T10:12:35.028969+0000","last_became_peered":"2024-04-23T10:12:35.028969+0000","last_unstale":"2024-04-23T10:24:45.222744+0000","last_undegraded":"2024-04-23T10:24:45.222744+0000","last_fullsized":"2024-04-23T10:24:45.222744+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'222","last_scrub_stamp":"2024-04-23T10:24:45.222519+0000","last_deep_scrub":"26'222","last_deep_scrub_stamp":"2024-04-23T10:24:45.222519+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.222519+0000","objects_scrubbed":0,"log_size":222,"log_dups_size":0,"ondisk_log_size":222,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:14:52.711185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.17","version":"26'73","reported_seq":113,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.068044+0000","last_change":"2024-04-23T10:24:48.068112+0000","last_active":"2024-04-23T10:24:48.068044+0000","last_peered":"2024-04-23T10:24:48.068044+0000","last_clean":"2024-04-23T10:24:48.068044+0000","last_became_active":"2024-04-23T10:12:34.053733+0000","last_became_peered":"2024-04-23T10:12:34.053733+0000","last_unstale":"2024-04-23T10:24:48.068044+0000","last_undegraded":"2024-04-23T10:24:48.068044+0000","last_fullsized":"2024-04-23T10:24:48.068044+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'73","last_scrub_stamp":"2024-04-23T10:24:48.067879+0000","last_deep_scrub":"26'73","last_deep_scrub_stamp":"2024-04-23T10:24:48.067879+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.067879+0000","objects_scrubbed":3,"log_size":73,"log_dups_size":0,"ondisk_log_size":73,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:13:49.428070+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":180,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.11","version":"26'832","reported_seq":940,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.678633+0000","last_change":"2024-04-23T10:24:59.678733+0000","last_active":"2024-04-23T10:24:59.678633+0000","last_peered":"2024-04-23T10:24:59.678633+0000","last_clean":"2024-04-23T10:24:59.678633+0000","last_became_active":"2024-04-23T10:12:39.146343+0000","last_became_peered":"2024-04-23T10:12:39.146343+0000","last_unstale":"2024-04-23T10:24:59.678633+0000","last_undegraded":"2024-04-23T10:24:59.678633+0000","last_fullsized":"2024-04-23T10:24:59.678633+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'832","last_scrub_stamp":"2024-04-23T10:24:59.678439+0000","last_deep_scrub":"26'832","last_deep_scrub_stamp":"2024-04-23T10:24:59.678439+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.678439+0000","objects_scrubbed":0,"log_size":832,"log_dups_size":0,"ondisk_log_size":832,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:37:16.988603+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":76,"num_read_kb":47499,"num_write":819,"num_write_kb":131639,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7,6,5],"acting":[3,7,6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"26'810","reported_seq":935,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.819726+0000","last_change":"2024-04-23T10:24:56.819788+0000","last_active":"2024-04-23T10:24:56.819726+0000","last_peered":"2024-04-23T10:24:56.819726+0000","last_clean":"2024-04-23T10:24:56.819726+0000","last_became_active":"2024-04-23T10:12:39.145900+0000","last_became_peered":"2024-04-23T10:12:39.145900+0000","last_unstale":"2024-04-23T10:24:56.819726+0000","last_undegraded":"2024-04-23T10:24:56.819726+0000","last_fullsized":"2024-04-23T10:24:56.819726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'810","last_scrub_stamp":"2024-04-23T10:24:56.819540+0000","last_deep_scrub":"26'810","last_deep_scrub_stamp":"2024-04-23T10:24:56.819540+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.819540+0000","objects_scrubbed":0,"log_size":810,"log_dups_size":0,"ondisk_log_size":810,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:27:37.138846+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":92,"num_read_kb":54035,"num_write":802,"num_write_kb":180687,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7,3,1],"acting":[0,7,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"26'212","reported_seq":250,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.680478+0000","last_change":"2024-04-23T10:24:53.680538+0000","last_active":"2024-04-23T10:24:53.680478+0000","last_peered":"2024-04-23T10:24:53.680478+0000","last_clean":"2024-04-23T10:24:53.680478+0000","last_became_active":"2024-04-23T10:12:35.027002+0000","last_became_peered":"2024-04-23T10:12:35.027002+0000","last_unstale":"2024-04-23T10:24:53.680478+0000","last_undegraded":"2024-04-23T10:24:53.680478+0000","last_fullsized":"2024-04-23T10:24:53.680478+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:24:53.680300+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:24:53.680300+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.680300+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:07.467468+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.18","version":"26'1049","reported_seq":1089,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.247814+0000","last_change":"2024-04-23T10:24:48.247889+0000","last_active":"2024-04-23T10:24:48.247814+0000","last_peered":"2024-04-23T10:24:48.247814+0000","last_clean":"2024-04-23T10:24:48.247814+0000","last_became_active":"2024-04-23T10:12:34.030480+0000","last_became_peered":"2024-04-23T10:12:34.030480+0000","last_unstale":"2024-04-23T10:24:48.247814+0000","last_undegraded":"2024-04-23T10:24:48.247814+0000","last_fullsized":"2024-04-23T10:24:48.247814+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'1049","last_scrub_stamp":"2024-04-23T10:24:48.247636+0000","last_deep_scrub":"26'1049","last_deep_scrub_stamp":"2024-04-23T10:24:48.247636+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.247636+0000","objects_scrubbed":3,"log_size":1049,"log_dups_size":0,"ondisk_log_size":1049,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:23:30.261658+0000","scrub_duration":43,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":8389190,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":976,"num_write_kb":8666,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1f","version":"26'723","reported_seq":807,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:57.996336+0000","last_change":"2024-04-23T10:24:57.996336+0000","last_active":"2024-04-23T10:24:57.996336+0000","last_peered":"2024-04-23T10:24:57.996336+0000","last_clean":"2024-04-23T10:24:57.996336+0000","last_became_active":"2024-04-23T10:12:39.104440+0000","last_became_peered":"2024-04-23T10:12:39.104440+0000","last_unstale":"2024-04-23T10:24:57.996336+0000","last_undegraded":"2024-04-23T10:24:57.996336+0000","last_fullsized":"2024-04-23T10:24:57.996336+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'723","last_scrub_stamp":"2024-04-23T10:24:57.996086+0000","last_deep_scrub":"26'723","last_deep_scrub_stamp":"2024-04-23T10:24:57.996086+0000","last_clean_scrub_stamp":"2024-04-23T10:24:57.996086+0000","objects_scrubbed":0,"log_size":723,"log_dups_size":0,"ondisk_log_size":723,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:34:25.064752+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":23582,"num_write":707,"num_write_kb":88737,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5,1,0],"acting":[6,5,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"26'221","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.734510+0000","last_change":"2024-04-23T10:24:52.734510+0000","last_active":"2024-04-23T10:24:52.734510+0000","last_peered":"2024-04-23T10:24:52.734510+0000","last_clean":"2024-04-23T10:24:52.734510+0000","last_became_active":"2024-04-23T10:13:16.026982+0000","last_became_peered":"2024-04-23T10:13:16.026982+0000","last_unstale":"2024-04-23T10:24:52.734510+0000","last_undegraded":"2024-04-23T10:24:52.734510+0000","last_fullsized":"2024-04-23T10:24:52.734510+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'221","last_scrub_stamp":"2024-04-23T10:24:52.734278+0000","last_deep_scrub":"26'221","last_deep_scrub_stamp":"2024-04-23T10:24:52.734278+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.734278+0000","objects_scrubbed":0,"log_size":221,"log_dups_size":0,"ondisk_log_size":221,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:24:17.990136+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.19","version":"26'155","reported_seq":194,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.463753+0000","last_change":"2024-04-23T10:24:47.463824+0000","last_active":"2024-04-23T10:24:47.463753+0000","last_peered":"2024-04-23T10:24:47.463753+0000","last_clean":"2024-04-23T10:24:47.463753+0000","last_became_active":"2024-04-23T10:12:34.037196+0000","last_became_peered":"2024-04-23T10:12:34.037196+0000","last_unstale":"2024-04-23T10:24:47.463753+0000","last_undegraded":"2024-04-23T10:24:47.463753+0000","last_fullsized":"2024-04-23T10:24:47.463753+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'155","last_scrub_stamp":"2024-04-23T10:24:47.463584+0000","last_deep_scrub":"26'155","last_deep_scrub_stamp":"2024-04-23T10:24:47.463584+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.463584+0000","objects_scrubbed":3,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:48:41.822513+0000","scrub_duration":19,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":104,"num_write_kb":4166,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":5000,"num_omap_keys":10,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.1a","version":"26'379","reported_seq":419,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.088020+0000","last_change":"2024-04-23T10:24:50.088020+0000","last_active":"2024-04-23T10:24:50.088020+0000","last_peered":"2024-04-23T10:24:50.088020+0000","last_clean":"2024-04-23T10:24:50.088020+0000","last_became_active":"2024-04-23T10:12:34.054376+0000","last_became_peered":"2024-04-23T10:12:34.054376+0000","last_unstale":"2024-04-23T10:24:50.088020+0000","last_undegraded":"2024-04-23T10:24:50.088020+0000","last_fullsized":"2024-04-23T10:24:50.088020+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'379","last_scrub_stamp":"2024-04-23T10:24:50.087751+0000","last_deep_scrub":"26'379","last_deep_scrub_stamp":"2024-04-23T10:24:50.087751+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.087751+0000","objects_scrubbed":6,"log_size":379,"log_dups_size":0,"ondisk_log_size":379,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:31:14.416736+0000","scrub_duration":55,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":318,"num_write_kb":12488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":3,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1b","version":"26'188","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.847377+0000","last_change":"2024-04-23T10:24:50.847377+0000","last_active":"2024-04-23T10:24:50.847377+0000","last_peered":"2024-04-23T10:24:50.847377+0000","last_clean":"2024-04-23T10:24:50.847377+0000","last_became_active":"2024-04-23T10:12:35.037414+0000","last_became_peered":"2024-04-23T10:12:35.037414+0000","last_unstale":"2024-04-23T10:24:50.847377+0000","last_undegraded":"2024-04-23T10:24:50.847377+0000","last_fullsized":"2024-04-23T10:24:50.847377+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:24:50.847129+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:24:50.847129+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.847129+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:43:19.995948+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1c","version":"26'716","reported_seq":811,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.673510+0000","last_change":"2024-04-23T10:24:50.673510+0000","last_active":"2024-04-23T10:24:50.673510+0000","last_peered":"2024-04-23T10:24:50.673510+0000","last_clean":"2024-04-23T10:24:50.673510+0000","last_became_active":"2024-04-23T10:12:39.080029+0000","last_became_peered":"2024-04-23T10:12:39.080029+0000","last_unstale":"2024-04-23T10:24:50.673510+0000","last_undegraded":"2024-04-23T10:24:50.673510+0000","last_fullsized":"2024-04-23T10:24:50.673510+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'716","last_scrub_stamp":"2024-04-23T10:24:50.673258+0000","last_deep_scrub":"26'716","last_deep_scrub_stamp":"2024-04-23T10:24:50.673258+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.673258+0000","objects_scrubbed":0,"log_size":716,"log_dups_size":0,"ondisk_log_size":716,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:12:17.512931+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":63,"num_read_kb":40799,"num_write":703,"num_write_kb":147067,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,5],"acting":[2,1,3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.1b","version":"26'114","reported_seq":153,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.452959+0000","last_change":"2024-04-23T10:24:46.452959+0000","last_active":"2024-04-23T10:24:46.452959+0000","last_peered":"2024-04-23T10:24:46.452959+0000","last_clean":"2024-04-23T10:24:46.452959+0000","last_became_active":"2024-04-23T10:12:34.032026+0000","last_became_peered":"2024-04-23T10:12:34.032026+0000","last_unstale":"2024-04-23T10:24:46.452959+0000","last_undegraded":"2024-04-23T10:24:46.452959+0000","last_fullsized":"2024-04-23T10:24:46.452959+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'114","last_scrub_stamp":"2024-04-23T10:24:46.452818+0000","last_deep_scrub":"26'114","last_deep_scrub_stamp":"2024-04-23T10:24:46.452818+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.452818+0000","objects_scrubbed":3,"log_size":114,"log_dups_size":0,"ondisk_log_size":114,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:13:27.133608+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4195508,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":54,"num_write_kb":4135,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"26'201","reported_seq":239,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.246559+0000","last_change":"2024-04-23T10:24:46.246559+0000","last_active":"2024-04-23T10:24:46.246559+0000","last_peered":"2024-04-23T10:24:46.246559+0000","last_clean":"2024-04-23T10:24:46.246559+0000","last_became_active":"2024-04-23T10:12:35.018685+0000","last_became_peered":"2024-04-23T10:12:35.018685+0000","last_unstale":"2024-04-23T10:24:46.246559+0000","last_undegraded":"2024-04-23T10:24:46.246559+0000","last_fullsized":"2024-04-23T10:24:46.246559+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'201","last_scrub_stamp":"2024-04-23T10:24:46.246333+0000","last_deep_scrub":"26'201","last_deep_scrub_stamp":"2024-04-23T10:24:46.246333+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.246333+0000","objects_scrubbed":0,"log_size":201,"log_dups_size":0,"ondisk_log_size":201,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:57:41.487852+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1d","version":"26'748","reported_seq":884,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:01.768076+0000","last_change":"2024-04-23T10:25:01.768076+0000","last_active":"2024-04-23T10:25:01.768076+0000","last_peered":"2024-04-23T10:25:01.768076+0000","last_clean":"2024-04-23T10:25:01.768076+0000","last_became_active":"2024-04-23T10:13:16.026889+0000","last_became_peered":"2024-04-23T10:13:16.026889+0000","last_unstale":"2024-04-23T10:25:01.768076+0000","last_undegraded":"2024-04-23T10:25:01.768076+0000","last_fullsized":"2024-04-23T10:25:01.768076+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'748","last_scrub_stamp":"2024-04-23T10:25:01.767925+0000","last_deep_scrub":"26'748","last_deep_scrub_stamp":"2024-04-23T10:25:01.767925+0000","last_clean_scrub_stamp":"2024-04-23T10:25:01.767925+0000","objects_scrubbed":0,"log_size":748,"log_dups_size":0,"ondisk_log_size":748,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:54:52.456916+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":97,"num_read_kb":52291,"num_write":733,"num_write_kb":168699,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5,4,2],"acting":[3,5,4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.20","version":"26'218","reported_seq":257,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.082218+0000","last_change":"2024-04-23T10:24:52.082218+0000","last_active":"2024-04-23T10:24:52.082218+0000","last_peered":"2024-04-23T10:24:52.082218+0000","last_clean":"2024-04-23T10:24:52.082218+0000","last_became_active":"2024-04-23T10:12:35.031248+0000","last_became_peered":"2024-04-23T10:12:35.031248+0000","last_unstale":"2024-04-23T10:24:52.082218+0000","last_undegraded":"2024-04-23T10:24:52.082218+0000","last_fullsized":"2024-04-23T10:24:52.082218+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'218","last_scrub_stamp":"2024-04-23T10:24:52.081988+0000","last_deep_scrub":"26'218","last_deep_scrub_stamp":"2024-04-23T10:24:52.081988+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.081988+0000","objects_scrubbed":0,"log_size":218,"log_dups_size":0,"ondisk_log_size":218,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:56:26.167286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.21","version":"26'217","reported_seq":255,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.666563+0000","last_change":"2024-04-23T10:24:48.666563+0000","last_active":"2024-04-23T10:24:48.666563+0000","last_peered":"2024-04-23T10:24:48.666563+0000","last_clean":"2024-04-23T10:24:48.666563+0000","last_became_active":"2024-04-23T10:12:35.028927+0000","last_became_peered":"2024-04-23T10:12:35.028927+0000","last_unstale":"2024-04-23T10:24:48.666563+0000","last_undegraded":"2024-04-23T10:24:48.666563+0000","last_fullsized":"2024-04-23T10:24:48.666563+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'217","last_scrub_stamp":"2024-04-23T10:24:48.666339+0000","last_deep_scrub":"26'217","last_deep_scrub_stamp":"2024-04-23T10:24:48.666339+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.666339+0000","objects_scrubbed":0,"log_size":217,"log_dups_size":0,"ondisk_log_size":217,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:53:39.479086+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.22","version":"26'238","reported_seq":277,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.287964+0000","last_change":"2024-04-23T10:24:54.287964+0000","last_active":"2024-04-23T10:24:54.287964+0000","last_peered":"2024-04-23T10:24:54.287964+0000","last_clean":"2024-04-23T10:24:54.287964+0000","last_became_active":"2024-04-23T10:12:35.025876+0000","last_became_peered":"2024-04-23T10:12:35.025876+0000","last_unstale":"2024-04-23T10:24:54.287964+0000","last_undegraded":"2024-04-23T10:24:54.287964+0000","last_fullsized":"2024-04-23T10:24:54.287964+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'238","last_scrub_stamp":"2024-04-23T10:24:54.287735+0000","last_deep_scrub":"26'238","last_deep_scrub_stamp":"2024-04-23T10:24:54.287735+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.287735+0000","objects_scrubbed":0,"log_size":238,"log_dups_size":0,"ondisk_log_size":238,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:11:58.112894+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.23","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:48.898094+0000","last_change":"2024-04-23T10:24:48.898094+0000","last_active":"2024-04-23T10:24:48.898094+0000","last_peered":"2024-04-23T10:24:48.898094+0000","last_clean":"2024-04-23T10:24:48.898094+0000","last_became_active":"2024-04-23T10:12:35.028092+0000","last_became_peered":"2024-04-23T10:12:35.028092+0000","last_unstale":"2024-04-23T10:24:48.898094+0000","last_undegraded":"2024-04-23T10:24:48.898094+0000","last_fullsized":"2024-04-23T10:24:48.898094+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:48.897766+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:48.897766+0000","last_clean_scrub_stamp":"2024-04-23T10:24:48.897766+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:09:55.689484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"26'191","reported_seq":228,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:44.457617+0000","last_change":"2024-04-23T10:24:44.457650+0000","last_active":"2024-04-23T10:24:44.457617+0000","last_peered":"2024-04-23T10:24:44.457617+0000","last_clean":"2024-04-23T10:24:44.457617+0000","last_became_active":"2024-04-23T10:12:35.036690+0000","last_became_peered":"2024-04-23T10:12:35.036690+0000","last_unstale":"2024-04-23T10:24:44.457617+0000","last_undegraded":"2024-04-23T10:24:44.457617+0000","last_fullsized":"2024-04-23T10:24:44.457617+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'191","last_scrub_stamp":"2024-04-23T10:24:44.457540+0000","last_deep_scrub":"26'191","last_deep_scrub_stamp":"2024-04-23T10:24:44.457540+0000","last_clean_scrub_stamp":"2024-04-23T10:24:44.457540+0000","objects_scrubbed":0,"log_size":191,"log_dups_size":0,"ondisk_log_size":191,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:17:59.205029+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.25","version":"26'210","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.634807+0000","last_change":"2024-04-23T10:24:52.634971+0000","last_active":"2024-04-23T10:24:52.634807+0000","last_peered":"2024-04-23T10:24:52.634807+0000","last_clean":"2024-04-23T10:24:52.634807+0000","last_became_active":"2024-04-23T10:12:35.025834+0000","last_became_peered":"2024-04-23T10:12:35.025834+0000","last_unstale":"2024-04-23T10:24:52.634807+0000","last_undegraded":"2024-04-23T10:24:52.634807+0000","last_fullsized":"2024-04-23T10:24:52.634807+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-23T10:24:52.634574+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-23T10:24:52.634574+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.634574+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:41.604368+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.26","version":"26'246","reported_seq":284,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.976053+0000","last_change":"2024-04-23T10:24:56.976111+0000","last_active":"2024-04-23T10:24:56.976053+0000","last_peered":"2024-04-23T10:24:56.976053+0000","last_clean":"2024-04-23T10:24:56.976053+0000","last_became_active":"2024-04-23T10:12:35.045336+0000","last_became_peered":"2024-04-23T10:12:35.045336+0000","last_unstale":"2024-04-23T10:24:56.976053+0000","last_undegraded":"2024-04-23T10:24:56.976053+0000","last_fullsized":"2024-04-23T10:24:56.976053+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'246","last_scrub_stamp":"2024-04-23T10:24:56.975881+0000","last_deep_scrub":"26'246","last_deep_scrub_stamp":"2024-04-23T10:24:56.975881+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.975881+0000","objects_scrubbed":0,"log_size":246,"log_dups_size":0,"ondisk_log_size":246,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:36:54.652261+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"26'195","reported_seq":232,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.535825+0000","last_change":"2024-04-23T10:24:54.535891+0000","last_active":"2024-04-23T10:24:54.535825+0000","last_peered":"2024-04-23T10:24:54.535825+0000","last_clean":"2024-04-23T10:24:54.535825+0000","last_became_active":"2024-04-23T10:12:35.043471+0000","last_became_peered":"2024-04-23T10:12:35.043471+0000","last_unstale":"2024-04-23T10:24:54.535825+0000","last_undegraded":"2024-04-23T10:24:54.535825+0000","last_fullsized":"2024-04-23T10:24:54.535825+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:54.535638+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:54.535638+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.535638+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T14:41:42.206146+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.28","version":"26'220","reported_seq":258,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.251179+0000","last_change":"2024-04-23T10:24:53.251238+0000","last_active":"2024-04-23T10:24:53.251179+0000","last_peered":"2024-04-23T10:24:53.251179+0000","last_clean":"2024-04-23T10:24:53.251179+0000","last_became_active":"2024-04-23T10:12:35.025747+0000","last_became_peered":"2024-04-23T10:12:35.025747+0000","last_unstale":"2024-04-23T10:24:53.251179+0000","last_undegraded":"2024-04-23T10:24:53.251179+0000","last_fullsized":"2024-04-23T10:24:53.251179+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'220","last_scrub_stamp":"2024-04-23T10:24:53.251000+0000","last_deep_scrub":"26'220","last_deep_scrub_stamp":"2024-04-23T10:24:53.251000+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.251000+0000","objects_scrubbed":0,"log_size":220,"log_dups_size":0,"ondisk_log_size":220,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:05:58.005176+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.29","version":"26'206","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.464773+0000","last_change":"2024-04-23T10:24:45.464815+0000","last_active":"2024-04-23T10:24:45.464773+0000","last_peered":"2024-04-23T10:24:45.464773+0000","last_clean":"2024-04-23T10:24:45.464773+0000","last_became_active":"2024-04-23T10:12:35.036632+0000","last_became_peered":"2024-04-23T10:12:35.036632+0000","last_unstale":"2024-04-23T10:24:45.464773+0000","last_undegraded":"2024-04-23T10:24:45.464773+0000","last_fullsized":"2024-04-23T10:24:45.464773+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:24:45.464685+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:24:45.464685+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.464685+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T11:42:45.209853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2a","version":"26'214","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.241224+0000","last_change":"2024-04-23T10:24:46.241334+0000","last_active":"2024-04-23T10:24:46.241224+0000","last_peered":"2024-04-23T10:24:46.241224+0000","last_clean":"2024-04-23T10:24:46.241224+0000","last_became_active":"2024-04-23T10:12:35.028528+0000","last_became_peered":"2024-04-23T10:12:35.028528+0000","last_unstale":"2024-04-23T10:24:46.241224+0000","last_undegraded":"2024-04-23T10:24:46.241224+0000","last_fullsized":"2024-04-23T10:24:46.241224+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:46.241011+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:46.241011+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.241011+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:44:30.655755+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2b","version":"26'214","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:52.817746+0000","last_change":"2024-04-23T10:24:52.817805+0000","last_active":"2024-04-23T10:24:52.817746+0000","last_peered":"2024-04-23T10:24:52.817746+0000","last_clean":"2024-04-23T10:24:52.817746+0000","last_became_active":"2024-04-23T10:12:35.046061+0000","last_became_peered":"2024-04-23T10:12:35.046061+0000","last_unstale":"2024-04-23T10:24:52.817746+0000","last_undegraded":"2024-04-23T10:24:52.817746+0000","last_fullsized":"2024-04-23T10:24:52.817746+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'214","last_scrub_stamp":"2024-04-23T10:24:52.817577+0000","last_deep_scrub":"26'214","last_deep_scrub_stamp":"2024-04-23T10:24:52.817577+0000","last_clean_scrub_stamp":"2024-04-23T10:24:52.817577+0000","objects_scrubbed":0,"log_size":214,"log_dups_size":0,"ondisk_log_size":214,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T13:13:35.035158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2c","version":"26'223","reported_seq":261,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.014458+0000","last_change":"2024-04-23T10:24:54.014524+0000","last_active":"2024-04-23T10:24:54.014458+0000","last_peered":"2024-04-23T10:24:54.014458+0000","last_clean":"2024-04-23T10:24:54.014458+0000","last_became_active":"2024-04-23T10:12:35.037922+0000","last_became_peered":"2024-04-23T10:12:35.037922+0000","last_unstale":"2024-04-23T10:24:54.014458+0000","last_undegraded":"2024-04-23T10:24:54.014458+0000","last_fullsized":"2024-04-23T10:24:54.014458+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'223","last_scrub_stamp":"2024-04-23T10:24:54.014249+0000","last_deep_scrub":"26'223","last_deep_scrub_stamp":"2024-04-23T10:24:54.014249+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.014249+0000","objects_scrubbed":0,"log_size":223,"log_dups_size":0,"ondisk_log_size":223,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:38:24.566106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.2d","version":"26'205","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.295201+0000","last_change":"2024-04-23T10:24:59.295259+0000","last_active":"2024-04-23T10:24:59.295201+0000","last_peered":"2024-04-23T10:24:59.295201+0000","last_clean":"2024-04-23T10:24:59.295201+0000","last_became_active":"2024-04-23T10:12:35.041331+0000","last_became_peered":"2024-04-23T10:12:35.041331+0000","last_unstale":"2024-04-23T10:24:59.295201+0000","last_undegraded":"2024-04-23T10:24:59.295201+0000","last_fullsized":"2024-04-23T10:24:59.295201+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'205","last_scrub_stamp":"2024-04-23T10:24:59.295024+0000","last_deep_scrub":"26'205","last_deep_scrub_stamp":"2024-04-23T10:24:59.295024+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.295024+0000","objects_scrubbed":0,"log_size":205,"log_dups_size":0,"ondisk_log_size":205,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:11:22.108853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2e","version":"26'209","reported_seq":246,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:49.618597+0000","last_change":"2024-04-23T10:24:49.618662+0000","last_active":"2024-04-23T10:24:49.618597+0000","last_peered":"2024-04-23T10:24:49.618597+0000","last_clean":"2024-04-23T10:24:49.618597+0000","last_became_active":"2024-04-23T10:12:35.041859+0000","last_became_peered":"2024-04-23T10:12:35.041859+0000","last_unstale":"2024-04-23T10:24:49.618597+0000","last_undegraded":"2024-04-23T10:24:49.618597+0000","last_fullsized":"2024-04-23T10:24:49.618597+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:24:49.618420+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:24:49.618420+0000","last_clean_scrub_stamp":"2024-04-23T10:24:49.618420+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:15:34.746958+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2f","version":"26'203","reported_seq":241,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.299045+0000","last_change":"2024-04-23T10:24:55.299110+0000","last_active":"2024-04-23T10:24:55.299045+0000","last_peered":"2024-04-23T10:24:55.299045+0000","last_clean":"2024-04-23T10:24:55.299045+0000","last_became_active":"2024-04-23T10:12:35.029480+0000","last_became_peered":"2024-04-23T10:12:35.029480+0000","last_unstale":"2024-04-23T10:24:55.299045+0000","last_undegraded":"2024-04-23T10:24:55.299045+0000","last_fullsized":"2024-04-23T10:24:55.299045+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'203","last_scrub_stamp":"2024-04-23T10:24:55.298873+0000","last_deep_scrub":"26'203","last_deep_scrub_stamp":"2024-04-23T10:24:55.298873+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.298873+0000","objects_scrubbed":0,"log_size":203,"log_dups_size":0,"ondisk_log_size":203,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:43:53.074724+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"26'219","reported_seq":243,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.700482+0000","last_change":"2024-04-23T10:24:51.700482+0000","last_active":"2024-04-23T10:24:51.700482+0000","last_peered":"2024-04-23T10:24:51.700482+0000","last_clean":"2024-04-23T10:24:51.700482+0000","last_became_active":"2024-04-23T10:13:16.027235+0000","last_became_peered":"2024-04-23T10:13:16.027235+0000","last_unstale":"2024-04-23T10:24:51.700482+0000","last_undegraded":"2024-04-23T10:24:51.700482+0000","last_fullsized":"2024-04-23T10:24:51.700482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'219","last_scrub_stamp":"2024-04-23T10:24:51.700128+0000","last_deep_scrub":"26'219","last_deep_scrub_stamp":"2024-04-23T10:24:51.700128+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.700128+0000","objects_scrubbed":0,"log_size":219,"log_dups_size":0,"ondisk_log_size":219,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:57:44.414875+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.31","version":"26'213","reported_seq":251,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.691144+0000","last_change":"2024-04-23T10:24:50.691202+0000","last_active":"2024-04-23T10:24:50.691144+0000","last_peered":"2024-04-23T10:24:50.691144+0000","last_clean":"2024-04-23T10:24:50.691144+0000","last_became_active":"2024-04-23T10:12:35.019020+0000","last_became_peered":"2024-04-23T10:12:35.019020+0000","last_unstale":"2024-04-23T10:24:50.691144+0000","last_undegraded":"2024-04-23T10:24:50.691144+0000","last_fullsized":"2024-04-23T10:24:50.691144+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-23T10:24:50.690970+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-23T10:24:50.690970+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.690970+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:36:06.736145+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"26'212","reported_seq":249,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:45.921246+0000","last_change":"2024-04-23T10:24:45.921306+0000","last_active":"2024-04-23T10:24:45.921246+0000","last_peered":"2024-04-23T10:24:45.921246+0000","last_clean":"2024-04-23T10:24:45.921246+0000","last_became_active":"2024-04-23T10:12:35.027987+0000","last_became_peered":"2024-04-23T10:12:35.027987+0000","last_unstale":"2024-04-23T10:24:45.921246+0000","last_undegraded":"2024-04-23T10:24:45.921246+0000","last_fullsized":"2024-04-23T10:24:45.921246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'212","last_scrub_stamp":"2024-04-23T10:24:45.921082+0000","last_deep_scrub":"26'212","last_deep_scrub_stamp":"2024-04-23T10:24:45.921082+0000","last_clean_scrub_stamp":"2024-04-23T10:24:45.921082+0000","objects_scrubbed":0,"log_size":212,"log_dups_size":0,"ondisk_log_size":212,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:43:21.459304+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.33","version":"26'200","reported_seq":237,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:53.504422+0000","last_change":"2024-04-23T10:24:53.504544+0000","last_active":"2024-04-23T10:24:53.504422+0000","last_peered":"2024-04-23T10:24:53.504422+0000","last_clean":"2024-04-23T10:24:53.504422+0000","last_became_active":"2024-04-23T10:12:35.031180+0000","last_became_peered":"2024-04-23T10:12:35.031180+0000","last_unstale":"2024-04-23T10:24:53.504422+0000","last_undegraded":"2024-04-23T10:24:53.504422+0000","last_fullsized":"2024-04-23T10:24:53.504422+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'200","last_scrub_stamp":"2024-04-23T10:24:53.504198+0000","last_deep_scrub":"26'200","last_deep_scrub_stamp":"2024-04-23T10:24:53.504198+0000","last_clean_scrub_stamp":"2024-04-23T10:24:53.504198+0000","objects_scrubbed":0,"log_size":200,"log_dups_size":0,"ondisk_log_size":200,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:36:01.149241+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.34","version":"26'187","reported_seq":225,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:50.192982+0000","last_change":"2024-04-23T10:24:50.193044+0000","last_active":"2024-04-23T10:24:50.192982+0000","last_peered":"2024-04-23T10:24:50.192982+0000","last_clean":"2024-04-23T10:24:50.192982+0000","last_became_active":"2024-04-23T10:12:35.034852+0000","last_became_peered":"2024-04-23T10:12:35.034852+0000","last_unstale":"2024-04-23T10:24:50.192982+0000","last_undegraded":"2024-04-23T10:24:50.192982+0000","last_fullsized":"2024-04-23T10:24:50.192982+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'187","last_scrub_stamp":"2024-04-23T10:24:50.192807+0000","last_deep_scrub":"26'187","last_deep_scrub_stamp":"2024-04-23T10:24:50.192807+0000","last_clean_scrub_stamp":"2024-04-23T10:24:50.192807+0000","objects_scrubbed":0,"log_size":187,"log_dups_size":0,"ondisk_log_size":187,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:02:18.792192+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.35","version":"26'188","reported_seq":226,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:55.061635+0000","last_change":"2024-04-23T10:24:55.061760+0000","last_active":"2024-04-23T10:24:55.061635+0000","last_peered":"2024-04-23T10:24:55.061635+0000","last_clean":"2024-04-23T10:24:55.061635+0000","last_became_active":"2024-04-23T10:12:35.038703+0000","last_became_peered":"2024-04-23T10:12:35.038703+0000","last_unstale":"2024-04-23T10:24:55.061635+0000","last_undegraded":"2024-04-23T10:24:55.061635+0000","last_fullsized":"2024-04-23T10:24:55.061635+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'188","last_scrub_stamp":"2024-04-23T10:24:55.061421+0000","last_deep_scrub":"26'188","last_deep_scrub_stamp":"2024-04-23T10:24:55.061421+0000","last_clean_scrub_stamp":"2024-04-23T10:24:55.061421+0000","objects_scrubbed":0,"log_size":188,"log_dups_size":0,"ondisk_log_size":188,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T17:18:27.015385+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.36","version":"26'207","reported_seq":245,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:56.016991+0000","last_change":"2024-04-23T10:24:56.017053+0000","last_active":"2024-04-23T10:24:56.016991+0000","last_peered":"2024-04-23T10:24:56.016991+0000","last_clean":"2024-04-23T10:24:56.016991+0000","last_became_active":"2024-04-23T10:12:35.040248+0000","last_became_peered":"2024-04-23T10:12:35.040248+0000","last_unstale":"2024-04-23T10:24:56.016991+0000","last_undegraded":"2024-04-23T10:24:56.016991+0000","last_fullsized":"2024-04-23T10:24:56.016991+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'207","last_scrub_stamp":"2024-04-23T10:24:56.016819+0000","last_deep_scrub":"26'207","last_deep_scrub_stamp":"2024-04-23T10:24:56.016819+0000","last_clean_scrub_stamp":"2024-04-23T10:24:56.016819+0000","objects_scrubbed":0,"log_size":207,"log_dups_size":0,"ondisk_log_size":207,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T10:32:20.695135+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.37","version":"26'210","reported_seq":248,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.347792+0000","last_change":"2024-04-23T10:24:46.347852+0000","last_active":"2024-04-23T10:24:46.347792+0000","last_peered":"2024-04-23T10:24:46.347792+0000","last_clean":"2024-04-23T10:24:46.347792+0000","last_became_active":"2024-04-23T10:12:35.034980+0000","last_became_peered":"2024-04-23T10:12:35.034980+0000","last_unstale":"2024-04-23T10:24:46.347792+0000","last_undegraded":"2024-04-23T10:24:46.347792+0000","last_fullsized":"2024-04-23T10:24:46.347792+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'210","last_scrub_stamp":"2024-04-23T10:24:46.347620+0000","last_deep_scrub":"26'210","last_deep_scrub_stamp":"2024-04-23T10:24:46.347620+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.347620+0000","objects_scrubbed":0,"log_size":210,"log_dups_size":0,"ondisk_log_size":210,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:16:28.360220+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.38","version":"26'190","reported_seq":227,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:51.481730+0000","last_change":"2024-04-23T10:24:51.481730+0000","last_active":"2024-04-23T10:24:51.481730+0000","last_peered":"2024-04-23T10:24:51.481730+0000","last_clean":"2024-04-23T10:24:51.481730+0000","last_became_active":"2024-04-23T10:12:35.025729+0000","last_became_peered":"2024-04-23T10:12:35.025729+0000","last_unstale":"2024-04-23T10:24:51.481730+0000","last_undegraded":"2024-04-23T10:24:51.481730+0000","last_fullsized":"2024-04-23T10:24:51.481730+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'190","last_scrub_stamp":"2024-04-23T10:24:51.481492+0000","last_deep_scrub":"26'190","last_deep_scrub_stamp":"2024-04-23T10:24:51.481492+0000","last_clean_scrub_stamp":"2024-04-23T10:24:51.481492+0000","objects_scrubbed":0,"log_size":190,"log_dups_size":0,"ondisk_log_size":190,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:53:42.889258+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.39","version":"26'206","reported_seq":244,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:02.334312+0000","last_change":"2024-04-23T10:25:02.334312+0000","last_active":"2024-04-23T10:25:02.334312+0000","last_peered":"2024-04-23T10:25:02.334312+0000","last_clean":"2024-04-23T10:25:02.334312+0000","last_became_active":"2024-04-23T10:12:35.044550+0000","last_became_peered":"2024-04-23T10:12:35.044550+0000","last_unstale":"2024-04-23T10:25:02.334312+0000","last_undegraded":"2024-04-23T10:25:02.334312+0000","last_fullsized":"2024-04-23T10:25:02.334312+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'206","last_scrub_stamp":"2024-04-23T10:25:02.334069+0000","last_deep_scrub":"26'206","last_deep_scrub_stamp":"2024-04-23T10:25:02.334069+0000","last_clean_scrub_stamp":"2024-04-23T10:25:02.334069+0000","objects_scrubbed":0,"log_size":206,"log_dups_size":0,"ondisk_log_size":206,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T19:21:54.695452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3a","version":"26'196","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:58.292183+0000","last_change":"2024-04-23T10:24:58.292183+0000","last_active":"2024-04-23T10:24:58.292183+0000","last_peered":"2024-04-23T10:24:58.292183+0000","last_clean":"2024-04-23T10:24:58.292183+0000","last_became_active":"2024-04-23T10:12:35.029900+0000","last_became_peered":"2024-04-23T10:12:35.029900+0000","last_unstale":"2024-04-23T10:24:58.292183+0000","last_undegraded":"2024-04-23T10:24:58.292183+0000","last_fullsized":"2024-04-23T10:24:58.292183+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'196","last_scrub_stamp":"2024-04-23T10:24:58.291942+0000","last_deep_scrub":"26'196","last_deep_scrub_stamp":"2024-04-23T10:24:58.291942+0000","last_clean_scrub_stamp":"2024-04-23T10:24:58.291942+0000","objects_scrubbed":0,"log_size":196,"log_dups_size":0,"ondisk_log_size":196,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T22:19:42.505724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3b","version":"26'209","reported_seq":247,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:47.340718+0000","last_change":"2024-04-23T10:24:47.340718+0000","last_active":"2024-04-23T10:24:47.340718+0000","last_peered":"2024-04-23T10:24:47.340718+0000","last_clean":"2024-04-23T10:24:47.340718+0000","last_became_active":"2024-04-23T10:12:35.034517+0000","last_became_peered":"2024-04-23T10:12:35.034517+0000","last_unstale":"2024-04-23T10:24:47.340718+0000","last_undegraded":"2024-04-23T10:24:47.340718+0000","last_fullsized":"2024-04-23T10:24:47.340718+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'209","last_scrub_stamp":"2024-04-23T10:24:47.340397+0000","last_deep_scrub":"26'209","last_deep_scrub_stamp":"2024-04-23T10:24:47.340397+0000","last_clean_scrub_stamp":"2024-04-23T10:24:47.340397+0000","objects_scrubbed":0,"log_size":209,"log_dups_size":0,"ondisk_log_size":209,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T20:08:34.025341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3c","version":"26'195","reported_seq":234,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:59.323274+0000","last_change":"2024-04-23T10:24:59.323336+0000","last_active":"2024-04-23T10:24:59.323274+0000","last_peered":"2024-04-23T10:24:59.323274+0000","last_clean":"2024-04-23T10:24:59.323274+0000","last_became_active":"2024-04-23T10:12:35.027069+0000","last_became_peered":"2024-04-23T10:12:35.027069+0000","last_unstale":"2024-04-23T10:24:59.323274+0000","last_undegraded":"2024-04-23T10:24:59.323274+0000","last_fullsized":"2024-04-23T10:24:59.323274+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:59.323099+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:59.323099+0000","last_clean_scrub_stamp":"2024-04-23T10:24:59.323099+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T15:31:21.810345+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3d","version":"26'195","reported_seq":233,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:46.879957+0000","last_change":"2024-04-23T10:24:46.879957+0000","last_active":"2024-04-23T10:24:46.879957+0000","last_peered":"2024-04-23T10:24:46.879957+0000","last_clean":"2024-04-23T10:24:46.879957+0000","last_became_active":"2024-04-23T10:12:35.027978+0000","last_became_peered":"2024-04-23T10:12:35.027978+0000","last_unstale":"2024-04-23T10:24:46.879957+0000","last_undegraded":"2024-04-23T10:24:46.879957+0000","last_fullsized":"2024-04-23T10:24:46.879957+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'195","last_scrub_stamp":"2024-04-23T10:24:46.879609+0000","last_deep_scrub":"26'195","last_deep_scrub_stamp":"2024-04-23T10:24:46.879609+0000","last_clean_scrub_stamp":"2024-04-23T10:24:46.879609+0000","objects_scrubbed":0,"log_size":195,"log_dups_size":0,"ondisk_log_size":195,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T12:08:21.088050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3e","version":"26'213","reported_seq":252,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:24:54.675246+0000","last_change":"2024-04-23T10:24:54.675246+0000","last_active":"2024-04-23T10:24:54.675246+0000","last_peered":"2024-04-23T10:24:54.675246+0000","last_clean":"2024-04-23T10:24:54.675246+0000","last_became_active":"2024-04-23T10:12:35.030543+0000","last_became_peered":"2024-04-23T10:12:35.030543+0000","last_unstale":"2024-04-23T10:24:54.675246+0000","last_undegraded":"2024-04-23T10:24:54.675246+0000","last_fullsized":"2024-04-23T10:24:54.675246+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'213","last_scrub_stamp":"2024-04-23T10:24:54.675005+0000","last_deep_scrub":"26'213","last_deep_scrub_stamp":"2024-04-23T10:24:54.675005+0000","last_clean_scrub_stamp":"2024-04-23T10:24:54.675005+0000","objects_scrubbed":0,"log_size":213,"log_dups_size":0,"ondisk_log_size":213,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T16:07:50.690888+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3f","version":"26'215","reported_seq":254,"reported_epoch":26,"state":"active+clean","last_fresh":"2024-04-23T10:25:03.300231+0000","last_change":"2024-04-23T10:25:03.300231+0000","last_active":"2024-04-23T10:25:03.300231+0000","last_peered":"2024-04-23T10:25:03.300231+0000","last_clean":"2024-04-23T10:25:03.300231+0000","last_became_active":"2024-04-23T10:12:35.047028+0000","last_became_peered":"2024-04-23T10:12:35.047028+0000","last_unstale":"2024-04-23T10:25:03.300231+0000","last_undegraded":"2024-04-23T10:25:03.300231+0000","last_fullsized":"2024-04-23T10:25:03.300231+0000","mapping_epoch":18,"log_start":"0'0","ondisk_log_start":"0'0","created":18,"last_epoch_clean":19,"parent":"0.0","parent_split_bits":0,"last_scrub":"26'215","last_scrub_stamp":"2024-04-23T10:25:03.299876+0000","last_deep_scrub":"26'215","last_deep_scrub_stamp":"2024-04-23T10:25:03.299876+0000","last_clean_scrub_stamp":"2024-04-23T10:25:03.299876+0000","objects_scrubbed":0,"log_size":215,"log_dups_size":0,"ondisk_log_size":215,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-24T18:17:52.570757+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":4,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2556,"num_read_kb":1382138,"num_write":24323,"num_write_kb":4267460,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":24806,"ondisk_log_size":24806,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":13233,"ondisk_log_size":13233,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":32,"stat_sum":{"num_bytes":135556661,"num_objects":130,"num_object_clones":0,"num_object_copies":260,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":130,"num_whiteouts":0,"num_read":597,"num_read_kb":1914,"num_write":9768,"num_write_kb":138960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":66,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":25000,"num_omap_keys":50,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":271360000,"data_stored":271113322,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10892,"ondisk_log_size":10892,"up":64,"acting":64,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834575008,"num_pgs":44,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":121472,"kb_used_data":50040,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94250368,"statfs":{"total":96636764160,"available":96512376832,"internally_reserved":0,"allocated":51240960,"data_stored":51039146,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":73136586},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834575006,"num_pgs":38,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":108464,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94263376,"statfs":{"total":96636764160,"available":96525697024,"internally_reserved":0,"allocated":46440448,"data_stored":46253836,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":64616902},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834575006,"num_pgs":43,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":118472,"kb_used_data":24896,"kb_used_omap":1,"kb_used_meta":93566,"kb_avail":94253368,"statfs":{"total":96636764160,"available":96515448832,"internally_reserved":0,"allocated":25493504,"data_stored":25284786,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":95812037},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834575008,"num_pgs":42,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126448,"kb_used_data":45352,"kb_used_omap":1,"kb_used_meta":81086,"kb_avail":94245392,"statfs":{"total":96636764160,"available":96507281408,"internally_reserved":0,"allocated":46440448,"data_stored":46253704,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":83032517},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834575008,"num_pgs":46,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":119920,"kb_used_data":34600,"kb_used_omap":1,"kb_used_meta":85310,"kb_avail":94251920,"statfs":{"total":96636764160,"available":96513966080,"internally_reserved":0,"allocated":35430400,"data_stored":35236009,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":87357895},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834575008,"num_pgs":27,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":72912,"kb_used_data":9800,"kb_used_omap":1,"kb_used_meta":63102,"kb_avail":94298928,"statfs":{"total":96636764160,"available":96562102272,"internally_reserved":0,"allocated":10035200,"data_stored":9835193,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":64616901},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834575007,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":140432,"kb_used_data":28744,"kb_used_omap":1,"kb_used_meta":111678,"kb_avail":94231408,"statfs":{"total":96636764160,"available":96492961792,"internally_reserved":0,"allocated":29433856,"data_stored":29241150,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":114358725},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834575008,"num_pgs":41,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":100984,"kb_used_data":29552,"kb_used_omap":1,"kb_used_meta":71422,"kb_avail":94270856,"statfs":{"total":96636764160,"available":96533356544,"internally_reserved":0,"allocated":30261248,"data_stored":30065818,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":73136581},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":29388800,"data_stored":29361002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":29155328,"data_stored":29126702,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":9756672,"data_stored":9720745,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":35151872,"data_stored":35121561,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":25214976,"data_stored":25170338,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":46161920,"data_stored":46139388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":50368512,"data_stored":50334330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-23T10:25:27.232 DEBUG:teuthology.orchestra.run.smithi026:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-23T10:25:27.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.401+0000 7f35f298b640 1 Processor -- start 2024-04-23T10:25:27.401 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.401+0000 7f35f298b640 1 -- start start 2024-04-23T10:25:27.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f298b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35ec1635e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f298b640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ec0ccde0 con 0x7f35ec0cc950 2024-04-23T10:25:27.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f298b640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f35ec15fd90 con 0x7f35ec0b5cf0 2024-04-23T10:25:27.402 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f298b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35ec160070 con 0x7f35ec0cdab0 2024-04-23T10:25:27.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f0f28640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f35ec0cc950 0x7f35ec0b3a30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59220/0 (socket says 172.21.15.26:59220) 2024-04-23T10:25:27.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f0f28640 1 -- 172.21.15.26:0/2161148377 learned_addr learned my addr 172.21.15.26:0/2161148377 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:27.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35ec1635e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1595653493 0 0) 0x7f35ec0ccde0 con 0x7f35ec0cc950 2024-04-23T10:25:27.403 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f35d8003530 con 0x7f35ec0cc950 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 886228700 0 0) 0x7f35d8003530 con 0x7f35ec0cc950 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 msgr2=0x7f35ec1635e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35ec1635e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 >> v1:172.21.15.190:6789/0 conn(0x7f35ec0b5cf0 legacy=0x7f35ec15f470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec162b00 con 0x7f35ec0cc950 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f35e4001680 con 0x7f35ec0cc950 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 >> v1:172.21.15.26:6789/0 conn(0x7f35ec0cc950 legacy=0x7f35ec0b3a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35d80039f0 0x7f35d8003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35d8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35d8004d50 0x7f35d80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec160070 con 0x7f35d80039f0 2024-04-23T10:25:27.405 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35d800b9d0 con 0x7f35d8004d50 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35d800bbd0 con 0x7f35ec0cdab0 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35d80039f0 0x7f35d8003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35f0f28640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35d8004d50 0x7f35d80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35d8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 -- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 msgr2=0x7f35d8004810 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35d8004810 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 -- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35d8004d50 msgr2=0x7f35d80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35d8004d50 0x7f35d80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 -- 172.21.15.26:0/2161148377 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35d8003530 con 0x7f35d80039f0 2024-04-23T10:25:27.406 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec0cdab0 0x7f35d8004810 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.405+0000 7f35ebfff640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35d80039f0 0x7f35d8003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009fa0 tx=0x7f35dc01cb80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586110b4379c92ee server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0b2070 con 0x7f35d80039f0 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35dc0a5c50 con 0x7f35d80039f0 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35eaffd640 1 -- 172.21.15.26:0/2161148377 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc009bf0 con 0x7f35d80039f0 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- 172.21.15.26:0/2161148377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35d80039f0 msgr2=0x7f35d8003dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.407 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 --2- 172.21.15.26:0/2161148377 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35d80039f0 0x7f35d8003dd0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7f35dc009fa0 tx=0x7f35dc01cb80 comp rx=0 tx=0).stop 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f0f28640 1 -- 172.21.15.26:0/2161148377 reap_dead start 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- 172.21.15.26:0/2161148377 shutdown_connections 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- 172.21.15.26:0/2161148377 >> 172.21.15.26:0/2161148377 conn(0x7f35ec06cc30 msgr2=0x7f35ec06d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- 172.21.15.26:0/2161148377 shutdown_connections 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- 172.21.15.26:0/2161148377 wait complete. 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 Processor -- start 2024-04-23T10:25:27.408 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- start start 2024-04-23T10:25:27.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 0x7f35ec156e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35ec1f6340 0x7f35ec158940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec160350 con 0x7f35ec156a60 2024-04-23T10:25:27.410 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f35ec1630c0 con 0x7f35ec1f6340 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f298b640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f35ec0b45a0 con 0x7f35ec1595a0 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40258/0 (socket says 172.21.15.26:40258) 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 -- 172.21.15.26:0/3108573148 learned_addr learned my addr 172.21.15.26:0/3108573148 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 0x7f35ec156e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35f0f28640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35ec1f6340 0x7f35ec158940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 -- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 msgr2=0x7f35ec156e40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 0x7f35ec156e40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 -- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35ec1f6340 msgr2=0x7f35ec158940 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35ec1f6340 0x7f35ec158940 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35ebfff640 1 -- 172.21.15.26:0/3108573148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f35ec157ea0 con 0x7f35ec156a60 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.409+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 0x7f35ec156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35ebfff640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0b0040 tx=0x7f35d8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc0b2050 con 0x7f35ec156a60 2024-04-23T10:25:27.411 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f35dc0b3040 con 0x7f35ec156a60 2024-04-23T10:25:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f35ec157570 con 0x7f35ec156a60 2024-04-23T10:25:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f35dc009bf0 con 0x7f35ec156a60 2024-04-23T10:25:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f35ec158420 con 0x7f35ec156a60 2024-04-23T10:25:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f35ec075df0 con 0x7f35ec156a60 2024-04-23T10:25:27.412 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f35dc0c0020 con 0x7f35ec156a60 2024-04-23T10:25:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 0x7f35cc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f35dc121e70 con 0x7f35ec156a60 2024-04-23T10:25:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 0x7f35cc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.413 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.413+0000 7f35eb7fe640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 0x7f35cc06a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0cefd0 tx=0x7f35d400a320 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.416 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.417+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f35dc016890 con 0x7f35ec156a60 2024-04-23T10:25:27.580 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.581+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f35ec158e80 con 0x7f35ec156a60 2024-04-23T10:25:27.586 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v10)=0 v10) ==== 123+0+0 (secure 0 0 0) 0x7f35dc0ab340 con 0x7f35ec156a60 2024-04-23T10:25:27.588 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35e8ff9640 1 -- 172.21.15.26:0/3108573148 <== mon.0 v2:172.21.15.26:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f35dc0f17e0 con 0x7f35ec156a60 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 msgr2=0x7f35cc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 0x7f35cc06a870 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f35ec0cefd0 tx=0x7f35d400a320 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 msgr2=0x7f35ec1f5950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 crypto rx=0x7f35dc0b0040 tx=0x7f35d8005840 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 shutdown_connections 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f35cc0683b0 0x7f35cc06a870 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f35ec1f6340 0x7f35ec158940 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f35ec1595a0 0x7f35ec156e40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 --2- 172.21.15.26:0/3108573148 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f35ec156a60 0x7f35ec1f5950 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 >> 172.21.15.26:0/3108573148 conn(0x7f35ec06cc30 msgr2=0x7f35ec0ce8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 shutdown_connections 2024-04-23T10:25:27.590 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.589+0000 7f35f298b640 1 -- 172.21.15.26:0/3108573148 wait complete. 2024-04-23T10:25:27.606 INFO:tasks.cephfs.filesystem:Destroying file system cephfs and related pools 2024-04-23T10:25:27.606 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:25:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.729+0000 7f3b67da0640 1 Processor -- start 2024-04-23T10:25:27.729 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.729+0000 7f3b67da0640 1 -- start start 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b67da0640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b600c6710 0x7f3b6015b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b67da0640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6015ea30 con 0x7f3b60155370 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b67da0640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3b6015ed10 con 0x7f3b6015e540 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b67da0640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f3b600c5b70 con 0x7f3b600c6710 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b6633d640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f3b600c6710 0x7f3b6015b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b65b3c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f3b60155370 0x7f3b6006d590 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59226/0 (socket says 172.21.15.26:59226) 2024-04-23T10:25:27.731 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b65b3c640 1 -- 172.21.15.26:0/1315828786 learned_addr learned my addr 172.21.15.26:0/1315828786 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b6633d640 1 -- 172.21.15.26:0/1315828786 >> v1:172.21.15.190:6789/0 conn(0x7f3b6015e540 legacy=0x7f3b600c6000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b64b3a640 1 -- 172.21.15.26:0/1315828786 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1999086790 0 0) 0x7f3b6015ea30 con 0x7f3b60155370 2024-04-23T10:25:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b6633d640 1 -- 172.21.15.26:0/1315828786 >> v1:172.21.15.26:6789/0 conn(0x7f3b60155370 legacy=0x7f3b6006d590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.732 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b6633d640 1 -- 172.21.15.26:0/1315828786 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b6015eff0 con 0x7f3b600c6710 2024-04-23T10:25:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.733+0000 7f3b6633d640 1 --2- 172.21.15.26:0/1315828786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b600c6710 0x7f3b6015b9d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3b600c5cf0 tx=0x7f3b5c01ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8075a1f953e757e server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b64b3a640 1 -- 172.21.15.26:0/1315828786 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0b5070 con 0x7f3b600c6710 2024-04-23T10:25:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b64b3a640 1 -- 172.21.15.26:0/1315828786 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3b5c0a8990 con 0x7f3b600c6710 2024-04-23T10:25:27.734 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b64b3a640 1 -- 172.21.15.26:0/1315828786 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0a8d80 con 0x7f3b600c6710 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/1315828786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b600c6710 msgr2=0x7f3b6015b9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 --2- 172.21.15.26:0/1315828786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b600c6710 0x7f3b6015b9d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f3b600c5cf0 tx=0x7f3b5c01ec90 comp rx=0 tx=0).stop 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/1315828786 shutdown_connections 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 --2- 172.21.15.26:0/1315828786 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b600c6710 0x7f3b6015b9d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/1315828786 >> 172.21.15.26:0/1315828786 conn(0x7f3b600676a0 msgr2=0x7f3b60067ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/1315828786 shutdown_connections 2024-04-23T10:25:27.735 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/1315828786 wait complete. 2024-04-23T10:25:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 Processor -- start 2024-04-23T10:25:27.736 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- start start 2024-04-23T10:25:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b600c6710 0x7f3b6014a980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.737 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b60155370 0x7f3b601f0c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f3b6006dca0 con 0x7f3b6015e540 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f3b600c5800 con 0x7f3b600c6710 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f3b6006de20 con 0x7f3b60155370 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40272/0 (socket says 172.21.15.26:40272) 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 -- 172.21.15.26:0/618086131 learned_addr learned my addr 172.21.15.26:0/618086131 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b65b3c640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b600c6710 0x7f3b6014a980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6533b640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b60155370 0x7f3b601f0c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 -- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b60155370 msgr2=0x7f3b601f0c00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b60155370 0x7f3b601f0c00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 -- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b600c6710 msgr2=0x7f3b6014a980 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b600c6710 0x7f3b6014a980 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.738 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 -- 172.21.15.26:0/618086131 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3b600ceb40 con 0x7f3b6015e540 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b6633d640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0b3040 tx=0x7f3b5c01ba30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0c0070 con 0x7f3b6015e540 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f3b5c004230 con 0x7f3b6015e540 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3b600cee20 con 0x7f3b6015e540 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f3b5c0b5040 con 0x7f3b6015e540 2024-04-23T10:25:27.739 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.737+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3b601f4450 con 0x7f3b6015e540 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3b60075df0 con 0x7f3b6015e540 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f3b5c0c3070 con 0x7f3b6015e540 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b567fc640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 0x7f3b4406a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f3b5c123ae0 con 0x7f3b6015e540 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b65b3c640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 0x7f3b4406a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:27.740 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.741+0000 7f3b65b3c640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 0x7f3b4406a870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b580012f0 tx=0x7f3b58009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:27.744 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.745+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f3b5c0187f0 con 0x7f3b6015e540 2024-04-23T10:25:27.949 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.949+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f3b600cad10 con 0x7f3b6015e540 2024-04-23T10:25:27.951 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b567fc640 1 -- 172.21.15.26:0/618086131 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f3b5c0f3bf0 con 0x7f3b6015e540 2024-04-23T10:25:27.951 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:25:27.951 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:25:27.952 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 msgr2=0x7f3b4406a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 0x7f3b4406a870 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7f3b580012f0 tx=0x7f3b58009040 comp rx=0 tx=0).stop 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 msgr2=0x7f3b60145480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f3b5c0b3040 tx=0x7f3b5c01ba30 comp rx=0 tx=0).stop 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 shutdown_connections 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f3b440683b0 0x7f3b4406a870 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f3b6015e540 0x7f3b60145480 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.954 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f3b60155370 0x7f3b601f0c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 --2- 172.21.15.26:0/618086131 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f3b600c6710 0x7f3b6014a980 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 >> 172.21.15.26:0/618086131 conn(0x7f3b600676a0 msgr2=0x7f3b60159c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.953+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 shutdown_connections 2024-04-23T10:25:27.955 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:27.957+0000 7f3b67da0640 1 -- 172.21.15.26:0/618086131 wait complete. 2024-04-23T10:25:27.971 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-04-23T10:25:28.089 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.089+0000 7f8b09082640 1 Processor -- start 2024-04-23T10:25:28.090 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.089+0000 7f8b09082640 1 -- start start 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b09082640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f8b040cda50 0x7f8b040c59c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b09082640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0415bc10 con 0x7f8b04155350 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b09082640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b0415beb0 con 0x7f8b0415b0b0 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b09082640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f8b040cca40 con 0x7f8b040cda50 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b02d9d640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f8b04155350 0x7f8b040cb7b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59236/0 (socket says 172.21.15.26:59236) 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b02d9d640 1 -- 172.21.15.26:0/210148598 learned_addr learned my addr 172.21.15.26:0/210148598 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b0259c640 1 --2- 172.21.15.26:0/210148598 >> v2:172.21.15.26:3300/0 conn(0x7f8b040cda50 0x7f8b040c59c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b01d9b640 1 -- 172.21.15.26:0/210148598 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3835002992 0 0) 0x7f8b0415bc10 con 0x7f8b04155350 2024-04-23T10:25:28.091 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b01d9b640 1 -- 172.21.15.26:0/210148598 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8aec003530 con 0x7f8b04155350 2024-04-23T10:25:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b0259c640 1 -- 172.21.15.26:0/210148598 >> v1:172.21.15.190:6789/0 conn(0x7f8b0415b0b0 legacy=0x7f8b0415b500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b0259c640 1 -- 172.21.15.26:0/210148598 >> v1:172.21.15.26:6789/0 conn(0x7f8b04155350 legacy=0x7f8b040cb7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.092 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b0259c640 1 -- 172.21.15.26:0/210148598 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b040ccc90 con 0x7f8b040cda50 2024-04-23T10:25:28.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b0259c640 1 --2- 172.21.15.26:0/210148598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b040c59c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097c0 tx=0x7f8af801ec90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6729aa98245b9c3 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.093 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b01d9b640 1 -- 172.21.15.26:0/210148598 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af80b5070 con 0x7f8b040cda50 2024-04-23T10:25:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b01d9b640 1 -- 172.21.15.26:0/210148598 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8af80a8990 con 0x7f8b040cda50 2024-04-23T10:25:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.093+0000 7f8b01d9b640 1 -- 172.21.15.26:0/210148598 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af80a8d80 con 0x7f8b040cda50 2024-04-23T10:25:28.094 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/210148598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 msgr2=0x7f8b040c59c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 --2- 172.21.15.26:0/210148598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b040c59c0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f8af80097c0 tx=0x7f8af801ec90 comp rx=0 tx=0).stop 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/210148598 shutdown_connections 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 --2- 172.21.15.26:0/210148598 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b040c59c0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/210148598 >> 172.21.15.26:0/210148598 conn(0x7f8b0406cc30 msgr2=0x7f8b0406d510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/210148598 shutdown_connections 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/210148598 wait complete. 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 Processor -- start 2024-04-23T10:25:28.095 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- start start 2024-04-23T10:25:28.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.097 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b04155350 0x7f8b040cfca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 0x7f8b041f49d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040cd530 con 0x7f8b040cda50 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f8b040cd250 con 0x7f8b0415b0b0 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f8b04155730 con 0x7f8b04155350 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40278/0 (socket says 172.21.15.26:40278) 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 -- 172.21.15.26:0/2888406726 learned_addr learned my addr 172.21.15.26:0/2888406726 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b0259c640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b04155350 0x7f8b040cfca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b0359e640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 0x7f8b041f49d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 -- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b04155350 msgr2=0x7f8b040cfca0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b04155350 0x7f8b040cfca0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.098 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 -- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 msgr2=0x7f8b041f49d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 0x7f8b041f49d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 -- 172.21.15.26:0/2888406726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b0415d5a0 con 0x7f8b040cda50 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b0359e640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 0x7f8b041f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b02d9d640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c4d0 tx=0x7f8af400c990 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4017070 con 0x7f8b040cda50 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f8af4005cf0 con 0x7f8b040cda50 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b0415d890 con 0x7f8b040cda50 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f8af4007270 con 0x7f8b040cda50 2024-04-23T10:25:28.099 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.097+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b0415de50 con 0x7f8b040cda50 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b04075df0 con 0x7f8b040cda50 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f8af401a070 con 0x7f8b040cda50 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8aeb7fe640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 0x7f8af006a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f8af4086310 con 0x7f8b040cda50 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8b0259c640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 0x7f8af006a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.100 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.101+0000 7f8b0259c640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 0x7f8af006a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b2000 tx=0x7f8af8008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.103 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.105+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f8af40564e0 con 0x7f8b040cda50 2024-04-23T10:25:28.302 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) -- 0x7f8b040cc610 con 0x7f8b040cda50 2024-04-23T10:25:28.303 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8aeb7fe640 1 -- 172.21.15.26:0/2888406726 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 19 v19) ==== 94+0+6918 (secure 0 0 0) 0x7f8af4055de0 con 0x7f8b040cda50 2024-04-23T10:25:28.304 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:25:28.304 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":4244,"name":"b","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.190:6839/1689683166","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6836","nonce":1689683166},{"type":"v1","addr":"172.21.15.190:6839","nonce":1689683166}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"epoch":3}],"filesystems":[{"mdsmap":{"epoch":19,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-04-23T10:12:34.380485+0000","modified":"2024-04-23T10:13:21.048533+0000","tableserver":0,"root":0,"session_timeout":300,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}},"max_mds":5,"in":[0,1,2,3,4],"up":{"mds_0":4287,"mds_1":4284,"mds_2":4282,"mds_3":4275,"mds_4":4260},"failed":[],"damaged":[],"stopped":[],"info":{"gid_4260":{"gid":4260,"name":"c","rank":4,"incarnation":18,"state":"up:active","state_seq":15,"addr":"172.21.15.26:6833/3926029460","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6832","nonce":3926029460},{"type":"v1","addr":"172.21.15.26:6833","nonce":3926029460}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4275":{"gid":4275,"name":"e","rank":3,"incarnation":16,"state":"up:active","state_seq":13,"addr":"172.21.15.26:6836/2066596634","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6834","nonce":2066596634},{"type":"v1","addr":"172.21.15.26:6836","nonce":2066596634}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4282":{"gid":4282,"name":"d","rank":2,"incarnation":14,"state":"up:active","state_seq":12,"addr":"172.21.15.190:6837/1581526507","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6835","nonce":1581526507},{"type":"v1","addr":"172.21.15.190:6837","nonce":1581526507}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4284":{"gid":4284,"name":"a","rank":1,"incarnation":10,"state":"up:active","state_seq":10,"addr":"172.21.15.26:6837/1290255157","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6835","nonce":1290255157},{"type":"v1","addr":"172.21.15.26:6837","nonce":1290255157}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}},"gid_4287":{"gid":4287,"name":"f","rank":0,"incarnation":4,"state":"up:active","state_seq":5,"addr":"172.21.15.190:6838/585421961","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6834","nonce":585421961},{"type":"v1","addr":"172.21.15.190:6838","nonce":585421961}]},"join_fscid":-1,"export_targets":[],"features":4540701547738038271,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2","feature_11":"minor log segments","feature_12":"quiesce subvolumes"}}}},"data_pools":[3,4],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":0,"qdb_leader":4287,"qdb_cluster":[4260,4275,4282,4284,4287]},"id":1}]} 2024-04-23T10:25:28.304 INFO:teuthology.orchestra.run.smithi026.stderr:dumped fsmap epoch 19 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 msgr2=0x7f8af006a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 0x7f8af006a840 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f8af80b2000 tx=0x7f8af8008040 comp rx=0 tx=0).stop 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 msgr2=0x7f8b0415ccf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.305+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f8af400c4d0 tx=0x7f8af400c990 comp rx=0 tx=0).stop 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 shutdown_connections 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f8af0068380 0x7f8af006a840 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.306 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f8b0415b0b0 0x7f8b041f49d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f8b04155350 0x7f8b040cfca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 --2- 172.21.15.26:0/2888406726 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f8b040cda50 0x7f8b0415ccf0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 >> 172.21.15.26:0/2888406726 conn(0x7f8b0406cc30 msgr2=0x7f8b040c6e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 shutdown_connections 2024-04-23T10:25:28.307 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.309+0000 7f8b09082640 1 -- 172.21.15.26:0/2888406726 wait complete. 2024-04-23T10:25:28.324 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-23T10:25:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.449+0000 7fea65d43640 1 Processor -- start 2024-04-23T10:25:28.449 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.449+0000 7fea65d43640 1 -- start start 2024-04-23T10:25:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea65d43640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea6014fbc0 0x7fea6006f700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea65d43640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea65d43640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fea600c5d70 con 0x7fea60074100 2024-04-23T10:25:28.450 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea65d43640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7fea600c6050 con 0x7fea6014fbc0 2024-04-23T10:25:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea65d43640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fea600c6330 con 0x7fea6014ffa0 2024-04-23T10:25:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea6014fbc0 0x7fea6006f700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.451 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5ffff640 1 --1- >> v1:172.21.15.190:6789/0 conn(0x7fea60074100 0x7fea600c7250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.190:6789/0 says I am v1:172.21.15.26:49892/0 (socket says 172.21.15.26:49892) 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7fea6014fbc0 0x7fea6006f700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3300/0 says I am v2:172.21.15.26:49602/0 (socket says 172.21.15.26:49602) 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5effd640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.190:3301/0 says I am v2:172.21.15.26:38710/0 (socket says 172.21.15.26:38710) 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5ffff640 1 -- 172.21.15.26:0/135958372 learned_addr learned my addr 172.21.15.26:0/135958372 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 -- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 msgr2=0x7fea600c8220 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 -- 172.21.15.26:0/135958372 >> v1:172.21.15.190:6789/0 conn(0x7fea60074100 legacy=0x7fea600c7250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 -- 172.21.15.26:0/135958372 --> v2:172.21.15.190:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea600c6610 con 0x7fea6014fbc0 2024-04-23T10:25:28.452 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5effd640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_done state changed! 2024-04-23T10:25:28.453 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.453+0000 7fea5f7fe640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea6006f700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fea500097c0 tx=0x7fea5001c4a0 comp rx=0 tx=0).ready entity=mon.1 client_cookie=eea567c51fed94df server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5e7fc640 1 -- 172.21.15.26:0/135958372 <== mon.1 v2:172.21.15.190:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea500aa620 con 0x7fea6014fbc0 2024-04-23T10:25:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5e7fc640 1 -- 172.21.15.26:0/135958372 <== mon.1 v2:172.21.15.190:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea500af070 con 0x7fea6014fbc0 2024-04-23T10:25:28.454 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5e7fc640 1 -- 172.21.15.26:0/135958372 <== mon.1 v2:172.21.15.190:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea500aaa00 con 0x7fea6014fbc0 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 msgr2=0x7fea6006f700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea6006f700 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7fea500097c0 tx=0x7fea5001c4a0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- 172.21.15.26:0/135958372 shutdown_connections 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea600c8220 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- 172.21.15.26:0/135958372 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea6006f700 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- 172.21.15.26:0/135958372 >> 172.21.15.26:0/135958372 conn(0x7fea6006b9d0 msgr2=0x7fea6006bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- 172.21.15.26:0/135958372 shutdown_connections 2024-04-23T10:25:28.455 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- 172.21.15.26:0/135958372 wait complete. 2024-04-23T10:25:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 Processor -- start 2024-04-23T10:25:28.456 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- start start 2024-04-23T10:25:28.458 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea600cb7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea601f5150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fea60166420 con 0x7fea60074100 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fea601662a0 con 0x7fea6014fbc0 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea65d43640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fea601665a0 con 0x7fea6014ffa0 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5f7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40288/0 (socket says 172.21.15.26:40288) 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.457+0000 7fea5f7fe640 1 -- 172.21.15.26:0/2269659580 learned_addr learned my addr 172.21.15.26:0/2269659580 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5effd640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea600cb7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5ffff640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea601f5150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 -- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 msgr2=0x7fea601f5150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea601f5150 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 -- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 msgr2=0x7fea600cb7c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.459 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea600cb7c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 -- 172.21.15.26:0/2269659580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fea601f5a70 con 0x7fea60074100 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5f7fe640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea500ac040 tx=0x7fea5001ace0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea500aad00 con 0x7fea60074100 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fea500be410 con 0x7fea60074100 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fea500be800 con 0x7fea60074100 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fea601f5d50 con 0x7fea60074100 2024-04-23T10:25:28.460 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fea6015b720 con 0x7fea60074100 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fea60075df0 con 0x7fea60074100 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fea500bc020 con 0x7fea60074100 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 0x7fea4c06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7fea50120fd0 con 0x7fea60074100 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.461+0000 7fea5effd640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 0x7fea4c06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.461 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.465+0000 7fea5effd640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 0x7fea4c06a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fea6006d910 tx=0x7fea54008040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.466 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.469+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fea50016090 con 0x7fea60074100 2024-04-23T10:25:28.624 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.625+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fea600c7df0 con 0x7fea60074100 2024-04-23T10:25:28.627 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea47fff640 1 -- 172.21.15.26:0/2269659580 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v26) ==== 74+0+18936 (secure 0 0 0) 0x7fea500f1290 con 0x7fea60074100 2024-04-23T10:25:28.627 INFO:teuthology.orchestra.run.smithi026.stdout: 2024-04-23T10:25:28.627 INFO:teuthology.orchestra.run.smithi026.stdout:{"epoch":26,"fsid":"8b8a27b9-fb94-41f0-8e5a-9f62c4cbb4d8","created":"2024-04-23T10:12:10.134000+0000","modified":"2024-04-23T10:13:16.013048+0000","last_up_change":"2024-04-23T10:12:20.813663+0000","last_in_change":"2024-04-23T10:12:12.346164+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":4,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-23T10:12:20.954549+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs_metadata","create_time":"2024-04-23T10:12:32.504271+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs_data","create_time":"2024-04-23T10:12:33.352859+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"20","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.05000000074505806},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_type":"Fair distribution","score_acting":1.3799999952316284,"score_stable":1.3799999952316284,"optimal_score":1,"raw_score_acting":1.3799999952316284,"raw_score_stable":1.3799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"cephfs_data_ec","create_time":"2024-04-23T10:12:37.057299+0000","flags":5,"flags_names":"hashpspool,ec_overwrites","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"cephfs_data_ec","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":8192,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_min":64,"target_size_ratio":0.89999997615814209},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"3b704f6e-2bbc-4b01-adb8-0852089ce65d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6817","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6819","nonce":1116322657}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6821","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6823","nonce":1116322657}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6828","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6830","nonce":1116322657}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6825","nonce":1116322657},{"type":"v1","addr":"172.21.15.26:6827","nonce":1116322657}]},"public_addr":"172.21.15.26:6819/1116322657","cluster_addr":"172.21.15.26:6823/1116322657","heartbeat_back_addr":"172.21.15.26:6830/1116322657","heartbeat_front_addr":"172.21.15.26:6827/1116322657","state":["exists","up"]},{"osd":1,"uuid":"8a2f2b1e-f93c-48c3-b2a5-b4da4fc541ef","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6816","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6818","nonce":1500743666}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6820","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6822","nonce":1500743666}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6829","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6831","nonce":1500743666}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6824","nonce":1500743666},{"type":"v1","addr":"172.21.15.26:6826","nonce":1500743666}]},"public_addr":"172.21.15.26:6818/1500743666","cluster_addr":"172.21.15.26:6822/1500743666","heartbeat_back_addr":"172.21.15.26:6831/1500743666","heartbeat_front_addr":"172.21.15.26:6826/1500743666","state":["exists","up"]},{"osd":2,"uuid":"fc4c2d8f-ff22-4bdc-8be1-14b8872a4af6","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6808","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6809","nonce":3344984401}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6810","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6811","nonce":3344984401}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6814","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6815","nonce":3344984401}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6812","nonce":3344984401},{"type":"v1","addr":"172.21.15.26:6813","nonce":3344984401}]},"public_addr":"172.21.15.26:6809/3344984401","cluster_addr":"172.21.15.26:6811/3344984401","heartbeat_back_addr":"172.21.15.26:6815/3344984401","heartbeat_front_addr":"172.21.15.26:6813/3344984401","state":["exists","up"]},{"osd":3,"uuid":"a2b65a5e-e51d-4e44-82fe-c4838dec90fd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6800","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6801","nonce":451500618}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6802","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6803","nonce":451500618}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6806","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6807","nonce":451500618}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.26:6804","nonce":451500618},{"type":"v1","addr":"172.21.15.26:6805","nonce":451500618}]},"public_addr":"172.21.15.26:6801/451500618","cluster_addr":"172.21.15.26:6803/451500618","heartbeat_back_addr":"172.21.15.26:6807/451500618","heartbeat_front_addr":"172.21.15.26:6805/451500618","state":["exists","up"]},{"osd":4,"uuid":"7eb3d3c0-88a6-4321-a9d6-9e54f8c3c080","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":25,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6817","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6819","nonce":3258213114}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6821","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6822","nonce":3258213114}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6828","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6830","nonce":3258213114}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6824","nonce":3258213114},{"type":"v1","addr":"172.21.15.190:6826","nonce":3258213114}]},"public_addr":"172.21.15.190:6819/3258213114","cluster_addr":"172.21.15.190:6822/3258213114","heartbeat_back_addr":"172.21.15.190:6830/3258213114","heartbeat_front_addr":"172.21.15.190:6826/3258213114","state":["exists","up"]},{"osd":5,"uuid":"c732841b-0bfa-48aa-b8ee-1642f4aa7bbd","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6800","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6801","nonce":228505156}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6802","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6803","nonce":228505156}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6806","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6807","nonce":228505156}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6804","nonce":228505156},{"type":"v1","addr":"172.21.15.190:6805","nonce":228505156}]},"public_addr":"172.21.15.190:6801/228505156","cluster_addr":"172.21.15.190:6803/228505156","heartbeat_back_addr":"172.21.15.190:6807/228505156","heartbeat_front_addr":"172.21.15.190:6805/228505156","state":["exists","up"]},{"osd":6,"uuid":"67dde11b-3898-490a-b93e-3033850fdd79","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":22,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6808","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6809","nonce":2710988300}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6810","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6811","nonce":2710988300}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6814","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6815","nonce":2710988300}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6812","nonce":2710988300},{"type":"v1","addr":"172.21.15.190:6813","nonce":2710988300}]},"public_addr":"172.21.15.190:6809/2710988300","cluster_addr":"172.21.15.190:6811/2710988300","heartbeat_back_addr":"172.21.15.190:6815/2710988300","heartbeat_front_addr":"172.21.15.190:6813/2710988300","state":["exists","up"]},{"osd":7,"uuid":"9d50cdc7-1954-4a67-be0f-81d1cb0d3efa","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":18,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6816","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6818","nonce":2532942072}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6820","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6823","nonce":2532942072}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6829","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6831","nonce":2532942072}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.190:6825","nonce":2532942072},{"type":"v1","addr":"172.21.15.190:6827","nonce":2532942072}]},"public_addr":"172.21.15.190:6818/2532942072","cluster_addr":"172.21.15.190:6823/2532942072","heartbeat_back_addr":"172.21.15.190:6831/2532942072","heartbeat_front_addr":"172.21.15.190:6827/2532942072","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.654841+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.856814+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.890485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.875252+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.838937+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.544269+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.671020+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-23T10:12:17.782566+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"3.7","mappings":[{"from":3,"to":2}]},{"pgid":"3.17","mappings":[{"from":5,"to":1}]},{"pgid":"3.18","mappings":[{"from":3,"to":2}]},{"pgid":"3.30","mappings":[{"from":5,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.6","mappings":[{"from":1,"to":5}]},{"pgid":"4.d","mappings":[{"from":1,"to":5}]},{"pgid":"4.1d","mappings":[{"from":1,"to":5}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"cephfs_data_ec":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"2","m":"2","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 msgr2=0x7fea4c06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 0x7fea4c06a840 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fea6006d910 tx=0x7fea54008040 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 msgr2=0x7fea601f1be0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 crypto rx=0x7fea500ac040 tx=0x7fea5001ace0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 shutdown_connections 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fea4c068380 0x7fea4c06a840 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fea6014ffa0 0x7fea601f5150 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fea6014fbc0 0x7fea600cb7c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 --2- 172.21.15.26:0/2269659580 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fea60074100 0x7fea601f1be0 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 >> 172.21.15.26:0/2269659580 conn(0x7fea6006b9d0 msgr2=0x7fea600c7250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.629 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 shutdown_connections 2024-04-23T10:25:28.630 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.629+0000 7fea65d43640 1 -- 172.21.15.26:0/2269659580 wait complete. 2024-04-23T10:25:28.645 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs fail cephfs 2024-04-23T10:25:28.759 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 Processor -- start 2024-04-23T10:25:28.760 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 -- start start 2024-04-23T10:25:28.761 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d540c8800 0x7f9d540c39e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 0x7f9d540c3f20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 0x7f9d540c5bf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7f9d54158090 con 0x7f9d540c8800 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f9d541585c0 con 0x7f9d540c4b40 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d59fec640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d540c52f0 con 0x7f9d540c5780 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d540c8800 0x7f9d540c39e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7f9d540c8800 0x7f9d540c39e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40296/0 (socket says 172.21.15.26:40296) 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 -- 172.21.15.26:0/1314847601 learned_addr learned my addr 172.21.15.26:0/1314847601 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d52ffd640 1 --2- 172.21.15.26:0/1314847601 >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 0x7f9d540c3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 -- 172.21.15.26:0/1314847601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 msgr2=0x7f9d540c5bf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d53fff640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 0x7f9d540c5bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 0x7f9d540c5bf0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.762 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 -- 172.21.15.26:0/1314847601 >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 msgr2=0x7f9d540c3f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:28.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 --2- 172.21.15.26:0/1314847601 >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 0x7f9d540c3f20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d537fe640 1 -- 172.21.15.26:0/1314847601 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d540c6130 con 0x7f9d540c8800 2024-04-23T10:25:28.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d52ffd640 1 --2- 172.21.15.26:0/1314847601 >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 0x7f9d540c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:28.763 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.761+0000 7f9d53fff640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 0x7f9d540c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:28.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d537fe640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c8800 0x7f9d540c39e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9d540707e0 tx=0x7f9d4401d7d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=109d962671636d53 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d527fc640 1 -- 172.21.15.26:0/1314847601 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d440b3070 con 0x7f9d540c8800 2024-04-23T10:25:28.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d527fc640 1 -- 172.21.15.26:0/1314847601 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d440a6800 con 0x7f9d540c8800 2024-04-23T10:25:28.764 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d527fc640 1 -- 172.21.15.26:0/1314847601 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d4400b040 con 0x7f9d540c8800 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 -- 172.21.15.26:0/1314847601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c8800 msgr2=0x7f9d540c39e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c8800 0x7f9d540c39e0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7f9d540707e0 tx=0x7f9d4401d7d0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 -- 172.21.15.26:0/1314847601 shutdown_connections 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c5780 0x7f9d540c5bf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 --2- 172.21.15.26:0/1314847601 >> v2:172.21.15.190:3300/0 conn(0x7f9d540c4b40 0x7f9d540c3f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 --2- 172.21.15.26:0/1314847601 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c8800 0x7f9d540c39e0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 -- 172.21.15.26:0/1314847601 >> 172.21.15.26:0/1314847601 conn(0x7f9d5406b9d0 msgr2=0x7f9d5406bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 -- 172.21.15.26:0/1314847601 shutdown_connections 2024-04-23T10:25:28.765 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.765+0000 7f9d59fec640 1 -- 172.21.15.26:0/1314847601 wait complete. 2024-04-23T10:25:28.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 Processor -- start 2024-04-23T10:25:28.766 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- start start 2024-04-23T10:25:28.767 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d540c4b40 0x7f9d54072b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c8800 0x7f9d5414b440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54074280 con 0x7f9d540c5780 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f9d54073fa0 con 0x7f9d540c4b40 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f9d54068610 con 0x7f9d540c8800 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40310/0 (socket says 172.21.15.26:40310) 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 -- 172.21.15.26:0/446425380 learned_addr learned my addr 172.21.15.26:0/446425380 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d537fe640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d540c4b40 0x7f9d54072b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 -- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c8800 msgr2=0x7f9d5414b440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c8800 0x7f9d5414b440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 -- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d540c4b40 msgr2=0x7f9d54072b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d540c4b40 0x7f9d54072b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 -- 172.21.15.26:0/446425380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9d54158b40 con 0x7f9d540c5780 2024-04-23T10:25:28.768 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d52ffd640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c7f0 tx=0x7f9d4800ccb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48015070 con 0x7f9d540c5780 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f9d480077c0 con 0x7f9d540c5780 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9d54154550 con 0x7f9d540c5780 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f9d48007bd0 con 0x7f9d540c5780 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9d54154b10 con 0x7f9d540c5780 2024-04-23T10:25:28.769 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9d54075df0 con 0x7f9d540c5780 2024-04-23T10:25:28.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f9d48018070 con 0x7f9d540c5780 2024-04-23T10:25:28.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 0x7f9d4006a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:28.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.769+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(26..26 src has 1..26) ==== 6764+0+0 (secure 0 0 0) 0x7f9d48086fc0 con 0x7f9d540c5780 2024-04-23T10:25:28.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.773+0000 7f9d537fe640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 0x7f9d4006a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:28.770 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.773+0000 7f9d537fe640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 0x7f9d4006a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d440b0000 tx=0x7f9d4400c040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:28.774 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.777+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f9d480570d0 con 0x7f9d540c5780 2024-04-23T10:25:28.968 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.969+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs fail", "fs_name": "cephfs"} v 0) -- 0x7f9d5406f840 con 0x7f9d540c5780 2024-04-23T10:25:28.972 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.973+0000 7f9d3bfff640 1 -- 172.21.15.26:0/446425380 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs fail", "fs_name": "cephfs"}]=0 cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. v20) ==== 161+0+0 (secure 0 0 0) 0x7f9d480569d0 con 0x7f9d540c5780 2024-04-23T10:25:28.972 INFO:teuthology.orchestra.run.smithi026.stderr:cephfs marked not joinable; MDS cannot join the cluster. All MDS ranks marked failed. 2024-04-23T10:25:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 msgr2=0x7f9d4006a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.979 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 0x7f9d4006a870 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x7f9d440b0000 tx=0x7f9d4400c040 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 msgr2=0x7f9d5414af00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7f9d4800c7f0 tx=0x7f9d4800ccb0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 shutdown_connections 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f9d400683b0 0x7f9d4006a870 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f9d540c8800 0x7f9d5414b440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f9d540c5780 0x7f9d5414af00 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 --2- 172.21.15.26:0/446425380 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f9d540c4b40 0x7f9d54072b50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 >> 172.21.15.26:0/446425380 conn(0x7f9d5406b9d0 msgr2=0x7f9d540ca9a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 shutdown_connections 2024-04-23T10:25:28.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:28.981+0000 7f9d59fec640 1 -- 172.21.15.26:0/446425380 wait complete. 2024-04-23T10:25:28.997 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs rm cephfs --yes-i-really-mean-it 2024-04-23T10:25:29.029 INFO:tasks.ceph.mds.a.smithi026.stdout:starting mds.a at 2024-04-23T10:25:29.045 INFO:tasks.ceph.mds.c.smithi026.stdout:starting mds.c at 2024-04-23T10:25:29.049 INFO:tasks.ceph.mds.e.smithi026.stdout:starting mds.e at 2024-04-23T10:25:29.066 INFO:tasks.ceph.mds.d.smithi190.stdout:starting mds.d at 2024-04-23T10:25:29.077 INFO:tasks.ceph.mds.f.smithi190.stdout:starting mds.f at 2024-04-23T10:25:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 Processor -- start 2024-04-23T10:25:29.113 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 -- start start 2024-04-23T10:25:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffafc15bb30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7ffafc06c4f0 0x7ffafc0c9300 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ffafc0c9090 con 0x7ffafc154f90 2024-04-23T10:25:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7ffafc0c8880 con 0x7ffafc06c4f0 2024-04-23T10:25:29.115 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.113+0000 7ffb01264640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc0c73a0 con 0x7ffafc155370 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafaffd640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7ffafc154f90 0x7ffafc0c7b60 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59276/0 (socket says 172.21.15.26:59276) 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafaffd640 1 -- 172.21.15.26:0/2616455410 learned_addr learned my addr 172.21.15.26:0/2616455410 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/2616455410 >> v2:172.21.15.190:3300/0 conn(0x7ffafc06c4f0 0x7ffafc0c9300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffafc15bb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2680865262 0 0) 0x7ffafc0c9090 con 0x7ffafc154f90 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ffae8003530 con 0x7ffafc154f90 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 2878414721 0 0) 0x7ffae8003530 con 0x7ffafc154f90 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 msgr2=0x7ffafc15bb30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffafc15bb30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 >> v2:172.21.15.190:3300/0 conn(0x7ffafc06c4f0 msgr2=0x7ffafc0c9300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 --2- 172.21.15.26:0/2616455410 >> v2:172.21.15.190:3300/0 conn(0x7ffafc06c4f0 0x7ffafc0c9300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc0c8ad0 con 0x7ffafc154f90 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7ffaec001680 con 0x7ffafc154f90 2024-04-23T10:25:29.116 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 >> v1:172.21.15.26:6789/0 conn(0x7ffafc154f90 legacy=0x7ffafc0c7b60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffae80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffae8003f40 0x7ffae8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8004d50 0x7ffae80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0c8880 con 0x7ffae8003f40 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0c73a0 con 0x7ffae8004d50 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffae800b9d0 con 0x7ffafc155370 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffae8003f40 0x7ffae8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafaffd640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffae80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8004d50 0x7ffae80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 -- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 msgr2=0x7ffae80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc155370 0x7ffae80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 -- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8004d50 msgr2=0x7ffae80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8004d50 0x7ffae80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 -- 172.21.15.26:0/2616455410 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffae8003530 con 0x7ffae8003f40 2024-04-23T10:25:29.117 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8004d50 0x7ffae80051d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_auth_reply_more state changed! 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffae8003f40 0x7ffae8004810 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009ae0 tx=0x7ffae401ca10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc67399d6855a22f server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae40b2070 con 0x7ffae8003f40 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffae40a5660 con 0x7ffae8003f40 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffaf9ffb640 1 -- 172.21.15.26:0/2616455410 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffae40096b0 con 0x7ffae8003f40 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 -- 172.21.15.26:0/2616455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffae8003f40 msgr2=0x7ffae8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 --2- 172.21.15.26:0/2616455410 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffae8003f40 0x7ffae8004810 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7ffae4009ae0 tx=0x7ffae401ca10 comp rx=0 tx=0).stop 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffafb7fe640 1 -- 172.21.15.26:0/2616455410 reap_dead start 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 -- 172.21.15.26:0/2616455410 shutdown_connections 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 -- 172.21.15.26:0/2616455410 >> 172.21.15.26:0/2616455410 conn(0x7ffafc06b9d0 msgr2=0x7ffafc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 -- 172.21.15.26:0/2616455410 shutdown_connections 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.117+0000 7ffb01264640 1 -- 172.21.15.26:0/2616455410 wait complete. 2024-04-23T10:25:29.119 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 Processor -- start 2024-04-23T10:25:29.120 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- start start 2024-04-23T10:25:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 0x7ffafc144e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc15c2c0 0x7ffafc157210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.121 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0ca220 con 0x7ffafc140da0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7ffafc0c7640 con 0x7ffae8003f40 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7ffafc0c3d30 con 0x7ffafc15c2c0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40362/0 (socket says 172.21.15.26:40362) 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 -- 172.21.15.26:0/1702418753 learned_addr learned my addr 172.21.15.26:0/1702418753 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafaffd640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 0x7ffafc144e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafa7fc640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc15c2c0 0x7ffafc157210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 -- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc15c2c0 msgr2=0x7ffafc157210 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc15c2c0 0x7ffafc157210 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 -- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 msgr2=0x7ffafc144e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 0x7ffafc144e00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 -- 172.21.15.26:0/1702418753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ffafc146410 con 0x7ffafc140da0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafaffd640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 0x7ffafc144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffafb7fe640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffafc071340 tx=0x7ffaf40115a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:29.122 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4007e60 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7ffaf401c070 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ffafc15d7f0 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7ffaf4016470 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ffafc15edc0 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.121+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ffafc075df0 con 0x7ffafc140da0 2024-04-23T10:25:29.123 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.125+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7ffaf4016610 con 0x7ffafc140da0 2024-04-23T10:25:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.125+0000 7ffaf37fe640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 0x7ffadc06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.125+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7194+0+0 (secure 0 0 0) 0x7ffaf40888a0 con 0x7ffafc140da0 2024-04-23T10:25:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.125+0000 7ffafaffd640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 0x7ffadc06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:29.124 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.125+0000 7ffafaffd640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 0x7ffadc06a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0017e0 tx=0x7ffaec007900 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:29.126 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.129+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7ffaf4026020 con 0x7ffafc140da0 2024-04-23T10:25:29.335 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.337+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true} v 0) -- 0x7ffafc0c5da0 con 0x7ffafc140da0 2024-04-23T10:25:29.975 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.977+0000 7ffaf37fe640 1 -- 172.21.15.26:0/1702418753 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "fs rm", "fs_name": "cephfs", "yes_i_really_mean_it": true}]=0 v21) ==== 104+0+0 (secure 0 0 0) 0x7ffafc146410 con 0x7ffafc140da0 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 msgr2=0x7ffadc06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 0x7ffadc06a870 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7ffaec0017e0 tx=0x7ffaec007900 comp rx=0 tx=0).stop 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 msgr2=0x7ffafc157750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7ffafc071340 tx=0x7ffaf40115a0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 shutdown_connections 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7ffadc0683b0 0x7ffadc06a870 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7ffafc140da0 0x7ffafc157750 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.980 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7ffafc15c2c0 0x7ffafc157210 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 --2- 172.21.15.26:0/1702418753 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7ffae8003f40 0x7ffafc144e00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:29.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 >> 172.21.15.26:0/1702418753 conn(0x7ffafc06b9d0 msgr2=0x7ffafc06bde0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:29.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 shutdown_connections 2024-04-23T10:25:29.981 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:29.981+0000 7ffb01264640 1 -- 172.21.15.26:0/1702418753 wait complete. 2024-04-23T10:25:30.008 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_metadata cephfs_metadata --yes-i-really-really-mean-it 2024-04-23T10:25:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 Processor -- start 2024-04-23T10:25:30.188 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 -- start start 2024-04-23T10:25:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c0c5fa0 0x7fd46c15ce00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.189 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 --2- >> v2:172.21.15.26:3300/0 conn(0x7fd46c0c6380 0x7fd46c163990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd46c06ce60 con 0x7fd46c15d340 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 -- --> v2:172.21.15.26:3300/0 -- mon_getmap magic: 0 -- 0x7fd46c0c8890 con 0x7fd46c0c6380 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd4711a8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c15c970 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46259c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fd46c15d340 0x7fd46c152cf0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59278/0 (socket says 172.21.15.26:59278) 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46259c640 1 -- 172.21.15.26:0/1743292453 learned_addr learned my addr 172.21.15.26:0/1743292453 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46b59e640 1 --2- 172.21.15.26:0/1743292453 >> v2:172.21.15.26:3300/0 conn(0x7fd46c0c6380 0x7fd46c163990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46ad9d640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c0c5fa0 0x7fd46c15ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46a59c640 1 -- 172.21.15.26:0/1743292453 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 772400798 0 0) 0x7fd46c06ce60 con 0x7fd46c15d340 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46a59c640 1 -- 172.21.15.26:0/1743292453 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fd458003530 con 0x7fd46c15d340 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46b59e640 1 -- 172.21.15.26:0/1743292453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c0c5fa0 msgr2=0x7fd46c15ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46b59e640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c0c5fa0 0x7fd46c15ce00 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46b59e640 1 -- 172.21.15.26:0/1743292453 >> v1:172.21.15.26:6789/0 conn(0x7fd46c15d340 legacy=0x7fd46c152cf0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:30.190 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.189+0000 7fd46b59e640 1 -- 172.21.15.26:0/1743292453 --> v2:172.21.15.26:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c0c8ae0 con 0x7fd46c0c6380 2024-04-23T10:25:30.191 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd46b59e640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c6380 0x7fd46c163990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46401c820 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d2558f2094feb80 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd46a59c640 1 -- 172.21.15.26:0/1743292453 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4640b2070 con 0x7fd46c0c6380 2024-04-23T10:25:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd46a59c640 1 -- 172.21.15.26:0/1743292453 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd4640a58e0 con 0x7fd46c0c6380 2024-04-23T10:25:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd46a59c640 1 -- 172.21.15.26:0/1743292453 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd4640a5cd0 con 0x7fd46c0c6380 2024-04-23T10:25:30.192 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- 172.21.15.26:0/1743292453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c6380 msgr2=0x7fd46c163990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c6380 0x7fd46c163990 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7fd464009d90 tx=0x7fd46401c820 comp rx=0 tx=0).stop 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- 172.21.15.26:0/1743292453 shutdown_connections 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c6380 0x7fd46c163990 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 --2- 172.21.15.26:0/1743292453 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c0c5fa0 0x7fd46c15ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- 172.21.15.26:0/1743292453 >> 172.21.15.26:0/1743292453 conn(0x7fd46c0c9130 msgr2=0x7fd46c0c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- 172.21.15.26:0/1743292453 shutdown_connections 2024-04-23T10:25:30.193 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- 172.21.15.26:0/1743292453 wait complete. 2024-04-23T10:25:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 Processor -- start 2024-04-23T10:25:30.194 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.193+0000 7fd4711a8640 1 -- start start 2024-04-23T10:25:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.195 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 0x7fd46c15e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c15d340 0x7fd46c15ae00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c06cc10 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fd46c06ca90 con 0x7fd46c0c6380 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fd46c0c6fa0 con 0x7fd46c15d340 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40380/0 (socket says 172.21.15.26:40380) 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 -- 172.21.15.26:0/2877622870 learned_addr learned my addr 172.21.15.26:0/2877622870 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46b59e640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c15d340 0x7fd46c15ae00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 -- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c15d340 msgr2=0x7fd46c15ae00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c15d340 0x7fd46c15ae00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46259c640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 0x7fd46c15e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 -- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 msgr2=0x7fd46c15e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 0x7fd46c15e110 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:30.196 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 -- 172.21.15.26:0/2877622870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd46c1f5240 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46259c640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 0x7fd46c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46ad9d640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d5f0 tx=0x7fd45c00dab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0125f0 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fd45c019070 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd46c1f5500 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fd45c0129d0 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.197 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd46c1f5ac0 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd46c075e60 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fd45c012b70 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 0x7fd44c06a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(27..27 src has 1..27) ==== 7194+0+0 (secure 0 0 0) 0x7fd45c0873f0 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.198 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.197+0000 7fd46259c640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 0x7fd44c06a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:30.199 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.201+0000 7fd46259c640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 0x7fd44c06a870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd46c1564f0 tx=0x7fd454009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:30.201 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.201+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fd45c057350 con 0x7fd46c0c5fa0 2024-04-23T10:25:30.368 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:30.369+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true} v 0) -- 0x7fd46c0cc410 con 0x7fd46c0c5fa0 2024-04-23T10:25:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.333+0000 7fd463fff640 1 -- 172.21.15.26:0/2877622870 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_metadata", "pool2": "cephfs_metadata", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_metadata' removed v28) ==== 181+0+0 (secure 0 0 0) 0x7fd45c056c50 con 0x7fd46c0c5fa0 2024-04-23T10:25:31.332 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_metadata' removed 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 msgr2=0x7fd44c06a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 0x7fd44c06a870 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7fd46c1564f0 tx=0x7fd454009040 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 msgr2=0x7fd46c0cad90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d5f0 tx=0x7fd45c00dab0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 shutdown_connections 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fd44c0683b0 0x7fd44c06a870 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fd46c15d340 0x7fd46c15ae00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fd46c0c6380 0x7fd46c15e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 --2- 172.21.15.26:0/2877622870 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fd46c0c5fa0 0x7fd46c0cad90 secure :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7fd45c00d5f0 tx=0x7fd45c00dab0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 >> 172.21.15.26:0/2877622870 conn(0x7fd46c0c9130 msgr2=0x7fd46c074e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:31.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 shutdown_connections 2024-04-23T10:25:31.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.337+0000 7fd4711a8640 1 -- 172.21.15.26:0/2877622870 wait complete. 2024-04-23T10:25:31.363 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data cephfs_data --yes-i-really-really-mean-it 2024-04-23T10:25:31.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.493+0000 7fae5e0b2640 1 Processor -- start 2024-04-23T10:25:31.493 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.493+0000 7fae5e0b2640 1 -- start start 2024-04-23T10:25:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae5e0b2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae581525d0 0x7fae58158760 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.496 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae5e0b2640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5815ba00 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae5e0b2640 1 -- --> v1:172.21.15.190:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fae5815bce0 con 0x7fae58158ca0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae5e0b2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae580c4240 con 0x7fae581525d0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae577fe640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7fae581521f0 0x7fae580c3b30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:59292/0 (socket says 172.21.15.26:59292) 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae577fe640 1 -- 172.21.15.26:0/126805481 learned_addr learned my addr 172.21.15.26:0/126805481 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae581525d0 0x7fae58158760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2469820741 0 0) 0x7fae5815ba00 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fae40003530 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 20393303 0 0) 0x7fae40003530 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae581525d0 msgr2=0x7fae58158760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae581525d0 0x7fae58158760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 >> v1:172.21.15.190:6789/0 conn(0x7fae58158ca0 legacy=0x7fae580c4f50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae5815bfc0 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7fae48001680 con 0x7fae581521f0 2024-04-23T10:25:31.497 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 >> v1:172.21.15.26:6789/0 conn(0x7fae581521f0 legacy=0x7fae580c3b30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae400039f0 0x7fae40003dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae40004350 0x7fae40004830 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae40005030 0x7fae4000b9d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fae580c4240 con 0x7fae40004350 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fae4000bf10 con 0x7fae40005030 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae4000c0c0 con 0x7fae400039f0 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae40004350 0x7fae40004830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae577fe640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae400039f0 0x7fae40003dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae57fff640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae40005030 0x7fae4000b9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 -- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae400039f0 msgr2=0x7fae40003dd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae400039f0 0x7fae40003dd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 -- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae40005030 msgr2=0x7fae4000b9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae40005030 0x7fae4000b9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.498 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.497+0000 7fae56ffd640 1 -- 172.21.15.26:0/126805481 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae40003530 con 0x7fae40004350 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae56ffd640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae40004350 0x7fae40004830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009ae0 tx=0x7fae4c01ca70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6b9576cb95002fec server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0b2070 con 0x7fae40004350 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fae4c0a5550 con 0x7fae40004350 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae567fc640 1 -- 172.21.15.26:0/126805481 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae4c0096b0 con 0x7fae40004350 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- 172.21.15.26:0/126805481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae40004350 msgr2=0x7fae40004830 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/126805481 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae40004350 0x7fae40004830 secure :-1 s=READY pgs=668 cs=0 l=1 rev1=1 crypto rx=0x7fae4c009ae0 tx=0x7fae4c01ca70 comp rx=0 tx=0).stop 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae57fff640 1 -- 172.21.15.26:0/126805481 reap_dead start 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- 172.21.15.26:0/126805481 shutdown_connections 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- 172.21.15.26:0/126805481 >> 172.21.15.26:0/126805481 conn(0x7fae580c9130 msgr2=0x7fae580c9540 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- 172.21.15.26:0/126805481 shutdown_connections 2024-04-23T10:25:31.500 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- 172.21.15.26:0/126805481 wait complete. 2024-04-23T10:25:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 Processor -- start 2024-04-23T10:25:31.501 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- start start 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae40004350 0x7fae581591b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 0x7fae581f1c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7fae580c5660 con 0x7fae580c7960 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7fae58158240 con 0x7fae580c7520 2024-04-23T10:25:31.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.501+0000 7fae5e0b2640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7fae580c57e0 con 0x7fae40004350 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:40404/0 (socket says 172.21.15.26:40404) 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 -- 172.21.15.26:0/3727079941 learned_addr learned my addr 172.21.15.26:0/3727079941 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae577fe640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae40004350 0x7fae581591b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae56ffd640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 0x7fae581f1c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 -- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae40004350 msgr2=0x7fae581591b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae40004350 0x7fae581591b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 -- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 msgr2=0x7fae581f1c20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 0x7fae581f1c20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 -- 172.21.15.26:0/3727079941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fae581598f0 con 0x7fae580c7960 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae56ffd640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 0x7fae581f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).send_auth_request state changed! 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae57fff640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e780 tx=0x7fae5000ec40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50003980 con 0x7fae580c7960 2024-04-23T10:25:31.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7fae50018070 con 0x7fae580c7960 2024-04-23T10:25:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7fae50003d80 con 0x7fae580c7960 2024-04-23T10:25:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fae58159bd0 con 0x7fae580c7960 2024-04-23T10:25:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fae581eec80 con 0x7fae580c7960 2024-04-23T10:25:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fae58075e60 con 0x7fae580c7960 2024-04-23T10:25:31.505 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7fae500050d0 con 0x7fae580c7960 2024-04-23T10:25:31.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 0x7fae4406a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:31.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(28..28 src has 1..28) ==== 6756+0+0 (secure 0 0 0) 0x7fae50086b40 con 0x7fae580c7960 2024-04-23T10:25:31.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.505+0000 7fae577fe640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 0x7fae4406a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:31.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.509+0000 7fae577fe640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 0x7fae4406a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fae48001ec0 tx=0x7fae48009040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:31.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.509+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7fae50056c50 con 0x7fae580c7960 2024-04-23T10:25:31.695 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:31.697+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true} v 0) -- 0x7fae58158700 con 0x7fae580c7960 2024-04-23T10:25:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae3ffff640 1 -- 172.21.15.26:0/3727079941 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data", "pool2": "cephfs_data", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data' removed v29) ==== 169+0+0 (secure 0 0 0) 0x7fae50056550 con 0x7fae580c7960 2024-04-23T10:25:32.334 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data' removed 2024-04-23T10:25:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 msgr2=0x7fae4406a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.337 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 0x7fae4406a840 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fae48001ec0 tx=0x7fae48009040 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 msgr2=0x7fae5814a690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7fae5000e780 tx=0x7fae5000ec40 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 shutdown_connections 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7fae44068380 0x7fae4406a840 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7fae580c7960 0x7fae5814a690 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7fae580c7520 0x7fae581f1c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 --2- 172.21.15.26:0/3727079941 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7fae40004350 0x7fae581591b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 >> 172.21.15.26:0/3727079941 conn(0x7fae580c9130 msgr2=0x7fae5814f470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 shutdown_connections 2024-04-23T10:25:32.338 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.337+0000 7fae5e0b2640 1 -- 172.21.15.26:0/3727079941 wait complete. 2024-04-23T10:25:32.376 DEBUG:teuthology.orchestra.run.smithi026:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool rm cephfs_data_ec cephfs_data_ec --yes-i-really-really-mean-it 2024-04-23T10:25:32.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 Processor -- start 2024-04-23T10:25:32.503 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 -- start start 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 --2- >> v2:172.21.15.190:3300/0 conn(0x7f4bfc15f090 0x7f4bfc15b3c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4bfc15b900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 -- --> v1:172.21.15.26:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f4bfc0cb2c0 con 0x7f4bfc1554d0 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 -- --> v2:172.21.15.190:3300/0 -- mon_getmap magic: 0 -- 0x7f4bfc15f5f0 con 0x7f4bfc15f090 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4c00991640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cc3d0 con 0x7f4bfc0cdf80 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bfa59c640 1 --1- >> v1:172.21.15.26:6789/0 conn(0x7f4bfc1554d0 0x7f4bfc0731b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.26:6789/0 says I am v1:172.21.15.26:58446/0 (socket says 172.21.15.26:58446) 2024-04-23T10:25:32.504 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bfa59c640 1 -- 172.21.15.26:0/4266615128 learned_addr learned my addr 172.21.15.26:0/4266615128 (peer_addr_for_me v1:172.21.15.26:0/0) 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v1:172.21.15.26:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1093826441 0 0) 0x7f4bfc0cb2c0 con 0x7f4bfc1554d0 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bfad9d640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4bfc15b900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 --> v1:172.21.15.26:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4be8003530 con 0x7f4bfc1554d0 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/4266615128 >> v2:172.21.15.190:3300/0 conn(0x7f4bfc15f090 0x7f4bfc15b3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v1:172.21.15.26:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 445744309 0 0) 0x7f4be8003530 con 0x7f4bfc1554d0 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 msgr2=0x7f4bfc15b900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4bfc15b900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 >> v2:172.21.15.190:3300/0 conn(0x7f4bfc15f090 msgr2=0x7f4bfc15b3c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:32.506 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 --2- 172.21.15.26:0/4266615128 >> v2:172.21.15.190:3300/0 conn(0x7f4bfc15f090 0x7f4bfc15b3c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 --> v1:172.21.15.26:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc0ccf80 con 0x7f4bfc1554d0 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v1:172.21.15.26:6789/0 3 ==== mon_map magic: 0 ==== 413+0+0 (unknown 1762464596 0 0) 0x7f4bec001680 con 0x7f4bfc1554d0 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 >> v1:172.21.15.26:6789/0 conn(0x7f4bfc1554d0 legacy=0x7f4bfc0731b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4be80039c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be8003f40 0x7f4be8004810 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d50 0x7f4be80051d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc15f5f0 con 0x7f4be8003f40 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cc3d0 con 0x7f4be8004d50 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4be800ba00 con 0x7f4bfc0cdf80 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be8003f40 0x7f4be8004810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bfa59c640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4be80039c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bfad9d640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d50 0x7f4be80051d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 msgr2=0x7f4be80039c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc0cdf80 0x7f4be80039c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.507 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d50 msgr2=0x7f4be80051d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-04-23T10:25:32.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8004d50 0x7f4be80051d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.508 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.505+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/4266615128 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4be8003530 con 0x7f4be8003f40 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be8003f40 0x7f4be8004810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009ae0 tx=0x7f4be401cab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=390f9ff07d5d0ad9 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40b2070 con 0x7f4be8003f40 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4be40a56a0 con 0x7f4be8003f40 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4bf959a640 1 -- 172.21.15.26:0/4266615128 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40096b0 con 0x7f4be8003f40 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- 172.21.15.26:0/4266615128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be8003f40 msgr2=0x7f4be8004810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.509 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 --2- 172.21.15.26:0/4266615128 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4be8003f40 0x7f4be8004810 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009ae0 tx=0x7f4be401cab0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4bfad9d640 1 -- 172.21.15.26:0/4266615128 reap_dead start 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- 172.21.15.26:0/4266615128 shutdown_connections 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- 172.21.15.26:0/4266615128 >> 172.21.15.26:0/4266615128 conn(0x7f4bfc067ca0 msgr2=0x7f4bfc06bad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- 172.21.15.26:0/4266615128 shutdown_connections 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- 172.21.15.26:0/4266615128 wait complete. 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 Processor -- start 2024-04-23T10:25:32.510 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.509+0000 7f4c00991640 1 -- start start 2024-04-23T10:25:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8003f40 0x7f4bfc15c230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 --2- >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc155980 0x7f4bfc0c99b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.511 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cb840 con 0x7f4bfc0c9000 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- --> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] -- mon_getmap magic: 0 -- 0x7f4bfc0cb560 con 0x7f4be8003f40 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- --> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] -- mon_getmap magic: 0 -- 0x7f4bfc0738c0 con 0x7f4bfc155980 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bfa59c640 1 --2- >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8003f40 0x7f4bfc15c230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 --2- >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.26:3300/0 says I am v2:172.21.15.26:58700/0 (socket says 172.21.15.26:58700) 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/2974174192 learned_addr learned my addr 172.21.15.26:0/2974174192 (peer_addr_for_me v2:172.21.15.26:0/0) 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bfad9d640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc155980 0x7f4bfc0c99b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc155980 msgr2=0x7f4bfc0c99b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc155980 0x7f4bfc0c99b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8003f40 msgr2=0x7f4bfc15c230 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8003f40 0x7f4bfc15c230 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 -- 172.21.15.26:0/2974174192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f4bfc0c7c40 con 0x7f4bfc0c9000 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf9d9b640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009a00 tx=0x7f4be8005840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 1 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be40b2040 con 0x7f4bfc0c9000 2024-04-23T10:25:32.512 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 2 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f4be400f000 con 0x7f4bfc0c9000 2024-04-23T10:25:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f4bfc0c7ee0 con 0x7f4bfc0c9000 2024-04-23T10:25:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 3 ==== mon_map magic: 0 ==== 413+0+0 (secure 0 0 0) 0x7f4be4004280 con 0x7f4bfc0c9000 2024-04-23T10:25:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f4bfc1563a0 con 0x7f4bfc0c9000 2024-04-23T10:25:32.513 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f4bfc075e60 con 0x7f4bfc0c9000 2024-04-23T10:25:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 4 ==== mgrmap(e 5) ==== 87987+0+0 (secure 0 0 0) 0x7f4be40c0030 con 0x7f4bfc0c9000 2024-04-23T10:25:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 0x7f4bdc06a840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-04-23T10:25:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.513+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 5 ==== osd_map(29..29 src has 1..29) ==== 6226+0+0 (secure 0 0 0) 0x7f4be4120ad0 con 0x7f4bfc0c9000 2024-04-23T10:25:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.517+0000 7f4bfa59c640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 0x7f4bdc06a840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-04-23T10:25:32.514 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.517+0000 7f4bfa59c640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 0x7f4bdc06a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4bec001870 tx=0x7f4bec007040 comp rx=0 tx=0).ready entity=mgr.4105 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-04-23T10:25:32.518 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.521+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+179799 (secure 0 0 0) 0x7f4be40c7060 con 0x7f4bfc0c9000 2024-04-23T10:25:32.683 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:32.685+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 --> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] -- mon_command({"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true} v 0) -- 0x7f4bfc0cad70 con 0x7f4bfc0c9000 2024-04-23T10:25:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.357+0000 7f4bf2ffd640 1 -- 172.21.15.26:0/2974174192 <== mon.0 v2:172.21.15.26:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool rm", "pool": "cephfs_data_ec", "pool2": "cephfs_data_ec", "yes_i_really_really_mean_it": true}]=0 pool 'cephfs_data_ec' removed v30) ==== 178+0+0 (secure 0 0 0) 0x7f4be40167c0 con 0x7f4bfc0c9000 2024-04-23T10:25:33.355 INFO:teuthology.orchestra.run.smithi026.stderr:pool 'cephfs_data_ec' removed 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 msgr2=0x7f4bdc06a840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 0x7f4bdc06a840 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f4bec001870 tx=0x7f4bec007040 comp rx=0 tx=0).stop 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 msgr2=0x7f4bfc156e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7f4be4009a00 tx=0x7f4be8005840 comp rx=0 tx=0).stop 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 shutdown_connections 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:6832/2066447761,v1:172.21.15.190:6833/2066447761] conn(0x7f4bdc068380 0x7f4bdc06a840 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3301/0,v1:172.21.15.190:6790/0] conn(0x7f4bfc155980 0x7f4bfc0c99b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.26:3300/0,v1:172.21.15.26:6789/0] conn(0x7f4bfc0c9000 0x7f4bfc156e80 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.361 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 --2- 172.21.15.26:0/2974174192 >> [v2:172.21.15.190:3300/0,v1:172.21.15.190:6789/0] conn(0x7f4be8003f40 0x7f4bfc15c230 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-04-23T10:25:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 >> 172.21.15.26:0/2974174192 conn(0x7f4bfc067ca0 msgr2=0x7f4bfc0c63d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-04-23T10:25:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 shutdown_connections 2024-04-23T10:25:33.362 INFO:teuthology.orchestra.run.smithi026.stderr:2024-04-23T10:25:33.361+0000 7f4c00991640 1 -- 172.21.15.26:0/2974174192 wait complete. 2024-04-23T10:25:33.388 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-23T10:25:33.388 DEBUG:tasks.ceph.mds.a:waiting for process to exit 2024-04-23T10:25:33.388 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.400 INFO:tasks.ceph.mds.a:Stopped 2024-04-23T10:25:33.401 DEBUG:tasks.ceph.mds.c:waiting for process to exit 2024-04-23T10:25:33.401 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.463 INFO:tasks.ceph.mds.c:Stopped 2024-04-23T10:25:33.463 DEBUG:tasks.ceph.mds.e:waiting for process to exit 2024-04-23T10:25:33.463 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.521 INFO:tasks.ceph.mds.e:Stopped 2024-04-23T10:25:33.522 DEBUG:tasks.ceph.mds.b:waiting for process to exit 2024-04-23T10:25:33.522 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.538 INFO:tasks.ceph.mds.b:Stopped 2024-04-23T10:25:33.539 DEBUG:tasks.ceph.mds.d:waiting for process to exit 2024-04-23T10:25:33.539 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.592 INFO:tasks.ceph.mds.d:Stopped 2024-04-23T10:25:33.592 DEBUG:tasks.ceph.mds.f:waiting for process to exit 2024-04-23T10:25:33.592 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.644 INFO:tasks.ceph.mds.f:Stopped 2024-04-23T10:25:33.644 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-23T10:25:33.644 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-23T10:25:33.644 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:33.720 INFO:tasks.ceph.osd.0:Stopped 2024-04-23T10:25:33.720 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-23T10:25:33.720 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:35.332 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 is failed for ~0s 2024-04-23T10:25:38.170 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:38.173 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:39.822 INFO:tasks.ceph.osd.1:Stopped 2024-04-23T10:25:39.822 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-23T10:25:39.822 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:39.897 INFO:tasks.ceph.osd.2:Stopped 2024-04-23T10:25:39.898 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-23T10:25:39.898 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:41.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-23T10:25:41.240 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.1 has been restored 2024-04-23T10:25:46.000 INFO:tasks.ceph.osd.3:Stopped 2024-04-23T10:25:46.000 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-23T10:25:46.000 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:46.077 INFO:tasks.ceph.osd.4:Stopped 2024-04-23T10:25:46.078 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-23T10:25:46.078 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:46.173 INFO:tasks.ceph.osd.5:Stopped 2024-04-23T10:25:46.173 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-23T10:25:46.174 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:46.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-23T10:25:46.888 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-23T10:25:52.275 INFO:tasks.ceph.osd.6:Stopped 2024-04-23T10:25:52.275 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-23T10:25:52.275 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.347 INFO:tasks.ceph.osd.7:Stopped 2024-04-23T10:25:52.347 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-23T10:25:52.347 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-23T10:25:52.347 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.376 INFO:tasks.ceph.mgr.y:Stopped 2024-04-23T10:25:52.376 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-23T10:25:52.376 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~6s 2024-04-23T10:25:52.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y is failed for ~0s 2024-04-23T10:25:52.406 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x is failed for ~0s 2024-04-23T10:25:52.406 INFO:tasks.ceph.mgr.x:Stopped 2024-04-23T10:25:52.406 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-23T10:25:52.406 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-23T10:25:52.407 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.435 INFO:tasks.ceph.mon.a:Stopped 2024-04-23T10:25:52.435 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-23T10:25:52.435 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.459 INFO:tasks.ceph.mon.b:Stopped 2024-04-23T10:25:52.459 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-23T10:25:52.459 INFO:teuthology.orchestra.run:waiting for 300 2024-04-23T10:25:52.522 INFO:tasks.ceph.mon.c:Stopped 2024-04-23T10:25:52.522 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-23T10:25:52.522 DEBUG:teuthology.orchestra.run.smithi026:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(OSD_SLOW_PING_TIME' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v 'filesystem is online with fewer MDS than max_mds' | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'do not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v 'deprecated feature inline_data' | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | egrep -v PG_AVAILABILITY | egrep -v PG_DEGRADED | egrep -v 'Reduced data availability' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-23T10:25:52.546 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:25:52.547 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-23T10:25:52.848 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:25:52.849 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-23T10:25:53.051 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:25:53.051 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-23T10:25:53.198 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:25:53.198 DEBUG:teuthology.orchestra.run.smithi026:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-23T10:25:53.325 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:25:53.325 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-23T10:25:53.851 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:25:53.851 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-23T10:25:54.093 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:25:54.094 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-23T10:25:54.268 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:25:54.268 DEBUG:teuthology.orchestra.run.smithi190:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-23T10:25:54.427 INFO:tasks.ceph:Archiving mon data... 2024-04-23T10:25:54.428 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/data/mon.a.tgz 2024-04-23T10:25:54.428 DEBUG:teuthology.orchestra.run.smithi026:> mktemp 2024-04-23T10:25:54.434 INFO:teuthology.orchestra.run.smithi026.stdout:/tmp/tmp.0wBuLUY5Sj 2024-04-23T10:25:54.434 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.0wBuLUY5Sj 2024-04-23T10:25:54.559 DEBUG:teuthology.orchestra.run.smithi026:> sudo chmod 0666 /tmp/tmp.0wBuLUY5Sj 2024-04-23T10:25:54.622 DEBUG:teuthology.orchestra.remote:smithi026:/tmp/tmp.0wBuLUY5Sj is 311KB 2024-04-23T10:25:54.684 DEBUG:teuthology.orchestra.run.smithi026:> rm -fr /tmp/tmp.0wBuLUY5Sj 2024-04-23T10:25:54.689 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/data/mon.b.tgz 2024-04-23T10:25:54.689 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-04-23T10:25:54.695 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.t2Ynr3J9sE 2024-04-23T10:25:54.695 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.t2Ynr3J9sE 2024-04-23T10:25:54.826 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.t2Ynr3J9sE 2024-04-23T10:25:54.892 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.t2Ynr3J9sE is 329KB 2024-04-23T10:25:54.953 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.t2Ynr3J9sE 2024-04-23T10:25:54.959 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/data/mon.c.tgz 2024-04-23T10:25:54.959 DEBUG:teuthology.orchestra.run.smithi190:> mktemp 2024-04-23T10:25:55.007 INFO:teuthology.orchestra.run.smithi190.stdout:/tmp/tmp.xhUb4QAbTY 2024-04-23T10:25:55.007 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.xhUb4QAbTY 2024-04-23T10:25:55.139 DEBUG:teuthology.orchestra.run.smithi190:> sudo chmod 0666 /tmp/tmp.xhUb4QAbTY 2024-04-23T10:25:55.204 DEBUG:teuthology.orchestra.remote:smithi190:/tmp/tmp.xhUb4QAbTY is 329KB 2024-04-23T10:25:55.265 DEBUG:teuthology.orchestra.run.smithi190:> rm -fr /tmp/tmp.xhUb4QAbTY 2024-04-23T10:25:55.271 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-23T10:25:55.271 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T10:25:55.273 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-23T10:25:55.334 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T10:25:55.375 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-23T10:25:55.375 INFO:tasks.ceph:Archiving crash dumps... 2024-04-23T10:25:55.377 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi026/crash 2024-04-23T10:25:55.378 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T10:25:55.392 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/lib/ceph/crash to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi190/crash 2024-04-23T10:25:55.393 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-23T10:25:55.431 INFO:tasks.ceph:Shutting down logrotate 2024-04-23T10:25:55.431 DEBUG:teuthology.orchestra.run.smithi026:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:55.439 DEBUG:teuthology.orchestra.run.smithi190:> sudo logrotate /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:55.509 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:55.534 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm /etc/logrotate.d/ceph-test.conf 2024-04-23T10:25:55.562 INFO:tasks.ceph:Compressing logs... 2024-04-23T10:25:55.562 DEBUG:teuthology.orchestra.run.smithi026:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:25:55.579 DEBUG:teuthology.orchestra.run.smithi190:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-23T10:25:55.598 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38772.log 2024-04-23T10:25:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36942.log 2024-04-23T10:25:55.599 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38772.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37206.log 2024-04-23T10:25:55.600 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38772.log.gz 2024-04-23T10:25:55.600 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36942.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37655.log 2024-04-23T10:25:55.601 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39311.log 2024-04-23T10:25:55.601 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37206.log: /var/log/ceph/ceph-client.admin.37655.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36942.log.gz 2024-04-23T10:25:55.601 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-23T10:25:55.602 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39311.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35039.log 2024-04-23T10:25:55.602 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mgr.y.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.39311.log.gz 2024-04-23T10:25:55.602 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37655.log.gz 2024-04-23T10:25:55.602 INFO:teuthology.orchestra.run.smithi026.stderr: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37206.log.gz 2024-04-23T10:25:55.602 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35247.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35039.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34150.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35247.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39601.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35039.log.gz 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34150.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35247.log.gz 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36767.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.34150.log.gz 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39601.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39418.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36294.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36767.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.39601.log.gz 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39418.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32551.log 2024-04-23T10:25:55.605 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.36767.log.gz 2024-04-23T10:25:55.606 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39418.log.gz 2024-04-23T10:25:55.606 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36294.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34987.log 2024-04-23T10:25:55.608 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36294.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32551.log: /var/log/ceph/ceph-client.admin.34987.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.32551.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36915.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.34987.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33651.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32913.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36915.log: /var/log/ceph/ceph-client.admin.33651.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36006.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36915.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33651.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32913.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37709.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36006.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.32913.log.gz 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39103.log 2024-04-23T10:25:55.609 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36006.log.gz 2024-04-23T10:25:55.610 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39025.log 2024-04-23T10:25:55.614 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37709.log: /var/log/ceph/ceph-client.admin.39103.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27712.log 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.37709.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39025.log: gzip -5 87.4% --verbose -- /var/log/ceph/ceph-client.admin.39285.log -- replaced with /var/log/ceph/ceph-client.admin.39103.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39025.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.27712.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39523.log 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39285.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27712.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36084.log 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.39285.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39523.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.35719.log 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36084.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38458.log 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39523.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr: 94.6% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-23T10:25:55.615 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.0.35719.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36084.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33838.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38458.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27602.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33838.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38207.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38458.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.27602.log: gzip 89.5% -5 --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.33838.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.32995.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.27602.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38207.log: gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.22686.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32995.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.38207.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34356.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32995.log.gz 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr:gzip/var/log/ceph/ceph.tmp-client.admin.22686.log: -5 --verbose -- /var/log/ceph/ceph-client.admin.36321.log 2024-04-23T10:25:55.616 INFO:teuthology.orchestra.run.smithi026.stderr: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.22686.log.gz 2024-04-23T10:25:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34356.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38694.log 2024-04-23T10:25:55.621 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34356.log.gz 2024-04-23T10:25:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38400.log 2024-04-23T10:25:55.621 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 88.7% -5 -- replaced with /var/log/ceph/ceph-client.admin.36321.log.gz/var/log/ceph/ceph-client.admin.38694.log: --verbose 2024-04-23T10:25:55.621 INFO:teuthology.orchestra.run.smithi026.stderr: -- /var/log/ceph/ceph-client.admin.33703.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38400.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38694.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39337.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33703.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33703.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39337.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38400.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38999.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39337.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35304.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35876.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38999.log: /var/log/ceph/ceph-client.admin.35304.log: gzip -5 88.4% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.38999.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr: /var/log/ceph/ceph-client.admin.34355.log 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.35304.log.gz 2024-04-23T10:25:55.622 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35876.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33494.log 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35876.log.gz 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32727.log 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33494.log: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.34355.log.gz 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 88.8% -5 -- replaced with /var/log/ceph/ceph-client.admin.33494.log.gz 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.38824.log 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32727.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34549.log 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38824.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.32727.log.gz 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35772.log 2024-04-23T10:25:55.623 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38824.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34549.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36136.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35772.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.34549.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34961.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35772.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36136.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32941.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36136.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34961.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35330.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33049.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32941.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34961.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39575.log 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32941.log.gz 2024-04-23T10:25:55.626 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33049.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.35330.log.gz 2024-04-23T10:25:55.627 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33049.log.gz 2024-04-23T10:25:55.627 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38485.log 2024-04-23T10:25:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39575.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36032.log 2024-04-23T10:25:55.628 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33075.log 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38485.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.39575.log.gz 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33468.log 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36032.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36032.log.gz 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33075.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38485.log.gz 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.33075.log.gz 2024-04-23T10:25:55.629 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35383.log 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33468.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37893.log 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35195.log 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35383.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33468.log.gz 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37893.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36557.log 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35980.log 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35383.log.gz 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37893.log.gz 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.631 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35195.log.gz 2024-04-23T10:25:55.632 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36557.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34159.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35980.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36407.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: 91.2%/var/log/ceph/ceph-client.admin.34159.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.35980.log.gz 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36557.log.gz 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35824.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34159.log.gz 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37038.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36407.log: /var/log/ceph/ceph-client.admin.35824.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37286.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6%/var/log/ceph/ceph-client.admin.37038.log: -- replaced with /var/log/ceph/ceph-client.admin.35824.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34347.log 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.634 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36407.log.gz 2024-04-23T10:25:55.635 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37286.log: 90.8% -- replaced with /var/log/ceph/ceph-client.admin.37038.log.gz 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27717.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27813.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27693.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27813.log: 87.4% -- replaced with /var/log/ceph/ceph-client.admin.27717.log.gz 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27813.log.gz 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27693.log: /var/log/ceph/ceph-osd.7.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27741.log 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27693.log.gz 2024-04-23T10:25:55.646 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27741.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27837.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.27741.log.gz 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27765.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27837.log: /var/log/ceph/ceph-client.admin.27765.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.27837.log.gz 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.f.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.27765.log.gz 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mgr.x.log: /var/log/ceph/ceph-mds.f.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27789.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.c.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-client.admin.27789.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.27789.log.gz 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.d.log 2024-04-23T10:25:55.647 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph.audit.log: 92.8% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T10:25:55.648 INFO:teuthology.orchestra.run.smithi190.stderr: 93.9% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T10:25:55.648 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.b.log 2024-04-23T10:25:55.648 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.d.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-23T10:25:55.650 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mds.b.log: 94.1% -- replaced with /var/log/ceph/ceph-mds.b.log.gz 2024-04-23T10:25:55.650 INFO:teuthology.orchestra.run.smithi190.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37286.log.gz 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36690.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34347.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34568.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34347.log.gz 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35954.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39129.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.36690.log.gz 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34568.log: /var/log/ceph/ceph-client.admin.35954.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34568.log.gz 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34364.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.35954.log.gz 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33598.log 2024-04-23T10:25:55.655 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39129.log: /var/log/ceph/ceph-client.admin.34364.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33898.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 88.4%/var/log/ceph/ceph-client.admin.33598.log: -- replaced with /var/log/ceph/ceph-client.admin.34364.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38798.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.39129.log.gz 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33598.log.gz 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33898.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35169.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.33898.log.gz 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38798.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38798.log.gz 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32885.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:gzip 87.7% -- replaced with /var/log/ceph/ceph-client.admin.35169.log.gz -5 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: --verbose -- /var/log/ceph/ceph-client.admin.36357.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-osd.3.log: /var/log/ceph/ceph-client.admin.32885.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38667.log 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr: 89.4%/var/log/ceph/ceph-client.admin.36357.log: -- replaced with /var/log/ceph/ceph-client.admin.32885.log.gz 2024-04-23T10:25:55.656 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39684.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38667.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36357.log.gz 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.38667.log.gz 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35433.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39684.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34572.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35433.log: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33281.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.39684.log.gz 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34572.log: 91.3% -- replaced with /var/log/ceph/ceph-client.admin.35433.log.gz 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34572.log.gz 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34155.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33281.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38869.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7%/var/log/ceph/ceph-client.admin.34155.log: -- replaced with /var/log/ceph/ceph-client.admin.33281.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39497.log 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.657 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34155.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38869.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38869.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34002.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39497.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36717.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.39497.log.gz/var/log/ceph/ceph-client.admin.34002.log: 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35143.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34002.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36717.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36717.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37092.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33864.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37092.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.35143.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38563.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39233.log 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.37092.log.gz 2024-04-23T10:25:55.658 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33864.log: /var/log/ceph/ceph-client.admin.38563.log: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.38563.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.33864.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36268.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39233.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33153.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0%/var/log/ceph/ceph-client.admin.36268.log: -- replaced with /var/log/ceph/ceph-client.admin.39233.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39736.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr: 87.3% -- replaced with /var/log/ceph/ceph-client.admin.36268.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33153.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.33153.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33127.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39736.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36190.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33127.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39736.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35273.log 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33127.log.gz 2024-04-23T10:25:55.659 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36190.log: /var/log/ceph/ceph-osd.1.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.36190.log.gz 2024-04-23T10:25:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34840.log 2024-04-23T10:25:55.660 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35273.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33755.log 2024-04-23T10:25:55.664 INFO:teuthology.orchestra.run.smithi026.stderr: 87.6% -- replaced with /var/log/ceph/ceph-client.admin.35273.log.gz/var/log/ceph/ceph-client.admin.34840.log: 2024-04-23T10:25:55.664 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34840.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34809.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34028.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33755.log: /var/log/ceph/ceph-client.admin.34809.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33755.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39447.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34809.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34028.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34028.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39549.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36507.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39447.log: /var/log/ceph/ceph-client.admin.39549.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39447.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39549.log.gz 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34352.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37786.log 2024-04-23T10:25:55.665 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36507.log: /var/log/ceph/ceph-client.admin.34352.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34352.log.gz 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.36507.log.gz 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34156.log 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33572.log 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37786.log: /var/log/ceph/ceph-client.admin.34156.log: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37786.log.gz 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34156.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39051.log 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33572.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.33572.log.gz 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35850.log 2024-04-23T10:25:55.666 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-23T10:25:55.667 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27861.log 2024-04-23T10:25:55.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39051.log: /var/log/ceph/ceph-client.admin.35850.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39051.log.gz 2024-04-23T10:25:55.668 INFO:teuthology.orchestra.run.smithi026.stderr: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.35850.log.gz 2024-04-23T10:25:55.668 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34160.log 2024-04-23T10:25:55.668 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.log: 87.0% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-23T10:25:55.669 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33677.log 2024-04-23T10:25:55.670 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34160.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38048.log 2024-04-23T10:25:55.670 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34160.log.gz/var/log/ceph/ceph-client.admin.33677.log: 2024-04-23T10:25:55.671 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35117.log 2024-04-23T10:25:55.671 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33677.log.gz 2024-04-23T10:25:55.671 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38048.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37179.log 2024-04-23T10:25:55.671 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.38048.log.gz 2024-04-23T10:25:55.672 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35117.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38947.log 2024-04-23T10:25:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37179.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.35117.log.gz 2024-04-23T10:25:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36058.log 2024-04-23T10:25:55.673 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37179.log.gz 2024-04-23T10:25:55.673 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38947.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33786.log 2024-04-23T10:25:55.674 INFO:teuthology.orchestra.run.smithi190.stderr:/var/log/ceph/ceph-osd.4.log: /var/log/ceph/ceph-client.admin.27861.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.27861.log.gz 2024-04-23T10:25:55.675 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36058.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.38947.log.gz 2024-04-23T10:25:55.675 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.36058.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33205.log 2024-04-23T10:25:55.675 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33786.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33729.log 2024-04-23T10:25:55.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33205.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33786.log.gz 2024-04-23T10:25:55.676 INFO:teuthology.orchestra.run.smithi026.stderr: 89.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34158.log 2024-04-23T10:25:55.676 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.33205.log.gz 2024-04-23T10:25:55.676 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32967.log 2024-04-23T10:25:55.677 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34158.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33729.log.gz 2024-04-23T10:25:55.677 INFO:teuthology.orchestra.run.smithi026.stderr: 87.7% -- replaced with /var/log/ceph/ceph-client.admin.34158.log.gz 2024-04-23T10:25:55.677 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36216.log 2024-04-23T10:25:55.678 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32967.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34874.log 2024-04-23T10:25:55.678 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5%/var/log/ceph/ceph-client.admin.36216.log: -- replaced with /var/log/ceph/ceph-client.admin.32967.log.gz 2024-04-23T10:25:55.679 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39077.log 2024-04-23T10:25:55.679 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.36216.log.gz 2024-04-23T10:25:55.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34874.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34573.log 2024-04-23T10:25:55.679 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39077.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34874.log.gz 2024-04-23T10:25:55.680 INFO:teuthology.orchestra.run.smithi026.stderr: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.39077.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32859.log 2024-04-23T10:25:55.680 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.680 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34573.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35483.log 2024-04-23T10:25:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32859.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34573.log.gz 2024-04-23T10:25:55.681 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.32859.log.gz 2024-04-23T10:25:55.681 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38895.log 2024-04-23T10:25:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35594.log 2024-04-23T10:25:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38895.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.38895.log.gz 2024-04-23T10:25:55.682 INFO:teuthology.orchestra.run.smithi026.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.admin.35483.log.gz 2024-04-23T10:25:55.682 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36457.log 2024-04-23T10:25:55.683 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39207.log 2024-04-23T10:25:55.684 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35594.log: /var/log/ceph/ceph-client.admin.36457.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.35594.log.gz 2024-04-23T10:25:55.685 INFO:teuthology.orchestra.run.smithi026.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.36457.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37119.log 2024-04-23T10:25:55.685 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.685 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39207.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34571.log 2024-04-23T10:25:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37119.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39207.log.gz 2024-04-23T10:25:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32781.log 2024-04-23T10:25:55.686 INFO:teuthology.orchestra.run.smithi026.stderr: 90.9% -- replaced with /var/log/ceph/ceph-client.admin.37119.log.gz 2024-04-23T10:25:55.686 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34571.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34571.log.gz 2024-04-23T10:25:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33231.log 2024-04-23T10:25:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36794.log 2024-04-23T10:25:55.687 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32781.log: /var/log/ceph/ceph-client.admin.33231.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.32781.log.gz 2024-04-23T10:25:55.688 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34106.log 2024-04-23T10:25:55.688 INFO:teuthology.orchestra.run.smithi026.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.admin.33231.log.gz 2024-04-23T10:25:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36794.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36794.log.gz 2024-04-23T10:25:55.689 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38589.log 2024-04-23T10:25:55.690 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38615.log 2024-04-23T10:25:55.691 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34106.log: /var/log/ceph/ceph-client.admin.38589.log: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34106.log.gz 2024-04-23T10:25:55.691 INFO:teuthology.orchestra.run.smithi026.stderr: 89.1%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35533.log 2024-04-23T10:25:55.691 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-client.admin.38589.log.gz 2024-04-23T10:25:55.692 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38615.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38615.log.gz 2024-04-23T10:25:55.692 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33625.log 2024-04-23T10:25:55.692 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36242.log 2024-04-23T10:25:55.693 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35533.log: /var/log/ceph/ceph-client.admin.33625.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33625.log.gz 2024-04-23T10:25:55.693 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.35533.log.gz 2024-04-23T10:25:55.694 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39155.log 2024-04-23T10:25:55.694 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35091.log 2024-04-23T10:25:55.694 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36242.log: /var/log/ceph/ceph-client.admin.39155.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.36242.log.gz 2024-04-23T10:25:55.695 INFO:teuthology.orchestra.run.smithi026.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.39155.log.gz 2024-04-23T10:25:55.695 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38973.log 2024-04-23T10:25:55.696 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35091.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35091.log.gz 2024-04-23T10:25:55.696 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34344.log 2024-04-23T10:25:55.697 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-23T10:25:55.697 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38973.log: /var/log/ceph/ceph-client.admin.34344.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38973.log.gz 2024-04-23T10:25:55.697 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.34344.log.gz 2024-04-23T10:25:55.697 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.c.log 2024-04-23T10:25:55.699 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph.audit.log: 89.1% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-23T10:25:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34570.log 2024-04-23T10:25:55.700 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.a.log 2024-04-23T10:25:55.701 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.c.log: /var/log/ceph/ceph-client.admin.34570.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.34570.log.gz 2024-04-23T10:25:55.704 INFO:teuthology.orchestra.run.smithi190.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.d.log.gz 2024-04-23T10:25:55.714 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32643.log 2024-04-23T10:25:55.730 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-mds.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37967.log 2024-04-23T10:25:55.731 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32643.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.32643.log.gz 2024-04-23T10:25:55.737 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38152.log 2024-04-23T10:25:55.738 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37967.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.37967.log.gz 2024-04-23T10:25:55.746 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33924.log 2024-04-23T10:25:55.747 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38152.log: 91.0% -- replaced with /var/log/ceph/ceph-client.admin.38152.log.gz 2024-04-23T10:25:55.756 INFO:teuthology.orchestra.run.smithi026.stderr: 93.3%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34567.log 2024-04-23T10:25:55.757 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33924.log: 89.7% -- replaced with /var/log/ceph/ceph-client.admin.33924.log.gz 2024-04-23T10:25:55.758 INFO:teuthology.orchestra.run.smithi026.stderr: -- replaced with /var/log/ceph/ceph-mds.c.log.gz 2024-04-23T10:25:55.762 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37259.log 2024-04-23T10:25:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34567.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.34567.log.gz 2024-04-23T10:25:55.763 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34054.log 2024-04-23T10:25:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37259.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.37259.log.gz 2024-04-23T10:25:55.764 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34142.log 2024-04-23T10:25:55.765 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34054.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.34054.log.gz 2024-04-23T10:25:55.766 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37994.log 2024-04-23T10:25:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34142.log: 87.5% -- replaced with /var/log/ceph/ceph-client.admin.34142.log.gz 2024-04-23T10:25:55.767 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33023.log 2024-04-23T10:25:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37994.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37994.log.gz 2024-04-23T10:25:55.769 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38320.log 2024-04-23T10:25:55.770 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33023.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.33023.log.gz 2024-04-23T10:25:55.770 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33520.log 2024-04-23T10:25:55.771 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38320.log: 91.2% -- replaced with /var/log/ceph/ceph-client.admin.38320.log.gz 2024-04-23T10:25:55.772 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35221.log 2024-04-23T10:25:55.773 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33520.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.33520.log.gz 2024-04-23T10:25:55.773 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32607.log 2024-04-23T10:25:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35221.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.35221.log.gz 2024-04-23T10:25:55.774 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35798.log 2024-04-23T10:25:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32607.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32607.log.gz 2024-04-23T10:25:55.776 INFO:teuthology.orchestra.run.smithi026.stderr: 93.2% -- replaced with /var/log/ceph/ceph-mds.a.log.gz 2024-04-23T10:25:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39710.log 2024-04-23T10:25:55.776 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32807.log 2024-04-23T10:25:55.777 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35798.log: /var/log/ceph/ceph-client.admin.39710.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.35798.log.gz 2024-04-23T10:25:55.777 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.39710.log.gz 2024-04-23T10:25:55.777 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36162.log 2024-04-23T10:25:55.778 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.32807.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.32807.log.gz 2024-04-23T10:25:55.778 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36110.log 2024-04-23T10:25:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35013.log 2024-04-23T10:25:55.779 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36162.log: /var/log/ceph/ceph-client.admin.36110.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36162.log.gz 2024-04-23T10:25:55.780 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.36110.log.gz 2024-04-23T10:25:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35928.log 2024-04-23T10:25:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33179.log 2024-04-23T10:25:55.780 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35013.log: /var/log/ceph/ceph-client.admin.35928.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.35013.log.gz 2024-04-23T10:25:55.781 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35928.log.gz 2024-04-23T10:25:55.781 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33976.log 2024-04-23T10:25:55.782 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38373.log 2024-04-23T10:25:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33179.log: /var/log/ceph/ceph-client.admin.33976.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.33179.log.gz 2024-04-23T10:25:55.783 INFO:teuthology.orchestra.run.smithi026.stderr: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.33976.log.gz 2024-04-23T10:25:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37813.log 2024-04-23T10:25:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34368.log 2024-04-23T10:25:55.783 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38373.log: /var/log/ceph/ceph-client.admin.37813.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.38373.log.gz 2024-04-23T10:25:55.784 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34901.log 2024-04-23T10:25:55.784 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34368.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.37813.log.gz 2024-04-23T10:25:55.784 INFO:teuthology.orchestra.run.smithi026.stderr: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.34368.log.gz 2024-04-23T10:25:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32753.log 2024-04-23T10:25:55.785 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38234.log 2024-04-23T10:25:55.786 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34901.log: /var/log/ceph/ceph-client.admin.32753.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.34901.log.gz 2024-04-23T10:25:55.786 INFO:teuthology.orchestra.run.smithi026.stderr: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.32753.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33409.log 2024-04-23T10:25:55.786 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.787 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38234.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.38234.log.gz 2024-04-23T10:25:55.787 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39181.log 2024-04-23T10:25:55.788 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38537.log 2024-04-23T10:25:55.789 INFO:teuthology.orchestra.run.smithi190.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-23T10:25:55.789 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33409.log: /var/log/ceph/ceph-client.admin.39181.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39181.log.gz 2024-04-23T10:25:55.790 INFO:teuthology.orchestra.run.smithi026.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.admin.33409.log.gz 2024-04-23T10:25:55.790 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37866.log 2024-04-23T10:25:55.791 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33546.log 2024-04-23T10:25:55.792 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38537.log: /var/log/ceph/ceph-client.admin.37866.log: 87.9% -- replaced with /var/log/ceph/ceph-client.admin.38537.log.gz 2024-04-23T10:25:55.792 INFO:teuthology.orchestra.run.smithi026.stderr: 89.5% -- replaced with /var/log/ceph/ceph-client.admin.37866.log.gz 2024-04-23T10:25:55.792 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35902.log 2024-04-23T10:25:55.793 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38125.log 2024-04-23T10:25:55.793 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33546.log: /var/log/ceph/ceph-client.admin.35902.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.33546.log.gz 2024-04-23T10:25:55.793 INFO:teuthology.orchestra.run.smithi026.stderr: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.35902.log.gz 2024-04-23T10:25:55.793 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37736.log 2024-04-23T10:25:55.794 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37011.log 2024-04-23T10:25:55.794 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38125.log: /var/log/ceph/ceph-client.admin.37736.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.38125.log.gz 2024-04-23T10:25:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39471.log 2024-04-23T10:25:55.795 INFO:teuthology.orchestra.run.smithi026.stderr: 91.1%/var/log/ceph/ceph-client.admin.37011.log: -- replaced with /var/log/ceph/ceph-client.admin.37736.log.gz 2024-04-23T10:25:55.795 INFO:teuthology.orchestra.run.smithi026.stderr: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.37011.log.gz 2024-04-23T10:25:55.795 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38075.log 2024-04-23T10:25:55.796 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39363.log 2024-04-23T10:25:55.796 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39471.log: /var/log/ceph/ceph-client.admin.38075.log: 89.1% -- replaced with /var/log/ceph/ceph-client.admin.39471.log.gz 2024-04-23T10:25:55.797 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34080.log 2024-04-23T10:25:55.797 INFO:teuthology.orchestra.run.smithi026.stderr: 90.7% -- replaced with /var/log/ceph/ceph-client.admin.38075.log.gz 2024-04-23T10:25:55.797 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39363.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.39363.log.gz 2024-04-23T10:25:55.798 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38293.log 2024-04-23T10:25:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38921.log 2024-04-23T10:25:55.799 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34080.log: /var/log/ceph/ceph-client.admin.38293.log: 88.9% -- replaced with /var/log/ceph/ceph-client.admin.34080.log.gz 2024-04-23T10:25:55.800 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38293.log.gz 2024-04-23T10:25:55.800 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38720.log 2024-04-23T10:25:55.800 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.27492.log 2024-04-23T10:25:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38921.log: /var/log/ceph/ceph-client.admin.38720.log: 89.2% -- replaced with /var/log/ceph/ceph-client.admin.38921.log.gz 2024-04-23T10:25:55.801 INFO:teuthology.orchestra.run.smithi026.stderr: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.38720.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34783.log 2024-04-23T10:25:55.801 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:25:55.801 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.27492.log: 90.0% -- replaced with /var/log/ceph/ceph-client.admin.27492.log.gz 2024-04-23T10:25:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34577.log 2024-04-23T10:25:55.802 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33812.log 2024-04-23T10:25:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34783.log: /var/log/ceph/ceph-client.admin.34577.log: 88.3% -- replaced with /var/log/ceph/ceph-client.admin.34783.log.gz 2024-04-23T10:25:55.803 INFO:teuthology.orchestra.run.smithi026.stderr: 88.5% -- replaced with /var/log/ceph/ceph-client.admin.34577.log.gz 2024-04-23T10:25:55.803 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32833.log 2024-04-23T10:25:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38641.log 2024-04-23T10:25:55.804 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33812.log: /var/log/ceph/ceph-client.admin.32833.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33812.log.gz 2024-04-23T10:25:55.804 INFO:teuthology.orchestra.run.smithi026.stderr: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.32833.log.gz 2024-04-23T10:25:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mds.e.log 2024-04-23T10:25:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38746.log 2024-04-23T10:25:55.805 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38641.log: /var/log/ceph/ceph-mds.e.log: 88.4% -- replaced with /var/log/ceph/ceph-client.admin.38641.log.gz 2024-04-23T10:25:55.806 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35065.log 2024-04-23T10:25:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.38746.log: 89.0% -- replaced with /var/log/ceph/ceph-client.admin.38746.log.gz 2024-04-23T10:25:55.807 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34935.log 2024-04-23T10:25:55.808 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.35065.log: 89.4% -- replaced with /var/log/ceph/ceph-client.admin.35065.log.gz 2024-04-23T10:25:55.808 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36638.log 2024-04-23T10:25:55.809 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34935.log: 88.7% -- replaced with /var/log/ceph/ceph-client.admin.34935.log.gz 2024-04-23T10:25:55.809 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36611.log 2024-04-23T10:25:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36638.log: 91.1% -- replaced with /var/log/ceph/ceph-client.admin.36638.log.gz 2024-04-23T10:25:55.811 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37625.log 2024-04-23T10:25:55.812 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.36611.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.36611.log.gz 2024-04-23T10:25:55.813 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39259.log 2024-04-23T10:25:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.37625.log: 88.1% -- replaced with /var/log/ceph/ceph-client.admin.37625.log.gz 2024-04-23T10:25:55.814 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33950.log 2024-04-23T10:25:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39259.log: 88.6% -- replaced with /var/log/ceph/ceph-client.admin.39259.log.gz 2024-04-23T10:25:55.815 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-04-23T10:25:55.816 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33950.log: 88.8% -- replaced with /var/log/ceph/ceph-client.admin.33950.log.gz 2024-04-23T10:25:55.817 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34144.log 2024-04-23T10:25:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.33101.log: 89.3% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gz 2024-04-23T10:25:55.818 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34363.log 2024-04-23T10:25:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34144.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.34144.log.gz 2024-04-23T10:25:55.819 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34757.log 2024-04-23T10:25:55.820 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34363.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34363.log.gz 2024-04-23T10:25:55.821 INFO:teuthology.orchestra.run.smithi026.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39389.log 2024-04-23T10:25:55.822 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.34757.log: 88.0% -- replaced with /var/log/ceph/ceph-client.admin.34757.log.gz 2024-04-23T10:25:55.823 INFO:teuthology.orchestra.run.smithi026.stderr:/var/log/ceph/ceph-client.admin.39389.log: 88.2% -- replaced with /var/log/ceph/ceph-client.admin.39389.log.gz 2024-04-23T10:25:55.875 INFO:teuthology.orchestra.run.smithi026.stderr: 92.8% -- replaced with /var/log/ceph/ceph-mds.e.log.gz 2024-04-23T10:25:55.876 INFO:teuthology.orchestra.run.smithi190.stderr: 92.5% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-23T10:25:55.935 INFO:teuthology.orchestra.run.smithi190.stderr: 92.3% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-23T10:25:56.324 INFO:teuthology.orchestra.run.smithi026.stderr: 90.6% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-23T10:25:57.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-23T10:25:57.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.y has been restored 2024-04-23T10:25:57.407 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.mgr.x has been restored 2024-04-23T10:26:02.909 INFO:teuthology.orchestra.run.smithi190.stderr: 92.0% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-23T10:26:04.192 INFO:teuthology.orchestra.run.smithi190.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-23T10:26:04.286 INFO:teuthology.orchestra.run.smithi190.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-23T10:26:04.760 INFO:teuthology.orchestra.run.smithi026.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-23T10:26:05.009 INFO:teuthology.orchestra.run.smithi026.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-23T10:26:06.898 INFO:teuthology.orchestra.run.smithi026.stderr: 91.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-23T10:26:07.025 INFO:teuthology.orchestra.run.smithi026.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-23T10:26:08.907 INFO:teuthology.orchestra.run.smithi190.stderr: 91.8% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-23T10:26:14.022 INFO:teuthology.orchestra.run.smithi026.stderr: 93.1% -- replaced with /var/log/ceph/ceph-client.0.35719.log.gz 2024-04-23T10:26:14.024 INFO:teuthology.orchestra.run.smithi026.stderr: 2024-04-23T10:26:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:real 0m18.443s 2024-04-23T10:26:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:user 0m58.931s 2024-04-23T10:26:14.024 INFO:teuthology.orchestra.run.smithi026.stderr:sys 0m1.865s 2024-04-23T10:27:00.227 INFO:teuthology.orchestra.run.smithi190.stderr: 94.4% -- replaced with /var/log/ceph/ceph-mds.f.log.gz 2024-04-23T10:27:00.228 INFO:teuthology.orchestra.run.smithi190.stderr: 2024-04-23T10:27:00.229 INFO:teuthology.orchestra.run.smithi190.stderr:real 1m4.619s 2024-04-23T10:27:00.229 INFO:teuthology.orchestra.run.smithi190.stderr:user 1m39.636s 2024-04-23T10:27:00.229 INFO:teuthology.orchestra.run.smithi190.stderr:sys 0m3.378s 2024-04-23T10:27:00.230 INFO:tasks.ceph:Archiving logs... 2024-04-23T10:27:00.230 DEBUG:teuthology.misc:Transferring archived files from smithi026:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi026/log 2024-04-23T10:27:00.231 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:27:07.454 DEBUG:teuthology.misc:Transferring archived files from smithi190:/var/log/ceph to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi190/log 2024-04-23T10:27:07.455 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-23T10:27:19.358 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-23T10:27:19.371 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-23T10:27:19.372 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:27:19.375 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-23T10:27:19.448 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-23T10:27:19.458 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-23T10:27:19.458 DEBUG:teuthology.orchestra.run.smithi026:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:27:19.460 DEBUG:teuthology.orchestra.run.smithi190:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout:============================================================================== 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout:*hv01.front.sepi 44.4.53.2 2 u 60 64 377 0.100 -2.832 0.086 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout:+hv02.front.sepi 63.231.80.2 3 u 63 64 377 0.078 -1.291 0.072 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout:+hv03.front.sepi 74.6.168.72 3 u 2 64 377 0.105 -1.027 0.071 2024-04-23T10:27:19.472 INFO:teuthology.orchestra.run.smithi190.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-23T10:27:19.473 INFO:teuthology.orchestra.run.smithi026.stdout: remote refid st t when poll reach delay offset jitter 2024-04-23T10:27:19.474 INFO:teuthology.orchestra.run.smithi026.stdout:============================================================================== 2024-04-23T10:27:19.474 INFO:teuthology.orchestra.run.smithi026.stdout:*hv01.front.sepi 44.4.53.2 2 u 63 64 377 0.080 -2.724 1.044 2024-04-23T10:27:19.474 INFO:teuthology.orchestra.run.smithi026.stdout:+hv02.front.sepi 63.231.80.2 3 u 58 64 377 0.087 -1.290 1.030 2024-04-23T10:27:19.474 INFO:teuthology.orchestra.run.smithi026.stdout:+hv03.front.sepi 74.6.168.72 3 u 65 64 377 0.091 -2.251 0.861 2024-04-23T10:27:19.474 INFO:teuthology.orchestra.run.smithi026.stdout: hv04.front.sepi .INIT. 16 u - 512 0 0.000 +0.000 0.000 2024-04-23T10:27:19.474 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-23T10:27:19.488 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-23T10:27:19.488 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-23T10:27:19.530 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-23T10:27:19.554 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-23T10:27:19.563 INFO:teuthology.task.internal:Duration was 1570.382276 seconds 2024-04-23T10:27:19.564 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-23T10:27:19.597 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-23T10:27:19.598 DEBUG:teuthology.orchestra.run.smithi026:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:27:19.600 DEBUG:teuthology.orchestra.run.smithi190:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-23T10:27:19.639 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-23T10:27:19.639 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi026.front.sepia.ceph.com 2024-04-23T10:27:19.639 DEBUG:teuthology.orchestra.run.smithi026:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:27:19.691 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi190.front.sepia.ceph.com 2024-04-23T10:27:19.692 DEBUG:teuthology.orchestra.run.smithi190:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-23T10:27:19.702 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-23T10:27:19.702 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:27:19.739 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-23T10:27:19.768 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-23T10:27:19.769 DEBUG:teuthology.orchestra.run.smithi026:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:27:19.810 DEBUG:teuthology.orchestra.run.smithi190:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-23T10:27:19.873 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-23T10:27:19.884 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-23T10:27:19.884 DEBUG:teuthology.orchestra.run.smithi026:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:27:19.894 DEBUG:teuthology.orchestra.run.smithi190:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-23T10:27:19.905 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-23T10:27:19.915 DEBUG:teuthology.orchestra.run.smithi026:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:27:19.939 DEBUG:teuthology.orchestra.run.smithi190:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:27:19.946 INFO:teuthology.orchestra.run.smithi026.stdout:kernel.core_pattern = core 2024-04-23T10:27:19.956 INFO:teuthology.orchestra.run.smithi190.stdout:kernel.core_pattern = core 2024-04-23T10:27:19.991 DEBUG:teuthology.orchestra.run.smithi026:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:27:20.009 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:27:20.009 DEBUG:teuthology.orchestra.run.smithi190:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-23T10:27:20.039 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-23T10:27:20.039 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-23T10:27:20.049 INFO:teuthology.task.internal:Transferring archived files... 2024-04-23T10:27:20.050 DEBUG:teuthology.misc:Transferring archived files from smithi026:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi026 2024-04-23T10:27:20.050 DEBUG:teuthology.orchestra.run.smithi026:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:27:20.079 DEBUG:teuthology.misc:Transferring archived files from smithi190:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/leonidus-2024-04-23_09:49:14-fs-wip-lusov-quiescer-distro-default-smithi/7669533/remote/smithi190 2024-04-23T10:27:20.079 DEBUG:teuthology.orchestra.run.smithi190:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-23T10:27:20.103 INFO:teuthology.task.internal:Removing archive directory... 2024-04-23T10:27:20.103 DEBUG:teuthology.orchestra.run.smithi026:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:27:20.119 DEBUG:teuthology.orchestra.run.smithi190:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-23T10:27:20.152 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-23T10:27:20.162 INFO:teuthology.task.internal:Not uploading archives. 2024-04-23T10:27:20.162 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-23T10:27:20.199 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-23T10:27:20.199 DEBUG:teuthology.orchestra.run.smithi026:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:27:20.202 DEBUG:teuthology.orchestra.run.smithi190:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-23T10:27:20.205 INFO:teuthology.orchestra.run.smithi026.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:27 /home/ubuntu/cephtest 2024-04-23T10:27:20.208 INFO:teuthology.orchestra.run.smithi190.stdout: 658466 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 23 10:27 /home/ubuntu/cephtest 2024-04-23T10:27:20.209 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-23T10:27:20.219 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-23T10:27:20.241 INFO:teuthology.run:Summary data: description: fs/thrash/workloads/{begin/{0-install 1-ceph 2-logrotate 3-modules} clusters/1a5s-mds-1c-client conf/{client mds mgr mon osd} distro/{ubuntu_latest} mount/fuse msgr-failures/osd-mds-delay objectstore-ec/bluestore-ec-root overrides/{client-shutdown frag ignorelist_health ignorelist_wrongly_marked_down pg_health prefetch_dirfrags/no prefetch_dirfrags/yes prefetch_entire_dirfrags/no prefetch_entire_dirfrags/yes races session_timeout thrashosds-health} ranks/5 tasks/{1-thrash/with-quiesce 2-workunit/suites/fsstress}} duration: 1570.3822762966156 flavor: default owner: scheduled_leonidus@teuthology success: true 2024-04-23T10:27:20.241 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-23T10:27:20.326 INFO:teuthology.run:pass